[14:47:33.830] New invocation is queued and will start shortly
[14:47:35.108] Starting the invocation (attempt 1)
[14:47:35.141] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2ab63c1f2e14a9878b7e4645bfd35dd56d14b243"
[14:47:35.142] Popped gitiles commit info from properties and tags
[14:47:35.142] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:47:35.142] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:47:35.142] Buildbucket request:
{
"requestId": "8952159475739142384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ab63c1f2e14a9878b7e4645bfd35dd56d14b243",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952159475739142384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:47:35.610] Scheduled build:
{
"id": "8786729413631362769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18589,
"createdBy": "project:chromium",
"createTime": "2023-03-13T14:47:35.216227631Z",
"updateTime": "2023-03-13T14:47:35.216227631Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ab63c1f2e14a9878b7e4645bfd35dd56d14b243",
"ref": "refs/heads/main"
}
}
}
[14:47:35.610] Task URL: https://cr-buildbucket.appspot.com/build/8786729413631362769
[14:47:35.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:2:0) after 7m23s
[14:50:58.805] Received PubSub notification, asking Buildbucket for the build status
[14:50:58.832] Build status: STARTED
[14:54:58.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:2:0)
[14:54:58.800] Build status: STARTED
[14:54:58.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:4:0) after 3m49s
[14:58:47.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:4:0)
[14:58:47.851] Build status: STARTED
[14:58:47.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:5:0) after 6m8s
[15:04:56.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:5:0)
[15:04:56.204] Build status: STARTED
[15:04:56.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:6:0) after 8m1s
[15:12:57.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:6:0)
[15:12:57.418] Build status: STARTED
[15:12:57.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:7:0) after 1m8s
[15:14:05.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:7:0)
[15:14:05.478] Build status: STARTED
[15:14:05.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:8:0) after 5m49s
[15:19:54.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:8:0)
[15:19:54.517] Build status: STARTED
[15:19:54.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:9:0) after 7m30s
[15:27:24.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:9:0)
[15:27:24.748] Build status: STARTED
[15:27:24.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:10:0) after 9m45s
[15:37:09.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:10:0)
[15:37:09.830] Build status: STARTED
[15:37:09.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:11:0) after 8m45s
[15:45:55.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:11:0)
[15:45:55.323] Build status: STARTED
[15:45:55.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:12:0) after 6m0s
[15:51:55.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:12:0)
[15:51:55.881] Build status: STARTED
[15:51:55.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:13:0) after 9m13s
[16:01:09.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:13:0)
[16:01:09.148] Build status: STARTED
[16:01:09.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:14:0) after 1m49s
[16:02:58.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:14:0)
[16:02:58.195] Build status: STARTED
[16:02:58.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:15:0) after 5m52s
[16:08:50.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:15:0)
[16:08:50.251] Build status: STARTED
[16:08:50.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:16:0) after 5m50s
[16:14:40.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:16:0)
[16:14:40.327] Build status: STARTED
[16:14:40.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:17:0) after 8m44s
[16:23:24.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:17:0)
[16:23:24.552] Build status: STARTED
[16:23:24.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:18:0) after 3m44s
[16:27:08.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:18:0)
[16:27:08.675] Build status: STARTED
[16:27:08.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:19:0) after 2m9s
[16:29:18.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:19:0)
[16:29:18.314] Build status: STARTED
[16:29:18.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:20:0) after 7m18s
[16:36:36.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:20:0)
[16:36:36.497] Build status: STARTED
[16:36:36.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:21:0) after 8m25s
[16:45:01.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:21:0)
[16:45:01.657] Build status: STARTED
[16:45:01.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:22:0) after 3m49s
[16:48:50.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:22:0)
[16:48:50.709] Build status: STARTED
[16:48:50.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:23:0) after 4m52s
[16:53:42.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:23:0)
[16:53:42.769] Build status: STARTED
[16:53:42.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:24:0) after 4m6s
[16:57:48.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:24:0)
[16:57:48.872] Build status: STARTED
[16:57:48.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:25:0) after 6m28s
[17:04:16.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:25:0)
[17:04:16.919] Build status: STARTED
[17:04:16.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:26:0) after 2m45s
[17:07:02.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:26:0)
[17:07:02.101] Build status: STARTED
[17:07:02.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:27:0) after 9m42s
[17:16:44.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:27:0)
[17:16:44.143] Build status: STARTED
[17:16:44.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:28:0) after 1m23s
[17:18:07.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:28:0)
[17:18:07.244] Build status: STARTED
[17:18:07.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:29:0) after 6m0s
[17:24:07.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:29:0)
[17:24:07.290] Build status: STARTED
[17:24:07.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:30:0) after 7m31s
[17:31:38.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:30:0)
[17:31:38.289] Build status: STARTED
[17:31:38.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:31:0) after 6m31s
[17:38:09.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:31:0)
[17:38:09.386] Build status: STARTED
[17:38:09.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:32:0) after 4m16s
[17:42:25.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:32:0)
[17:42:25.438] Build status: STARTED
[17:42:25.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:33:0) after 3m10s
[17:45:35.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:33:0)
[17:45:35.521] Build status: STARTED
[17:45:35.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:34:0) after 4m48s
[17:50:23.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:34:0)
[17:50:23.539] Build status: STARTED
[17:50:23.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:35:0) after 7m35s
[17:57:59.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:35:0)
[17:57:59.131] Build status: STARTED
[17:57:59.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:36:0) after 4m33s
[18:02:32.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:36:0)
[18:02:32.260] Build status: STARTED
[18:02:32.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:37:0) after 7m29s
[18:10:01.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:37:0)
[18:10:01.305] Build status: STARTED
[18:10:01.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:38:0) after 4m3s
[18:14:04.374] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:38:0)
[18:14:04.396] Build status: STARTED
[18:14:04.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:39:0) after 3m14s
[18:17:18.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:39:0)
[18:17:18.437] Build status: STARTED
[18:17:18.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:40:0) after 6m10s
[18:23:28.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:40:0)
[18:23:28.497] Build status: STARTED
[18:23:28.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:41:0) after 7m47s
[18:31:15.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:41:0)
[18:31:15.647] Build status: STARTED
[18:31:15.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:42:0) after 1m53s
[18:33:08.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:42:0)
[18:33:08.807] Build status: STARTED
[18:33:08.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:43:0) after 2m16s
[18:35:24.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:43:0)
[18:35:25.027] Build status: STARTED
[18:35:25.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:44:0) after 3m0s
[18:38:25.300] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:44:0)
[18:38:25.322] Build status: STARTED
[18:38:25.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:45:0) after 3m49s
[18:42:14.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:45:0)
[18:42:14.602] Build status: STARTED
[18:42:14.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:46:0) after 3m29s
[18:45:44.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:46:0)
[18:45:44.089] Build status: STARTED
[18:45:44.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:47:0) after 9m22s
[18:55:06.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:47:0)
[18:55:06.153] Build status: STARTED
[18:55:06.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:48:0) after 2m55s
[18:58:01.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:48:0)
[18:58:01.406] Build status: STARTED
[18:58:01.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:49:0) after 9m54s
[19:07:55.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:49:0)
[19:07:55.698] Build status: STARTED
[19:07:55.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:50:0) after 2m57s
[19:10:52.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:50:0)
[19:10:52.763] Build status: STARTED
[19:10:52.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:51:0) after 5m47s
[19:16:39.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:51:0)
[19:16:39.979] Build status: STARTED
[19:16:39.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:52:0) after 4m34s
[19:21:14.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:52:0)
[19:21:14.040] Build status: STARTED
[19:21:14.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:53:0) after 3m32s
[19:24:46.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:53:0)
[19:24:46.119] Build status: STARTED
[19:24:46.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:54:0) after 6m48s
[19:31:34.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:54:0)
[19:31:34.232] Build status: STARTED
[19:31:34.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:55:0) after 1m58s
[19:33:32.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:55:0)
[19:33:32.593] Build status: STARTED
[19:33:32.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:56:0) after 6m46s
[19:40:18.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:56:0)
[19:40:18.718] Build status: STARTED
[19:40:18.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:57:0) after 2m9s
[19:42:27.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:57:0)
[19:42:27.811] Build status: STARTED
[19:42:27.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:58:0) after 3m12s
[19:45:39.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:58:0)
[19:45:39.862] Build status: STARTED
[19:45:39.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:59:0) after 3m58s
[19:49:37.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:59:0)
[19:49:37.904] Build status: STARTED
[19:49:37.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:60:0) after 1m33s
[19:51:11.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:60:0)
[19:51:11.066] Build status: STARTED
[19:51:11.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:61:0) after 5m8s
[19:56:19.137] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:61:0)
[19:56:19.184] Build status: STARTED
[19:56:19.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:62:0) after 3m17s
[19:59:36.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:62:0)
[19:59:36.540] Build status: STARTED
[19:59:36.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:63:0) after 7m1s
[20:06:37.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:63:0)
[20:06:37.656] Build status: STARTED
[20:06:37.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:64:0) after 1m34s
[20:08:12.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:64:0)
[20:08:12.080] Build status: STARTED
[20:08:12.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:65:0) after 2m10s
[20:10:22.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:65:0)
[20:10:22.461] Build status: STARTED
[20:10:22.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:66:0) after 5m45s
[20:16:07.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:66:0)
[20:16:07.670] Build status: STARTED
[20:16:07.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:67:0) after 8m28s
[20:24:36.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:67:0)
[20:24:36.145] Build status: STARTED
[20:24:36.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:68:0) after 1m22s
[20:25:58.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:68:0)
[20:25:58.528] Build status: STARTED
[20:25:58.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:69:0) after 2m4s
[20:28:02.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:69:0)
[20:28:02.625] Build status: STARTED
[20:28:02.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:70:0) after 7m29s
[20:35:31.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:70:0)
[20:35:31.781] Build status: STARTED
[20:35:31.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:71:0) after 1m32s
[20:37:03.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:71:0)
[20:37:03.934] Build status: STARTED
[20:37:03.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:72:0) after 4m6s
[20:41:10.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:72:0)
[20:41:10.297] Build status: STARTED
[20:41:10.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:73:0) after 8m23s
[20:49:33.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:73:0)
[20:49:33.527] Build status: STARTED
[20:49:33.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:74:0) after 8m10s
[20:57:43.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:74:0)
[20:57:43.552] Build status: STARTED
[20:57:43.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:75:0) after 6m53s
[21:04:36.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:75:0)
[21:04:36.761] Build status: STARTED
[21:04:36.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:76:0) after 9m14s
[21:13:50.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:76:0)
[21:13:50.821] Build status: STARTED
[21:13:50.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:77:0) after 5m16s
[21:19:06.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:77:0)
[21:19:06.974] Build status: STARTED
[21:19:06.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:78:0) after 2m28s
[21:21:35.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:78:0)
[21:21:35.063] Build status: STARTED
[21:21:35.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:79:0) after 2m38s
[21:24:13.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:79:0)
[21:24:13.287] Build status: STARTED
[21:24:13.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:80:0) after 9m17s
[21:33:30.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:80:0)
[21:33:30.539] Build status: STARTED
[21:33:30.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:81:0) after 9m19s
[21:42:49.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:81:0)
[21:42:49.623] Build status: STARTED
[21:42:49.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:82:0) after 2m49s
[21:45:38.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:82:0)
[21:45:38.679] Build status: STARTED
[21:45:38.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:83:0) after 1m47s
[21:47:25.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:83:0)
[21:47:25.732] Build status: STARTED
[21:47:25.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:84:0) after 3m19s
[21:50:44.766] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:84:0)
[21:50:44.876] Build status: STARTED
[21:50:44.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:85:0) after 3m1s
[21:53:45.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:85:0)
[21:53:45.986] Build status: STARTED
[21:53:45.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:86:0) after 2m48s
[21:56:34.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:86:0)
[21:56:34.078] Build status: STARTED
[21:56:34.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:87:0) after 5m51s
[22:02:25.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:87:0)
[22:02:25.139] Build status: STARTED
[22:02:25.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:88:0) after 6m34s
[22:08:59.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:88:0)
[22:08:59.153] Build status: STARTED
[22:08:59.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:89:0) after 8m39s
[22:17:38.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:89:0)
[22:17:38.538] Build status: STARTED
[22:17:38.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:90:0) after 3m41s
[22:21:19.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:90:0)
[22:21:19.732] Build status: STARTED
[22:21:19.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:91:0) after 6m58s
[22:28:17.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:91:0)
[22:28:17.840] Build status: STARTED
[22:28:17.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:92:0) after 3m19s
[22:31:36.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:92:0)
[22:31:36.970] Build status: STARTED
[22:31:36.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:93:0) after 4m24s
[22:36:01.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:93:0)
[22:36:01.049] Build status: STARTED
[22:36:01.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:94:0) after 8m5s
[22:44:06.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:94:0)
[22:44:06.094] Build status: STARTED
[22:44:06.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:95:0) after 1m43s
[22:45:49.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:95:0)
[22:45:49.189] Build status: STARTED
[22:45:49.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:96:0) after 7m21s
[22:53:10.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:96:0)
[22:53:10.338] Build status: STARTED
[22:53:10.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:97:0) after 1m59s
[22:55:09.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:97:0)
[22:55:09.502] Build status: STARTED
[22:55:09.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:98:0) after 1m54s
[22:57:04.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:98:0)
[22:57:04.110] Build status: STARTED
[22:57:04.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:99:0) after 5m56s
[23:03:00.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:99:0)
[23:03:00.197] Build status: STARTED
[23:03:00.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:100:0) after 1m50s
[23:04:50.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:100:0)
[23:04:50.354] Build status: STARTED
[23:04:50.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:101:0) after 3m13s
[23:08:03.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:101:0)
[23:08:03.750] Build status: STARTED
[23:08:03.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:102:0) after 2m2s
[23:10:05.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:102:0)
[23:10:05.830] Build status: STARTED
[23:10:05.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:103:0) after 7m34s
[23:17:39.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:103:0)
[23:17:39.972] Build status: STARTED
[23:17:39.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:104:0) after 8m25s
[23:26:05.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:104:0)
[23:26:05.059] Build status: STARTED
[23:26:05.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:105:0) after 7m23s
[23:33:28.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:105:0)
[23:33:28.350] Build status: STARTED
[23:33:28.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:106:0) after 2m43s
[23:36:11.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:106:0)
[23:36:11.426] Build status: STARTED
[23:36:11.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:107:0) after 5m24s
[23:41:35.713] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:107:0)
[23:41:35.737] Build status: STARTED
[23:41:35.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:108:0) after 9m2s
[23:50:37.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:108:0)
[23:50:37.791] Build status: STARTED
[23:50:37.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:109:0) after 8m20s
[23:58:57.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:109:0)
[23:58:57.904] Build status: STARTED
[23:58:57.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:110:0) after 2m32s
[00:01:29.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:110:0)
[00:01:29.958] Build status: STARTED
[00:01:29.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:111:0) after 5m5s
[00:06:36.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:111:0)
[00:06:36.296] Build status: STARTED
[00:06:36.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:112:0) after 2m46s
[00:09:22.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:112:0)
[00:09:22.426] Build status: STARTED
[00:09:22.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:113:0) after 5m19s
[00:14:41.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:113:0)
[00:14:41.596] Build status: STARTED
[00:14:41.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:114:0) after 7m45s
[00:22:27.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:114:0)
[00:22:27.156] Build status: STARTED
[00:22:27.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:115:0) after 3m31s
[00:25:58.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:115:0)
[00:25:58.783] Build status: STARTED
[00:25:58.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:116:0) after 3m52s
[00:29:51.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:116:0)
[00:29:51.461] Build status: STARTED
[00:29:51.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:117:0) after 5m12s
[00:35:03.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:117:0)
[00:35:03.560] Build status: STARTED
[00:35:03.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:118:0) after 4m29s
[00:39:32.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:118:0)
[00:39:32.640] Build status: STARTED
[00:39:32.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:119:0) after 8m55s
[00:48:27.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:119:0)
[00:48:27.800] Build status: STARTED
[00:48:27.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952159475739142384:120:0) after 6m11s
[00:54:36.199] Received PubSub notification, asking Buildbucket for the build status
[00:54:36.223] Build:
{
"id": "8786729413631362769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18589,
"createdBy": "project:chromium",
"createTime": "2023-03-13T14:47:35.216227631Z",
"startTime": "2023-03-13T14:50:58.023522Z",
"endTime": "2023-03-14T00:54:35.501663903Z",
"updateTime": "2023-03-14T00:54:35.501663903Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ab63c1f2e14a9878b7e4645bfd35dd56d14b243",
"ref": "refs/heads/main"
}
}
}
[00:54:36.223] Invocation finished in 10h7m2.401210866s with status FAILED