[18:43:08.692] New invocation is queued and will start shortly
[18:43:09.772] Starting the invocation (attempt 1)
[18:43:09.801] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fe2a15dcb1f0fce3f5d5b0cc795f4faa53f11ec2"
[18:43:09.801] Popped gitiles commit info from properties and tags
[18:43:09.801] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:43:09.801] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:43:09.801] Buildbucket request:
{
"requestId": "8946527642351193584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe2a15dcb1f0fce3f5d5b0cc795f4faa53f11ec2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946527642351193584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:43:10.217] Scheduled build:
{
"id": "8781097580458797009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18985,
"createdBy": "project:chromium",
"createTime": "2023-05-14T18:43:09.867722061Z",
"updateTime": "2023-05-14T18:43:09.867722061Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe2a15dcb1f0fce3f5d5b0cc795f4faa53f11ec2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:43:10.217] Task URL: https://cr-buildbucket.appspot.com/build/8781097580458797009
[18:43:10.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:2:0) after 2m20s
[18:45:30.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:2:0)
[18:45:30.330] Build status: SCHEDULED
[18:45:30.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:3:0) after 7m48s
[18:46:43.525] Received PubSub notification, asking Buildbucket for the build status
[18:46:43.543] Build status: STARTED
[18:53:18.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:3:0)
[18:53:18.477] Build status: STARTED
[18:53:18.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:5:0) after 9m22s
[19:02:40.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:5:0)
[19:02:40.593] Build status: STARTED
[19:02:40.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:6:0) after 1m54s
[19:04:35.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:6:0)
[19:04:35.025] Build status: STARTED
[19:04:35.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:7:0) after 5m37s
[19:10:12.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:7:0)
[19:10:12.165] Build status: STARTED
[19:10:12.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:8:0) after 2m6s
[19:12:18.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:8:0)
[19:12:18.179] Build status: STARTED
[19:12:18.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:9:0) after 6m11s
[19:18:29.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:9:0)
[19:18:29.223] Build status: STARTED
[19:18:29.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:10:0) after 2m59s
[19:21:28.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:10:0)
[19:21:28.259] Build status: STARTED
[19:21:28.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:11:0) after 7m33s
[19:29:01.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:11:0)
[19:29:01.291] Build status: STARTED
[19:29:01.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:12:0) after 9m50s
[19:38:51.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:12:0)
[19:38:51.336] Build status: STARTED
[19:38:51.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:13:0) after 8m11s
[19:47:02.372] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:13:0)
[19:47:02.390] Build status: STARTED
[19:47:02.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:14:0) after 8m45s
[19:55:47.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:14:0)
[19:55:47.469] Build status: STARTED
[19:55:47.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:15:0) after 4m11s
[19:59:58.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:15:0)
[19:59:58.481] Build status: STARTED
[19:59:58.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:16:0) after 9m0s
[20:08:58.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:16:0)
[20:08:58.657] Build status: STARTED
[20:08:58.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:17:0) after 3m20s
[20:12:18.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:17:0)
[20:12:18.689] Build status: STARTED
[20:12:18.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:18:0) after 9m58s
[20:22:16.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:18:0)
[20:22:16.939] Build status: STARTED
[20:22:16.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:19:0) after 3m22s
[20:25:38.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:19:0)
[20:25:39.038] Build status: STARTED
[20:25:39.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:20:0) after 4m55s
[20:30:34.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:20:0)
[20:30:34.101] Build status: STARTED
[20:30:34.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:21:0) after 9m33s
[20:40:07.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:21:0)
[20:40:07.141] Build status: STARTED
[20:40:07.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:22:0) after 2m3s
[20:42:10.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:22:0)
[20:42:10.218] Build status: STARTED
[20:42:10.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:23:0) after 4m46s
[20:46:56.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:23:0)
[20:46:56.280] Build status: STARTED
[20:46:56.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:24:0) after 9m12s
[20:56:08.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:24:0)
[20:56:08.326] Build status: STARTED
[20:56:08.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:25:0) after 2m45s
[20:58:53.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:25:0)
[20:58:53.574] Build status: STARTED
[20:58:53.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:26:0) after 3m57s
[21:02:50.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:26:0)
[21:02:50.613] Build status: STARTED
[21:02:50.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:27:0) after 8m7s
[21:10:57.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:27:0)
[21:10:57.660] Build status: STARTED
[21:10:57.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:28:0) after 1m19s
[21:12:16.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:28:0)
[21:12:16.772] Build status: STARTED
[21:12:16.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:29:0) after 3m57s
[21:16:13.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:29:0)
[21:16:13.815] Build status: STARTED
[21:16:13.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:30:0) after 9m3s
[21:25:16.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:30:0)
[21:25:16.906] Build status: STARTED
[21:25:16.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:31:0) after 5m8s
[21:30:24.938] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:31:0)
[21:30:24.960] Build status: STARTED
[21:30:24.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:32:0) after 3m50s
[21:34:14.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:32:0)
[21:34:15.063] Build status: STARTED
[21:34:15.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:33:0) after 1m45s
[21:36:00.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:33:0)
[21:36:00.323] Build status: STARTED
[21:36:00.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:34:0) after 3m0s
[21:39:00.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:34:0)
[21:39:00.369] Build status: STARTED
[21:39:00.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:35:0) after 4m10s
[21:43:10.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:35:0)
[21:43:10.544] Build status: STARTED
[21:43:10.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:36:0) after 2m40s
[21:45:50.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:36:0)
[21:45:50.731] Build status: STARTED
[21:45:50.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:37:0) after 4m57s
[21:50:47.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:37:0)
[21:50:47.801] Build status: STARTED
[21:50:47.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:38:0) after 1m17s
[21:52:05.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:38:0)
[21:52:05.075] Build status: STARTED
[21:52:05.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:39:0) after 7m38s
[21:59:43.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:39:0)
[21:59:43.214] Build status: STARTED
[21:59:43.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:40:0) after 9m42s
[22:09:25.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:40:0)
[22:09:25.270] Build status: STARTED
[22:09:25.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:41:0) after 5m38s
[22:15:03.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:41:0)
[22:15:03.360] Build status: STARTED
[22:15:03.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:42:0) after 9m37s
[22:24:40.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:42:0)
[22:24:40.404] Build status: STARTED
[22:24:40.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:43:0) after 1m17s
[22:25:57.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:43:0)
[22:25:57.505] Build status: STARTED
[22:25:57.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:44:0) after 1m42s
[22:27:39.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:44:0)
[22:27:39.556] Build status: STARTED
[22:27:39.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:45:0) after 1m50s
[22:29:29.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:45:0)
[22:29:29.654] Build status: STARTED
[22:29:29.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:46:0) after 7m58s
[22:37:27.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:46:0)
[22:37:27.699] Build status: STARTED
[22:37:27.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:47:0) after 3m32s
[22:40:59.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:47:0)
[22:40:59.862] Build status: STARTED
[22:40:59.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:48:0) after 3m29s
[22:44:28.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:48:0)
[22:44:28.943] Build status: STARTED
[22:44:28.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:49:0) after 4m22s
[22:48:50.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:49:0)
[22:48:50.984] Build status: STARTED
[22:48:50.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:50:0) after 1m22s
[22:50:13.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:50:0)
[22:50:13.304] Build status: STARTED
[22:50:13.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:51:0) after 9m12s
[22:59:25.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:51:0)
[22:59:25.352] Build status: STARTED
[22:59:25.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:52:0) after 7m11s
[23:06:36.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:52:0)
[23:06:36.495] Build status: STARTED
[23:06:36.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:53:0) after 8m1s
[23:14:37.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:53:0)
[23:14:37.618] Build status: STARTED
[23:14:37.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:54:0) after 8m52s
[23:23:29.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:54:0)
[23:23:29.664] Build status: STARTED
[23:23:29.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:55:0) after 5m14s
[23:28:44.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:55:0)
[23:28:44.036] Build status: STARTED
[23:28:44.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:56:0) after 1m30s
[23:30:14.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:56:0)
[23:30:14.281] Build status: STARTED
[23:30:14.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:57:0) after 9m37s
[23:39:51.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:57:0)
[23:39:51.327] Build status: STARTED
[23:39:51.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:58:0) after 2m39s
[23:42:30.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:58:0)
[23:42:30.383] Build status: STARTED
[23:42:30.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:59:0) after 2m45s
[23:45:15.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:59:0)
[23:45:15.552] Build status: STARTED
[23:45:15.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:60:0) after 3m0s
[23:48:15.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:60:0)
[23:48:15.672] Build status: STARTED
[23:48:15.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:61:0) after 7m29s
[23:55:44.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:61:0)
[23:55:44.739] Build status: STARTED
[23:55:44.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:62:0) after 5m21s
[00:01:06.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:62:0)
[00:01:06.246] Build status: STARTED
[00:01:06.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:63:0) after 3m22s
[00:04:28.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:63:0)
[00:04:28.475] Build status: STARTED
[00:04:28.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:64:0) after 8m42s
[00:13:11.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:64:0)
[00:13:11.130] Build status: STARTED
[00:13:11.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:65:0) after 8m55s
[00:22:06.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:65:0)
[00:22:06.179] Build status: STARTED
[00:22:06.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:66:0) after 5m9s
[00:27:15.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:66:0)
[00:27:15.219] Build status: STARTED
[00:27:15.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:67:0) after 3m48s
[00:31:03.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:67:0)
[00:31:03.468] Build status: STARTED
[00:31:03.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:68:0) after 1m15s
[00:32:18.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:68:0)
[00:32:18.522] Build status: STARTED
[00:32:18.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:69:0) after 3m21s
[00:35:39.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:69:0)
[00:35:39.667] Build status: STARTED
[00:35:39.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:70:0) after 5m1s
[00:40:40.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:70:0)
[00:40:40.717] Build status: STARTED
[00:40:40.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:71:0) after 6m30s
[00:47:10.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:71:0)
[00:47:10.843] Build status: STARTED
[00:47:10.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:72:0) after 3m27s
[00:50:37.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:72:0)
[00:50:37.880] Build status: STARTED
[00:50:37.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:73:0) after 4m16s
[00:54:53.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:73:0)
[00:54:53.942] Build status: STARTED
[00:54:53.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:74:0) after 5m35s
[01:00:29.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:74:0)
[01:00:29.098] Build status: STARTED
[01:00:29.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:75:0) after 7m12s
[01:07:41.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:75:0)
[01:07:41.154] Build status: STARTED
[01:07:41.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:76:0) after 5m43s
[01:13:24.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:76:0)
[01:13:24.225] Build status: STARTED
[01:13:24.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:77:0) after 6m7s
[01:19:31.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:77:0)
[01:19:31.528] Build status: STARTED
[01:19:31.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:78:0) after 8m7s
[01:27:38.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:78:0)
[01:27:38.614] Build status: STARTED
[01:27:38.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:79:0) after 4m27s
[01:32:05.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:79:0)
[01:32:05.660] Build status: STARTED
[01:32:05.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:80:0) after 6m32s
[01:38:37.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:80:0)
[01:38:37.840] Build status: STARTED
[01:38:37.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:81:0) after 5m35s
[01:44:12.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:81:0)
[01:44:12.963] Build status: STARTED
[01:44:12.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:82:0) after 3m8s
[01:47:21.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:82:0)
[01:47:21.163] Build status: STARTED
[01:47:21.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:83:0) after 7m14s
[01:54:35.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:83:0)
[01:54:35.229] Build status: STARTED
[01:54:35.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:84:0) after 6m28s
[02:01:03.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:84:0)
[02:01:03.372] Build status: STARTED
[02:01:03.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:85:0) after 1m37s
[02:02:40.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:85:0)
[02:02:40.409] Build status: STARTED
[02:02:40.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:86:0) after 7m53s
[02:10:33.431] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:86:0)
[02:10:33.453] Build status: STARTED
[02:10:33.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:87:0) after 9m4s
[02:19:37.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:87:0)
[02:19:37.637] Build status: STARTED
[02:19:37.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:88:0) after 3m45s
[02:23:22.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:88:0)
[02:23:22.678] Build status: STARTED
[02:23:22.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:89:0) after 8m15s
[02:31:37.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:89:0)
[02:31:37.739] Build status: STARTED
[02:31:37.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:90:0) after 2m59s
[02:34:36.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:90:0)
[02:34:36.890] Build status: STARTED
[02:34:36.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:91:0) after 8m59s
[02:43:36.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:91:0)
[02:43:36.254] Build status: STARTED
[02:43:36.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:92:0) after 4m5s
[02:47:41.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:92:0)
[02:47:41.293] Build status: STARTED
[02:47:41.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:93:0) after 9m57s
[02:57:38.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:93:0)
[02:57:38.337] Build status: STARTED
[02:57:38.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:94:0) after 4m14s
[03:01:52.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:94:0)
[03:01:52.380] Build status: STARTED
[03:01:52.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:95:0) after 5m59s
[03:07:51.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:95:0)
[03:07:51.425] Build status: STARTED
[03:07:51.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:96:0) after 2m50s
[03:10:41.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:96:0)
[03:10:41.467] Build status: STARTED
[03:10:41.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:97:0) after 2m48s
[03:13:29.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:97:0)
[03:13:29.521] Build status: STARTED
[03:13:29.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:98:0) after 2m56s
[03:16:25.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:98:0)
[03:16:25.615] Build status: STARTED
[03:16:25.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:99:0) after 4m54s
[03:21:19.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:99:0)
[03:21:19.656] Build status: STARTED
[03:21:19.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:100:0) after 7m49s
[03:29:08.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:100:0)
[03:29:08.697] Build status: STARTED
[03:29:08.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:101:0) after 5m12s
[03:34:20.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:101:0)
[03:34:20.834] Build status: STARTED
[03:34:20.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:102:0) after 9m12s
[03:43:32.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:102:0)
[03:43:32.934] Build status: STARTED
[03:43:32.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:103:0) after 2m54s
[03:46:27.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:103:0)
[03:46:27.026] Build status: STARTED
[03:46:27.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:104:0) after 7m47s
[03:54:14.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:104:0)
[03:54:14.277] Build status: STARTED
[03:54:14.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:105:0) after 6m33s
[04:00:47.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:105:0)
[04:00:47.338] Build status: STARTED
[04:00:47.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:106:0) after 8m8s
[04:08:55.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:106:0)
[04:08:55.384] Build status: STARTED
[04:08:55.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:107:0) after 8m22s
[04:17:17.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:107:0)
[04:17:17.461] Build status: STARTED
[04:17:17.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:108:0) after 1m49s
[04:19:06.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:108:0)
[04:19:06.574] Build status: STARTED
[04:19:06.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:109:0) after 8m14s
[04:27:20.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:109:0)
[04:27:20.588] Build status: STARTED
[04:27:20.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:110:0) after 3m46s
[04:31:06.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:110:0)
[04:31:06.682] Build status: STARTED
[04:31:06.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:111:0) after 2m44s
[04:33:50.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:111:0)
[04:33:50.724] Build status: STARTED
[04:33:50.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:112:0) after 3m41s
[04:37:31.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:112:0)
[04:37:31.772] Build status: STARTED
[04:37:31.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:113:0) after 1m20s
[04:38:51.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:113:0)
[04:38:51.877] Build status: STARTED
[04:38:51.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:114:0) after 7m46s
[04:46:37.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:114:0)
[04:46:37.919] Build status: STARTED
[04:46:37.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:115:0) after 2m16s
[04:48:53.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:115:0)
[04:48:53.992] Build status: STARTED
[04:48:53.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:116:0) after 2m55s
[04:51:49.036] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:116:0)
[04:51:49.056] Build status: STARTED
[04:51:49.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:117:0) after 4m48s
[04:56:37.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:117:0)
[04:56:37.098] Build status: STARTED
[04:56:37.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:118:0) after 3m35s
[05:00:12.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:118:0)
[05:00:12.241] Build status: STARTED
[05:00:12.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:119:0) after 5m38s
[05:05:50.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:119:0)
[05:05:50.321] Build status: STARTED
[05:05:50.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:120:0) after 5m38s
[05:11:28.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:120:0)
[05:11:28.579] Build status: STARTED
[05:11:28.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946527642351193584:121:0) after 6m44s
[05:16:53.264] Received PubSub notification, asking Buildbucket for the build status
[05:16:53.284] Build:
{
"id": "8781097580458797009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18985,
"createdBy": "project:chromium",
"createTime": "2023-05-14T18:43:09.867722061Z",
"startTime": "2023-05-14T18:46:42.752579Z",
"endTime": "2023-05-15T05:16:17.541994628Z",
"updateTime": "2023-05-15T05:16:17.541994628Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe2a15dcb1f0fce3f5d5b0cc795f4faa53f11ec2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:16:53.284] Invocation finished in 10h33m44.604757355s with status FAILED