[19:29:03.343] New invocation is queued and will start shortly
[19:29:04.431] Starting the invocation (attempt 1)
[19:29:04.470] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a309f6890eec4b070ca5c97c18bf2f6e1cfdc440"
[19:29:04.470] Popped gitiles commit info from properties and tags
[19:29:04.470] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:29:04.470] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:29:04.470] Buildbucket request:
{
"requestId": "8952504153669200704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a309f6890eec4b070ca5c97c18bf2f6e1cfdc440",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952504153669200704"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:29:04.949] Scheduled build:
{
"id": "8787074091761672081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18574,
"createdBy": "project:chromium",
"createTime": "2023-03-09T19:29:04.536737510Z",
"updateTime": "2023-03-09T19:29:04.536737510Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a309f6890eec4b070ca5c97c18bf2f6e1cfdc440",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:29:04.949] Task URL: https://cr-buildbucket.appspot.com/build/8787074091761672081
[19:29:04.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:2:0) after 8m2s
[19:33:08.832] Received PubSub notification, asking Buildbucket for the build status
[19:33:08.854] Build status: STARTED
[19:37:07.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:2:0)
[19:37:07.047] Build status: STARTED
[19:37:07.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:4:0) after 8m8s
[19:45:15.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:4:0)
[19:45:15.274] Build status: STARTED
[19:45:15.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:5:0) after 5m21s
[19:50:36.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:5:0)
[19:50:36.413] Build status: STARTED
[19:50:36.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:6:0) after 8m4s
[19:58:40.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:6:0)
[19:58:40.461] Build status: STARTED
[19:58:40.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:7:0) after 5m40s
[20:04:21.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:7:0)
[20:04:21.382] Build status: STARTED
[20:04:21.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:8:0) after 4m25s
[20:08:46.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:8:0)
[20:08:46.728] Build status: STARTED
[20:08:46.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:9:0) after 4m15s
[20:13:01.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:9:0)
[20:13:01.958] Build status: STARTED
[20:13:01.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:10:0) after 2m3s
[20:15:05.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:10:0)
[20:15:05.123] Build status: STARTED
[20:15:05.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:11:0) after 1m36s
[20:16:41.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:11:0)
[20:16:41.191] Build status: STARTED
[20:16:41.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:12:0) after 6m49s
[20:23:30.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:12:0)
[20:23:30.690] Build status: STARTED
[20:23:30.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:13:0) after 1m30s
[20:25:00.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:13:0)
[20:25:00.842] Build status: STARTED
[20:25:00.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:14:0) after 5m51s
[20:30:51.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:14:0)
[20:30:51.943] Build status: STARTED
[20:30:51.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:15:0) after 6m22s
[20:37:13.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:15:0)
[20:37:14.021] Build status: STARTED
[20:37:14.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:16:0) after 7m2s
[20:44:16.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:16:0)
[20:44:16.166] Build status: STARTED
[20:44:16.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:17:0) after 5m48s
[20:50:04.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:17:0)
[20:50:04.717] Build status: STARTED
[20:50:04.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:18:0) after 4m18s
[20:54:23.038] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:18:0)
[20:54:23.060] Build status: STARTED
[20:54:23.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:19:0) after 9m45s
[21:04:08.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:19:0)
[21:04:08.384] Build status: STARTED
[21:04:08.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:20:0) after 9m42s
[21:13:50.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:20:0)
[21:13:50.442] Build status: STARTED
[21:13:50.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:21:0) after 7m24s
[21:21:14.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:21:0)
[21:21:14.535] Build status: STARTED
[21:21:14.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:22:0) after 5m0s
[21:26:14.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:22:0)
[21:26:14.695] Build status: STARTED
[21:26:14.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:23:0) after 2m48s
[21:29:02.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:23:0)
[21:29:02.995] Build status: STARTED
[21:29:02.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:24:0) after 4m5s
[21:33:08.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:24:0)
[21:33:08.072] Build status: STARTED
[21:33:08.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:25:0) after 9m6s
[21:42:14.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:25:0)
[21:42:14.305] Build status: STARTED
[21:42:14.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:26:0) after 6m50s
[21:49:04.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:26:0)
[21:49:04.378] Build status: STARTED
[21:49:04.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:27:0) after 7m8s
[21:56:12.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:27:0)
[21:56:12.509] Build status: STARTED
[21:56:12.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:28:0) after 7m53s
[22:04:05.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:28:0)
[22:04:05.688] Build status: STARTED
[22:04:05.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:29:0) after 9m25s
[22:13:31.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:29:0)
[22:13:31.186] Build status: STARTED
[22:13:31.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:30:0) after 8m9s
[22:21:40.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:30:0)
[22:21:40.289] Build status: STARTED
[22:21:40.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:31:0) after 8m18s
[22:29:58.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:31:0)
[22:29:58.547] Build status: STARTED
[22:29:58.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:32:0) after 6m13s
[22:36:11.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:32:0)
[22:36:11.802] Build status: STARTED
[22:36:11.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:33:0) after 7m15s
[22:43:26.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:33:0)
[22:43:26.964] Build status: STARTED
[22:43:26.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:34:0) after 7m21s
[22:50:48.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:34:0)
[22:50:48.036] Build status: STARTED
[22:50:48.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:35:0) after 5m5s
[22:55:53.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:35:0)
[22:55:53.618] Build status: STARTED
[22:55:53.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:36:0) after 4m48s
[23:00:41.713] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:36:0)
[23:00:41.743] Build status: STARTED
[23:00:41.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:37:0) after 4m48s
[23:05:29.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:37:0)
[23:05:29.964] Build status: STARTED
[23:05:29.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:38:0) after 3m27s
[23:08:57.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:38:0)
[23:08:57.073] Build status: STARTED
[23:08:57.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:39:0) after 5m40s
[23:14:37.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:39:0)
[23:14:37.254] Build status: STARTED
[23:14:37.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:40:0) after 3m27s
[23:18:04.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:40:0)
[23:18:04.681] Build status: STARTED
[23:18:04.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:41:0) after 4m54s
[23:22:58.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:41:0)
[23:22:58.859] Build status: STARTED
[23:22:58.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:42:0) after 6m37s
[23:29:36.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:42:0)
[23:29:36.070] Build status: STARTED
[23:29:36.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:43:0) after 9m43s
[23:39:19.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:43:0)
[23:39:19.235] Build status: STARTED
[23:39:19.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:44:0) after 5m6s
[23:44:25.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:44:0)
[23:44:25.343] Build status: STARTED
[23:44:25.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:45:0) after 3m14s
[23:47:39.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:45:0)
[23:47:39.491] Build status: STARTED
[23:47:39.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:46:0) after 4m19s
[23:51:58.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:46:0)
[23:51:58.684] Build status: STARTED
[23:51:58.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:47:0) after 7m14s
[23:59:13.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:47:0)
[23:59:13.159] Build status: STARTED
[23:59:13.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:48:0) after 1m55s
[00:01:08.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:48:0)
[00:01:08.418] Build status: STARTED
[00:01:08.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:49:0) after 8m6s
[00:09:14.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:49:0)
[00:09:14.529] Build status: STARTED
[00:09:14.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:50:0) after 3m26s
[00:12:40.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:50:0)
[00:12:40.611] Build status: STARTED
[00:12:40.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:51:0) after 6m7s
[00:18:47.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:51:0)
[00:18:47.727] Build status: STARTED
[00:18:47.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:52:0) after 9m24s
[00:28:12.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:52:0)
[00:28:12.214] Build status: STARTED
[00:28:12.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:53:0) after 2m23s
[00:30:35.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:53:0)
[00:30:35.407] Build status: STARTED
[00:30:35.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:54:0) after 8m31s
[00:39:06.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:54:0)
[00:39:06.478] Build status: STARTED
[00:39:06.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:55:0) after 8m38s
[00:47:44.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:55:0)
[00:47:44.908] Build status: STARTED
[00:47:44.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:56:0) after 9m18s
[00:57:03.136] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:56:0)
[00:57:03.184] Build status: STARTED
[00:57:03.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:57:0) after 9m1s
[01:06:04.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:57:0)
[01:06:04.279] Build status: STARTED
[01:06:04.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:58:0) after 8m55s
[01:14:59.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:58:0)
[01:14:59.333] Build status: STARTED
[01:14:59.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:59:0) after 8m28s
[01:23:27.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:59:0)
[01:23:27.400] Build status: STARTED
[01:23:27.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:60:0) after 1m38s
[01:25:05.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:60:0)
[01:25:05.793] Build status: STARTED
[01:25:05.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:61:0) after 1m44s
[01:26:49.982] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:61:0)
[01:26:50.004] Build status: STARTED
[01:26:50.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:62:0) after 8m28s
[01:35:18.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:62:0)
[01:35:18.306] Build status: STARTED
[01:35:18.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:63:0) after 2m4s
[01:37:22.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:63:0)
[01:37:22.770] Build status: STARTED
[01:37:22.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:64:0) after 4m35s
[01:41:58.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:64:0)
[01:41:58.318] Build status: STARTED
[01:41:58.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:65:0) after 3m32s
[01:45:30.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:65:0)
[01:45:30.677] Build status: STARTED
[01:45:30.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:66:0) after 5m2s
[01:50:32.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:66:0)
[01:50:32.747] Build status: STARTED
[01:50:32.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:67:0) after 3m52s
[01:54:24.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:67:0)
[01:54:24.807] Build status: STARTED
[01:54:24.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:68:0) after 9m44s
[02:04:08.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:68:0)
[02:04:09.015] Build status: STARTED
[02:04:09.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:69:0) after 5m11s
[02:09:20.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:69:0)
[02:09:20.178] Build status: STARTED
[02:09:20.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:70:0) after 9m27s
[02:18:47.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:70:0)
[02:18:47.236] Build status: STARTED
[02:18:47.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:71:0) after 6m46s
[02:25:33.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:71:0)
[02:25:33.634] Build status: STARTED
[02:25:33.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:72:0) after 4m7s
[02:29:41.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:72:0)
[02:29:41.296] Build status: STARTED
[02:29:41.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:73:0) after 2m18s
[02:31:59.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:73:0)
[02:31:59.355] Build status: STARTED
[02:31:59.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:74:0) after 6m32s
[02:38:31.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:74:0)
[02:38:31.420] Build status: STARTED
[02:38:31.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:75:0) after 4m38s
[02:43:09.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:75:0)
[02:43:09.482] Build status: STARTED
[02:43:09.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:76:0) after 3m48s
[02:46:58.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:76:0)
[02:46:58.231] Build status: STARTED
[02:46:58.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:77:0) after 3m13s
[02:50:11.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:77:0)
[02:50:11.382] Build status: STARTED
[02:50:11.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:78:0) after 1m51s
[02:52:02.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:78:0)
[02:52:02.515] Build status: STARTED
[02:52:02.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:79:0) after 6m10s
[02:58:12.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:79:0)
[02:58:12.815] Build status: STARTED
[02:58:12.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:80:0) after 6m24s
[03:04:37.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:80:0)
[03:04:37.242] Build status: STARTED
[03:04:37.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:81:0) after 5m16s
[03:09:53.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:81:0)
[03:09:53.641] Build status: STARTED
[03:09:53.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:82:0) after 1m34s
[03:11:27.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:82:0)
[03:11:27.742] Build status: STARTED
[03:11:27.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:83:0) after 4m4s
[03:15:31.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:83:0)
[03:15:31.913] Build status: STARTED
[03:15:31.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:84:0) after 5m7s
[03:20:39.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:84:0)
[03:20:39.215] Build status: STARTED
[03:20:39.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:85:0) after 9m0s
[03:29:39.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:85:0)
[03:29:39.553] Build status: STARTED
[03:29:39.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:86:0) after 5m34s
[03:35:13.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:86:0)
[03:35:13.791] Build status: STARTED
[03:35:13.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:87:0) after 1m6s
[03:36:20.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:87:0)
[03:36:20.101] Build status: STARTED
[03:36:20.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:88:0) after 9m28s
[03:45:48.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:88:0)
[03:45:48.234] Build status: STARTED
[03:45:48.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:89:0) after 1m18s
[03:47:06.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:89:0)
[03:47:06.245] Build status: STARTED
[03:47:06.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:90:0) after 5m48s
[03:52:54.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:90:0)
[03:52:54.524] Build status: STARTED
[03:52:54.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:91:0) after 4m9s
[03:57:03.713] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:91:0)
[03:57:03.736] Build status: STARTED
[03:57:03.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:92:0) after 1m43s
[03:58:46.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:92:0)
[03:58:46.823] Build status: STARTED
[03:58:46.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:93:0) after 7m12s
[04:05:59.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:93:0)
[04:05:59.091] Build status: STARTED
[04:05:59.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:94:0) after 3m56s
[04:09:55.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:94:0)
[04:09:55.164] Build status: STARTED
[04:09:55.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:95:0) after 7m6s
[04:17:01.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:95:0)
[04:17:01.428] Build status: STARTED
[04:17:01.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:96:0) after 9m36s
[04:26:37.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:96:0)
[04:26:37.478] Build status: STARTED
[04:26:37.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:97:0) after 6m29s
[04:33:06.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:97:0)
[04:33:06.536] Build status: STARTED
[04:33:06.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:98:0) after 9m14s
[04:42:20.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:98:0)
[04:42:20.742] Build status: STARTED
[04:42:20.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:99:0) after 1m22s
[04:43:42.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:99:0)
[04:43:42.815] Build status: STARTED
[04:43:42.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:100:0) after 9m9s
[04:52:51.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:100:0)
[04:52:52.114] Build status: STARTED
[04:52:52.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:101:0) after 2m46s
[04:55:38.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:101:0)
[04:55:38.126] Build status: STARTED
[04:55:38.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:102:0) after 4m48s
[05:00:26.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:102:0)
[05:00:26.193] Build status: STARTED
[05:00:26.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:103:0) after 1m35s
[05:02:01.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:103:0)
[05:02:01.725] Build status: STARTED
[05:02:01.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:104:0) after 9m5s
[05:11:06.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:104:0)
[05:11:06.780] Build status: STARTED
[05:11:06.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:105:0) after 4m16s
[05:15:22.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:105:0)
[05:15:22.854] Build status: STARTED
[05:15:22.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:106:0) after 3m18s
[05:18:40.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:106:0)
[05:18:40.945] Build status: STARTED
[05:18:40.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:107:0) after 5m52s
[05:24:32.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:107:0)
[05:24:33.025] Build status: STARTED
[05:24:33.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952504153669200704:108:0) after 7m28s
[05:26:18.542] Received PubSub notification, asking Buildbucket for the build status
[05:26:18.580] Build:
{
"id": "8787074091761672081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18574,
"createdBy": "project:chromium",
"createTime": "2023-03-09T19:29:04.536737510Z",
"startTime": "2023-03-09T19:33:08.249734Z",
"endTime": "2023-03-10T05:26:18.128739486Z",
"updateTime": "2023-03-10T05:26:18.128739486Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a309f6890eec4b070ca5c97c18bf2f6e1cfdc440",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:26:18.580] Invocation finished in 9h57m15.246664664s with status FAILED