[16:39:00.775] New invocation is queued and will start shortly
[16:39:01.891] Starting the invocation (attempt 1)
[16:39:01.925] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c321308b5a79ed1abcc099314402061427af9764"
[16:39:01.925] Popped gitiles commit info from properties and tags
[16:39:01.925] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:39:01.925] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:39:01.925] Buildbucket request:
{
"requestId": "8990927965594381392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c321308b5a79ed1abcc099314402061427af9764",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8990927965594381392"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:39:02.425] Scheduled build:
{
"id": "8825497903660473089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26414,
"createdBy": "project:chromium",
"createTime": "2022-01-09T16:39:01.989241448Z",
"updateTime": "2022-01-09T16:39:01.989241448Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c321308b5a79ed1abcc099314402061427af9764",
"ref": "refs/heads/main"
}
}
}
[16:39:02.425] Task URL: https://cr-buildbucket.appspot.com/build/8825497903660473089
[16:39:02.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:2:0) after 4m12s
[16:43:14.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:2:0)
[16:43:14.629] Build status: SCHEDULED
[16:43:14.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:3:0) after 5m27s
[16:48:41.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:3:0)
[16:48:41.641] Build status: SCHEDULED
[16:48:41.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:4:0) after 7m3s
[16:49:09.151] Received PubSub notification, asking Buildbucket for the build status
[16:49:09.171] Build status: STARTED
[16:55:44.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:4:0)
[16:55:44.688] Build status: STARTED
[16:55:44.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:6:0) after 1m0s
[16:56:44.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:6:0)
[16:56:44.750] Build status: STARTED
[16:56:44.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:7:0) after 7m29s
[17:04:14.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:7:0)
[17:04:14.285] Build status: STARTED
[17:04:14.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:8:0) after 9m33s
[17:13:47.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:8:0)
[17:13:47.331] Build status: STARTED
[17:13:47.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:9:0) after 6m14s
[17:20:01.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:9:0)
[17:20:01.379] Build status: STARTED
[17:20:01.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:10:0) after 1m33s
[17:21:35.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:10:0)
[17:21:35.729] Build status: STARTED
[17:21:35.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:11:0) after 6m21s
[17:27:56.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:11:0)
[17:27:56.883] Build status: STARTED
[17:27:56.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:12:0) after 3m44s
[17:31:40.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:12:0)
[17:31:40.956] Build status: STARTED
[17:31:40.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:13:0) after 2m40s
[17:34:20.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:13:0)
[17:34:21.014] Build status: STARTED
[17:34:21.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:14:0) after 2m16s
[17:36:37.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:14:0)
[17:36:37.019] Build status: STARTED
[17:36:37.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:15:0) after 4m33s
[17:41:10.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:15:0)
[17:41:10.064] Build status: STARTED
[17:41:10.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:16:0) after 5m45s
[17:46:56.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:16:0)
[17:46:56.058] Build status: STARTED
[17:46:56.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:17:0) after 6m2s
[17:52:58.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:17:0)
[17:52:58.494] Build status: STARTED
[17:52:58.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:18:0) after 1m27s
[17:54:25.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:18:0)
[17:54:25.719] Build status: STARTED
[17:54:25.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:19:0) after 6m21s
[18:00:46.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:19:0)
[18:00:46.787] Build status: STARTED
[18:00:46.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:20:0) after 4m12s
[18:04:59.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:20:0)
[18:04:59.027] Build status: STARTED
[18:04:59.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:21:0) after 9m29s
[18:14:28.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:21:0)
[18:14:28.240] Build status: STARTED
[18:14:28.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:22:0) after 7m39s
[18:22:07.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:22:0)
[18:22:07.291] Build status: STARTED
[18:22:07.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:23:0) after 9m0s
[18:31:07.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:23:0)
[18:31:07.330] Build status: STARTED
[18:31:07.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:24:0) after 9m35s
[18:40:42.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:24:0)
[18:40:42.492] Build status: STARTED
[18:40:42.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:25:0) after 2m33s
[18:43:15.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:25:0)
[18:43:15.535] Build status: STARTED
[18:43:15.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:26:0) after 8m13s
[18:51:28.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:26:0)
[18:51:28.579] Build status: STARTED
[18:51:28.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:27:0) after 1m48s
[18:53:16.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:27:0)
[18:53:16.648] Build status: STARTED
[18:53:16.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:28:0) after 7m31s
[19:00:47.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:28:0)
[19:00:47.682] Build status: STARTED
[19:00:47.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:29:0) after 8m41s
[19:09:28.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:29:0)
[19:09:28.719] Build status: STARTED
[19:09:28.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:30:0) after 4m51s
[19:14:19.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:30:0)
[19:14:19.757] Build status: STARTED
[19:14:19.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:31:0) after 9m52s
[19:24:11.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:31:0)
[19:24:11.814] Build status: STARTED
[19:24:11.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:32:0) after 5m56s
[19:30:07.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:32:0)
[19:30:07.941] Build status: STARTED
[19:30:07.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:33:0) after 7m20s
[19:37:27.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:33:0)
[19:37:27.979] Build status: STARTED
[19:37:27.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:34:0) after 4m31s
[19:41:58.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:34:0)
[19:41:59.016] Build status: STARTED
[19:41:59.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:35:0) after 8m53s
[19:50:52.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:35:0)
[19:50:52.092] Build status: STARTED
[19:50:52.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:36:0) after 4m55s
[19:55:47.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:36:0)
[19:55:47.147] Build status: STARTED
[19:55:47.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:37:0) after 3m26s
[19:59:13.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:37:0)
[19:59:13.181] Build status: STARTED
[19:59:13.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:38:0) after 8m11s
[20:07:24.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:38:0)
[20:07:24.351] Build status: STARTED
[20:07:24.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:39:0) after 6m8s
[20:13:32.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:39:0)
[20:13:32.394] Build status: STARTED
[20:13:32.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:40:0) after 7m8s
[20:20:40.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:40:0)
[20:20:40.452] Build status: STARTED
[20:20:40.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:41:0) after 2m38s
[20:23:18.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:41:0)
[20:23:18.556] Build status: STARTED
[20:23:18.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:42:0) after 8m53s
[20:32:11.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:42:0)
[20:32:11.823] Build status: STARTED
[20:32:11.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:43:0) after 2m57s
[20:35:08.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:43:0)
[20:35:08.935] Build status: STARTED
[20:35:08.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:44:0) after 6m48s
[20:41:56.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:44:0)
[20:41:56.971] Build status: STARTED
[20:41:56.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:45:0) after 3m36s
[20:45:33.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:45:0)
[20:45:33.302] Build status: STARTED
[20:45:33.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:46:0) after 3m36s
[20:49:09.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:46:0)
[20:49:09.379] Build status: STARTED
[20:49:09.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:47:0) after 4m50s
[20:53:59.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:47:0)
[20:53:59.435] Build status: STARTED
[20:53:59.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:48:0) after 8m1s
[21:02:00.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:48:0)
[21:02:00.474] Build status: STARTED
[21:02:00.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:49:0) after 5m42s
[21:07:43.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:49:0)
[21:07:43.087] Build status: STARTED
[21:07:43.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:50:0) after 9m58s
[21:17:41.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:50:0)
[21:17:41.330] Build status: STARTED
[21:17:41.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:51:0) after 4m8s
[21:21:49.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:51:0)
[21:21:49.532] Build status: STARTED
[21:21:49.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:52:0) after 7m32s
[21:29:21.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:52:0)
[21:29:21.598] Build status: STARTED
[21:29:21.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:53:0) after 6m12s
[21:35:33.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:53:0)
[21:35:33.636] Build status: STARTED
[21:35:33.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:54:0) after 5m27s
[21:41:00.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:54:0)
[21:41:00.687] Build status: STARTED
[21:41:00.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:55:0) after 8m31s
[21:49:32.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:55:0)
[21:49:32.069] Build status: STARTED
[21:49:32.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:56:0) after 2m35s
[21:52:07.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:56:0)
[21:52:07.131] Build status: STARTED
[21:52:07.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:57:0) after 6m20s
[21:58:27.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:57:0)
[21:58:27.682] Build status: STARTED
[21:58:27.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:58:0) after 6m27s
[22:04:54.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:58:0)
[22:04:54.784] Build status: STARTED
[22:04:54.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:59:0) after 7m9s
[22:12:03.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:59:0)
[22:12:03.819] Build status: STARTED
[22:12:03.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:60:0) after 4m50s
[22:16:53.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:60:0)
[22:16:53.868] Build status: STARTED
[22:16:53.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:61:0) after 7m9s
[22:24:02.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:61:0)
[22:24:02.925] Build status: STARTED
[22:24:02.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:62:0) after 1m3s
[22:25:06.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:62:0)
[22:25:06.126] Build status: STARTED
[22:25:06.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:63:0) after 7m27s
[22:32:33.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:63:0)
[22:32:33.243] Build status: STARTED
[22:32:33.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:64:0) after 3m51s
[22:36:24.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:64:0)
[22:36:24.293] Build status: STARTED
[22:36:24.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:65:0) after 2m10s
[22:38:34.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:65:0)
[22:38:34.367] Build status: STARTED
[22:38:34.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:66:0) after 9m22s
[22:47:56.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:66:0)
[22:47:57.413] Build status: STARTED
[22:47:57.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:67:0) after 9m6s
[22:57:03.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:67:0)
[22:57:03.454] Build status: STARTED
[22:57:03.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:68:0) after 8m41s
[23:05:44.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:68:0)
[23:05:44.738] Build status: STARTED
[23:05:44.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:69:0) after 5m22s
[23:11:06.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:69:0)
[23:11:06.783] Build status: STARTED
[23:11:06.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:70:0) after 1m58s
[23:13:04.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:70:0)
[23:13:04.819] Build status: STARTED
[23:13:04.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:71:0) after 6m51s
[23:19:55.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:71:0)
[23:19:56.006] Build status: STARTED
[23:19:56.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:72:0) after 9m59s
[23:29:55.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:72:0)
[23:29:55.381] Build status: STARTED
[23:29:55.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:73:0) after 1m2s
[23:30:57.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:73:0)
[23:30:57.822] Build status: STARTED
[23:30:57.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:74:0) after 4m30s
[23:35:27.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:74:0)
[23:35:27.868] Build status: STARTED
[23:35:27.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:75:0) after 9m25s
[23:44:52.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:75:0)
[23:44:52.929] Build status: STARTED
[23:44:52.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:76:0) after 2m36s
[23:47:28.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:76:0)
[23:47:28.973] Build status: STARTED
[23:47:28.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:77:0) after 1m14s
[23:48:42.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:77:0)
[23:48:43.008] Build status: STARTED
[23:48:43.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:78:0) after 1m45s
[23:50:28.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:78:0)
[23:50:28.486] Build status: STARTED
[23:50:28.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:79:0) after 6m25s
[23:56:53.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:79:0)
[23:56:53.532] Build status: STARTED
[23:56:53.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:80:0) after 8m37s
[00:05:30.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:80:0)
[00:05:30.598] Build status: STARTED
[00:05:30.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:81:0) after 7m18s
[00:12:48.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:81:0)
[00:12:48.786] Build status: STARTED
[00:12:48.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:82:0) after 1m53s
[00:14:41.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:82:0)
[00:14:41.952] Build status: STARTED
[00:14:41.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:83:0) after 6m48s
[00:21:30.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:83:0)
[00:21:30.171] Build status: STARTED
[00:21:30.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:84:0) after 8m12s
[00:29:42.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:84:0)
[00:29:42.230] Build status: STARTED
[00:29:42.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:85:0) after 4m30s
[00:34:12.258] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:85:0)
[00:34:12.288] Build status: STARTED
[00:34:12.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:86:0) after 1m3s
[00:35:15.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:86:0)
[00:35:15.395] Build status: STARTED
[00:35:15.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:87:0) after 1m15s
[00:36:30.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:87:0)
[00:36:30.444] Build status: STARTED
[00:36:30.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:88:0) after 9m48s
[00:46:18.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:88:0)
[00:46:18.612] Build status: STARTED
[00:46:18.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:89:0) after 2m48s
[00:49:06.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:89:0)
[00:49:06.689] Build status: STARTED
[00:49:06.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:90:0) after 7m44s
[00:56:51.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:90:0)
[00:56:51.033] Build status: STARTED
[00:56:51.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:91:0) after 2m22s
[00:59:13.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:91:0)
[00:59:13.136] Build status: STARTED
[00:59:13.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:92:0) after 9m23s
[01:08:36.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:92:0)
[01:08:36.546] Build status: STARTED
[01:08:36.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:93:0) after 9m44s
[01:18:20.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:93:0)
[01:18:20.848] Build status: STARTED
[01:18:20.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:94:0) after 8m38s
[01:26:58.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:94:0)
[01:26:58.916] Build status: STARTED
[01:26:58.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:95:0) after 6m27s
[01:33:25.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:95:0)
[01:33:26.058] Build status: STARTED
[01:33:26.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:96:0) after 5m35s
[01:39:01.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:96:0)
[01:39:01.112] Build status: STARTED
[01:39:01.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:97:0) after 4m50s
[01:43:51.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:97:0)
[01:43:51.259] Build status: STARTED
[01:43:51.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:98:0) after 4m41s
[01:48:32.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:98:0)
[01:48:32.421] Build status: STARTED
[01:48:32.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:99:0) after 4m45s
[01:53:17.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:99:0)
[01:53:17.570] Build status: STARTED
[01:53:17.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:100:0) after 2m32s
[01:55:49.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:100:0)
[01:55:49.655] Build status: STARTED
[01:55:49.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:101:0) after 3m12s
[01:59:01.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:101:0)
[01:59:01.675] Build status: STARTED
[01:59:01.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:102:0) after 3m33s
[02:02:34.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:102:0)
[02:02:34.716] Build status: STARTED
[02:02:34.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:103:0) after 1m33s
[02:04:07.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:103:0)
[02:04:07.899] Build status: STARTED
[02:04:07.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:104:0) after 2m33s
[02:06:41.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:104:0)
[02:06:41.114] Build status: STARTED
[02:06:41.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:105:0) after 6m20s
[02:13:01.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:105:0)
[02:13:01.211] Build status: STARTED
[02:13:01.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:106:0) after 9m56s
[02:22:57.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:106:0)
[02:22:57.247] Build status: STARTED
[02:22:57.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:107:0) after 6m14s
[02:29:11.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:107:0)
[02:29:11.404] Build status: STARTED
[02:29:11.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:108:0) after 6m12s
[02:35:23.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:108:0)
[02:35:23.459] Build status: STARTED
[02:35:23.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:109:0) after 5m1s
[02:40:24.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:109:0)
[02:40:24.546] Build status: STARTED
[02:40:24.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:110:0) after 9m6s
[02:49:30.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:110:0)
[02:49:30.718] Build status: STARTED
[02:49:30.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:111:0) after 6m19s
[02:55:49.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:111:0)
[02:55:49.744] Build status: STARTED
[02:55:49.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:112:0) after 8m2s
[03:03:51.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:112:0)
[03:03:51.880] Build status: STARTED
[03:03:51.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:113:0) after 3m8s
[03:06:59.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:113:0)
[03:06:59.944] Build status: STARTED
[03:06:59.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:114:0) after 8m23s
[03:15:22.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:114:0)
[03:15:22.947] Build status: STARTED
[03:15:22.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:115:0) after 8m48s
[03:24:11.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:115:0)
[03:24:11.058] Build status: STARTED
[03:24:11.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:116:0) after 3m4s
[03:27:15.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:116:0)
[03:27:15.349] Build status: STARTED
[03:27:15.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990927965594381392:117:0) after 9m23s
[03:32:38.099] Received PubSub notification, asking Buildbucket for the build status
[03:32:38.116] Build:
{
"id": "8825497903660473089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26414,
"createdBy": "project:chromium",
"createTime": "2022-01-09T16:39:01.989241448Z",
"startTime": "2022-01-09T16:49:08.570171Z",
"endTime": "2022-01-10T03:32:37.747821567Z",
"updateTime": "2022-01-10T03:32:37.747821567Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c321308b5a79ed1abcc099314402061427af9764",
"ref": "refs/heads/main"
}
}
}
[03:32:38.117] Invocation finished in 10h53m37.355785588s with status FAILED