[16:36:40.250] New invocation is queued and will start shortly
[16:36:41.464] Starting the invocation (attempt 1)
[16:36:41.502] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1e5f137537219814ae612531c5269b822e7acd27"
[16:36:41.502] Popped gitiles commit info from properties and tags
[16:36:41.502] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:36:41.502] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:36:41.502] Buildbucket request:
{
"requestId": "8988300800927859744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e5f137537219814ae612531c5269b822e7acd27",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8988300800927859744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:36:42.095] Scheduled build:
{
"id": "8822870738874605457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26508,
"createdBy": "project:chromium",
"createTime": "2022-02-07T16:36:41.571737051Z",
"updateTime": "2022-02-07T16:36:41.571737051Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e5f137537219814ae612531c5269b822e7acd27",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:36:42.095] Task URL: https://cr-buildbucket.appspot.com/build/8822870738874605457
[16:36:42.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:2:0) after 7m7s
[16:43:49.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:2:0)
[16:43:49.264] Build status: SCHEDULED
[16:43:49.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:3:0) after 9m9s
[16:52:58.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:3:0)
[16:52:58.312] Build status: SCHEDULED
[16:52:58.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:4:0) after 6m0s
[16:55:23.335] Received PubSub notification, asking Buildbucket for the build status
[16:55:23.356] Build status: STARTED
[16:58:58.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:4:0)
[16:58:58.372] Build status: STARTED
[16:58:58.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:6:0) after 2m46s
[17:01:44.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:6:0)
[17:01:44.489] Build status: STARTED
[17:01:44.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:7:0) after 3m31s
[17:05:15.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:7:0)
[17:05:15.592] Build status: STARTED
[17:05:15.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:8:0) after 7m32s
[17:12:47.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:8:0)
[17:12:47.685] Build status: STARTED
[17:12:47.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:9:0) after 6m27s
[17:19:15.062] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:9:0)
[17:19:15.087] Build status: STARTED
[17:19:15.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:10:0) after 2m28s
[17:21:43.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:10:0)
[17:21:43.132] Build status: STARTED
[17:21:43.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:11:0) after 1m40s
[17:23:23.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:11:0)
[17:23:23.230] Build status: STARTED
[17:23:23.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:12:0) after 4m34s
[17:27:57.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:12:0)
[17:27:57.460] Build status: STARTED
[17:27:57.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:13:0) after 4m43s
[17:32:40.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:13:0)
[17:32:40.553] Build status: STARTED
[17:32:40.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:14:0) after 4m1s
[17:36:41.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:14:0)
[17:36:41.625] Build status: STARTED
[17:36:41.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:15:0) after 1m17s
[17:37:58.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:15:0)
[17:37:58.807] Build status: STARTED
[17:37:58.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:16:0) after 8m10s
[17:46:08.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:16:0)
[17:46:08.985] Build status: STARTED
[17:46:08.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:17:0) after 5m44s
[17:51:53.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:17:0)
[17:51:53.086] Build status: STARTED
[17:51:53.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:18:0) after 9m17s
[18:01:10.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:18:0)
[18:01:10.132] Build status: STARTED
[18:01:10.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:19:0) after 1m40s
[18:02:50.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:19:0)
[18:02:50.138] Build status: STARTED
[18:02:50.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:20:0) after 4m29s
[18:07:19.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:20:0)
[18:07:19.184] Build status: STARTED
[18:07:19.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:21:0) after 9m40s
[18:16:59.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:21:0)
[18:16:59.269] Build status: STARTED
[18:16:59.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:22:0) after 8m55s
[18:25:54.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:22:0)
[18:25:54.309] Build status: STARTED
[18:25:54.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:23:0) after 2m45s
[18:28:39.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:23:0)
[18:28:39.363] Build status: STARTED
[18:28:39.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:24:0) after 2m59s
[18:31:39.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:24:0)
[18:31:39.298] Build status: STARTED
[18:31:39.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:25:0) after 4m31s
[18:36:10.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:25:0)
[18:36:10.343] Build status: STARTED
[18:36:10.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:26:0) after 3m34s
[18:39:44.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:26:0)
[18:39:44.417] Build status: STARTED
[18:39:44.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:27:0) after 3m27s
[18:43:11.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:27:0)
[18:43:11.799] Build status: STARTED
[18:43:11.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:28:0) after 5m52s
[18:49:04.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:28:0)
[18:49:04.114] Build status: STARTED
[18:49:04.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:29:0) after 8m58s
[18:58:02.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:29:0)
[18:58:02.164] Build status: STARTED
[18:58:02.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:30:0) after 3m10s
[19:01:12.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:30:0)
[19:01:12.415] Build status: STARTED
[19:01:12.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:31:0) after 7m9s
[19:08:21.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:31:0)
[19:08:21.547] Build status: STARTED
[19:08:21.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:32:0) after 5m20s
[19:13:41.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:32:0)
[19:13:41.913] Build status: STARTED
[19:13:41.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:33:0) after 2m23s
[19:16:05.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:33:0)
[19:16:05.075] Build status: STARTED
[19:16:05.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:34:0) after 4m1s
[19:20:07.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:34:0)
[19:20:07.140] Build status: STARTED
[19:20:07.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:35:0) after 4m4s
[19:24:11.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:35:0)
[19:24:11.196] Build status: STARTED
[19:24:11.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:36:0) after 7m39s
[19:31:50.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:36:0)
[19:31:50.272] Build status: STARTED
[19:31:50.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:37:0) after 4m32s
[19:36:22.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:37:0)
[19:36:22.513] Build status: STARTED
[19:36:22.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:38:0) after 3m21s
[19:39:43.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:38:0)
[19:39:43.844] Build status: STARTED
[19:39:43.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:39:0) after 1m54s
[19:41:37.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:39:0)
[19:41:37.895] Build status: STARTED
[19:41:37.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:40:0) after 2m24s
[19:44:01.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:40:0)
[19:44:02.025] Build status: STARTED
[19:44:02.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:41:0) after 3m9s
[19:47:11.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:41:0)
[19:47:11.547] Build status: STARTED
[19:47:11.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:42:0) after 3m13s
[19:50:24.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:42:0)
[19:50:24.683] Build status: STARTED
[19:50:24.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:43:0) after 8m2s
[19:58:26.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:43:0)
[19:58:27.008] Build status: STARTED
[19:58:27.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:44:0) after 9m34s
[20:08:01.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:44:0)
[20:08:01.114] Build status: STARTED
[20:08:01.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:45:0) after 8m6s
[20:16:07.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:45:0)
[20:16:07.175] Build status: STARTED
[20:16:07.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:46:0) after 5m50s
[20:21:57.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:46:0)
[20:21:57.339] Build status: STARTED
[20:21:57.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:47:0) after 9m49s
[20:31:46.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:47:0)
[20:31:46.502] Build status: STARTED
[20:31:46.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:48:0) after 5m53s
[20:37:39.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:48:0)
[20:37:39.656] Build status: STARTED
[20:37:39.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:49:0) after 8m10s
[20:45:49.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:49:0)
[20:45:49.701] Build status: STARTED
[20:45:49.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:50:0) after 6m16s
[20:52:05.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:50:0)
[20:52:05.748] Build status: STARTED
[20:52:05.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:51:0) after 2m15s
[20:54:21.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:51:0)
[20:54:21.220] Build status: STARTED
[20:54:21.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:52:0) after 8m50s
[21:03:11.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:52:0)
[21:03:11.349] Build status: STARTED
[21:03:11.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:53:0) after 3m43s
[21:06:54.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:53:0)
[21:06:54.399] Build status: STARTED
[21:06:54.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:54:0) after 6m46s
[21:13:40.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:54:0)
[21:13:40.459] Build status: STARTED
[21:13:40.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:55:0) after 8m25s
[21:22:05.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:55:0)
[21:22:05.497] Build status: STARTED
[21:22:05.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:56:0) after 3m53s
[21:25:58.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:56:0)
[21:25:58.754] Build status: STARTED
[21:25:58.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:57:0) after 4m31s
[21:30:29.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:57:0)
[21:30:29.801] Build status: STARTED
[21:30:29.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:58:0) after 4m51s
[21:35:20.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:58:0)
[21:35:20.861] Build status: STARTED
[21:35:20.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:59:0) after 8m19s
[21:43:39.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:59:0)
[21:43:40.250] Build status: STARTED
[21:43:40.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:60:0) after 9m32s
[21:53:12.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:60:0)
[21:53:12.321] Build status: STARTED
[21:53:12.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:61:0) after 5m36s
[21:58:48.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:61:0)
[21:58:48.375] Build status: STARTED
[21:58:48.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:62:0) after 8m23s
[22:07:11.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:62:0)
[22:07:11.469] Build status: STARTED
[22:07:11.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:63:0) after 8m58s
[22:16:09.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:63:0)
[22:16:09.825] Build status: STARTED
[22:16:09.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:64:0) after 3m54s
[22:20:03.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:64:0)
[22:20:03.847] Build status: STARTED
[22:20:03.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:65:0) after 2m42s
[22:22:45.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:65:0)
[22:22:45.887] Build status: STARTED
[22:22:45.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:66:0) after 8m12s
[22:30:57.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:66:0)
[22:30:57.975] Build status: STARTED
[22:30:57.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:67:0) after 1m34s
[22:32:31.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:67:0)
[22:32:32.074] Build status: STARTED
[22:32:32.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:68:0) after 6m25s
[22:38:57.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:68:0)
[22:38:57.164] Build status: STARTED
[22:38:57.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:69:0) after 5m52s
[22:44:49.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:69:0)
[22:44:49.353] Build status: STARTED
[22:44:49.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:70:0) after 2m14s
[22:47:03.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:70:0)
[22:47:03.436] Build status: STARTED
[22:47:03.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:71:0) after 6m40s
[22:53:43.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:71:0)
[22:53:43.517] Build status: STARTED
[22:53:43.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:72:0) after 4m17s
[22:58:00.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:72:0)
[22:58:00.607] Build status: STARTED
[22:58:00.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:73:0) after 2m15s
[23:00:15.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:73:0)
[23:00:15.664] Build status: STARTED
[23:00:15.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:74:0) after 9m52s
[23:10:07.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:74:0)
[23:10:07.893] Build status: STARTED
[23:10:07.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:75:0) after 6m40s
[23:16:47.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:75:0)
[23:16:48.021] Build status: STARTED
[23:16:48.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:76:0) after 7m54s
[23:24:42.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:76:0)
[23:24:42.104] Build status: STARTED
[23:24:42.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:77:0) after 3m15s
[23:27:57.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:77:0)
[23:27:57.173] Build status: STARTED
[23:27:57.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:78:0) after 5m13s
[23:33:10.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:78:0)
[23:33:10.218] Build status: STARTED
[23:33:10.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:79:0) after 6m30s
[23:39:40.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:79:0)
[23:39:40.310] Build status: STARTED
[23:39:40.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:80:0) after 8m42s
[23:48:22.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:80:0)
[23:48:22.356] Build status: STARTED
[23:48:22.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:81:0) after 5m37s
[23:53:59.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:81:0)
[23:53:59.511] Build status: STARTED
[23:53:59.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:82:0) after 7m50s
[00:01:49.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:82:0)
[00:01:49.562] Build status: STARTED
[00:01:49.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:83:0) after 9m34s
[00:11:24.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:83:0)
[00:11:24.134] Build status: STARTED
[00:11:24.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:84:0) after 8m44s
[00:20:08.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:84:0)
[00:20:08.592] Build status: STARTED
[00:20:08.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:85:0) after 2m14s
[00:22:22.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:85:0)
[00:22:22.643] Build status: STARTED
[00:22:22.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:86:0) after 7m2s
[00:29:25.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:86:0)
[00:29:25.265] Build status: STARTED
[00:29:25.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:87:0) after 6m48s
[00:36:13.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:87:0)
[00:36:13.706] Build status: STARTED
[00:36:13.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:88:0) after 6m3s
[00:42:16.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:88:0)
[00:42:16.750] Build status: STARTED
[00:42:16.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:89:0) after 3m14s
[00:45:30.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:89:0)
[00:45:31.053] Build status: STARTED
[00:45:31.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:90:0) after 3m52s
[00:49:23.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:90:0)
[00:49:23.212] Build status: STARTED
[00:49:23.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:91:0) after 1m47s
[00:51:10.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:91:0)
[00:51:10.479] Build status: STARTED
[00:51:10.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:92:0) after 1m6s
[00:52:16.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:92:0)
[00:52:16.744] Build status: STARTED
[00:52:16.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:93:0) after 8m34s
[01:00:50.812] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:93:0)
[01:00:50.832] Build status: STARTED
[01:00:50.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:94:0) after 6m21s
[01:07:11.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:94:0)
[01:07:11.895] Build status: STARTED
[01:07:11.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:95:0) after 2m22s
[01:09:33.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:95:0)
[01:09:33.968] Build status: STARTED
[01:09:33.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:96:0) after 4m54s
[01:14:28.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:96:0)
[01:14:28.102] Build status: STARTED
[01:14:28.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:97:0) after 8m29s
[01:22:57.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:97:0)
[01:22:57.350] Build status: STARTED
[01:22:57.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:98:0) after 7m27s
[01:30:24.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:98:0)
[01:30:24.570] Build status: STARTED
[01:30:24.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:99:0) after 1m51s
[01:32:15.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:99:0)
[01:32:15.868] Build status: STARTED
[01:32:15.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:100:0) after 1m40s
[01:33:56.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:100:0)
[01:33:56.138] Build status: STARTED
[01:33:56.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:101:0) after 8m45s
[01:42:41.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:101:0)
[01:42:41.188] Build status: STARTED
[01:42:41.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:102:0) after 8m42s
[01:51:23.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:102:0)
[01:51:23.302] Build status: STARTED
[01:51:23.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:103:0) after 9m52s
[02:01:15.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:103:0)
[02:01:15.425] Build status: STARTED
[02:01:15.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:104:0) after 1m10s
[02:02:25.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:104:0)
[02:02:25.546] Build status: STARTED
[02:02:25.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:105:0) after 3m47s
[02:06:12.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:105:0)
[02:06:12.777] Build status: STARTED
[02:06:12.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:106:0) after 8m22s
[02:14:34.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:106:0)
[02:14:34.793] Build status: STARTED
[02:14:34.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:107:0) after 2m10s
[02:16:44.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:107:0)
[02:16:44.940] Build status: STARTED
[02:16:44.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:108:0) after 1m28s
[02:18:13.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:108:0)
[02:18:13.271] Build status: STARTED
[02:18:13.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:109:0) after 7m55s
[02:26:08.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:109:0)
[02:26:08.750] Build status: STARTED
[02:26:08.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:110:0) after 3m47s
[02:29:55.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:110:0)
[02:29:55.836] Build status: STARTED
[02:29:55.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:111:0) after 5m50s
[02:35:45.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:111:0)
[02:35:45.967] Build status: STARTED
[02:35:45.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:112:0) after 3m15s
[02:39:01.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:112:0)
[02:39:01.289] Build status: STARTED
[02:39:01.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:113:0) after 6m54s
[02:45:55.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:113:0)
[02:45:55.470] Build status: STARTED
[02:45:55.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:114:0) after 4m59s
[02:50:54.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:114:0)
[02:50:54.640] Build status: STARTED
[02:50:54.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:115:0) after 6m22s
[02:57:16.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:115:0)
[02:57:16.780] Build status: STARTED
[02:57:16.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:116:0) after 1m5s
[02:58:21.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:116:0)
[02:58:22.006] Build status: STARTED
[02:58:22.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:117:0) after 5m23s
[03:03:45.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:117:0)
[03:03:45.050] Build status: STARTED
[03:03:45.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:118:0) after 5m2s
[03:08:47.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:118:0)
[03:08:47.279] Build status: STARTED
[03:08:47.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:119:0) after 9m26s
[03:18:13.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:119:0)
[03:18:13.458] Build status: STARTED
[03:18:13.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:120:0) after 5m58s
[03:24:11.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:120:0)
[03:24:11.587] Build status: STARTED
[03:24:11.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:121:0) after 9m43s
[03:33:54.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:121:0)
[03:33:54.679] Build status: STARTED
[03:33:54.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:122:0) after 4m48s
[03:38:42.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:122:0)
[03:38:42.742] Build status: STARTED
[03:38:42.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988300800927859744:123:0) after 8m19s
[03:45:34.207] Received PubSub notification, asking Buildbucket for the build status
[03:45:34.236] Build:
{
"id": "8822870738874605457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26508,
"createdBy": "project:chromium",
"createTime": "2022-02-07T16:36:41.571737051Z",
"startTime": "2022-02-07T16:55:22.695498Z",
"endTime": "2022-02-08T03:45:33.598952213Z",
"updateTime": "2022-02-08T03:45:33.598952213Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e5f137537219814ae612531c5269b822e7acd27",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:45:34.236] Invocation finished in 11h8m54.006087706s with status FAILED