[18:03:48.649] New invocation is queued and will start shortly
[18:03:50.499] Starting the invocation (attempt 1)
[18:03:50.539] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c689b3e2093ede12a50a2a5db9bfc78215f68247"
[18:03:50.539] Popped gitiles commit info from properties and tags
[18:03:50.539] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:03:50.539] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:03:50.539] Buildbucket request:
{
"requestId": "8989473079112475120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c689b3e2093ede12a50a2a5db9bfc78215f68247",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8989473079112475120"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:03:51.169] Scheduled build:
{
"id": "8824043016358051873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26452,
"createdBy": "project:chromium",
"createTime": "2022-01-25T18:03:50.643216613Z",
"updateTime": "2022-01-25T18:03:50.643216613Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c689b3e2093ede12a50a2a5db9bfc78215f68247",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:03:51.169] Task URL: https://cr-buildbucket.appspot.com/build/8824043016358051873
[18:03:51.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:2:0) after 4m1s
[18:07:52.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:2:0)
[18:07:52.236] Build status: SCHEDULED
[18:07:52.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:3:0) after 5m21s
[18:13:13.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:3:0)
[18:13:13.291] Build status: SCHEDULED
[18:13:13.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:4:0) after 2m23s
[18:15:36.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:4:0)
[18:15:36.364] Build status: SCHEDULED
[18:15:36.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:5:0) after 1m0s
[18:16:36.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:5:0)
[18:16:36.478] Build status: SCHEDULED
[18:16:36.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:6:0) after 8m48s
[18:22:46.360] Received PubSub notification, asking Buildbucket for the build status
[18:22:46.430] Build status: STARTED
[18:25:24.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:6:0)
[18:25:24.530] Build status: STARTED
[18:25:24.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:8:0) after 7m4s
[18:32:28.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:8:0)
[18:32:28.577] Build status: STARTED
[18:32:28.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:9:0) after 1m24s
[18:33:52.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:9:0)
[18:33:52.629] Build status: STARTED
[18:33:52.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:10:0) after 5m51s
[18:39:43.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:10:0)
[18:39:43.759] Build status: STARTED
[18:39:43.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:11:0) after 6m56s
[18:46:39.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:11:0)
[18:46:39.815] Build status: STARTED
[18:46:39.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:12:0) after 2m13s
[18:48:52.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:12:0)
[18:48:52.912] Build status: STARTED
[18:48:52.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:13:0) after 7m23s
[18:56:15.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:13:0)
[18:56:16.016] Build status: STARTED
[18:56:16.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:14:0) after 4m7s
[19:00:23.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:14:0)
[19:00:23.168] Build status: STARTED
[19:00:23.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:15:0) after 7m8s
[19:07:31.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:15:0)
[19:07:31.329] Build status: STARTED
[19:07:31.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:16:0) after 8m42s
[19:16:13.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:16:0)
[19:16:13.396] Build status: STARTED
[19:16:13.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:17:0) after 9m49s
[19:26:02.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:17:0)
[19:26:02.589] Build status: STARTED
[19:26:02.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:18:0) after 5m36s
[19:31:38.752] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:18:0)
[19:31:38.784] Build status: STARTED
[19:31:38.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:19:0) after 5m35s
[19:37:13.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:19:0)
[19:37:13.836] Build status: STARTED
[19:37:13.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:20:0) after 5m17s
[19:42:30.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:20:0)
[19:42:30.890] Build status: STARTED
[19:42:30.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:21:0) after 4m39s
[19:47:10.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:21:0)
[19:47:10.176] Build status: STARTED
[19:47:10.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:22:0) after 1m30s
[19:48:40.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:22:0)
[19:48:40.255] Build status: STARTED
[19:48:40.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:23:0) after 3m33s
[19:52:13.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:23:0)
[19:52:13.308] Build status: STARTED
[19:52:13.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:24:0) after 9m27s
[20:01:40.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:24:0)
[20:01:40.390] Build status: STARTED
[20:01:40.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:25:0) after 8m0s
[20:09:40.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:25:0)
[20:09:40.470] Build status: STARTED
[20:09:40.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:26:0) after 3m50s
[20:13:30.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:26:0)
[20:13:30.669] Build status: STARTED
[20:13:30.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:27:0) after 6m25s
[20:19:55.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:27:0)
[20:19:55.719] Build status: STARTED
[20:19:55.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:28:0) after 7m55s
[20:27:50.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:28:0)
[20:27:50.817] Build status: STARTED
[20:27:50.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:29:0) after 1m21s
[20:29:11.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:29:0)
[20:29:11.912] Build status: STARTED
[20:29:11.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:30:0) after 2m5s
[20:31:16.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:30:0)
[20:31:17.292] Build status: STARTED
[20:31:17.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:31:0) after 1m0s
[20:32:17.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:31:0)
[20:32:17.374] Build status: STARTED
[20:32:17.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:32:0) after 6m59s
[20:39:16.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:32:0)
[20:39:17.044] Build status: STARTED
[20:39:17.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:33:0) after 2m37s
[20:41:54.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:33:0)
[20:41:54.087] Build status: STARTED
[20:41:54.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:34:0) after 9m51s
[20:51:45.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:34:0)
[20:51:45.213] Build status: STARTED
[20:51:45.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:35:0) after 8m0s
[20:59:45.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:35:0)
[20:59:45.341] Build status: STARTED
[20:59:45.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:36:0) after 3m8s
[21:02:53.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:36:0)
[21:02:53.398] Build status: STARTED
[21:02:53.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:37:0) after 4m11s
[21:07:04.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:37:0)
[21:07:05.044] Build status: STARTED
[21:07:05.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:38:0) after 8m3s
[21:15:08.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:38:0)
[21:15:08.152] Build status: STARTED
[21:15:08.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:39:0) after 3m31s
[21:18:39.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:39:0)
[21:18:39.413] Build status: STARTED
[21:18:39.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:40:0) after 3m4s
[21:21:43.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:40:0)
[21:21:43.530] Build status: STARTED
[21:21:43.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:41:0) after 1m4s
[21:22:47.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:41:0)
[21:22:47.575] Build status: STARTED
[21:22:47.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:42:0) after 4m43s
[21:27:30.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:42:0)
[21:27:30.922] Build status: STARTED
[21:27:30.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:43:0) after 9m21s
[21:36:51.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:43:0)
[21:36:51.970] Build status: STARTED
[21:36:51.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:44:0) after 2m46s
[21:39:38.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:44:0)
[21:39:38.100] Build status: STARTED
[21:39:38.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:45:0) after 1m49s
[21:41:27.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:45:0)
[21:41:27.208] Build status: STARTED
[21:41:27.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:46:0) after 3m9s
[21:44:36.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:46:0)
[21:44:36.211] Build status: STARTED
[21:44:36.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:47:0) after 3m26s
[21:48:02.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:47:0)
[21:48:02.388] Build status: STARTED
[21:48:02.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:48:0) after 7m20s
[21:55:22.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:48:0)
[21:55:22.652] Build status: STARTED
[21:55:22.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:49:0) after 6m16s
[22:01:38.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:49:0)
[22:01:38.763] Build status: STARTED
[22:01:38.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:50:0) after 6m19s
[22:07:57.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:50:0)
[22:07:57.900] Build status: STARTED
[22:07:57.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:51:0) after 5m4s
[22:13:02.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:51:0)
[22:13:02.049] Build status: STARTED
[22:13:02.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:52:0) after 5m43s
[22:18:45.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:52:0)
[22:18:45.115] Build status: STARTED
[22:18:45.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:53:0) after 3m41s
[22:22:26.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:53:0)
[22:22:26.279] Build status: STARTED
[22:22:26.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:54:0) after 1m42s
[22:24:08.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:54:0)
[22:24:08.338] Build status: STARTED
[22:24:08.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:55:0) after 5m14s
[22:29:22.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:55:0)
[22:29:22.578] Build status: STARTED
[22:29:22.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:56:0) after 3m39s
[22:33:01.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:56:0)
[22:33:01.618] Build status: STARTED
[22:33:01.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:57:0) after 5m39s
[22:38:40.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:57:0)
[22:38:40.666] Build status: STARTED
[22:38:40.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:58:0) after 9m43s
[22:48:23.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:58:0)
[22:48:23.741] Build status: STARTED
[22:48:23.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:59:0) after 3m26s
[22:51:49.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:59:0)
[22:51:49.790] Build status: STARTED
[22:51:49.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:60:0) after 8m35s
[23:00:24.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:60:0)
[23:00:25.008] Build status: STARTED
[23:00:25.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:61:0) after 1m56s
[23:02:21.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:61:0)
[23:02:21.303] Build status: STARTED
[23:02:21.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:62:0) after 6m21s
[23:08:42.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:62:0)
[23:08:42.316] Build status: STARTED
[23:08:42.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:63:0) after 3m11s
[23:11:53.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:63:0)
[23:11:53.517] Build status: STARTED
[23:11:53.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:64:0) after 8m1s
[23:19:54.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:64:0)
[23:19:54.900] Build status: STARTED
[23:19:54.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:65:0) after 9m33s
[23:29:27.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:65:0)
[23:29:27.947] Build status: STARTED
[23:29:27.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:66:0) after 3m9s
[23:32:36.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:66:0)
[23:32:37.040] Build status: STARTED
[23:32:37.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:67:0) after 3m47s
[23:36:24.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:67:0)
[23:36:24.085] Build status: STARTED
[23:36:24.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:68:0) after 3m15s
[23:39:39.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:68:0)
[23:39:39.644] Build status: STARTED
[23:39:39.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:69:0) after 6m22s
[23:46:01.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:69:0)
[23:46:01.745] Build status: STARTED
[23:46:01.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:70:0) after 4m22s
[23:50:23.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:70:0)
[23:50:23.968] Build status: STARTED
[23:50:23.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:71:0) after 5m56s
[23:56:20.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:71:0)
[23:56:20.091] Build status: STARTED
[23:56:20.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:72:0) after 7m35s
[00:03:55.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:72:0)
[00:03:55.252] Build status: STARTED
[00:03:55.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:73:0) after 8m41s
[00:12:36.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:73:0)
[00:12:36.420] Build status: STARTED
[00:12:36.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:74:0) after 3m49s
[00:16:25.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:74:0)
[00:16:25.568] Build status: STARTED
[00:16:25.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:75:0) after 2m59s
[00:19:24.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:75:0)
[00:19:24.635] Build status: STARTED
[00:19:24.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:76:0) after 2m17s
[00:21:41.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:76:0)
[00:21:41.681] Build status: STARTED
[00:21:41.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:77:0) after 7m42s
[00:29:23.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:77:0)
[00:29:23.717] Build status: STARTED
[00:29:23.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:78:0) after 3m46s
[00:33:09.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:78:0)
[00:33:09.969] Build status: STARTED
[00:33:09.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:79:0) after 6m33s
[00:39:43.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:79:0)
[00:39:43.083] Build status: STARTED
[00:39:43.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:80:0) after 3m34s
[00:43:17.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:80:0)
[00:43:17.133] Build status: STARTED
[00:43:17.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:81:0) after 9m40s
[00:52:57.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:81:0)
[00:52:57.252] Build status: STARTED
[00:52:57.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:82:0) after 3m35s
[00:56:32.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:82:0)
[00:56:32.308] Build status: STARTED
[00:56:32.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:83:0) after 7m55s
[01:04:27.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:83:0)
[01:04:27.626] Build status: STARTED
[01:04:27.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:84:0) after 4m20s
[01:08:47.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:84:0)
[01:08:47.855] Build status: STARTED
[01:08:47.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:85:0) after 4m32s
[01:13:20.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:85:0)
[01:13:20.032] Build status: STARTED
[01:13:20.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:86:0) after 1m19s
[01:14:39.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:86:0)
[01:14:39.360] Build status: STARTED
[01:14:39.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:87:0) after 1m25s
[01:16:04.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:87:0)
[01:16:04.589] Build status: STARTED
[01:16:04.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:88:0) after 9m52s
[01:25:56.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:88:0)
[01:25:56.622] Build status: STARTED
[01:25:56.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:89:0) after 6m51s
[01:32:47.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:89:0)
[01:32:47.979] Build status: STARTED
[01:32:47.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:90:0) after 6m7s
[01:38:55.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:90:0)
[01:38:55.255] Build status: STARTED
[01:38:55.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:91:0) after 4m13s
[01:43:08.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:91:0)
[01:43:08.320] Build status: STARTED
[01:43:08.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:92:0) after 4m58s
[01:48:06.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:92:0)
[01:48:06.705] Build status: STARTED
[01:48:06.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:93:0) after 6m25s
[01:54:32.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:93:0)
[01:54:32.045] Build status: STARTED
[01:54:32.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:94:0) after 4m41s
[01:59:13.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:94:0)
[01:59:13.092] Build status: STARTED
[01:59:13.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:95:0) after 3m2s
[02:02:15.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:95:0)
[02:02:15.143] Build status: STARTED
[02:02:15.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:96:0) after 7m37s
[02:09:52.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:96:0)
[02:09:52.563] Build status: STARTED
[02:09:52.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:97:0) after 5m29s
[02:15:21.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:97:0)
[02:15:21.692] Build status: STARTED
[02:15:21.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:98:0) after 6m36s
[02:21:57.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:98:0)
[02:21:57.818] Build status: STARTED
[02:21:57.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:99:0) after 4m44s
[02:26:42.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:99:0)
[02:26:42.720] Build status: STARTED
[02:26:42.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:100:0) after 4m44s
[02:31:27.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:100:0)
[02:31:27.092] Build status: STARTED
[02:31:27.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:101:0) after 6m25s
[02:37:52.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:101:0)
[02:37:52.181] Build status: STARTED
[02:37:52.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:102:0) after 9m37s
[02:47:29.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:102:0)
[02:47:29.623] Build status: STARTED
[02:47:29.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:103:0) after 4m59s
[02:52:28.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:103:0)
[02:52:28.694] Build status: STARTED
[02:52:28.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:104:0) after 5m2s
[02:57:30.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:104:0)
[02:57:30.762] Build status: STARTED
[02:57:30.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:105:0) after 8m25s
[03:05:55.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:105:0)
[03:05:55.909] Build status: STARTED
[03:05:55.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:106:0) after 3m59s
[03:09:55.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:106:0)
[03:09:55.081] Build status: STARTED
[03:09:55.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:107:0) after 6m0s
[03:15:55.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:107:0)
[03:15:55.836] Build status: STARTED
[03:15:55.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:108:0) after 2m10s
[03:18:05.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:108:0)
[03:18:05.954] Build status: STARTED
[03:18:05.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:109:0) after 1m26s
[03:19:32.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:109:0)
[03:19:32.138] Build status: STARTED
[03:19:32.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:110:0) after 7m43s
[03:27:15.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:110:0)
[03:27:15.424] Build status: STARTED
[03:27:15.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:111:0) after 1m8s
[03:28:23.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:111:0)
[03:28:23.484] Build status: STARTED
[03:28:23.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:112:0) after 6m48s
[03:35:11.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:112:0)
[03:35:11.742] Build status: STARTED
[03:35:11.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:113:0) after 8m35s
[03:43:46.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:113:0)
[03:43:46.791] Build status: STARTED
[03:43:46.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:114:0) after 4m22s
[03:48:08.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:114:0)
[03:48:08.868] Build status: STARTED
[03:48:08.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:115:0) after 7m32s
[03:55:40.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:115:0)
[03:55:40.970] Build status: STARTED
[03:55:40.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:116:0) after 1m20s
[03:57:01.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:116:0)
[03:57:01.130] Build status: STARTED
[03:57:01.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:117:0) after 8m11s
[04:05:12.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:117:0)
[04:05:12.416] Build status: STARTED
[04:05:12.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:118:0) after 7m42s
[04:12:54.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:118:0)
[04:12:54.888] Build status: STARTED
[04:12:54.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:119:0) after 1m32s
[04:14:27.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:119:0)
[04:14:27.363] Build status: STARTED
[04:14:27.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:120:0) after 7m56s
[04:22:23.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:120:0)
[04:22:23.412] Build status: STARTED
[04:22:23.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:121:0) after 9m40s
[04:32:03.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:121:0)
[04:32:03.609] Build status: STARTED
[04:32:03.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:122:0) after 7m27s
[04:39:30.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:122:0)
[04:39:30.673] Build status: STARTED
[04:39:30.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:123:0) after 3m45s
[04:43:15.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:123:0)
[04:43:15.742] Build status: STARTED
[04:43:15.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:124:0) after 7m39s
[04:50:54.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:124:0)
[04:50:55.071] Build status: STARTED
[04:50:55.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:125:0) after 3m42s
[04:54:37.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:125:0)
[04:54:37.269] Build status: STARTED
[04:54:37.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:126:0) after 5m17s
[04:59:54.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:126:0)
[04:59:54.446] Build status: STARTED
[04:59:54.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8989473079112475120:127:0) after 3m34s
[05:00:36.675] Received PubSub notification, asking Buildbucket for the build status
[05:00:36.697] Build:
{
"id": "8824043016358051873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26452,
"createdBy": "project:chromium",
"createTime": "2022-01-25T18:03:50.643216613Z",
"startTime": "2022-01-25T18:22:45.700973Z",
"endTime": "2022-01-26T05:00:36.072481848Z",
"updateTime": "2022-01-26T05:00:36.072481848Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c689b3e2093ede12a50a2a5db9bfc78215f68247",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:00:36.697] Invocation finished in 10h56m48.064049847s with status FAILED