[04:19:50.129] New invocation is queued and will start shortly
[04:19:51.235] Starting the invocation (attempt 1)
[04:19:51.278] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1638f8155834e034f8f9ce0f98d6f31f93267e25"
[04:19:51.278] Popped gitiles commit info from properties and tags
[04:19:51.278] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:19:51.278] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:19:51.278] Buildbucket request:
{
"requestId": "8955551056750051824",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1638f8155834e034f8f9ce0f98d6f31f93267e25",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955551056750051824"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:19:51.725] Scheduled build:
{
"id": "8790120994749885233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28764,
"createdBy": "project:chromium",
"createTime": "2023-02-04T04:19:51.411293875Z",
"updateTime": "2023-02-04T04:19:51.411293875Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1638f8155834e034f8f9ce0f98d6f31f93267e25",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:19:51.725] Task URL: https://cr-buildbucket.appspot.com/build/8790120994749885233
[04:19:51.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:2:0) after 5m11s
[04:23:19.725] Received PubSub notification, asking Buildbucket for the build status
[04:23:19.749] Build status: STARTED
[04:25:02.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:2:0)
[04:25:02.795] Build status: STARTED
[04:25:02.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:4:0) after 4m56s
[04:29:59.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:4:0)
[04:29:59.087] Build status: STARTED
[04:29:59.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:5:0) after 7m44s
[04:37:43.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:5:0)
[04:37:43.235] Build status: STARTED
[04:37:43.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:6:0) after 9m51s
[04:47:34.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:6:0)
[04:47:34.303] Build status: STARTED
[04:47:34.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:7:0) after 9m57s
[04:57:31.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:7:0)
[04:57:31.455] Build status: STARTED
[04:57:31.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:8:0) after 2m9s
[04:59:40.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:8:0)
[04:59:40.575] Build status: STARTED
[04:59:40.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:9:0) after 1m26s
[05:01:06.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:9:0)
[05:01:06.662] Build status: STARTED
[05:01:06.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:10:0) after 5m33s
[05:06:39.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:10:0)
[05:06:39.724] Build status: STARTED
[05:06:39.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:11:0) after 1m22s
[05:08:01.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:11:0)
[05:08:02.026] Build status: STARTED
[05:08:02.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:12:0) after 3m31s
[05:11:33.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:12:0)
[05:11:33.094] Build status: STARTED
[05:11:33.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:13:0) after 3m0s
[05:14:33.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:13:0)
[05:14:33.146] Build status: STARTED
[05:14:33.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:14:0) after 7m1s
[05:21:34.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:14:0)
[05:21:34.309] Build status: STARTED
[05:21:34.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:15:0) after 9m9s
[05:30:43.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:15:0)
[05:30:43.356] Build status: STARTED
[05:30:43.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:16:0) after 2m40s
[05:33:23.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:16:0)
[05:33:23.412] Build status: STARTED
[05:33:23.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:17:0) after 7m29s
[05:40:52.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:17:0)
[05:40:52.469] Build status: STARTED
[05:40:52.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:18:0) after 1m44s
[05:42:36.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:18:0)
[05:42:36.639] Build status: STARTED
[05:42:36.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:19:0) after 6m52s
[05:49:28.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:19:0)
[05:49:28.688] Build status: STARTED
[05:49:28.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:20:0) after 9m18s
[05:58:46.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:20:0)
[05:58:46.727] Build status: STARTED
[05:58:46.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:21:0) after 5m48s
[06:04:34.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:21:0)
[06:04:34.778] Build status: STARTED
[06:04:34.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:22:0) after 3m26s
[06:08:00.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:22:0)
[06:08:00.854] Build status: STARTED
[06:08:00.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:23:0) after 4m57s
[06:12:57.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:23:0)
[06:12:58.012] Build status: STARTED
[06:12:58.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:24:0) after 4m39s
[06:17:37.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:24:0)
[06:17:37.071] Build status: STARTED
[06:17:37.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:25:0) after 4m36s
[06:22:13.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:25:0)
[06:22:13.128] Build status: STARTED
[06:22:13.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:26:0) after 9m20s
[06:31:33.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:26:0)
[06:31:33.258] Build status: STARTED
[06:31:33.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:27:0) after 8m50s
[06:40:23.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:27:0)
[06:40:23.451] Build status: STARTED
[06:40:23.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:28:0) after 6m57s
[06:47:20.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:28:0)
[06:47:20.556] Build status: STARTED
[06:47:20.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:29:0) after 3m45s
[06:51:05.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:29:0)
[06:51:05.622] Build status: STARTED
[06:51:05.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:30:0) after 2m8s
[06:53:13.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:30:0)
[06:53:13.679] Build status: STARTED
[06:53:13.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:31:0) after 6m45s
[06:59:58.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:31:0)
[06:59:58.729] Build status: STARTED
[06:59:58.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:32:0) after 6m52s
[07:06:50.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:32:0)
[07:06:50.875] Build status: STARTED
[07:06:50.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:33:0) after 3m6s
[07:09:56.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:33:0)
[07:09:56.926] Build status: STARTED
[07:09:56.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:34:0) after 3m25s
[07:13:22.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:34:0)
[07:13:22.152] Build status: STARTED
[07:13:22.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:35:0) after 8m40s
[07:22:02.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:35:0)
[07:22:02.365] Build status: STARTED
[07:22:02.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:36:0) after 1m50s
[07:23:52.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:36:0)
[07:23:52.520] Build status: STARTED
[07:23:52.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:37:0) after 1m53s
[07:25:45.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:37:0)
[07:25:45.673] Build status: STARTED
[07:25:45.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:38:0) after 4m45s
[07:30:30.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:38:0)
[07:30:30.743] Build status: STARTED
[07:30:30.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:39:0) after 5m48s
[07:36:18.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:39:0)
[07:36:18.965] Build status: STARTED
[07:36:18.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:40:0) after 7m20s
[07:43:39.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:40:0)
[07:43:39.070] Build status: STARTED
[07:43:39.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:41:0) after 7m6s
[07:50:45.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:41:0)
[07:50:45.104] Build status: STARTED
[07:50:45.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:42:0) after 2m46s
[07:53:31.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:42:0)
[07:53:31.348] Build status: STARTED
[07:53:31.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:43:0) after 9m45s
[08:03:16.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:43:0)
[08:03:16.402] Build status: STARTED
[08:03:16.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:44:0) after 9m22s
[08:12:38.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:44:0)
[08:12:38.620] Build status: STARTED
[08:12:38.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:45:0) after 2m40s
[08:15:18.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:45:0)
[08:15:18.666] Build status: STARTED
[08:15:18.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:46:0) after 6m27s
[08:21:45.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:46:0)
[08:21:45.766] Build status: STARTED
[08:21:45.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:47:0) after 6m8s
[08:27:53.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:47:0)
[08:27:53.779] Build status: STARTED
[08:27:53.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:48:0) after 1m24s
[08:29:17.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:48:0)
[08:29:18.146] Build status: STARTED
[08:29:18.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:49:0) after 5m42s
[08:35:00.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:49:0)
[08:35:00.399] Build status: STARTED
[08:35:00.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:50:0) after 3m24s
[08:38:24.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:50:0)
[08:38:24.627] Build status: STARTED
[08:38:24.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:51:0) after 2m10s
[08:40:34.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:51:0)
[08:40:34.839] Build status: STARTED
[08:40:34.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:52:0) after 3m45s
[08:44:19.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:52:0)
[08:44:19.895] Build status: STARTED
[08:44:19.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:53:0) after 1m46s
[08:46:05.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:53:0)
[08:46:05.947] Build status: STARTED
[08:46:05.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:54:0) after 6m14s
[08:52:20.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:54:0)
[08:52:20.125] Build status: STARTED
[08:52:20.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:55:0) after 8m17s
[09:00:37.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:55:0)
[09:00:37.325] Build status: STARTED
[09:00:37.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:56:0) after 4m7s
[09:04:44.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:56:0)
[09:04:44.337] Build status: STARTED
[09:04:44.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:57:0) after 6m30s
[09:11:14.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:57:0)
[09:11:14.417] Build status: STARTED
[09:11:14.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:58:0) after 8m50s
[09:20:04.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:58:0)
[09:20:04.473] Build status: STARTED
[09:20:04.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:59:0) after 6m7s
[09:26:11.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:59:0)
[09:26:11.532] Build status: STARTED
[09:26:11.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:60:0) after 3m1s
[09:29:12.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:60:0)
[09:29:12.594] Build status: STARTED
[09:29:12.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:61:0) after 7m36s
[09:36:48.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:61:0)
[09:36:48.653] Build status: STARTED
[09:36:48.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:62:0) after 2m7s
[09:38:55.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:62:0)
[09:38:55.789] Build status: STARTED
[09:38:55.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:63:0) after 2m3s
[09:40:58.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:63:0)
[09:40:58.890] Build status: STARTED
[09:40:58.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:64:0) after 7m44s
[09:48:42.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:64:0)
[09:48:42.944] Build status: STARTED
[09:48:42.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:65:0) after 8m29s
[09:57:12.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:65:0)
[09:57:12.199] Build status: STARTED
[09:57:12.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:66:0) after 9m28s
[10:06:40.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:66:0)
[10:06:40.353] Build status: STARTED
[10:06:40.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:67:0) after 7m37s
[10:14:17.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:67:0)
[10:14:17.739] Build status: STARTED
[10:14:17.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:68:0) after 5m14s
[10:19:31.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:68:0)
[10:19:31.821] Build status: STARTED
[10:19:31.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:69:0) after 9m25s
[10:28:56.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:69:0)
[10:28:56.995] Build status: STARTED
[10:28:56.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:70:0) after 2m36s
[10:31:33.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:70:0)
[10:31:33.374] Build status: STARTED
[10:31:33.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:71:0) after 7m4s
[10:38:37.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:71:0)
[10:38:37.470] Build status: STARTED
[10:38:37.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:72:0) after 9m52s
[10:48:29.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:72:0)
[10:48:29.542] Build status: STARTED
[10:48:29.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:73:0) after 1m44s
[10:50:13.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:73:0)
[10:50:13.610] Build status: STARTED
[10:50:13.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:74:0) after 7m19s
[10:57:32.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:74:0)
[10:57:32.676] Build status: STARTED
[10:57:32.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:75:0) after 1m8s
[10:58:40.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:75:0)
[10:58:40.742] Build status: STARTED
[10:58:40.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:76:0) after 4m47s
[11:03:27.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:76:0)
[11:03:27.898] Build status: STARTED
[11:03:27.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:77:0) after 7m30s
[11:10:58.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:77:0)
[11:10:58.081] Build status: STARTED
[11:10:58.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:78:0) after 9m0s
[11:19:58.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:78:0)
[11:19:58.112] Build status: STARTED
[11:19:58.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:79:0) after 8m6s
[11:28:04.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:79:0)
[11:28:04.273] Build status: STARTED
[11:28:04.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:80:0) after 3m51s
[11:31:55.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:80:0)
[11:31:55.422] Build status: STARTED
[11:31:55.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:81:0) after 6m51s
[11:38:46.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:81:0)
[11:38:46.560] Build status: STARTED
[11:38:46.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:82:0) after 8m4s
[11:46:50.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:82:0)
[11:46:50.623] Build status: STARTED
[11:46:50.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:83:0) after 9m36s
[11:56:26.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:83:0)
[11:56:26.691] Build status: STARTED
[11:56:26.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:84:0) after 7m28s
[12:03:54.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:84:0)
[12:03:54.880] Build status: STARTED
[12:03:54.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:85:0) after 3m4s
[12:06:59.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:85:0)
[12:06:59.091] Build status: STARTED
[12:06:59.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:86:0) after 2m7s
[12:09:06.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:86:0)
[12:09:06.347] Build status: STARTED
[12:09:06.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:87:0) after 8m0s
[12:17:06.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:87:0)
[12:17:06.544] Build status: STARTED
[12:17:06.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:88:0) after 2m25s
[12:19:31.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:88:0)
[12:19:31.678] Build status: STARTED
[12:19:31.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:89:0) after 4m42s
[12:24:13.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:89:0)
[12:24:13.724] Build status: STARTED
[12:24:13.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:90:0) after 5m23s
[12:29:36.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:90:0)
[12:29:36.787] Build status: STARTED
[12:29:36.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:91:0) after 2m54s
[12:32:30.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:91:0)
[12:32:30.910] Build status: STARTED
[12:32:30.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:92:0) after 6m22s
[12:38:52.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:92:0)
[12:38:52.959] Build status: STARTED
[12:38:52.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:93:0) after 7m39s
[12:46:32.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:93:0)
[12:46:32.126] Build status: STARTED
[12:46:32.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:94:0) after 6m54s
[12:53:26.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:94:0)
[12:53:26.387] Build status: STARTED
[12:53:26.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:95:0) after 3m10s
[12:56:37.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:95:0)
[12:56:37.081] Build status: STARTED
[12:56:37.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:96:0) after 1m3s
[12:57:40.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:96:0)
[12:57:40.262] Build status: STARTED
[12:57:40.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:97:0) after 2m45s
[13:00:25.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:97:0)
[13:00:25.324] Build status: STARTED
[13:00:25.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:98:0) after 3m53s
[13:04:19.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:98:0)
[13:04:19.421] Build status: STARTED
[13:04:19.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:99:0) after 9m10s
[13:13:29.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:99:0)
[13:13:29.472] Build status: STARTED
[13:13:29.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:100:0) after 9m32s
[13:23:01.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:100:0)
[13:23:01.545] Build status: STARTED
[13:23:01.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:101:0) after 4m22s
[13:27:23.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:101:0)
[13:27:23.815] Build status: STARTED
[13:27:23.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:102:0) after 3m33s
[13:30:56.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:102:0)
[13:30:56.864] Build status: STARTED
[13:30:56.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:103:0) after 5m22s
[13:36:18.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:103:0)
[13:36:19.004] Build status: STARTED
[13:36:19.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:104:0) after 6m25s
[13:42:44.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:104:0)
[13:42:44.056] Build status: STARTED
[13:42:44.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:105:0) after 2m57s
[13:45:41.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:105:0)
[13:45:41.305] Build status: STARTED
[13:45:41.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:106:0) after 6m33s
[13:52:14.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:106:0)
[13:52:14.841] Build status: STARTED
[13:52:14.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:107:0) after 8m8s
[14:00:22.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:107:0)
[14:00:22.894] Build status: STARTED
[14:00:22.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:108:0) after 8m9s
[14:08:31.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:108:0)
[14:08:31.955] Build status: STARTED
[14:08:31.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:109:0) after 9m58s
[14:18:30.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:109:0)
[14:18:30.065] Build status: STARTED
[14:18:30.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:110:0) after 8m43s
[14:27:13.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:110:0)
[14:27:13.354] Build status: STARTED
[14:27:13.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:111:0) after 7m48s
[14:35:01.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:111:0)
[14:35:01.440] Build status: STARTED
[14:35:01.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:112:0) after 6m50s
[14:41:51.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:112:0)
[14:41:51.590] Build status: STARTED
[14:41:51.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:113:0) after 4m17s
[14:46:08.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:113:0)
[14:46:08.635] Build status: STARTED
[14:46:08.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:114:0) after 2m41s
[14:48:49.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:114:0)
[14:48:49.774] Build status: STARTED
[14:48:49.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:115:0) after 7m2s
[14:55:52.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:115:0)
[14:55:52.049] Build status: STARTED
[14:55:52.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:116:0) after 7m23s
[15:03:15.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:116:0)
[15:03:15.126] Build status: STARTED
[15:03:15.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:117:0) after 6m49s
[15:10:04.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:117:0)
[15:10:04.211] Build status: STARTED
[15:10:04.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:118:0) after 2m24s
[15:12:28.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:118:0)
[15:12:28.320] Build status: STARTED
[15:12:28.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:119:0) after 8m6s
[15:20:34.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:119:0)
[15:20:34.433] Build status: STARTED
[15:20:34.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:120:0) after 7m29s
[15:28:03.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:120:0)
[15:28:03.501] Build status: STARTED
[15:28:03.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:121:0) after 4m7s
[15:32:10.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:121:0)
[15:32:10.519] Build status: STARTED
[15:32:10.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:122:0) after 5m27s
[15:37:37.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:122:0)
[15:37:37.697] Build status: STARTED
[15:37:37.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:123:0) after 9m47s
[15:47:24.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:123:0)
[15:47:24.983] Build status: STARTED
[15:47:24.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:124:0) after 5m44s
[15:53:09.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:124:0)
[15:53:09.362] Build status: STARTED
[15:53:09.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:125:0) after 2m25s
[15:55:34.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:125:0)
[15:55:34.406] Build status: STARTED
[15:55:34.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:126:0) after 1m7s
[15:56:41.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:126:0)
[15:56:41.466] Build status: STARTED
[15:56:41.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:127:0) after 8m23s
[16:05:04.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:127:0)
[16:05:04.733] Build status: STARTED
[16:05:04.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:128:0) after 5m34s
[16:10:38.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:128:0)
[16:10:38.831] Build status: STARTED
[16:10:38.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:129:0) after 2m21s
[16:12:59.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:129:0)
[16:12:59.893] Build status: STARTED
[16:12:59.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:130:0) after 2m19s
[16:15:18.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:130:0)
[16:15:18.955] Build status: STARTED
[16:15:18.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:131:0) after 7m23s
[16:22:42.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:131:0)
[16:22:42.028] Build status: STARTED
[16:22:42.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:132:0) after 9m10s
[16:31:52.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:132:0)
[16:31:52.086] Build status: STARTED
[16:31:52.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:133:0) after 6m18s
[16:38:10.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:133:0)
[16:38:10.171] Build status: STARTED
[16:38:10.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:134:0) after 1m20s
[16:39:30.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:134:0)
[16:39:30.283] Build status: STARTED
[16:39:30.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8955551056750051824:135:0) after 6m49s
[16:41:12.102] Received PubSub notification, asking Buildbucket for the build status
[16:41:12.121] Build:
{
"id": "8790120994749885233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28764,
"createdBy": "project:chromium",
"createTime": "2023-02-04T04:19:51.411293875Z",
"startTime": "2023-02-04T04:23:19.149333Z",
"endTime": "2023-02-04T16:41:11.668240934Z",
"updateTime": "2023-02-04T16:41:11.668240934Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1638f8155834e034f8f9ce0f98d6f31f93267e25",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:41:12.121] Invocation finished in 12h21m22.001198649s with status FAILED