[10:16:02.241] New invocation is queued and will start shortly
[10:16:03.318] Starting the invocation (attempt 1)
[10:16:03.361] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3967bb17620ab603b35898589c0fb11ef7f6b8ff"
[10:16:03.361] Popped gitiles commit info from properties and tags
[10:16:03.361] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:16:03.361] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:16:03.361] Buildbucket request:
{
"requestId": "8987871763477805504",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3967bb17620ab603b35898589c0fb11ef7f6b8ff",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8987871763477805504"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:16:03.997] Scheduled build:
{
"id": "8822441701522587233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26525,
"createdBy": "project:chromium",
"createTime": "2022-02-12T10:16:03.474506407Z",
"updateTime": "2022-02-12T10:16:03.474506407Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3967bb17620ab603b35898589c0fb11ef7f6b8ff",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:16:03.997] Task URL: https://cr-buildbucket.appspot.com/build/8822441701522587233
[10:16:03.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:2:0) after 9m20s
[10:16:40.200] Received PubSub notification, asking Buildbucket for the build status
[10:16:40.242] Build status: STARTED
[10:25:24.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:2:0)
[10:25:24.037] Build status: STARTED
[10:25:24.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:4:0) after 4m43s
[10:30:07.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:4:0)
[10:30:07.151] Build status: STARTED
[10:30:07.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:5:0) after 1m22s
[10:31:29.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:5:0)
[10:31:29.572] Build status: STARTED
[10:31:29.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:6:0) after 3m58s
[10:35:27.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:6:0)
[10:35:27.657] Build status: STARTED
[10:35:27.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:7:0) after 2m55s
[10:38:22.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:7:0)
[10:38:22.707] Build status: STARTED
[10:38:22.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:8:0) after 6m53s
[10:45:15.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:8:0)
[10:45:15.960] Build status: STARTED
[10:45:15.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:9:0) after 4m32s
[10:49:48.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:9:0)
[10:49:48.116] Build status: STARTED
[10:49:48.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:10:0) after 7m23s
[10:57:11.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:10:0)
[10:57:11.585] Build status: STARTED
[10:57:11.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:11:0) after 3m38s
[11:00:49.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:11:0)
[11:00:49.696] Build status: STARTED
[11:00:49.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:12:0) after 1m59s
[11:02:48.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:12:0)
[11:02:48.783] Build status: STARTED
[11:02:48.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:13:0) after 2m17s
[11:05:05.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:13:0)
[11:05:05.843] Build status: STARTED
[11:05:05.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:14:0) after 2m29s
[11:07:35.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:14:0)
[11:07:35.208] Build status: STARTED
[11:07:35.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:15:0) after 3m41s
[11:11:16.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:15:0)
[11:11:16.356] Build status: STARTED
[11:11:16.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:16:0) after 8m45s
[11:20:01.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:16:0)
[11:20:01.467] Build status: STARTED
[11:20:01.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:17:0) after 3m21s
[11:23:22.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:17:0)
[11:23:22.729] Build status: STARTED
[11:23:22.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:18:0) after 3m17s
[11:26:39.752] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:18:0)
[11:26:39.786] Build status: STARTED
[11:26:39.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:19:0) after 4m51s
[11:31:30.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:19:0)
[11:31:30.826] Build status: STARTED
[11:31:30.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:20:0) after 3m12s
[11:34:42.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:20:0)
[11:34:42.881] Build status: STARTED
[11:34:42.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:21:0) after 2m18s
[11:37:00.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:21:0)
[11:37:00.892] Build status: STARTED
[11:37:00.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:22:0) after 6m11s
[11:43:12.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:22:0)
[11:43:12.222] Build status: STARTED
[11:43:12.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:23:0) after 9m5s
[11:52:17.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:23:0)
[11:52:17.507] Build status: STARTED
[11:52:17.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:24:0) after 2m23s
[11:54:40.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:24:0)
[11:54:40.558] Build status: STARTED
[11:54:40.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:25:0) after 1m23s
[11:56:03.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:25:0)
[11:56:03.639] Build status: STARTED
[11:56:03.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:26:0) after 3m26s
[11:59:29.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:26:0)
[11:59:29.706] Build status: STARTED
[11:59:29.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:27:0) after 3m47s
[12:03:16.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:27:0)
[12:03:16.932] Build status: STARTED
[12:03:16.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:28:0) after 9m20s
[12:12:36.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:28:0)
[12:12:36.996] Build status: STARTED
[12:12:36.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:29:0) after 8m2s
[12:20:39.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:29:0)
[12:20:39.039] Build status: STARTED
[12:20:39.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:30:0) after 2m59s
[12:23:38.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:30:0)
[12:23:38.087] Build status: STARTED
[12:23:38.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:31:0) after 6m6s
[12:29:44.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:31:0)
[12:29:44.149] Build status: STARTED
[12:29:44.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:32:0) after 3m55s
[12:33:39.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:32:0)
[12:33:39.568] Build status: STARTED
[12:33:39.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:33:0) after 7m18s
[12:40:57.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:33:0)
[12:40:57.632] Build status: STARTED
[12:40:57.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:34:0) after 5m41s
[12:46:38.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:34:0)
[12:46:38.685] Build status: STARTED
[12:46:38.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:35:0) after 4m57s
[12:51:35.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:35:0)
[12:51:35.751] Build status: STARTED
[12:51:35.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:36:0) after 3m21s
[12:54:56.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:36:0)
[12:54:56.878] Build status: STARTED
[12:54:56.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:37:0) after 9m7s
[13:04:03.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:37:0)
[13:04:03.937] Build status: STARTED
[13:04:03.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:38:0) after 4m53s
[13:08:57.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:38:0)
[13:08:57.183] Build status: STARTED
[13:08:57.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:39:0) after 2m55s
[13:11:52.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:39:0)
[13:11:52.234] Build status: STARTED
[13:11:52.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:40:0) after 1m50s
[13:13:42.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:40:0)
[13:13:42.300] Build status: STARTED
[13:13:42.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:41:0) after 9m15s
[13:22:57.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:41:0)
[13:22:57.461] Build status: STARTED
[13:22:57.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:42:0) after 2m45s
[13:25:42.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:42:0)
[13:25:42.511] Build status: STARTED
[13:25:42.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:43:0) after 1m52s
[13:27:34.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:43:0)
[13:27:34.975] Build status: STARTED
[13:27:34.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:44:0) after 6m43s
[13:34:18.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:44:0)
[13:34:18.086] Build status: STARTED
[13:34:18.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:45:0) after 4m12s
[13:38:30.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:45:0)
[13:38:30.169] Build status: STARTED
[13:38:30.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:46:0) after 1m27s
[13:39:57.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:46:0)
[13:39:57.487] Build status: STARTED
[13:39:57.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:47:0) after 4m20s
[13:44:17.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:47:0)
[13:44:17.576] Build status: STARTED
[13:44:17.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:48:0) after 9m32s
[13:53:49.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:48:0)
[13:53:49.625] Build status: STARTED
[13:53:49.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:49:0) after 1m1s
[13:54:50.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:49:0)
[13:54:51.081] Build status: STARTED
[13:54:51.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:50:0) after 4m25s
[13:59:16.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:50:0)
[13:59:16.143] Build status: STARTED
[13:59:16.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:51:0) after 8m38s
[14:07:54.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:51:0)
[14:07:54.201] Build status: STARTED
[14:07:54.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:52:0) after 8m50s
[14:16:44.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:52:0)
[14:16:44.247] Build status: STARTED
[14:16:44.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:53:0) after 8m37s
[14:25:21.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:53:0)
[14:25:21.292] Build status: STARTED
[14:25:21.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:54:0) after 2m17s
[14:27:38.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:54:0)
[14:27:38.422] Build status: STARTED
[14:27:38.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:55:0) after 1m12s
[14:28:50.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:55:0)
[14:28:50.805] Build status: STARTED
[14:28:50.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:56:0) after 3m24s
[14:32:14.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:56:0)
[14:32:14.852] Build status: STARTED
[14:32:14.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:57:0) after 6m33s
[14:38:47.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:57:0)
[14:38:47.923] Build status: STARTED
[14:38:47.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:58:0) after 9m51s
[14:48:38.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:58:0)
[14:48:38.995] Build status: STARTED
[14:48:38.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:59:0) after 2m9s
[14:50:48.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:59:0)
[14:50:48.081] Build status: STARTED
[14:50:48.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:60:0) after 2m13s
[14:53:01.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:60:0)
[14:53:01.143] Build status: STARTED
[14:53:01.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:61:0) after 8m29s
[15:01:30.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:61:0)
[15:01:30.200] Build status: STARTED
[15:01:30.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:62:0) after 8m19s
[15:09:49.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:62:0)
[15:09:49.247] Build status: STARTED
[15:09:49.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:63:0) after 4m17s
[15:14:06.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:63:0)
[15:14:06.302] Build status: STARTED
[15:14:06.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:64:0) after 1m43s
[15:15:49.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:64:0)
[15:15:49.356] Build status: STARTED
[15:15:49.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:65:0) after 7m38s
[15:23:27.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:65:0)
[15:23:27.414] Build status: STARTED
[15:23:27.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:66:0) after 7m55s
[15:31:22.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:66:0)
[15:31:22.599] Build status: STARTED
[15:31:22.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:67:0) after 7m4s
[15:38:26.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:67:0)
[15:38:26.640] Build status: STARTED
[15:38:26.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:68:0) after 5m48s
[15:44:14.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:68:0)
[15:44:14.693] Build status: STARTED
[15:44:14.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:69:0) after 6m56s
[15:51:10.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:69:0)
[15:51:10.960] Build status: STARTED
[15:51:10.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:70:0) after 7m33s
[15:58:44.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:70:0)
[15:58:44.288] Build status: STARTED
[15:58:44.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:71:0) after 7m37s
[16:06:21.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:71:0)
[16:06:21.350] Build status: STARTED
[16:06:21.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:72:0) after 3m3s
[16:09:24.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:72:0)
[16:09:24.913] Build status: STARTED
[16:09:24.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:73:0) after 2m11s
[16:11:36.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:73:0)
[16:11:36.960] Build status: STARTED
[16:11:36.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:74:0) after 6m36s
[16:18:12.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:74:0)
[16:18:13.012] Build status: STARTED
[16:18:13.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:75:0) after 8m26s
[16:26:39.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:75:0)
[16:26:39.124] Build status: STARTED
[16:26:39.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:76:0) after 5m23s
[16:32:02.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:76:0)
[16:32:02.195] Build status: STARTED
[16:32:02.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:77:0) after 7m58s
[16:40:00.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:77:0)
[16:40:00.259] Build status: STARTED
[16:40:00.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:78:0) after 1m21s
[16:41:21.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:78:0)
[16:41:21.387] Build status: STARTED
[16:41:21.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:79:0) after 1m57s
[16:43:18.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:79:0)
[16:43:18.443] Build status: STARTED
[16:43:18.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:80:0) after 1m8s
[16:44:26.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:80:0)
[16:44:26.498] Build status: STARTED
[16:44:26.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:81:0) after 3m12s
[16:47:38.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:81:0)
[16:47:38.789] Build status: STARTED
[16:47:38.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:82:0) after 8m1s
[16:55:39.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:82:0)
[16:55:39.880] Build status: STARTED
[16:55:39.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:83:0) after 9m22s
[17:05:02.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:83:0)
[17:05:02.165] Build status: STARTED
[17:05:02.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:84:0) after 9m50s
[17:14:52.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:84:0)
[17:14:52.241] Build status: STARTED
[17:14:52.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:85:0) after 4m51s
[17:19:43.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:85:0)
[17:19:43.292] Build status: STARTED
[17:19:43.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:86:0) after 3m12s
[17:22:55.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:86:0)
[17:22:55.360] Build status: STARTED
[17:22:55.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:87:0) after 4m55s
[17:27:50.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:87:0)
[17:27:50.427] Build status: STARTED
[17:27:50.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:88:0) after 5m41s
[17:33:31.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:88:0)
[17:33:31.473] Build status: STARTED
[17:33:31.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:89:0) after 1m33s
[17:35:04.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:89:0)
[17:35:04.517] Build status: STARTED
[17:35:04.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:90:0) after 9m17s
[17:44:21.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:90:0)
[17:44:21.603] Build status: STARTED
[17:44:21.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:91:0) after 4m31s
[17:48:52.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:91:0)
[17:48:52.650] Build status: STARTED
[17:48:52.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:92:0) after 1m47s
[17:50:39.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:92:0)
[17:50:39.906] Build status: STARTED
[17:50:39.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:93:0) after 5m33s
[17:56:13.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:93:0)
[17:56:13.155] Build status: STARTED
[17:56:13.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:94:0) after 9m21s
[18:05:34.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:94:0)
[18:05:34.694] Build status: STARTED
[18:05:34.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:95:0) after 4m5s
[18:09:39.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:95:0)
[18:09:39.929] Build status: STARTED
[18:09:39.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:96:0) after 7m18s
[18:16:57.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:96:0)
[18:16:57.978] Build status: STARTED
[18:16:57.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:97:0) after 6m32s
[18:23:29.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:97:0)
[18:23:30.021] Build status: STARTED
[18:23:30.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:98:0) after 3m22s
[18:26:52.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:98:0)
[18:26:52.081] Build status: STARTED
[18:26:52.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:99:0) after 9m36s
[18:36:28.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:99:0)
[18:36:28.159] Build status: STARTED
[18:36:28.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:100:0) after 6m51s
[18:43:19.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:100:0)
[18:43:19.201] Build status: STARTED
[18:43:19.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:101:0) after 8m53s
[18:52:12.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:101:0)
[18:52:12.707] Build status: STARTED
[18:52:12.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:102:0) after 4m40s
[18:56:52.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:102:0)
[18:56:52.759] Build status: STARTED
[18:56:52.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:103:0) after 7m39s
[19:04:31.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:103:0)
[19:04:31.816] Build status: STARTED
[19:04:31.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:104:0) after 5m37s
[19:10:08.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:104:0)
[19:10:08.879] Build status: STARTED
[19:10:08.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:105:0) after 8m12s
[19:18:21.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:105:0)
[19:18:21.079] Build status: STARTED
[19:18:21.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:106:0) after 5m2s
[19:23:23.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:106:0)
[19:23:23.129] Build status: STARTED
[19:23:23.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:107:0) after 1m34s
[19:24:57.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:107:0)
[19:24:57.199] Build status: STARTED
[19:24:57.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:108:0) after 6m13s
[19:31:10.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:108:0)
[19:31:10.888] Build status: STARTED
[19:31:10.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:109:0) after 9m10s
[19:40:20.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:109:0)
[19:40:20.977] Build status: STARTED
[19:40:20.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:110:0) after 5m6s
[19:45:27.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:110:0)
[19:45:27.161] Build status: STARTED
[19:45:27.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:111:0) after 4m15s
[19:49:42.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:111:0)
[19:49:42.303] Build status: STARTED
[19:49:42.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:112:0) after 3m33s
[19:53:15.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:112:0)
[19:53:15.350] Build status: STARTED
[19:53:15.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:113:0) after 5m15s
[19:58:30.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:113:0)
[19:58:30.486] Build status: STARTED
[19:58:30.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:114:0) after 5m15s
[20:03:45.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:114:0)
[20:03:45.551] Build status: STARTED
[20:03:45.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:115:0) after 6m32s
[20:10:17.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:115:0)
[20:10:17.602] Build status: STARTED
[20:10:17.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:116:0) after 3m13s
[20:13:30.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:116:0)
[20:13:30.683] Build status: STARTED
[20:13:30.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:117:0) after 8m53s
[20:22:23.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:117:0)
[20:22:23.886] Build status: STARTED
[20:22:23.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:118:0) after 6m21s
[20:28:44.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:118:0)
[20:28:44.947] Build status: STARTED
[20:28:44.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:119:0) after 1m1s
[20:29:46.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:119:0)
[20:29:46.100] Build status: STARTED
[20:29:46.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:120:0) after 1m16s
[20:31:02.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:120:0)
[20:31:02.149] Build status: STARTED
[20:31:02.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:121:0) after 9m33s
[20:40:35.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:121:0)
[20:40:35.193] Build status: STARTED
[20:40:35.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:122:0) after 6m20s
[20:46:55.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:122:0)
[20:46:55.293] Build status: STARTED
[20:46:55.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:123:0) after 1m22s
[20:48:17.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:123:0)
[20:48:17.349] Build status: STARTED
[20:48:17.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:124:0) after 2m30s
[20:50:47.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:124:0)
[20:50:47.550] Build status: STARTED
[20:50:47.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:125:0) after 5m35s
[20:56:22.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:125:0)
[20:56:22.649] Build status: STARTED
[20:56:22.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:126:0) after 3m23s
[20:59:45.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:126:0)
[20:59:45.785] Build status: STARTED
[20:59:45.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:127:0) after 6m41s
[21:06:26.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:127:0)
[21:06:26.971] Build status: STARTED
[21:06:26.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8987871763477805504:128:0) after 7m32s
[21:10:57.310] Received PubSub notification, asking Buildbucket for the build status
[21:10:57.341] Build:
{
"id": "8822441701522587233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26525,
"createdBy": "project:chromium",
"createTime": "2022-02-12T10:16:03.474506407Z",
"startTime": "2022-02-12T10:16:39.239913Z",
"endTime": "2022-02-12T21:10:56.913001863Z",
"updateTime": "2022-02-12T21:10:56.913001863Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3967bb17620ab603b35898589c0fb11ef7f6b8ff",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:10:57.341] Invocation finished in 10h54m55.115136987s with status FAILED