[00:14:04.123] New invocation is queued and will start shortly
[00:14:05.330] Starting the invocation (attempt 1)
[00:14:05.377] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bd68b1880ccf878c65226ef55a38d2a2f31fc19f"
[00:14:05.377] Popped gitiles commit info from properties and tags
[00:14:05.377] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:14:05.377] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:14:05.377] Buildbucket request:
{
"requestId": "8993345454053878432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd68b1880ccf878c65226ef55a38d2a2f31fc19f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8993345454053878432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:14:06.062] Scheduled build:
{
"id": "8827915392016901153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26355,
"createdBy": "project:chromium",
"createTime": "2021-12-14T00:14:05.434549676Z",
"updateTime": "2021-12-14T00:14:05.434549676Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd68b1880ccf878c65226ef55a38d2a2f31fc19f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:14:06.062] Task URL: https://cr-buildbucket.appspot.com/build/8827915392016901153
[00:14:06.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:2:0) after 1m48s
[00:15:54.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:2:0)
[00:15:54.137] Build status: SCHEDULED
[00:15:54.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:3:0) after 3m18s
[00:19:12.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:3:0)
[00:19:12.196] Build status: SCHEDULED
[00:19:12.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:4:0) after 7m8s
[00:26:20.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:4:0)
[00:26:20.288] Build status: SCHEDULED
[00:26:20.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:5:0) after 2m57s
[00:29:17.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:5:0)
[00:29:17.526] Build status: SCHEDULED
[00:29:17.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:6:0) after 9m16s
[00:38:33.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:6:0)
[00:38:33.619] Build status: SCHEDULED
[00:38:33.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:7:0) after 5m29s
[00:43:47.616] Received PubSub notification, asking Buildbucket for the build status
[00:43:47.660] Build status: STARTED
[00:44:02.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:7:0)
[00:44:02.894] Build status: STARTED
[00:44:02.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:9:0) after 5m7s
[00:49:09.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:9:0)
[00:49:10.004] Build status: STARTED
[00:49:10.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:10:0) after 1m3s
[00:50:13.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:10:0)
[00:50:13.074] Build status: STARTED
[00:50:13.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:11:0) after 1m46s
[00:51:59.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:11:0)
[00:51:59.088] Build status: STARTED
[00:51:59.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:12:0) after 7m20s
[00:59:19.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:12:0)
[00:59:19.535] Build status: STARTED
[00:59:19.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:13:0) after 9m43s
[01:09:02.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:13:0)
[01:09:02.873] Build status: STARTED
[01:09:02.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:14:0) after 9m0s
[01:18:03.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:14:0)
[01:18:03.323] Build status: STARTED
[01:18:03.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:15:0) after 4m1s
[01:22:04.649] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:15:0)
[01:22:04.680] Build status: STARTED
[01:22:04.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:16:0) after 9m11s
[01:31:15.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:16:0)
[01:31:15.796] Build status: STARTED
[01:31:15.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:17:0) after 6m22s
[01:37:37.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:17:0)
[01:37:37.912] Build status: STARTED
[01:37:37.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:18:0) after 7m35s
[01:45:12.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:18:0)
[01:45:12.978] Build status: STARTED
[01:45:12.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:19:0) after 5m54s
[01:51:07.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:19:0)
[01:51:07.034] Build status: STARTED
[01:51:07.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:20:0) after 1m9s
[01:52:16.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:20:0)
[01:52:16.166] Build status: STARTED
[01:52:16.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:21:0) after 7m33s
[01:59:49.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:21:0)
[01:59:49.286] Build status: STARTED
[01:59:49.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:22:0) after 6m17s
[02:06:06.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:22:0)
[02:06:06.490] Build status: STARTED
[02:06:06.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:23:0) after 4m21s
[02:10:27.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:23:0)
[02:10:27.757] Build status: STARTED
[02:10:27.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:24:0) after 9m38s
[02:20:05.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:24:0)
[02:20:05.879] Build status: STARTED
[02:20:05.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:25:0) after 3m22s
[02:23:27.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:25:0)
[02:23:27.958] Build status: STARTED
[02:23:27.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:26:0) after 9m31s
[02:32:58.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:26:0)
[02:32:59.008] Build status: STARTED
[02:32:59.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:27:0) after 5m17s
[02:38:16.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:27:0)
[02:38:16.084] Build status: STARTED
[02:38:16.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:28:0) after 1m28s
[02:39:44.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:28:0)
[02:39:44.130] Build status: STARTED
[02:39:44.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:29:0) after 3m53s
[02:43:37.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:29:0)
[02:43:37.157] Build status: STARTED
[02:43:37.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:30:0) after 5m12s
[02:48:49.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:30:0)
[02:48:49.278] Build status: STARTED
[02:48:49.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:31:0) after 1m40s
[02:50:29.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:31:0)
[02:50:29.338] Build status: STARTED
[02:50:29.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:32:0) after 2m35s
[02:53:04.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:32:0)
[02:53:04.748] Build status: STARTED
[02:53:04.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:33:0) after 7m20s
[03:00:24.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:33:0)
[03:00:24.938] Build status: STARTED
[03:00:24.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:34:0) after 8m2s
[03:08:27.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:34:0)
[03:08:27.307] Build status: STARTED
[03:08:27.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:35:0) after 3m40s
[03:12:07.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:35:0)
[03:12:07.402] Build status: STARTED
[03:12:07.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:36:0) after 3m48s
[03:15:55.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:36:0)
[03:15:55.942] Build status: STARTED
[03:15:55.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:37:0) after 8m45s
[03:24:40.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:37:0)
[03:24:41.018] Build status: STARTED
[03:24:41.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:38:0) after 6m5s
[03:30:46.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:38:0)
[03:30:46.173] Build status: STARTED
[03:30:46.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:39:0) after 8m6s
[03:38:52.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:39:0)
[03:38:52.239] Build status: STARTED
[03:38:52.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:40:0) after 7m23s
[03:46:15.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:40:0)
[03:46:15.471] Build status: STARTED
[03:46:15.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:41:0) after 2m34s
[03:48:49.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:41:0)
[03:48:49.544] Build status: STARTED
[03:48:49.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:42:0) after 2m36s
[03:51:25.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:42:0)
[03:51:25.814] Build status: STARTED
[03:51:25.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:43:0) after 5m55s
[03:57:20.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:43:0)
[03:57:20.879] Build status: STARTED
[03:57:20.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:44:0) after 8m14s
[04:05:35.250] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:44:0)
[04:05:35.277] Build status: STARTED
[04:05:35.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:45:0) after 4m49s
[04:10:24.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:45:0)
[04:10:24.339] Build status: STARTED
[04:10:24.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:46:0) after 5m19s
[04:15:43.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:46:0)
[04:15:43.432] Build status: STARTED
[04:15:43.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:47:0) after 8m30s
[04:24:13.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:47:0)
[04:24:13.532] Build status: STARTED
[04:24:13.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:48:0) after 1m59s
[04:26:12.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:48:0)
[04:26:12.583] Build status: STARTED
[04:26:12.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:49:0) after 4m41s
[04:30:53.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:49:0)
[04:30:53.711] Build status: STARTED
[04:30:53.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:50:0) after 1m12s
[04:32:05.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:50:0)
[04:32:05.763] Build status: STARTED
[04:32:05.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:51:0) after 1m57s
[04:34:03.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:51:0)
[04:34:03.225] Build status: STARTED
[04:34:03.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:52:0) after 8m54s
[04:42:57.250] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:52:0)
[04:42:57.288] Build status: STARTED
[04:42:57.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:53:0) after 8m56s
[04:51:53.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:53:0)
[04:51:53.450] Build status: STARTED
[04:51:53.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:54:0) after 6m18s
[04:58:11.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:54:0)
[04:58:11.506] Build status: STARTED
[04:58:11.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:55:0) after 2m23s
[05:00:34.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:55:0)
[05:00:34.600] Build status: STARTED
[05:00:34.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:56:0) after 3m59s
[05:04:33.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:56:0)
[05:04:33.650] Build status: STARTED
[05:04:33.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:57:0) after 2m31s
[05:07:04.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:57:0)
[05:07:04.951] Build status: STARTED
[05:07:04.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:58:0) after 8m2s
[05:15:07.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:58:0)
[05:15:07.145] Build status: STARTED
[05:15:07.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:59:0) after 3m51s
[05:18:58.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:59:0)
[05:18:58.245] Build status: STARTED
[05:18:58.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:60:0) after 4m16s
[05:23:14.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:60:0)
[05:23:14.329] Build status: STARTED
[05:23:14.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:61:0) after 9m21s
[05:32:35.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:61:0)
[05:32:35.382] Build status: STARTED
[05:32:35.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:62:0) after 4m49s
[05:37:24.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:62:0)
[05:37:24.473] Build status: STARTED
[05:37:24.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:63:0) after 8m49s
[05:46:13.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:63:0)
[05:46:13.528] Build status: STARTED
[05:46:13.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:64:0) after 9m14s
[05:55:27.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:64:0)
[05:55:27.759] Build status: STARTED
[05:55:27.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:65:0) after 5m59s
[06:01:26.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:65:0)
[06:01:26.893] Build status: STARTED
[06:01:26.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:66:0) after 2m19s
[06:03:46.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:66:0)
[06:03:46.259] Build status: STARTED
[06:03:46.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:67:0) after 2m7s
[06:05:53.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:67:0)
[06:05:53.480] Build status: STARTED
[06:05:53.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:68:0) after 6m59s
[06:12:52.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:68:0)
[06:12:52.828] Build status: STARTED
[06:12:52.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:69:0) after 9m12s
[06:22:04.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:69:0)
[06:22:04.938] Build status: STARTED
[06:22:04.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:70:0) after 9m4s
[06:31:08.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:70:0)
[06:31:09.000] Build status: STARTED
[06:31:09.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:71:0) after 9m13s
[06:40:21.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:71:0)
[06:40:22.030] Build status: STARTED
[06:40:22.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:72:0) after 2m8s
[06:42:30.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:72:0)
[06:42:30.111] Build status: STARTED
[06:42:30.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:73:0) after 4m38s
[06:47:08.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:73:0)
[06:47:08.248] Build status: STARTED
[06:47:08.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:74:0) after 4m32s
[06:51:40.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:74:0)
[06:51:40.294] Build status: STARTED
[06:51:40.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:75:0) after 7m7s
[06:58:47.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:75:0)
[06:58:47.359] Build status: STARTED
[06:58:47.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:76:0) after 3m7s
[07:01:54.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:76:0)
[07:01:54.411] Build status: STARTED
[07:01:54.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:77:0) after 3m53s
[07:05:47.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:77:0)
[07:05:47.577] Build status: STARTED
[07:05:47.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:78:0) after 6m24s
[07:12:11.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:78:0)
[07:12:11.715] Build status: STARTED
[07:12:11.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:79:0) after 7m50s
[07:20:01.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:79:0)
[07:20:01.779] Build status: STARTED
[07:20:01.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:80:0) after 7m1s
[07:27:02.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:80:0)
[07:27:02.858] Build status: STARTED
[07:27:02.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:81:0) after 9m22s
[07:36:24.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:81:0)
[07:36:24.937] Build status: STARTED
[07:36:24.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:82:0) after 5m11s
[07:41:36.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:82:0)
[07:41:36.088] Build status: STARTED
[07:41:36.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:83:0) after 4m31s
[07:46:07.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:83:0)
[07:46:07.237] Build status: STARTED
[07:46:07.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:84:0) after 4m41s
[07:50:48.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:84:0)
[07:50:48.374] Build status: STARTED
[07:50:48.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:85:0) after 2m43s
[07:53:31.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:85:0)
[07:53:31.385] Build status: STARTED
[07:53:31.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:86:0) after 7m29s
[08:01:00.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:86:0)
[08:01:00.557] Build status: STARTED
[08:01:00.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:87:0) after 7m35s
[08:08:35.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:87:0)
[08:08:35.865] Build status: STARTED
[08:08:35.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:88:0) after 1m33s
[08:10:08.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:88:0)
[08:10:08.924] Build status: STARTED
[08:10:08.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:89:0) after 9m52s
[08:20:01.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:89:0)
[08:20:01.060] Build status: STARTED
[08:20:01.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:90:0) after 7m23s
[08:27:24.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:90:0)
[08:27:24.109] Build status: STARTED
[08:27:24.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:91:0) after 6m59s
[08:34:23.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:91:0)
[08:34:23.156] Build status: STARTED
[08:34:23.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:92:0) after 9m32s
[08:43:55.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:92:0)
[08:43:55.226] Build status: STARTED
[08:43:55.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:93:0) after 1m16s
[08:45:11.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:93:0)
[08:45:11.283] Build status: STARTED
[08:45:11.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:94:0) after 9m8s
[08:54:19.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:94:0)
[08:54:19.529] Build status: STARTED
[08:54:19.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:95:0) after 5m8s
[08:59:27.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:95:0)
[08:59:27.728] Build status: STARTED
[08:59:27.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:96:0) after 4m35s
[09:04:02.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:96:0)
[09:04:02.950] Build status: STARTED
[09:04:02.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:97:0) after 4m10s
[09:08:12.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:97:0)
[09:08:12.972] Build status: STARTED
[09:08:12.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:98:0) after 4m26s
[09:12:39.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:98:0)
[09:12:39.126] Build status: STARTED
[09:12:39.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:99:0) after 7m25s
[09:20:04.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:99:0)
[09:20:04.394] Build status: STARTED
[09:20:04.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:100:0) after 8m10s
[09:28:14.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:100:0)
[09:28:14.495] Build status: STARTED
[09:28:14.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:101:0) after 8m57s
[09:37:11.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:101:0)
[09:37:11.560] Build status: STARTED
[09:37:11.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:102:0) after 8m13s
[09:45:24.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:102:0)
[09:45:24.893] Build status: STARTED
[09:45:24.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:103:0) after 3m23s
[09:48:47.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:103:0)
[09:48:48.007] Build status: STARTED
[09:48:48.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:104:0) after 4m46s
[09:53:34.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:104:0)
[09:53:34.057] Build status: STARTED
[09:53:34.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:105:0) after 5m22s
[09:58:56.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:105:0)
[09:58:56.136] Build status: STARTED
[09:58:56.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:106:0) after 8m46s
[10:07:42.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:106:0)
[10:07:42.207] Build status: STARTED
[10:07:42.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:107:0) after 1m6s
[10:08:48.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:107:0)
[10:08:48.480] Build status: STARTED
[10:08:48.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:108:0) after 7m29s
[10:16:17.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:108:0)
[10:16:17.511] Build status: STARTED
[10:16:17.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:109:0) after 7m41s
[10:23:58.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:109:0)
[10:23:58.564] Build status: STARTED
[10:23:58.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:110:0) after 1m35s
[10:25:33.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:110:0)
[10:25:33.619] Build status: STARTED
[10:25:33.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:111:0) after 3m24s
[10:28:57.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:111:0)
[10:28:57.672] Build status: STARTED
[10:28:57.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:112:0) after 8m25s
[10:37:22.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:112:0)
[10:37:22.747] Build status: STARTED
[10:37:22.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:113:0) after 3m21s
[10:40:43.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:113:0)
[10:40:43.839] Build status: STARTED
[10:40:43.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:114:0) after 8m0s
[10:48:43.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:114:0)
[10:48:43.899] Build status: STARTED
[10:48:43.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:115:0) after 1m47s
[10:50:31.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:115:0)
[10:50:31.117] Build status: STARTED
[10:50:31.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:116:0) after 7m9s
[10:57:40.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:116:0)
[10:57:40.292] Build status: STARTED
[10:57:40.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:117:0) after 7m15s
[11:04:55.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:117:0)
[11:04:55.362] Build status: STARTED
[11:04:55.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:118:0) after 5m39s
[11:10:34.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:118:0)
[11:10:34.412] Build status: STARTED
[11:10:34.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8993345454053878432:119:0) after 8m7s
[11:17:28.058] Received PubSub notification, asking Buildbucket for the build status
[11:17:28.078] Build:
{
"id": "8827915392016901153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26355,
"createdBy": "project:chromium",
"createTime": "2021-12-14T00:14:05.434549676Z",
"startTime": "2021-12-14T00:43:46.747555Z",
"endTime": "2021-12-14T11:17:26.804734373Z",
"updateTime": "2021-12-14T11:17:26.804734373Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd68b1880ccf878c65226ef55a38d2a2f31fc19f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[11:17:28.078] Invocation finished in 11h3m23.9714333s with status FAILED