[00:52:12.102] New invocation is queued and will start shortly
[00:52:13.197] Starting the invocation (attempt 1)
[00:52:13.249] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/86734aff40498d30943cfa6474feefd440674edd"
[00:52:13.249] Popped gitiles commit info from properties and tags
[00:52:13.249] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:52:13.249] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:52:13.250] Buildbucket request:
{
"requestId": "8990625145941254704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "86734aff40498d30943cfa6474feefd440674edd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8990625145941254704"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:52:13.769] Scheduled build:
{
"id": "8825195084008314433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26424,
"createdBy": "project:chromium",
"createTime": "2022-01-13T00:52:13.314543198Z",
"updateTime": "2022-01-13T00:52:13.314543198Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "86734aff40498d30943cfa6474feefd440674edd",
"ref": "refs/heads/main"
}
}
}
[00:52:13.769] Task URL: https://cr-buildbucket.appspot.com/build/8825195084008314433
[00:52:13.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:2:0) after 5m35s
[00:57:48.841] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:2:0)
[00:57:48.859] Build status: SCHEDULED
[00:57:48.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:3:0) after 3m7s
[01:00:56.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:3:0)
[01:00:56.285] Build status: SCHEDULED
[01:00:56.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:4:0) after 6m57s
[01:07:53.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:4:0)
[01:07:53.386] Build status: SCHEDULED
[01:07:53.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:5:0) after 5m35s
[01:13:28.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:5:0)
[01:13:28.494] Build status: SCHEDULED
[01:13:28.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:6:0) after 6m52s
[01:14:16.944] Received PubSub notification, asking Buildbucket for the build status
[01:14:16.967] Build status: STARTED
[01:20:20.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:6:0)
[01:20:20.666] Build status: STARTED
[01:20:20.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:8:0) after 5m39s
[01:26:00.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:8:0)
[01:26:00.096] Build status: STARTED
[01:26:00.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:9:0) after 3m11s
[01:29:11.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:9:0)
[01:29:11.146] Build status: STARTED
[01:29:11.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:10:0) after 2m11s
[01:31:22.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:10:0)
[01:31:22.213] Build status: STARTED
[01:31:22.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:11:0) after 4m18s
[01:35:40.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:11:0)
[01:35:40.257] Build status: STARTED
[01:35:40.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:12:0) after 9m11s
[01:44:51.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:12:0)
[01:44:51.346] Build status: STARTED
[01:44:51.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:13:0) after 7m7s
[01:51:58.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:13:0)
[01:51:58.422] Build status: STARTED
[01:51:58.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:14:0) after 3m26s
[01:55:24.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:14:0)
[01:55:24.674] Build status: STARTED
[01:55:24.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:15:0) after 2m32s
[01:57:56.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:15:0)
[01:57:56.930] Build status: STARTED
[01:57:56.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:16:0) after 1m27s
[01:59:23.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:16:0)
[01:59:23.994] Build status: STARTED
[01:59:23.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:17:0) after 2m48s
[02:02:12.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:17:0)
[02:02:12.040] Build status: STARTED
[02:02:12.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:18:0) after 9m18s
[02:11:30.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:18:0)
[02:11:30.113] Build status: STARTED
[02:11:30.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:19:0) after 2m27s
[02:13:57.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:19:0)
[02:13:57.247] Build status: STARTED
[02:13:57.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:20:0) after 5m11s
[02:19:08.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:20:0)
[02:19:08.516] Build status: STARTED
[02:19:08.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:21:0) after 9m8s
[02:28:16.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:21:0)
[02:28:16.574] Build status: STARTED
[02:28:16.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:22:0) after 3m48s
[02:32:04.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:22:0)
[02:32:04.668] Build status: STARTED
[02:32:04.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:23:0) after 6m26s
[02:38:30.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:23:0)
[02:38:30.721] Build status: STARTED
[02:38:30.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:24:0) after 3m34s
[02:42:04.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:24:0)
[02:42:04.825] Build status: STARTED
[02:42:04.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:25:0) after 2m46s
[02:44:50.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:25:0)
[02:44:50.879] Build status: STARTED
[02:44:50.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:26:0) after 7m27s
[02:52:18.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:26:0)
[02:52:18.357] Build status: STARTED
[02:52:18.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:27:0) after 7m16s
[02:59:34.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:27:0)
[02:59:34.793] Build status: STARTED
[02:59:34.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:28:0) after 5m33s
[03:05:07.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:28:0)
[03:05:07.918] Build status: STARTED
[03:05:07.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:29:0) after 5m26s
[03:10:34.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:29:0)
[03:10:34.328] Build status: STARTED
[03:10:34.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:30:0) after 4m58s
[03:15:32.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:30:0)
[03:15:32.423] Build status: STARTED
[03:15:32.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:31:0) after 6m8s
[03:21:40.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:31:0)
[03:21:40.484] Build status: STARTED
[03:21:40.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:32:0) after 5m15s
[03:26:55.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:32:0)
[03:26:55.579] Build status: STARTED
[03:26:55.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:33:0) after 7m0s
[03:33:55.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:33:0)
[03:33:55.654] Build status: STARTED
[03:33:55.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:34:0) after 4m10s
[03:38:05.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:34:0)
[03:38:05.709] Build status: STARTED
[03:38:05.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:35:0) after 8m53s
[03:46:58.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:35:0)
[03:46:58.897] Build status: STARTED
[03:46:58.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:36:0) after 9m16s
[03:56:15.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:36:0)
[03:56:15.150] Build status: STARTED
[03:56:15.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:37:0) after 2m56s
[03:59:11.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:37:0)
[03:59:11.229] Build status: STARTED
[03:59:11.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:38:0) after 1m22s
[04:00:33.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:38:0)
[04:00:33.358] Build status: STARTED
[04:00:33.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:39:0) after 7m1s
[04:07:34.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:39:0)
[04:07:34.455] Build status: STARTED
[04:07:34.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:40:0) after 3m31s
[04:11:05.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:40:0)
[04:11:05.561] Build status: STARTED
[04:11:05.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:41:0) after 9m51s
[04:20:56.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:41:0)
[04:20:56.615] Build status: STARTED
[04:20:56.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:42:0) after 5m5s
[04:26:01.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:42:0)
[04:26:01.681] Build status: STARTED
[04:26:01.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:43:0) after 5m27s
[04:31:28.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:43:0)
[04:31:28.741] Build status: STARTED
[04:31:28.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:44:0) after 7m28s
[04:38:56.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:44:0)
[04:38:56.945] Build status: STARTED
[04:38:56.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:45:0) after 4m19s
[04:43:16.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:45:0)
[04:43:16.221] Build status: STARTED
[04:43:16.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:46:0) after 1m15s
[04:44:31.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:46:0)
[04:44:31.712] Build status: STARTED
[04:44:31.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:47:0) after 2m30s
[04:47:01.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:47:0)
[04:47:01.878] Build status: STARTED
[04:47:01.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:48:0) after 4m30s
[04:51:31.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:48:0)
[04:51:31.995] Build status: STARTED
[04:51:31.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:49:0) after 5m6s
[04:56:38.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:49:0)
[04:56:38.049] Build status: STARTED
[04:56:38.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:50:0) after 4m43s
[05:01:21.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:50:0)
[05:01:21.135] Build status: STARTED
[05:01:21.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:51:0) after 7m14s
[05:08:35.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:51:0)
[05:08:35.229] Build status: STARTED
[05:08:35.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:52:0) after 9m35s
[05:18:10.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:52:0)
[05:18:10.312] Build status: STARTED
[05:18:10.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:53:0) after 4m10s
[05:22:20.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:53:0)
[05:22:20.480] Build status: STARTED
[05:22:20.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:54:0) after 7m48s
[05:30:08.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:54:0)
[05:30:08.662] Build status: STARTED
[05:30:08.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:55:0) after 3m30s
[05:33:38.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:55:0)
[05:33:38.796] Build status: STARTED
[05:33:38.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:56:0) after 8m29s
[05:42:07.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:56:0)
[05:42:07.950] Build status: STARTED
[05:42:07.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:57:0) after 1m7s
[05:43:14.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:57:0)
[05:43:15.006] Build status: STARTED
[05:43:15.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:58:0) after 5m14s
[05:48:29.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:58:0)
[05:48:29.345] Build status: STARTED
[05:48:29.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:59:0) after 4m58s
[05:53:27.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:59:0)
[05:53:27.420] Build status: STARTED
[05:53:27.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:60:0) after 7m7s
[06:00:34.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:60:0)
[06:00:34.428] Build status: STARTED
[06:00:34.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:61:0) after 3m12s
[06:03:46.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:61:0)
[06:03:46.485] Build status: STARTED
[06:03:46.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:62:0) after 2m39s
[06:06:25.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:62:0)
[06:06:25.795] Build status: STARTED
[06:06:25.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:63:0) after 7m55s
[06:14:20.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:63:0)
[06:14:20.947] Build status: STARTED
[06:14:20.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:64:0) after 4m43s
[06:19:04.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:64:0)
[06:19:04.066] Build status: STARTED
[06:19:04.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:65:0) after 6m10s
[06:25:14.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:65:0)
[06:25:14.302] Build status: STARTED
[06:25:14.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:66:0) after 4m27s
[06:29:41.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:66:0)
[06:29:41.350] Build status: STARTED
[06:29:41.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:67:0) after 3m3s
[06:32:44.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:67:0)
[06:32:44.622] Build status: STARTED
[06:32:44.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:68:0) after 6m48s
[06:39:32.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:68:0)
[06:39:32.698] Build status: STARTED
[06:39:32.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:69:0) after 9m22s
[06:48:54.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:69:0)
[06:48:55.027] Build status: STARTED
[06:48:55.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:70:0) after 5m35s
[06:54:30.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:70:0)
[06:54:30.122] Build status: STARTED
[06:54:30.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:71:0) after 1m8s
[06:55:38.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:71:0)
[06:55:38.324] Build status: STARTED
[06:55:38.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:72:0) after 9m47s
[07:05:25.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:72:0)
[07:05:25.426] Build status: STARTED
[07:05:25.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:73:0) after 3m11s
[07:08:36.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:73:0)
[07:08:36.491] Build status: STARTED
[07:08:36.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:74:0) after 4m5s
[07:12:41.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:74:0)
[07:12:41.573] Build status: STARTED
[07:12:41.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:75:0) after 2m50s
[07:15:32.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:75:0)
[07:15:32.060] Build status: STARTED
[07:15:32.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:76:0) after 7m47s
[07:23:19.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:76:0)
[07:23:19.070] Build status: STARTED
[07:23:19.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:77:0) after 9m18s
[07:32:37.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:77:0)
[07:32:37.134] Build status: STARTED
[07:32:37.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:78:0) after 5m43s
[07:38:20.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:78:0)
[07:38:20.208] Build status: STARTED
[07:38:20.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:79:0) after 8m47s
[07:47:07.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:79:0)
[07:47:07.278] Build status: STARTED
[07:47:07.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:80:0) after 8m10s
[07:55:17.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:80:0)
[07:55:17.468] Build status: STARTED
[07:55:17.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:81:0) after 1m16s
[07:56:33.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:81:0)
[07:56:33.517] Build status: STARTED
[07:56:33.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:82:0) after 7m6s
[08:03:39.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:82:0)
[08:03:39.578] Build status: STARTED
[08:03:39.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:83:0) after 2m5s
[08:05:44.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:83:0)
[08:05:45.084] Build status: STARTED
[08:05:45.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:84:0) after 2m59s
[08:08:44.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:84:0)
[08:08:44.208] Build status: STARTED
[08:08:44.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:85:0) after 4m50s
[08:13:34.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:85:0)
[08:13:34.265] Build status: STARTED
[08:13:34.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:86:0) after 4m20s
[08:17:54.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:86:0)
[08:17:54.413] Build status: STARTED
[08:17:54.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:87:0) after 1m37s
[08:19:31.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:87:0)
[08:19:31.468] Build status: STARTED
[08:19:31.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:88:0) after 1m42s
[08:21:13.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:88:0)
[08:21:13.654] Build status: STARTED
[08:21:13.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:89:0) after 5m58s
[08:27:11.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:89:0)
[08:27:11.759] Build status: STARTED
[08:27:11.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:90:0) after 5m54s
[08:33:05.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:90:0)
[08:33:05.856] Build status: STARTED
[08:33:05.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:91:0) after 4m53s
[08:37:58.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:91:0)
[08:37:58.909] Build status: STARTED
[08:37:58.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:92:0) after 2m17s
[08:40:16.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:92:0)
[08:40:16.028] Build status: STARTED
[08:40:16.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:93:0) after 2m27s
[08:42:43.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:93:0)
[08:42:43.384] Build status: STARTED
[08:42:43.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:94:0) after 8m3s
[08:50:46.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:94:0)
[08:50:46.449] Build status: STARTED
[08:50:46.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:95:0) after 8m32s
[08:59:18.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:95:0)
[08:59:18.504] Build status: STARTED
[08:59:18.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:96:0) after 1m17s
[09:00:35.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:96:0)
[09:00:35.571] Build status: STARTED
[09:00:35.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:97:0) after 6m16s
[09:06:51.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:97:0)
[09:06:51.805] Build status: STARTED
[09:06:51.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:98:0) after 1m22s
[09:08:13.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:98:0)
[09:08:13.965] Build status: STARTED
[09:08:13.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:99:0) after 4m49s
[09:13:03.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:99:0)
[09:13:03.044] Build status: STARTED
[09:13:03.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:100:0) after 2m56s
[09:15:59.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:100:0)
[09:15:59.065] Build status: STARTED
[09:15:59.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:101:0) after 8m12s
[09:24:11.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:101:0)
[09:24:11.120] Build status: STARTED
[09:24:11.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:102:0) after 1m37s
[09:25:48.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:102:0)
[09:25:48.405] Build status: STARTED
[09:25:48.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:103:0) after 8m37s
[09:34:25.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:103:0)
[09:34:25.602] Build status: STARTED
[09:34:25.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:104:0) after 4m10s
[09:38:35.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:104:0)
[09:38:35.659] Build status: STARTED
[09:38:35.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:105:0) after 2m21s
[09:40:56.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:105:0)
[09:40:56.721] Build status: STARTED
[09:40:56.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:106:0) after 9m30s
[09:50:27.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:106:0)
[09:50:27.064] Build status: STARTED
[09:50:27.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:107:0) after 4m19s
[09:54:46.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:107:0)
[09:54:46.120] Build status: STARTED
[09:54:46.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:108:0) after 3m6s
[09:57:52.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:108:0)
[09:57:52.287] Build status: STARTED
[09:57:52.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:109:0) after 1m14s
[09:59:06.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:109:0)
[09:59:06.373] Build status: STARTED
[09:59:06.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:110:0) after 4m4s
[10:03:10.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:110:0)
[10:03:10.504] Build status: STARTED
[10:03:10.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:111:0) after 3m3s
[10:06:13.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:111:0)
[10:06:13.854] Build status: STARTED
[10:06:13.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:112:0) after 3m56s
[10:10:09.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:112:0)
[10:10:09.935] Build status: STARTED
[10:10:09.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:113:0) after 4m25s
[10:14:34.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:113:0)
[10:14:35.000] Build status: STARTED
[10:14:35.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:114:0) after 9m34s
[10:24:09.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:114:0)
[10:24:09.207] Build status: STARTED
[10:24:09.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:115:0) after 6m56s
[10:31:05.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:115:0)
[10:31:05.264] Build status: STARTED
[10:31:05.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:116:0) after 3m58s
[10:35:03.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:116:0)
[10:35:03.347] Build status: STARTED
[10:35:03.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:117:0) after 1m36s
[10:36:39.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:117:0)
[10:36:39.436] Build status: STARTED
[10:36:39.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:118:0) after 2m57s
[10:39:36.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:118:0)
[10:39:36.730] Build status: STARTED
[10:39:36.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:119:0) after 3m4s
[10:42:40.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:119:0)
[10:42:40.797] Build status: STARTED
[10:42:40.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:120:0) after 7m31s
[10:50:11.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:120:0)
[10:50:11.945] Build status: STARTED
[10:50:11.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:121:0) after 3m29s
[10:53:41.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:121:0)
[10:53:41.187] Build status: STARTED
[10:53:41.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:122:0) after 4m14s
[10:57:55.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:122:0)
[10:57:55.278] Build status: STARTED
[10:57:55.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:123:0) after 9m41s
[11:07:36.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:123:0)
[11:07:36.397] Build status: STARTED
[11:07:36.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:124:0) after 1m20s
[11:08:56.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:124:0)
[11:08:56.551] Build status: STARTED
[11:08:56.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:125:0) after 5m54s
[11:14:50.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:125:0)
[11:14:50.624] Build status: STARTED
[11:14:50.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:126:0) after 6m40s
[11:21:30.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:126:0)
[11:21:30.684] Build status: STARTED
[11:21:30.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:127:0) after 4m2s
[11:25:32.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:127:0)
[11:25:32.808] Build status: STARTED
[11:25:32.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:128:0) after 8m42s
[11:34:14.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:128:0)
[11:34:14.871] Build status: STARTED
[11:34:14.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:129:0) after 5m12s
[11:39:26.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:129:0)
[11:39:27.024] Build status: STARTED
[11:39:27.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:130:0) after 2m55s
[11:42:22.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:130:0)
[11:42:22.136] Build status: STARTED
[11:42:22.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:131:0) after 6m56s
[11:49:18.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:131:0)
[11:49:18.396] Build status: STARTED
[11:49:18.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:132:0) after 3m50s
[11:53:08.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:132:0)
[11:53:08.759] Build status: STARTED
[11:53:08.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:133:0) after 9m26s
[12:02:34.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:133:0)
[12:02:34.964] Build status: STARTED
[12:02:34.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:134:0) after 2m50s
[12:05:25.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:134:0)
[12:05:25.206] Build status: STARTED
[12:05:25.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990625145941254704:135:0) after 8m12s
[12:12:48.306] Received PubSub notification, asking Buildbucket for the build status
[12:12:48.345] Build:
{
"id": "8825195084008314433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26424,
"createdBy": "project:chromium",
"createTime": "2022-01-13T00:52:13.314543198Z",
"startTime": "2022-01-13T01:14:16.300001Z",
"endTime": "2022-01-13T12:12:47.704375725Z",
"updateTime": "2022-01-13T12:12:47.704375725Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "86734aff40498d30943cfa6474feefd440674edd",
"ref": "refs/heads/main"
}
}
}
[12:12:48.345] Invocation finished in 11h20m36.258058495s with status FAILED