[15:52:20.080] New invocation is queued and will start shortly
[15:52:21.157] Starting the invocation (attempt 1)
[15:52:21.194] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c1aca8e56c88f60072b21edb894bc81e0067c580"
[15:52:21.194] Popped gitiles commit info from properties and tags
[15:52:21.194] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:52:21.194] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:52:21.194] Buildbucket request:
{
"requestId": "8991474484140829232",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c1aca8e56c88f60072b21edb894bc81e0067c580",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8991474484140829232"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:52:21.789] Scheduled build:
{
"id": "8826044422130590465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26400,
"createdBy": "project:chromium",
"createTime": "2022-01-03T15:52:21.361454232Z",
"updateTime": "2022-01-03T15:52:21.361454232Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c1aca8e56c88f60072b21edb894bc81e0067c580",
"ref": "refs/heads/main"
}
}
}
[15:52:21.789] Task URL: https://cr-buildbucket.appspot.com/build/8826044422130590465
[15:52:21.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:2:0) after 3m15s
[15:55:36.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:2:0)
[15:55:36.943] Build status: SCHEDULED
[15:55:36.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:3:0) after 4m21s
[15:59:57.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:3:0)
[15:59:57.984] Build status: SCHEDULED
[15:59:57.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:4:0) after 9m12s
[16:04:53.949] Received PubSub notification, asking Buildbucket for the build status
[16:04:53.970] Build status: STARTED
[16:09:10.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:4:0)
[16:09:10.053] Build status: STARTED
[16:09:10.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:6:0) after 1m39s
[16:10:49.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:6:0)
[16:10:49.076] Build status: STARTED
[16:10:49.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:7:0) after 7m32s
[16:18:21.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:7:0)
[16:18:21.241] Build status: STARTED
[16:18:21.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:8:0) after 2m41s
[16:21:02.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:8:0)
[16:21:02.302] Build status: STARTED
[16:21:02.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:9:0) after 1m53s
[16:22:55.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:9:0)
[16:22:55.341] Build status: STARTED
[16:22:55.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:10:0) after 4m54s
[16:27:49.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:10:0)
[16:27:49.393] Build status: STARTED
[16:27:49.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:11:0) after 7m31s
[16:35:20.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:11:0)
[16:35:20.541] Build status: STARTED
[16:35:20.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:12:0) after 9m58s
[16:45:18.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:12:0)
[16:45:18.680] Build status: STARTED
[16:45:18.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:13:0) after 5m50s
[16:51:09.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:13:0)
[16:51:09.058] Build status: STARTED
[16:51:09.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:14:0) after 5m47s
[16:56:56.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:14:0)
[16:56:56.153] Build status: STARTED
[16:56:56.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:15:0) after 8m51s
[17:05:47.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:15:0)
[17:05:47.288] Build status: STARTED
[17:05:47.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:16:0) after 6m16s
[17:12:03.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:16:0)
[17:12:05.179] Build status: STARTED
[17:12:05.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:17:0) after 6m3s
[17:18:08.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:17:0)
[17:18:08.386] Build status: STARTED
[17:18:08.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:18:0) after 3m33s
[17:21:41.437] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:18:0)
[17:21:41.476] Build status: STARTED
[17:21:41.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:19:0) after 8m39s
[17:30:20.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:19:0)
[17:30:20.584] Build status: STARTED
[17:30:20.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:20:0) after 4m12s
[17:34:32.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:20:0)
[17:34:32.680] Build status: STARTED
[17:34:32.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:21:0) after 9m16s
[17:43:48.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:21:0)
[17:43:48.723] Build status: STARTED
[17:43:48.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:22:0) after 8m32s
[17:52:20.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:22:0)
[17:52:20.888] Build status: STARTED
[17:52:20.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:23:0) after 1m31s
[17:53:52.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:23:0)
[17:53:52.057] Build status: STARTED
[17:53:52.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:24:0) after 8m39s
[18:02:31.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:24:0)
[18:02:31.154] Build status: STARTED
[18:02:31.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:25:0) after 2m52s
[18:05:23.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:25:0)
[18:05:23.308] Build status: STARTED
[18:05:23.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:26:0) after 7m30s
[18:12:53.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:26:0)
[18:12:53.363] Build status: STARTED
[18:12:53.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:27:0) after 8m26s
[18:21:19.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:27:0)
[18:21:19.425] Build status: STARTED
[18:21:19.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:28:0) after 3m34s
[18:24:53.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:28:0)
[18:24:53.529] Build status: STARTED
[18:24:53.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:29:0) after 1m25s
[18:26:18.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:29:0)
[18:26:18.762] Build status: STARTED
[18:26:18.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:30:0) after 1m2s
[18:27:21.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:30:0)
[18:27:21.088] Build status: STARTED
[18:27:21.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:31:0) after 2m28s
[18:29:49.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:31:0)
[18:29:49.319] Build status: STARTED
[18:29:49.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:32:0) after 7m29s
[18:37:18.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:32:0)
[18:37:18.590] Build status: STARTED
[18:37:18.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:33:0) after 7m9s
[18:44:27.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:33:0)
[18:44:27.646] Build status: STARTED
[18:44:27.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:34:0) after 3m44s
[18:48:11.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:34:0)
[18:48:11.777] Build status: STARTED
[18:48:11.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:35:0) after 7m31s
[18:55:42.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:35:0)
[18:55:42.861] Build status: STARTED
[18:55:42.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:36:0) after 9m32s
[19:05:15.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:36:0)
[19:05:15.103] Build status: STARTED
[19:05:15.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:37:0) after 8m42s
[19:13:57.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:37:0)
[19:13:57.209] Build status: STARTED
[19:13:57.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:38:0) after 4m55s
[19:18:52.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:38:0)
[19:18:52.239] Build status: STARTED
[19:18:52.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:39:0) after 9m2s
[19:27:54.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:39:0)
[19:27:54.632] Build status: STARTED
[19:27:54.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:40:0) after 2m23s
[19:30:17.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:40:0)
[19:30:17.775] Build status: STARTED
[19:30:17.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:41:0) after 3m17s
[19:33:34.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:41:0)
[19:33:34.978] Build status: STARTED
[19:33:34.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:42:0) after 1m54s
[19:35:29.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:42:0)
[19:35:29.159] Build status: STARTED
[19:35:29.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:43:0) after 9m43s
[19:45:12.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:43:0)
[19:45:12.201] Build status: STARTED
[19:45:12.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:44:0) after 3m37s
[19:48:49.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:44:0)
[19:48:49.364] Build status: STARTED
[19:48:49.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:45:0) after 4m15s
[19:53:04.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:45:0)
[19:53:04.406] Build status: STARTED
[19:53:04.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:46:0) after 8m4s
[20:01:08.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:46:0)
[20:01:08.466] Build status: STARTED
[20:01:08.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:47:0) after 5m58s
[20:07:06.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:47:0)
[20:07:06.515] Build status: STARTED
[20:07:06.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:48:0) after 9m34s
[20:16:40.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:48:0)
[20:16:40.718] Build status: STARTED
[20:16:40.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:49:0) after 3m38s
[20:20:18.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:49:0)
[20:20:18.763] Build status: STARTED
[20:20:18.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:50:0) after 6m52s
[20:27:10.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:50:0)
[20:27:10.860] Build status: STARTED
[20:27:10.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:51:0) after 6m10s
[20:33:20.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:51:0)
[20:33:20.991] Build status: STARTED
[20:33:20.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:52:0) after 1m3s
[20:34:24.258] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:52:0)
[20:34:24.287] Build status: STARTED
[20:34:24.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:53:0) after 1m51s
[20:36:15.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:53:0)
[20:36:15.367] Build status: STARTED
[20:36:15.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:54:0) after 8m39s
[20:44:54.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:54:0)
[20:44:54.449] Build status: STARTED
[20:44:54.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:55:0) after 2m26s
[20:47:20.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:55:0)
[20:47:20.530] Build status: STARTED
[20:47:20.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:56:0) after 5m31s
[20:52:51.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:56:0)
[20:52:51.676] Build status: STARTED
[20:52:51.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:57:0) after 2m45s
[20:55:36.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:57:0)
[20:55:36.756] Build status: STARTED
[20:55:36.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:58:0) after 9m21s
[21:04:58.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:58:0)
[21:04:58.217] Build status: STARTED
[21:04:58.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:59:0) after 8m27s
[21:13:25.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:59:0)
[21:13:25.309] Build status: STARTED
[21:13:25.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:60:0) after 5m19s
[21:18:44.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:60:0)
[21:18:44.375] Build status: STARTED
[21:18:44.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:61:0) after 8m37s
[21:27:21.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:61:0)
[21:27:21.454] Build status: STARTED
[21:27:21.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:62:0) after 1m22s
[21:28:43.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:62:0)
[21:28:43.632] Build status: STARTED
[21:28:43.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:63:0) after 9m10s
[21:37:53.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:63:0)
[21:37:53.843] Build status: STARTED
[21:37:53.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:64:0) after 2m39s
[21:40:32.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:64:0)
[21:40:33.167] Build status: STARTED
[21:40:33.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:65:0) after 9m5s
[21:49:38.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:65:0)
[21:49:38.388] Build status: STARTED
[21:49:38.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:66:0) after 2m9s
[21:51:47.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:66:0)
[21:51:47.474] Build status: STARTED
[21:51:47.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:67:0) after 3m57s
[21:55:44.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:67:0)
[21:55:44.511] Build status: STARTED
[21:55:44.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:68:0) after 5m14s
[22:00:58.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:68:0)
[22:00:58.766] Build status: STARTED
[22:00:58.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:69:0) after 1m58s
[22:02:56.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:69:0)
[22:02:56.968] Build status: STARTED
[22:02:56.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:70:0) after 4m33s
[22:07:29.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:70:0)
[22:07:30.016] Build status: STARTED
[22:07:30.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:71:0) after 9m58s
[22:17:28.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:71:0)
[22:17:28.284] Build status: STARTED
[22:17:28.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:72:0) after 5m14s
[22:22:42.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:72:0)
[22:22:42.316] Build status: STARTED
[22:22:42.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:73:0) after 6m43s
[22:29:25.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:73:0)
[22:29:25.414] Build status: STARTED
[22:29:25.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:74:0) after 7m2s
[22:36:27.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:74:0)
[22:36:27.451] Build status: STARTED
[22:36:27.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:75:0) after 2m13s
[22:38:40.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:75:0)
[22:38:40.694] Build status: STARTED
[22:38:40.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:76:0) after 6m37s
[22:45:17.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:76:0)
[22:45:17.735] Build status: STARTED
[22:45:17.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:77:0) after 2m7s
[22:47:24.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:77:0)
[22:47:24.944] Build status: STARTED
[22:47:24.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:78:0) after 6m22s
[22:53:46.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:78:0)
[22:53:46.999] Build status: STARTED
[22:53:46.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:79:0) after 5m59s
[22:59:46.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:79:0)
[22:59:46.058] Build status: STARTED
[22:59:46.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:80:0) after 6m25s
[23:06:11.062] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:80:0)
[23:06:11.099] Build status: STARTED
[23:06:11.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:81:0) after 7m33s
[23:13:44.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:81:0)
[23:13:44.149] Build status: STARTED
[23:13:44.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:82:0) after 5m41s
[23:19:25.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:82:0)
[23:19:25.212] Build status: STARTED
[23:19:25.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:83:0) after 9m26s
[23:28:51.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:83:0)
[23:28:51.258] Build status: STARTED
[23:28:51.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:84:0) after 8m51s
[23:37:42.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:84:0)
[23:37:42.571] Build status: STARTED
[23:37:42.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:85:0) after 2m51s
[23:40:33.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:85:0)
[23:40:33.626] Build status: STARTED
[23:40:33.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:86:0) after 4m8s
[23:44:41.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:86:0)
[23:44:41.688] Build status: STARTED
[23:44:41.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:87:0) after 3m0s
[23:47:41.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:87:0)
[23:47:41.809] Build status: STARTED
[23:47:41.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:88:0) after 8m16s
[23:55:57.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:88:0)
[23:55:57.854] Build status: STARTED
[23:55:57.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:89:0) after 8m23s
[00:04:20.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:89:0)
[00:04:20.963] Build status: STARTED
[00:04:20.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:90:0) after 6m23s
[00:10:43.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:90:0)
[00:10:44.006] Build status: STARTED
[00:10:44.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:91:0) after 4m54s
[00:15:38.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:91:0)
[00:15:38.089] Build status: STARTED
[00:15:38.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:92:0) after 3m34s
[00:19:12.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:92:0)
[00:19:12.115] Build status: STARTED
[00:19:12.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:93:0) after 5m59s
[00:25:11.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:93:0)
[00:25:11.613] Build status: STARTED
[00:25:11.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:94:0) after 1m43s
[00:26:54.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:94:0)
[00:26:55.002] Build status: STARTED
[00:26:55.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:95:0) after 3m21s
[00:30:16.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:95:0)
[00:30:16.517] Build status: STARTED
[00:30:16.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:96:0) after 5m33s
[00:35:49.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:96:0)
[00:35:49.772] Build status: STARTED
[00:35:49.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:97:0) after 6m29s
[00:42:18.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:97:0)
[00:42:18.830] Build status: STARTED
[00:42:18.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:98:0) after 2m11s
[00:44:29.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:98:0)
[00:44:29.888] Build status: STARTED
[00:44:29.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:99:0) after 2m42s
[00:47:11.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:99:0)
[00:47:11.955] Build status: STARTED
[00:47:11.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:100:0) after 8m42s
[00:55:54.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:100:0)
[00:55:54.867] Build status: STARTED
[00:55:54.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:101:0) after 5m39s
[01:01:33.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:101:0)
[01:01:33.924] Build status: STARTED
[01:01:33.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:102:0) after 2m15s
[01:03:48.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:102:0)
[01:03:49.024] Build status: STARTED
[01:03:49.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:103:0) after 9m15s
[01:13:04.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:103:0)
[01:13:04.938] Build status: STARTED
[01:13:04.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:104:0) after 6m37s
[01:19:42.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:104:0)
[01:19:42.413] Build status: STARTED
[01:19:42.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:105:0) after 2m55s
[01:22:37.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:105:0)
[01:22:37.721] Build status: STARTED
[01:22:37.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:106:0) after 4m11s
[01:26:48.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:106:0)
[01:26:48.777] Build status: STARTED
[01:26:48.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:107:0) after 5m19s
[01:32:07.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:107:0)
[01:32:07.888] Build status: STARTED
[01:32:07.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:108:0) after 9m40s
[01:41:47.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:108:0)
[01:41:48.003] Build status: STARTED
[01:41:48.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:109:0) after 4m52s
[01:46:40.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:109:0)
[01:46:40.046] Build status: STARTED
[01:46:40.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:110:0) after 2m26s
[01:49:06.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:110:0)
[01:49:06.096] Build status: STARTED
[01:49:06.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:111:0) after 5m25s
[01:54:31.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:111:0)
[01:54:31.355] Build status: STARTED
[01:54:31.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:112:0) after 1m0s
[01:55:31.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:112:0)
[01:55:31.403] Build status: STARTED
[01:55:31.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:113:0) after 1m26s
[01:56:57.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:113:0)
[01:56:57.549] Build status: STARTED
[01:56:57.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:114:0) after 2m36s
[01:59:34.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:114:0)
[01:59:34.899] Build status: STARTED
[01:59:34.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:115:0) after 5m58s
[02:05:32.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:115:0)
[02:05:32.945] Build status: STARTED
[02:05:32.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:116:0) after 5m43s
[02:11:16.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:116:0)
[02:11:16.249] Build status: STARTED
[02:11:16.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:117:0) after 2m33s
[02:13:49.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:117:0)
[02:13:49.303] Build status: STARTED
[02:13:49.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:118:0) after 9m10s
[02:22:59.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:118:0)
[02:22:59.348] Build status: STARTED
[02:22:59.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:119:0) after 6m51s
[02:29:50.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:119:0)
[02:29:50.463] Build status: STARTED
[02:29:50.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:120:0) after 5m2s
[02:34:52.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:120:0)
[02:34:52.606] Build status: STARTED
[02:34:52.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:121:0) after 5m29s
[02:40:21.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:121:0)
[02:40:21.678] Build status: STARTED
[02:40:21.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991474484140829232:122:0) after 9m2s
[02:47:34.975] Received PubSub notification, asking Buildbucket for the build status
[02:47:37.996] Build:
{
"id": "8826044422130590465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26400,
"createdBy": "project:chromium",
"createTime": "2022-01-03T15:52:21.361454232Z",
"startTime": "2022-01-03T16:04:53.169029Z",
"endTime": "2022-01-04T02:47:34.673922994Z",
"updateTime": "2022-01-04T02:47:34.673922994Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c1aca8e56c88f60072b21edb894bc81e0067c580",
"ref": "refs/heads/main"
}
}
}
[02:47:37.996] Invocation finished in 10h55m17.936098551s with status FAILED