[10:41:11.666] New invocation is queued and will start shortly
[10:41:12.765] Starting the invocation (attempt 1)
[10:41:12.803] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/01f1a0f455bcf9aae08c5922b8a7b6d02952d986"
[10:41:12.803] Popped gitiles commit info from properties and tags
[10:41:12.803] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:41:12.803] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:41:12.803] Buildbucket request:
{
"requestId": "8976183172065512352",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "01f1a0f455bcf9aae08c5922b8a7b6d02952d986",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8976183172065512352"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:41:13.551] Scheduled build:
{
"id": "8810753110099239473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 27998,
"createdBy": "project:chromium",
"createTime": "2022-06-21T10:41:12.909473584Z",
"updateTime": "2022-06-21T10:41:12.909473584Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "01f1a0f455bcf9aae08c5922b8a7b6d02952d986",
"ref": "refs/heads/main"
}
}
}
[10:41:13.551] Task URL: https://cr-buildbucket.appspot.com/build/8810753110099239473
[10:41:13.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:2:0) after 4m41s
[10:45:54.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:2:0)
[10:45:54.635] Build status: SCHEDULED
[10:45:54.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:3:0) after 1m54s
[10:47:48.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:3:0)
[10:47:48.694] Build status: SCHEDULED
[10:47:48.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:4:0) after 2m45s
[10:50:33.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:4:0)
[10:50:33.733] Build status: SCHEDULED
[10:50:33.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:5:0) after 2m38s
[10:53:11.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:5:0)
[10:53:11.794] Build status: SCHEDULED
[10:53:11.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:6:0) after 9m35s
[11:02:46.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:6:0)
[11:02:46.978] Build status: SCHEDULED
[11:02:46.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:7:0) after 3m21s
[11:06:08.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:7:0)
[11:06:08.141] Build status: SCHEDULED
[11:06:08.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:8:0) after 9m59s
[11:12:20.210] Received PubSub notification, asking Buildbucket for the build status
[11:12:20.245] Build status: STARTED
[11:16:07.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:8:0)
[11:16:07.321] Build status: STARTED
[11:16:07.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:10:0) after 4m57s
[11:21:04.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:10:0)
[11:21:04.403] Build status: STARTED
[11:21:04.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:11:0) after 6m35s
[11:27:39.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:11:0)
[11:27:39.448] Build status: STARTED
[11:27:39.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:12:0) after 2m56s
[11:30:35.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:12:0)
[11:30:35.524] Build status: STARTED
[11:30:35.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:13:0) after 7m0s
[11:37:35.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:13:0)
[11:37:35.575] Build status: STARTED
[11:37:35.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:14:0) after 9m45s
[11:47:20.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:14:0)
[11:47:20.738] Build status: STARTED
[11:47:20.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:15:0) after 1m10s
[11:48:30.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:15:0)
[11:48:30.805] Build status: STARTED
[11:48:30.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:16:0) after 1m34s
[11:50:04.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:16:0)
[11:50:04.842] Build status: STARTED
[11:50:04.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:17:0) after 6m3s
[11:56:07.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:17:0)
[11:56:07.999] Build status: STARTED
[11:56:07.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:18:0) after 7m27s
[12:03:35.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:18:0)
[12:03:35.048] Build status: STARTED
[12:03:35.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:19:0) after 3m35s
[12:07:10.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:19:0)
[12:07:10.366] Build status: STARTED
[12:07:10.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:20:0) after 7m23s
[12:14:33.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:20:0)
[12:14:33.521] Build status: STARTED
[12:14:33.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:21:0) after 1m15s
[12:15:48.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:21:0)
[12:15:48.753] Build status: STARTED
[12:15:48.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:22:0) after 8m50s
[12:24:38.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:22:0)
[12:24:38.903] Build status: STARTED
[12:24:38.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:23:0) after 8m6s
[12:32:44.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:23:0)
[12:32:44.949] Build status: STARTED
[12:32:44.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:24:0) after 8m4s
[12:40:48.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:24:0)
[12:40:48.995] Build status: STARTED
[12:40:48.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:25:0) after 2m17s
[12:43:06.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:25:0)
[12:43:06.055] Build status: STARTED
[12:43:06.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:26:0) after 7m47s
[12:50:53.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:26:0)
[12:50:53.115] Build status: STARTED
[12:50:53.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:27:0) after 1m27s
[12:52:20.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:27:0)
[12:52:20.212] Build status: STARTED
[12:52:20.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:28:0) after 5m32s
[12:57:52.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:28:0)
[12:57:52.274] Build status: STARTED
[12:57:52.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:29:0) after 7m29s
[13:05:21.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:29:0)
[13:05:21.333] Build status: STARTED
[13:05:21.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:30:0) after 4m28s
[13:09:49.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:30:0)
[13:09:49.429] Build status: STARTED
[13:09:49.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:31:0) after 2m17s
[13:12:06.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:31:0)
[13:12:06.594] Build status: STARTED
[13:12:06.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:32:0) after 1m10s
[13:13:16.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:32:0)
[13:13:16.825] Build status: STARTED
[13:13:16.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:33:0) after 5m42s
[13:18:58.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:33:0)
[13:18:58.893] Build status: STARTED
[13:18:58.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:34:0) after 4m52s
[13:23:50.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:34:0)
[13:23:51.021] Build status: STARTED
[13:23:51.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:35:0) after 3m5s
[13:26:56.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:35:0)
[13:26:56.168] Build status: STARTED
[13:26:56.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:36:0) after 2m55s
[13:29:51.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:36:0)
[13:29:51.259] Build status: STARTED
[13:29:51.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:37:0) after 6m47s
[13:36:38.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:37:0)
[13:36:38.583] Build status: STARTED
[13:36:38.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:38:0) after 2m51s
[13:39:29.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:38:0)
[13:39:29.813] Build status: STARTED
[13:39:29.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:39:0) after 9m46s
[13:49:15.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:39:0)
[13:49:15.992] Build status: STARTED
[13:49:15.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:40:0) after 6m55s
[13:56:11.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:40:0)
[13:56:11.044] Build status: STARTED
[13:56:11.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:41:0) after 8m12s
[14:04:23.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:41:0)
[14:04:23.124] Build status: STARTED
[14:04:23.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:42:0) after 6m56s
[14:11:19.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:42:0)
[14:11:19.201] Build status: STARTED
[14:11:19.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:43:0) after 8m41s
[14:20:00.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:43:0)
[14:20:00.367] Build status: STARTED
[14:20:00.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:44:0) after 6m11s
[14:26:11.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:44:0)
[14:26:11.412] Build status: STARTED
[14:26:11.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:45:0) after 4m33s
[14:30:44.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:45:0)
[14:30:44.502] Build status: STARTED
[14:30:44.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:46:0) after 9m37s
[14:40:21.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:46:0)
[14:40:21.900] Build status: STARTED
[14:40:21.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:47:0) after 9m38s
[14:49:59.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:47:0)
[14:49:59.991] Build status: STARTED
[14:49:59.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:48:0) after 5m12s
[14:55:12.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:48:0)
[14:55:12.052] Build status: STARTED
[14:55:12.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:49:0) after 1m51s
[14:57:03.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:49:0)
[14:57:03.295] Build status: STARTED
[14:57:03.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:50:0) after 2m33s
[14:59:36.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:50:0)
[14:59:36.393] Build status: STARTED
[14:59:36.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:51:0) after 2m3s
[15:01:39.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:51:0)
[15:01:39.684] Build status: STARTED
[15:01:39.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:52:0) after 2m57s
[15:04:37.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:52:0)
[15:04:37.164] Build status: STARTED
[15:04:37.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:53:0) after 7m22s
[15:11:59.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:53:0)
[15:11:59.365] Build status: STARTED
[15:11:59.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:54:0) after 3m13s
[15:15:12.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:54:0)
[15:15:12.665] Build status: STARTED
[15:15:12.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:55:0) after 4m22s
[15:19:34.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:55:0)
[15:19:34.800] Build status: STARTED
[15:19:34.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:56:0) after 7m12s
[15:26:46.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:56:0)
[15:26:46.893] Build status: STARTED
[15:26:46.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:57:0) after 5m13s
[15:31:59.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:57:0)
[15:31:59.951] Build status: STARTED
[15:31:59.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:58:0) after 5m14s
[15:37:14.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:58:0)
[15:37:14.074] Build status: STARTED
[15:37:14.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:59:0) after 8m53s
[15:46:07.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:59:0)
[15:46:07.638] Build status: STARTED
[15:46:07.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:60:0) after 6m44s
[15:52:51.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:60:0)
[15:52:51.751] Build status: STARTED
[15:52:51.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:61:0) after 1m37s
[15:54:28.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:61:0)
[15:54:28.903] Build status: STARTED
[15:54:28.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:62:0) after 7m25s
[16:01:54.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:62:0)
[16:01:54.035] Build status: STARTED
[16:01:54.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:63:0) after 6m17s
[16:08:11.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:63:0)
[16:08:11.094] Build status: STARTED
[16:08:11.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:64:0) after 6m57s
[16:15:08.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:64:0)
[16:15:08.244] Build status: STARTED
[16:15:08.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:65:0) after 9m51s
[16:24:59.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:65:0)
[16:24:59.438] Build status: STARTED
[16:24:59.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:66:0) after 5m8s
[16:30:07.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:66:0)
[16:30:07.610] Build status: STARTED
[16:30:07.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:67:0) after 3m42s
[16:33:49.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:67:0)
[16:33:49.958] Build status: STARTED
[16:33:49.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:68:0) after 5m11s
[16:39:01.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:68:0)
[16:39:01.384] Build status: STARTED
[16:39:01.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:69:0) after 6m18s
[16:45:19.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:69:0)
[16:45:19.545] Build status: STARTED
[16:45:19.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:70:0) after 2m1s
[16:47:20.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:70:0)
[16:47:20.674] Build status: STARTED
[16:47:20.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:71:0) after 8m35s
[16:55:55.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:71:0)
[16:55:55.935] Build status: STARTED
[16:55:55.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:72:0) after 6m26s
[17:02:21.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:72:0)
[17:02:22.040] Build status: STARTED
[17:02:22.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:73:0) after 1m54s
[17:04:16.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:73:0)
[17:04:16.212] Build status: STARTED
[17:04:16.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:74:0) after 3m39s
[17:07:55.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:74:0)
[17:07:55.272] Build status: STARTED
[17:07:55.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:75:0) after 6m48s
[17:14:43.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:75:0)
[17:14:43.570] Build status: STARTED
[17:14:43.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:76:0) after 3m29s
[17:18:12.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:76:0)
[17:18:12.672] Build status: STARTED
[17:18:12.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:77:0) after 5m51s
[17:24:03.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:77:0)
[17:24:03.843] Build status: STARTED
[17:24:03.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:78:0) after 3m4s
[17:27:07.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:78:0)
[17:27:07.902] Build status: STARTED
[17:27:07.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:79:0) after 3m28s
[17:30:36.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:79:0)
[17:30:36.354] Build status: STARTED
[17:30:36.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:80:0) after 4m46s
[17:35:22.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:80:0)
[17:35:22.656] Build status: STARTED
[17:35:22.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:81:0) after 4m3s
[17:39:25.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:81:0)
[17:39:25.793] Build status: STARTED
[17:39:25.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:82:0) after 6m11s
[17:45:36.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:82:0)
[17:45:36.878] Build status: STARTED
[17:45:36.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:83:0) after 9m10s
[17:54:46.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:83:0)
[17:54:46.987] Build status: STARTED
[17:54:46.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:84:0) after 9m59s
[18:04:46.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:84:0)
[18:04:46.073] Build status: STARTED
[18:04:46.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:85:0) after 7m54s
[18:12:40.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:85:0)
[18:12:40.182] Build status: STARTED
[18:12:40.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:86:0) after 9m4s
[18:21:44.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:86:0)
[18:21:44.258] Build status: STARTED
[18:21:44.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:87:0) after 5m31s
[18:27:15.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:87:0)
[18:27:15.358] Build status: STARTED
[18:27:15.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:88:0) after 8m47s
[18:36:02.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:88:0)
[18:36:02.422] Build status: STARTED
[18:36:02.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:89:0) after 1m52s
[18:37:54.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:89:0)
[18:37:54.476] Build status: STARTED
[18:37:54.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:90:0) after 4m29s
[18:42:23.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:90:0)
[18:42:23.529] Build status: STARTED
[18:42:23.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:91:0) after 6m31s
[18:48:54.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:91:0)
[18:48:54.688] Build status: STARTED
[18:48:54.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:92:0) after 6m52s
[18:55:46.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:92:0)
[18:55:46.785] Build status: STARTED
[18:55:46.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:93:0) after 2m32s
[18:58:18.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:93:0)
[18:58:18.834] Build status: STARTED
[18:58:18.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:94:0) after 7m58s
[19:06:16.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:94:0)
[19:06:16.902] Build status: STARTED
[19:06:16.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:95:0) after 4m2s
[19:10:18.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:95:0)
[19:10:18.967] Build status: STARTED
[19:10:18.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:96:0) after 2m47s
[19:13:05.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:96:0)
[19:13:06.027] Build status: STARTED
[19:13:06.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:97:0) after 7m59s
[19:21:05.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:97:0)
[19:21:05.565] Build status: STARTED
[19:21:05.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:98:0) after 1m25s
[19:22:30.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:98:0)
[19:22:30.732] Build status: STARTED
[19:22:30.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:99:0) after 8m4s
[19:30:34.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:99:0)
[19:30:34.879] Build status: STARTED
[19:30:34.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:100:0) after 6m20s
[19:36:55.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:100:0)
[19:36:55.190] Build status: STARTED
[19:36:55.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:101:0) after 4m39s
[19:41:34.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:101:0)
[19:41:34.542] Build status: STARTED
[19:41:34.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:102:0) after 7m58s
[19:49:32.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:102:0)
[19:49:32.676] Build status: STARTED
[19:49:32.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:103:0) after 1m35s
[19:51:07.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:103:0)
[19:51:07.737] Build status: STARTED
[19:51:07.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:104:0) after 2m5s
[19:53:12.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:104:0)
[19:53:12.768] Build status: STARTED
[19:53:12.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:105:0) after 4m8s
[19:57:20.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:105:0)
[19:57:20.842] Build status: STARTED
[19:57:20.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:106:0) after 1m16s
[19:58:36.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:106:0)
[19:58:36.948] Build status: STARTED
[19:58:36.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:107:0) after 1m30s
[20:00:07.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:107:0)
[20:00:07.093] Build status: STARTED
[20:00:07.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:108:0) after 3m11s
[20:03:18.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:108:0)
[20:03:18.145] Build status: STARTED
[20:03:18.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:109:0) after 8m9s
[20:11:27.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:109:0)
[20:11:27.423] Build status: STARTED
[20:11:27.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:110:0) after 9m2s
[20:20:29.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:110:0)
[20:20:29.471] Build status: STARTED
[20:20:29.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:111:0) after 4m3s
[20:24:32.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:111:0)
[20:24:32.524] Build status: STARTED
[20:24:32.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:112:0) after 3m44s
[20:28:16.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:112:0)
[20:28:16.777] Build status: STARTED
[20:28:16.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:113:0) after 4m2s
[20:32:18.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:113:0)
[20:32:18.823] Build status: STARTED
[20:32:18.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:114:0) after 1m25s
[20:33:43.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:114:0)
[20:33:43.875] Build status: STARTED
[20:33:43.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:115:0) after 6m22s
[20:40:05.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:115:0)
[20:40:05.921] Build status: STARTED
[20:40:05.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:116:0) after 5m47s
[20:45:52.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:116:0)
[20:45:52.995] Build status: STARTED
[20:45:52.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:117:0) after 1m48s
[20:47:41.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:117:0)
[20:47:41.053] Build status: STARTED
[20:47:41.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:118:0) after 5m18s
[20:52:59.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:118:0)
[20:52:59.114] Build status: STARTED
[20:52:59.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:119:0) after 6m42s
[20:59:41.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:119:0)
[20:59:41.261] Build status: STARTED
[20:59:41.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:120:0) after 6m45s
[21:06:26.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:120:0)
[21:06:26.431] Build status: STARTED
[21:06:26.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:121:0) after 4m16s
[21:10:42.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:121:0)
[21:10:42.488] Build status: STARTED
[21:10:42.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:122:0) after 1m29s
[21:12:11.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:122:0)
[21:12:11.560] Build status: STARTED
[21:12:11.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:123:0) after 5m53s
[21:18:04.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:123:0)
[21:18:04.624] Build status: STARTED
[21:18:04.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:124:0) after 1m7s
[21:19:11.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:124:0)
[21:19:11.631] Build status: STARTED
[21:19:11.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:125:0) after 5m4s
[21:24:15.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:125:0)
[21:24:15.764] Build status: STARTED
[21:24:15.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:126:0) after 7m42s
[21:31:57.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:126:0)
[21:31:57.805] Build status: STARTED
[21:31:57.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:127:0) after 2m38s
[21:34:35.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:127:0)
[21:34:35.854] Build status: STARTED
[21:34:35.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:128:0) after 4m14s
[21:38:49.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:128:0)
[21:38:49.962] Build status: STARTED
[21:38:49.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:129:0) after 1m18s
[21:40:07.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:129:0)
[21:40:08.006] Build status: STARTED
[21:40:08.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:130:0) after 7m58s
[21:48:06.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:130:0)
[21:48:06.135] Build status: STARTED
[21:48:06.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:131:0) after 4m10s
[21:52:16.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:131:0)
[21:52:16.405] Build status: STARTED
[21:52:16.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:132:0) after 4m36s
[21:56:52.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:132:0)
[21:56:52.536] Build status: STARTED
[21:56:52.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:133:0) after 4m52s
[22:01:44.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:133:0)
[22:01:44.605] Build status: STARTED
[22:01:44.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:134:0) after 5m52s
[22:07:37.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:134:0)
[22:07:37.140] Build status: STARTED
[22:07:37.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:135:0) after 2m44s
[22:10:21.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:135:0)
[22:10:21.374] Build status: STARTED
[22:10:21.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:136:0) after 6m2s
[22:16:23.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:136:0)
[22:16:23.558] Build status: STARTED
[22:16:23.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:137:0) after 2m5s
[22:18:28.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:137:0)
[22:18:28.822] Build status: STARTED
[22:18:28.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:138:0) after 2m25s
[22:20:53.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:138:0)
[22:20:53.878] Build status: STARTED
[22:20:53.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:139:0) after 4m10s
[22:25:03.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:139:0)
[22:25:03.939] Build status: STARTED
[22:25:03.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:140:0) after 4m26s
[22:29:30.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:140:0)
[22:29:30.157] Build status: STARTED
[22:29:30.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:141:0) after 6m56s
[22:36:26.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:141:0)
[22:36:26.215] Build status: STARTED
[22:36:26.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:142:0) after 5m2s
[22:41:28.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:142:0)
[22:41:28.543] Build status: STARTED
[22:41:28.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:143:0) after 7m11s
[22:48:39.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:143:0)
[22:48:39.579] Build status: STARTED
[22:48:39.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:144:0) after 1m58s
[22:50:37.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:144:0)
[22:50:37.644] Build status: STARTED
[22:50:37.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:145:0) after 2m48s
[22:53:25.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:145:0)
[22:53:25.800] Build status: STARTED
[22:53:25.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:146:0) after 1m41s
[22:55:06.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:146:0)
[22:55:06.904] Build status: STARTED
[22:55:06.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:147:0) after 3m7s
[22:58:14.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:147:0)
[22:58:14.224] Build status: STARTED
[22:58:14.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:148:0) after 2m30s
[23:00:45.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:148:0)
[23:00:45.047] Build status: STARTED
[23:00:45.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:149:0) after 4m14s
[23:04:59.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:149:0)
[23:04:59.276] Build status: STARTED
[23:04:59.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:150:0) after 4m3s
[23:09:02.437] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:150:0)
[23:09:02.459] Build status: STARTED
[23:09:02.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976183172065512352:151:0) after 9m19s
[23:11:31.089] Received PubSub notification, asking Buildbucket for the build status
[23:11:31.117] Build:
{
"id": "8810753110099239473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 27998,
"createdBy": "project:chromium",
"createTime": "2022-06-21T10:41:12.909473584Z",
"startTime": "2022-06-21T11:12:19.630778Z",
"endTime": "2022-06-21T23:11:25.599898908Z",
"updateTime": "2022-06-21T23:11:25.599898908Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "01f1a0f455bcf9aae08c5922b8a7b6d02952d986",
"ref": "refs/heads/main"
}
}
}
[23:11:31.117] Invocation finished in 12h30m19.466024043s with status FAILED