[12:44:18.617] New invocation is queued and will start shortly
[12:44:19.884] Starting the invocation (attempt 1)
[12:44:19.925] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cf2628d7ba18156dfa5de0b479ef9704a0bcdf63"
[12:44:19.925] Popped gitiles commit info from properties and tags
[12:44:19.925] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:44:19.927] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:44:19.927] Buildbucket request:
{
"requestId": "8991486313605971184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cf2628d7ba18156dfa5de0b479ef9704a0bcdf63",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8991486313605971184"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:44:20.498] Scheduled build:
{
"id": "8826056251516392849",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 27398,
"createdBy": "project:chromium",
"createTime": "2022-01-03T12:44:19.979210642Z",
"updateTime": "2022-01-03T12:44:19.979210642Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cf2628d7ba18156dfa5de0b479ef9704a0bcdf63",
"ref": "refs/heads/main"
}
}
}
[12:44:20.498] Task URL: https://cr-buildbucket.appspot.com/build/8826056251516392849
[12:44:20.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:2:0) after 6m42s
[12:51:02.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:2:0)
[12:51:02.699] Build status: SCHEDULED
[12:51:02.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:3:0) after 4m40s
[12:55:42.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:3:0)
[12:55:42.745] Build status: SCHEDULED
[12:55:42.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:4:0) after 4m50s
[13:00:32.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:4:0)
[13:00:32.925] Build status: SCHEDULED
[13:00:32.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:5:0) after 1m23s
[13:01:56.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:5:0)
[13:01:56.086] Build status: SCHEDULED
[13:01:56.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:6:0) after 7m14s
[13:03:48.696] Received PubSub notification, asking Buildbucket for the build status
[13:03:48.715] Build status: STARTED
[13:09:10.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:6:0)
[13:09:10.367] Build status: STARTED
[13:09:10.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:8:0) after 4m57s
[13:14:07.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:8:0)
[13:14:07.512] Build status: STARTED
[13:14:07.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:9:0) after 5m21s
[13:19:28.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:9:0)
[13:19:28.552] Build status: STARTED
[13:19:28.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:10:0) after 4m11s
[13:23:39.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:10:0)
[13:23:39.594] Build status: STARTED
[13:23:39.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:11:0) after 3m37s
[13:27:16.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:11:0)
[13:27:16.663] Build status: STARTED
[13:27:16.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:12:0) after 2m52s
[13:30:08.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:12:0)
[13:30:08.699] Build status: STARTED
[13:30:08.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:13:0) after 6m34s
[13:36:42.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:13:0)
[13:36:42.758] Build status: STARTED
[13:36:42.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:14:0) after 3m16s
[13:39:58.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:14:0)
[13:39:58.874] Build status: STARTED
[13:39:58.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:15:0) after 7m37s
[13:47:35.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:15:0)
[13:47:36.000] Build status: STARTED
[13:47:36.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:16:0) after 2m1s
[13:49:37.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:16:0)
[13:49:37.043] Build status: STARTED
[13:49:37.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:17:0) after 7m29s
[13:57:06.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:17:0)
[13:57:06.304] Build status: STARTED
[13:57:06.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:18:0) after 2m59s
[14:00:05.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:18:0)
[14:00:05.467] Build status: STARTED
[14:00:05.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:19:0) after 6m59s
[14:07:04.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:19:0)
[14:07:04.739] Build status: STARTED
[14:07:04.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:20:0) after 5m24s
[14:12:29.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:20:0)
[14:12:29.039] Build status: STARTED
[14:12:29.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:21:0) after 9m2s
[14:21:31.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:21:0)
[14:21:31.176] Build status: STARTED
[14:21:31.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:22:0) after 2m14s
[14:23:45.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:22:0)
[14:23:45.261] Build status: STARTED
[14:23:45.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:23:0) after 9m51s
[14:33:36.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:23:0)
[14:33:36.316] Build status: STARTED
[14:33:36.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:24:0) after 2m29s
[14:36:05.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:24:0)
[14:36:05.389] Build status: STARTED
[14:36:05.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:25:0) after 3m22s
[14:39:27.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:25:0)
[14:39:27.530] Build status: STARTED
[14:39:27.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:26:0) after 8m42s
[14:48:09.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:26:0)
[14:48:09.602] Build status: STARTED
[14:48:09.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:27:0) after 2m49s
[14:50:58.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:27:0)
[14:50:58.687] Build status: STARTED
[14:50:58.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:28:0) after 4m11s
[14:55:09.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:28:0)
[14:55:09.807] Build status: STARTED
[14:55:09.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:29:0) after 5m57s
[15:01:06.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:29:0)
[15:01:06.816] Build status: STARTED
[15:01:06.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:30:0) after 1m40s
[15:02:46.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:30:0)
[15:02:46.871] Build status: STARTED
[15:02:46.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:31:0) after 1m1s
[15:03:47.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:31:0)
[15:03:47.910] Build status: STARTED
[15:03:47.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:32:0) after 7m6s
[15:10:53.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:32:0)
[15:10:54.010] Build status: STARTED
[15:10:54.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:33:0) after 8m54s
[15:19:48.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:33:0)
[15:19:48.185] Build status: STARTED
[15:19:48.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:34:0) after 6m44s
[15:26:32.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:34:0)
[15:26:32.262] Build status: STARTED
[15:26:32.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:35:0) after 7m29s
[15:34:01.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:35:0)
[15:34:01.466] Build status: STARTED
[15:34:01.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:36:0) after 3m36s
[15:37:37.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:36:0)
[15:37:37.853] Build status: STARTED
[15:37:37.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:37:0) after 5m2s
[15:42:39.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:37:0)
[15:42:39.924] Build status: STARTED
[15:42:39.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:38:0) after 7m27s
[15:50:07.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:38:0)
[15:50:07.139] Build status: STARTED
[15:50:07.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:39:0) after 8m10s
[15:58:17.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:39:0)
[15:58:17.180] Build status: STARTED
[15:58:17.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:40:0) after 5m40s
[16:03:57.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:40:0)
[16:03:57.238] Build status: STARTED
[16:03:57.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:41:0) after 7m27s
[16:11:24.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:41:0)
[16:11:24.397] Build status: STARTED
[16:11:24.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:42:0) after 1m19s
[16:12:43.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:42:0)
[16:12:43.544] Build status: STARTED
[16:12:43.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:43:0) after 2m13s
[16:14:56.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:43:0)
[16:14:56.607] Build status: STARTED
[16:14:56.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:44:0) after 6m46s
[16:21:42.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:44:0)
[16:21:42.692] Build status: STARTED
[16:21:42.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:45:0) after 8m2s
[16:29:44.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:45:0)
[16:29:44.742] Build status: STARTED
[16:29:44.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:46:0) after 3m58s
[16:33:42.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:46:0)
[16:33:42.855] Build status: STARTED
[16:33:42.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:47:0) after 4m32s
[16:38:14.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:47:0)
[16:38:14.916] Build status: STARTED
[16:38:14.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:48:0) after 6m5s
[16:44:19.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:48:0)
[16:44:19.960] Build status: STARTED
[16:44:19.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:49:0) after 6m24s
[16:50:43.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:49:0)
[16:50:44.024] Build status: STARTED
[16:50:44.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:50:0) after 2m16s
[16:53:00.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:50:0)
[16:53:00.266] Build status: STARTED
[16:53:00.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:51:0) after 9m1s
[17:02:01.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:51:0)
[17:02:01.319] Build status: STARTED
[17:02:01.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:52:0) after 7m33s
[17:09:34.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:52:0)
[17:09:34.526] Build status: STARTED
[17:09:34.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:53:0) after 6m18s
[17:15:52.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:53:0)
[17:15:52.738] Build status: STARTED
[17:15:52.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:54:0) after 9m32s
[17:25:24.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:54:0)
[17:25:24.910] Build status: STARTED
[17:25:24.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:55:0) after 6m34s
[17:31:59.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:55:0)
[17:31:59.184] Build status: STARTED
[17:31:59.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:56:0) after 4m32s
[17:36:31.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:56:0)
[17:36:31.245] Build status: STARTED
[17:36:31.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:57:0) after 6m40s
[17:43:11.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:57:0)
[17:43:11.372] Build status: STARTED
[17:43:11.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:58:0) after 3m6s
[17:46:17.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:58:0)
[17:46:17.439] Build status: STARTED
[17:46:17.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:59:0) after 2m58s
[17:49:15.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:59:0)
[17:49:15.490] Build status: STARTED
[17:49:15.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:60:0) after 7m39s
[17:56:54.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:60:0)
[17:56:54.694] Build status: STARTED
[17:56:54.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:61:0) after 1m12s
[17:58:06.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:61:0)
[17:58:07.034] Build status: STARTED
[17:58:07.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:62:0) after 5m18s
[18:03:25.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:62:0)
[18:03:25.132] Build status: STARTED
[18:03:25.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:63:0) after 1m1s
[18:04:26.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:63:0)
[18:04:26.175] Build status: STARTED
[18:04:26.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:64:0) after 5m55s
[18:10:21.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:64:0)
[18:10:21.198] Build status: STARTED
[18:10:21.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:65:0) after 3m10s
[18:13:31.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:65:0)
[18:13:31.252] Build status: STARTED
[18:13:31.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:66:0) after 4m4s
[18:17:35.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:66:0)
[18:17:35.293] Build status: STARTED
[18:17:35.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:67:0) after 5m12s
[18:22:47.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:67:0)
[18:22:47.728] Build status: STARTED
[18:22:47.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:68:0) after 9m36s
[18:32:23.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:68:0)
[18:32:23.839] Build status: STARTED
[18:32:23.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:69:0) after 1m24s
[18:33:47.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:69:0)
[18:33:47.930] Build status: STARTED
[18:33:47.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:70:0) after 5m24s
[18:39:11.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:70:0)
[18:39:11.975] Build status: STARTED
[18:39:11.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:71:0) after 2m31s
[18:41:43.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:71:0)
[18:41:43.107] Build status: STARTED
[18:41:43.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:72:0) after 1m47s
[18:43:30.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:72:0)
[18:43:30.163] Build status: STARTED
[18:43:30.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:73:0) after 2m21s
[18:45:51.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:73:0)
[18:45:51.304] Build status: STARTED
[18:45:51.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:74:0) after 2m57s
[18:48:48.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:74:0)
[18:48:48.382] Build status: STARTED
[18:48:48.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:75:0) after 2m20s
[18:51:08.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:75:0)
[18:51:08.426] Build status: STARTED
[18:51:08.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:76:0) after 5m49s
[18:56:57.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:76:0)
[18:56:58.001] Build status: STARTED
[18:56:58.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:77:0) after 6m52s
[19:03:50.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:77:0)
[19:03:50.257] Build status: STARTED
[19:03:50.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:78:0) after 6m32s
[19:10:22.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:78:0)
[19:10:22.307] Build status: STARTED
[19:10:22.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:79:0) after 5m11s
[19:15:33.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:79:0)
[19:15:33.561] Build status: STARTED
[19:15:33.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:80:0) after 5m58s
[19:21:31.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:80:0)
[19:21:31.692] Build status: STARTED
[19:21:31.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:81:0) after 6m46s
[19:28:17.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:81:0)
[19:28:17.755] Build status: STARTED
[19:28:17.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:82:0) after 7m39s
[19:35:56.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:82:0)
[19:35:56.857] Build status: STARTED
[19:35:56.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:83:0) after 1m0s
[19:36:56.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:83:0)
[19:36:56.915] Build status: STARTED
[19:36:56.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:84:0) after 4m44s
[19:41:40.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:84:0)
[19:41:40.973] Build status: STARTED
[19:41:40.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:85:0) after 5m29s
[19:47:10.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:85:0)
[19:47:10.099] Build status: STARTED
[19:47:10.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:86:0) after 4m47s
[19:51:57.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:86:0)
[19:51:57.141] Build status: STARTED
[19:51:57.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:87:0) after 9m17s
[20:01:14.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:87:0)
[20:01:14.296] Build status: STARTED
[20:01:14.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:88:0) after 4m56s
[20:06:10.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:88:0)
[20:06:10.342] Build status: STARTED
[20:06:10.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:89:0) after 6m58s
[20:13:08.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:89:0)
[20:13:08.493] Build status: STARTED
[20:13:08.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:90:0) after 8m33s
[20:21:41.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:90:0)
[20:21:41.546] Build status: STARTED
[20:21:41.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:91:0) after 6m2s
[20:27:43.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:91:0)
[20:27:43.588] Build status: STARTED
[20:27:43.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:92:0) after 8m40s
[20:36:23.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:92:0)
[20:36:23.665] Build status: STARTED
[20:36:23.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:93:0) after 7m40s
[20:44:03.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:93:0)
[20:44:03.856] Build status: STARTED
[20:44:03.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:94:0) after 3m48s
[20:47:51.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:94:0)
[20:47:51.979] Build status: STARTED
[20:47:51.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:95:0) after 4m11s
[20:52:03.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:95:0)
[20:52:03.293] Build status: STARTED
[20:52:03.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:96:0) after 9m8s
[21:01:11.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:96:0)
[21:01:11.580] Build status: STARTED
[21:01:11.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:97:0) after 7m43s
[21:08:54.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:97:0)
[21:08:54.743] Build status: STARTED
[21:08:54.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:98:0) after 8m48s
[21:17:42.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:98:0)
[21:17:42.783] Build status: STARTED
[21:17:42.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:99:0) after 3m45s
[21:21:27.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:99:0)
[21:21:27.872] Build status: STARTED
[21:21:27.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:100:0) after 2m4s
[21:23:32.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:100:0)
[21:23:32.159] Build status: STARTED
[21:23:32.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:101:0) after 6m27s
[21:29:59.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:101:0)
[21:29:59.271] Build status: STARTED
[21:29:59.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:102:0) after 1m54s
[21:31:53.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:102:0)
[21:31:53.418] Build status: STARTED
[21:31:53.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:103:0) after 9m16s
[21:41:09.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:103:0)
[21:41:09.509] Build status: STARTED
[21:41:09.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:104:0) after 1m37s
[21:42:46.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:104:0)
[21:42:46.551] Build status: STARTED
[21:42:46.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:105:0) after 1m51s
[21:44:37.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:105:0)
[21:44:37.758] Build status: STARTED
[21:44:37.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:106:0) after 1m51s
[21:46:28.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:106:0)
[21:46:28.808] Build status: STARTED
[21:46:28.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:107:0) after 6m14s
[21:52:42.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:107:0)
[21:52:42.846] Build status: STARTED
[21:52:42.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:108:0) after 4m41s
[21:57:23.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:108:0)
[21:57:23.887] Build status: STARTED
[21:57:23.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:109:0) after 8m23s
[22:05:46.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:109:0)
[22:05:47.012] Build status: STARTED
[22:05:47.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:110:0) after 6m52s
[22:12:39.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:110:0)
[22:12:39.185] Build status: STARTED
[22:12:39.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:111:0) after 3m23s
[22:16:02.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:111:0)
[22:16:02.228] Build status: STARTED
[22:16:02.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:112:0) after 7m54s
[22:23:56.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:112:0)
[22:23:56.299] Build status: STARTED
[22:23:56.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:113:0) after 4m58s
[22:28:54.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:113:0)
[22:28:54.353] Build status: STARTED
[22:28:54.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:114:0) after 2m2s
[22:30:56.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:114:0)
[22:30:56.611] Build status: STARTED
[22:30:56.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:115:0) after 1m55s
[22:32:52.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:115:0)
[22:32:52.863] Build status: STARTED
[22:32:52.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:116:0) after 6m51s
[22:39:43.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:116:0)
[22:39:43.925] Build status: STARTED
[22:39:43.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:117:0) after 9m20s
[22:49:04.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:117:0)
[22:49:04.058] Build status: STARTED
[22:49:04.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:118:0) after 1m27s
[22:50:31.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:118:0)
[22:50:31.211] Build status: STARTED
[22:50:31.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:119:0) after 3m38s
[22:54:09.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:119:0)
[22:54:09.476] Build status: STARTED
[22:54:09.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:120:0) after 9m53s
[23:04:02.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:120:0)
[23:04:02.560] Build status: STARTED
[23:04:02.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:121:0) after 5m27s
[23:09:29.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:121:0)
[23:09:29.625] Build status: STARTED
[23:09:29.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:122:0) after 1m47s
[23:11:16.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:122:0)
[23:11:16.732] Build status: STARTED
[23:11:16.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:123:0) after 7m58s
[23:19:14.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:123:0)
[23:19:14.800] Build status: STARTED
[23:19:14.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:124:0) after 9m39s
[23:28:53.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:124:0)
[23:28:53.961] Build status: STARTED
[23:28:53.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:125:0) after 6m48s
[23:35:41.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:125:0)
[23:35:42.009] Build status: STARTED
[23:35:42.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8991486313605971184:126:0) after 8m50s
[23:40:39.216] Received PubSub notification, asking Buildbucket for the build status
[23:40:39.255] Build:
{
"id": "8826056251516392849",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 27398,
"createdBy": "project:chromium",
"createTime": "2022-01-03T12:44:19.979210642Z",
"startTime": "2022-01-03T13:03:48.093033Z",
"endTime": "2022-01-03T23:40:35.875158352Z",
"updateTime": "2022-01-03T23:40:35.875158352Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cf2628d7ba18156dfa5de0b479ef9704a0bcdf63",
"ref": "refs/heads/main"
}
}
}
[23:40:39.255] Invocation finished in 10h56m20.652043133s with status FAILED