[20:06:46.182] New invocation is queued and will start shortly
[20:06:47.241] Starting the invocation (attempt 1)
[20:06:47.386] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d472cf52032cbed7bde9595842d2ea5f55b74a66"
[20:06:47.386] Popped gitiles commit info from properties and tags
[20:06:47.386] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:06:47.387] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:06:47.387] Buildbucket request:
{
"requestId": "9003145485150490704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d472cf52032cbed7bde9595842d2ea5f55b74a66",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9003145485150490704"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:06:48.936] Scheduled build:
{
"id": "8837715423086605377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 26432,
"createdBy": "project:chromium",
"createTime": "2021-08-27T20:06:47.502292631Z",
"updateTime": "2021-08-27T20:06:47.764462779Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d472cf52032cbed7bde9595842d2ea5f55b74a66",
"ref": "refs/heads/main"
}
}
}
[20:06:48.936] Task URL: https://cr-buildbucket.appspot.com/build/8837715423086605377
[20:06:48.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:2:0) after 6m57s
[20:08:31.502] Received PubSub notification, asking Buildbucket for the build status
[20:08:31.531] Build status: STARTED
[20:13:46.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:2:0)
[20:13:46.260] Build status: STARTED
[20:13:46.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:4:0) after 9m22s
[20:23:08.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:4:0)
[20:23:08.310] Build status: STARTED
[20:23:08.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:5:0) after 7m5s
[20:30:13.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:5:0)
[20:30:13.381] Build status: STARTED
[20:30:13.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:6:0) after 9m46s
[20:39:59.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:6:0)
[20:39:59.689] Build status: STARTED
[20:39:59.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:7:0) after 3m10s
[20:43:09.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:7:0)
[20:43:09.883] Build status: STARTED
[20:43:09.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:8:0) after 3m5s
[20:46:15.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:8:0)
[20:46:15.332] Build status: STARTED
[20:46:15.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:9:0) after 9m56s
[20:56:11.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:9:0)
[20:56:11.461] Build status: STARTED
[20:56:11.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:10:0) after 8m47s
[21:04:58.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:10:0)
[21:04:58.609] Build status: STARTED
[21:04:58.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:11:0) after 4m48s
[21:09:46.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:11:0)
[21:09:46.794] Build status: STARTED
[21:09:46.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:12:0) after 1m35s
[21:11:22.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:12:0)
[21:11:22.087] Build status: STARTED
[21:11:22.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:13:0) after 3m36s
[21:14:58.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:13:0)
[21:14:58.143] Build status: STARTED
[21:14:58.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:14:0) after 4m45s
[21:19:43.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:14:0)
[21:19:43.770] Build status: STARTED
[21:19:43.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:15:0) after 3m38s
[21:23:22.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:15:0)
[21:23:22.160] Build status: STARTED
[21:23:22.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:16:0) after 7m34s
[21:30:56.206] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:16:0)
[21:30:56.296] Build status: STARTED
[21:30:56.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:17:0) after 7m2s
[21:37:58.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:17:0)
[21:37:58.522] Build status: STARTED
[21:37:58.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:18:0) after 9m26s
[21:47:24.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:18:0)
[21:47:24.600] Build status: STARTED
[21:47:24.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:19:0) after 3m55s
[21:51:19.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:19:0)
[21:51:19.681] Build status: STARTED
[21:51:19.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:20:0) after 2m55s
[21:54:14.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:20:0)
[21:54:14.750] Build status: STARTED
[21:54:14.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:21:0) after 2m57s
[21:57:12.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:21:0)
[21:57:12.044] Build status: STARTED
[21:57:12.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:22:0) after 3m32s
[22:00:44.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:22:0)
[22:00:44.259] Build status: STARTED
[22:00:44.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:23:0) after 4m20s
[22:05:04.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:23:0)
[22:05:04.334] Build status: STARTED
[22:05:04.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:24:0) after 5m29s
[22:10:33.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:24:0)
[22:10:33.508] Build status: STARTED
[22:10:33.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:25:0) after 9m34s
[22:20:07.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:25:0)
[22:20:07.589] Build status: STARTED
[22:20:07.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:26:0) after 2m6s
[22:22:13.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:26:0)
[22:22:13.664] Build status: STARTED
[22:22:13.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:27:0) after 7m40s
[22:29:54.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:27:0)
[22:29:54.169] Build status: STARTED
[22:29:54.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:28:0) after 7m43s
[22:37:37.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:28:0)
[22:37:37.322] Build status: STARTED
[22:37:37.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:29:0) after 9m5s
[22:46:42.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:29:0)
[22:46:42.579] Build status: STARTED
[22:46:42.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:30:0) after 8m46s
[22:55:28.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:30:0)
[22:55:28.654] Build status: STARTED
[22:55:28.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:31:0) after 8m24s
[23:03:52.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:31:0)
[23:03:52.741] Build status: STARTED
[23:03:52.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:32:0) after 2m34s
[23:06:26.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:32:0)
[23:06:26.957] Build status: STARTED
[23:06:26.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:33:0) after 5m42s
[23:12:09.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:33:0)
[23:12:09.131] Build status: STARTED
[23:12:09.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:34:0) after 1m58s
[23:14:07.250] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:34:0)
[23:14:07.285] Build status: STARTED
[23:14:07.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:35:0) after 2m20s
[23:16:27.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:35:0)
[23:16:27.483] Build status: STARTED
[23:16:27.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:36:0) after 6m41s
[23:23:08.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:36:0)
[23:23:08.590] Build status: STARTED
[23:23:08.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:37:0) after 2m18s
[23:25:26.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:37:0)
[23:25:26.886] Build status: STARTED
[23:25:26.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:38:0) after 3m59s
[23:29:26.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:38:0)
[23:29:26.093] Build status: STARTED
[23:29:26.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:39:0) after 4m14s
[23:33:40.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:39:0)
[23:33:40.290] Build status: STARTED
[23:33:40.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:40:0) after 4m39s
[23:38:19.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:40:0)
[23:38:19.585] Build status: STARTED
[23:38:19.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:41:0) after 4m21s
[23:42:40.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:41:0)
[23:42:40.745] Build status: STARTED
[23:42:40.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:42:0) after 9m44s
[23:52:24.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:42:0)
[23:52:25.020] Build status: STARTED
[23:52:25.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:43:0) after 7m45s
[00:00:10.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:43:0)
[00:00:10.159] Build status: STARTED
[00:00:10.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:44:0) after 7m18s
[00:07:28.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:44:0)
[00:07:28.355] Build status: STARTED
[00:07:28.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:45:0) after 9m29s
[00:16:57.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:45:0)
[00:16:57.568] Build status: STARTED
[00:16:57.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:46:0) after 1m48s
[00:18:45.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:46:0)
[00:18:45.903] Build status: STARTED
[00:18:45.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:47:0) after 5m20s
[00:24:05.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:47:0)
[00:24:05.974] Build status: STARTED
[00:24:05.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:48:0) after 8m50s
[00:32:56.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:48:0)
[00:32:56.142] Build status: STARTED
[00:32:56.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:49:0) after 6m30s
[00:39:26.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:49:0)
[00:39:26.211] Build status: STARTED
[00:39:26.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:50:0) after 2m15s
[00:41:41.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:50:0)
[00:41:41.492] Build status: STARTED
[00:41:41.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:51:0) after 3m25s
[00:45:06.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:51:0)
[00:45:06.778] Build status: STARTED
[00:45:06.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:52:0) after 6m46s
[00:51:52.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:52:0)
[00:51:52.841] Build status: STARTED
[00:51:52.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:53:0) after 4m45s
[00:56:37.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:53:0)
[00:56:37.895] Build status: STARTED
[00:56:37.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:54:0) after 4m41s
[01:01:18.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:54:0)
[01:01:18.995] Build status: STARTED
[01:01:18.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:55:0) after 2m50s
[01:04:09.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:55:0)
[01:04:09.206] Build status: STARTED
[01:04:09.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:56:0) after 4m14s
[01:08:23.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:56:0)
[01:08:23.413] Build status: STARTED
[01:08:23.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:57:0) after 5m57s
[01:14:20.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:57:0)
[01:14:20.602] Build status: STARTED
[01:14:20.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:58:0) after 3m38s
[01:17:58.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:58:0)
[01:17:58.743] Build status: STARTED
[01:17:58.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:59:0) after 1m30s
[01:19:28.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:59:0)
[01:19:28.779] Build status: STARTED
[01:19:28.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:60:0) after 4m22s
[01:23:51.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:60:0)
[01:23:51.038] Build status: STARTED
[01:23:51.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:61:0) after 1m38s
[01:25:29.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:61:0)
[01:25:29.176] Build status: STARTED
[01:25:29.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:62:0) after 7m22s
[01:32:51.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:62:0)
[01:32:51.402] Build status: STARTED
[01:32:51.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:63:0) after 7m20s
[01:40:11.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:63:0)
[01:40:11.536] Build status: STARTED
[01:40:11.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9003145485150490704:64:0) after 9m57s
[01:43:29.898] Received PubSub notification, asking Buildbucket for the build status
[01:43:29.960] Build:
{
"id": "8837715423086605377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 26432,
"createdBy": "project:chromium",
"createTime": "2021-08-27T20:06:47.502292631Z",
"startTime": "2021-08-27T20:08:30.489689Z",
"endTime": "2021-08-28T01:43:29.350149935Z",
"updateTime": "2021-08-28T01:43:29.350480340Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d472cf52032cbed7bde9595842d2ea5f55b74a66",
"ref": "refs/heads/main"
}
}
}
[01:43:29.960] Invocation finished in 5h36m43.808705715s with status FAILED