[21:29:00.978] New invocation is queued and will start shortly
[21:29:02.316] Starting the invocation (attempt 1)
[21:29:02.350] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/57036f6778f1ede2c32e55d57d2ca6c408c14b48"
[21:29:02.350] Popped gitiles commit info from properties and tags
[21:29:02.350] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:29:02.350] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:29:02.350] Buildbucket request:
{
"requestId": "8998429268372697872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "57036f6778f1ede2c32e55d57d2ca6c408c14b48",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8998429268372697872"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux CFI"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:29:02.972] Scheduled build:
{
"id": "8832999206192202673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"number": 21226,
"createdBy": "project:chromium",
"createTime": "2021-10-18T21:29:02.425590431Z",
"updateTime": "2021-10-18T21:29:02.708082022Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "57036f6778f1ede2c32e55d57d2ca6c408c14b48",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:29:02.972] Task URL: https://cr-buildbucket.appspot.com/build/8832999206192202673
[21:29:02.972] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:2:0) after 6m25s
[21:30:48.323] Received PubSub notification, asking Buildbucket for the build status
[21:30:48.354] Build status: STARTED
[21:35:28.094] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:2:0)
[21:35:28.277] Build status: STARTED
[21:35:28.277] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:4:0) after 6m55s
[21:42:23.398] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:4:0)
[21:42:23.478] Build status: STARTED
[21:42:23.478] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:5:0) after 5m47s
[21:48:10.519] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:5:0)
[21:48:10.572] Build status: STARTED
[21:48:10.572] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:6:0) after 3m0s
[21:51:10.776] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:6:0)
[21:51:10.826] Build status: STARTED
[21:51:10.826] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:7:0) after 2m9s
[21:53:19.914] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:7:0)
[21:53:19.975] Build status: STARTED
[21:53:19.975] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:8:0) after 8m47s
[22:02:07.353] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:8:0)
[22:02:07.397] Build status: STARTED
[22:02:07.397] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:9:0) after 2m13s
[22:04:20.424] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:9:0)
[22:04:20.460] Build status: STARTED
[22:04:20.460] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:10:0) after 1m31s
[22:05:51.500] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:10:0)
[22:05:51.530] Build status: STARTED
[22:05:51.530] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:11:0) after 3m6s
[22:08:57.563] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:11:0)
[22:08:57.601] Build status: STARTED
[22:08:57.601] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:12:0) after 1m39s
[22:10:36.675] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:12:0)
[22:10:36.707] Build status: STARTED
[22:10:36.707] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:13:0) after 1m2s
[22:11:39.238] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:13:0)
[22:11:39.278] Build status: STARTED
[22:11:39.278] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:14:0) after 5m48s
[22:17:27.400] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:14:0)
[22:17:27.425] Build status: STARTED
[22:17:27.425] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:15:0) after 3m26s
[22:20:53.559] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:15:0)
[22:20:53.596] Build status: STARTED
[22:20:53.596] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:16:0) after 1m52s
[22:22:45.626] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:16:0)
[22:22:45.660] Build status: STARTED
[22:22:45.660] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:17:0) after 5m3s
[22:27:48.903] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:17:0)
[22:27:48.931] Build status: STARTED
[22:27:48.931] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:18:0) after 8m32s
[22:36:21.126] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:18:0)
[22:36:21.178] Build status: STARTED
[22:36:21.178] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:19:0) after 5m35s
[22:41:56.510] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:19:0)
[22:41:56.568] Build status: STARTED
[22:41:56.568] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:20:0) after 7m14s
[22:49:10.683] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:20:0)
[22:49:10.710] Build status: STARTED
[22:49:10.710] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:21:0) after 8m49s
[22:57:59.974] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:21:0)
[22:58:00.003] Build status: STARTED
[22:58:00.003] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:22:0) after 7m20s
[23:05:20.027] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:22:0)
[23:05:20.061] Build status: STARTED
[23:05:20.061] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:23:0) after 6m28s
[23:11:48.274] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:23:0)
[23:11:48.373] Build status: STARTED
[23:11:48.373] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:24:0) after 9m24s
[23:21:12.403] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:24:0)
[23:21:12.429] Build status: STARTED
[23:21:12.429] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:25:0) after 6m59s
[23:28:11.579] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:25:0)
[23:28:11.608] Build status: STARTED
[23:28:11.608] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:26:0) after 5m1s
[23:33:12.681] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:26:0)
[23:33:12.712] Build status: STARTED
[23:33:12.712] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:27:0) after 1m30s
[23:34:42.878] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:27:0)
[23:34:42.906] Build status: STARTED
[23:34:42.906] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:28:0) after 1m13s
[23:35:56.034] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:28:0)
[23:35:56.068] Build status: STARTED
[23:35:56.068] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:29:0) after 9m44s
[23:45:40.096] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:29:0)
[23:45:40.131] Build status: STARTED
[23:45:40.131] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:30:0) after 9m16s
[23:54:56.175] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:30:0)
[23:54:56.206] Build status: STARTED
[23:54:56.206] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:31:0) after 3m31s
[23:58:27.244] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:31:0)
[23:58:27.271] Build status: STARTED
[23:58:27.271] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:32:0) after 5m31s
[00:03:58.297] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:32:0)
[00:03:58.325] Build status: STARTED
[00:03:58.325] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:33:0) after 5m31s
[00:09:29.520] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:33:0)
[00:09:29.551] Build status: STARTED
[00:09:29.551] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:34:0) after 1m19s
[00:10:48.591] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:34:0)
[00:10:48.618] Build status: STARTED
[00:10:48.618] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:35:0) after 3m59s
[00:14:47.644] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:35:0)
[00:14:47.692] Build status: STARTED
[00:14:47.692] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:36:0) after 3m9s
[00:17:56.800] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:36:0)
[00:17:56.878] Build status: STARTED
[00:17:56.878] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:37:0) after 3m11s
[00:21:08.097] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:37:0)
[00:21:08.130] Build status: STARTED
[00:21:08.130] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:38:0) after 7m59s
[00:29:07.323] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:38:0)
[00:29:07.396] Build status: STARTED
[00:29:07.396] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:39:0) after 7m50s
[00:36:57.437] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:39:0)
[00:36:57.508] Build status: STARTED
[00:36:57.508] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:40:0) after 8m41s
[00:45:38.533] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:40:0)
[00:45:38.562] Build status: STARTED
[00:45:38.562] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:41:0) after 3m46s
[00:49:24.587] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:41:0)
[00:49:24.620] Build status: STARTED
[00:49:24.620] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:42:0) after 4m19s
[00:53:43.664] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:42:0)
[00:53:43.697] Build status: STARTED
[00:53:43.697] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:43:0) after 5m27s
[00:59:10.719] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:43:0)
[00:59:10.747] Build status: STARTED
[00:59:10.747] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:44:0) after 4m12s
[01:03:22.773] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:44:0)
[01:03:22.802] Build status: STARTED
[01:03:22.802] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:45:0) after 7m45s
[01:11:08.038] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:45:0)
[01:11:08.069] Build status: STARTED
[01:11:08.069] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:46:0) after 8m1s
[01:19:09.115] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:46:0)
[01:19:09.190] Build status: STARTED
[01:19:09.190] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:47:0) after 7m55s
[01:27:04.443] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:47:0)
[01:27:04.476] Build status: STARTED
[01:27:04.476] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:48:0) after 1m43s
[01:28:47.520] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:48:0)
[01:28:47.551] Build status: STARTED
[01:28:47.551] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:49:0) after 1m30s
[01:30:17.576] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:49:0)
[01:30:17.692] Build status: STARTED
[01:30:17.692] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:50:0) after 3m54s
[01:34:12.020] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:50:0)
[01:34:12.073] Build status: STARTED
[01:34:12.073] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:51:0) after 6m52s
[01:41:04.188] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:51:0)
[01:41:04.223] Build status: STARTED
[01:41:04.223] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:52:0) after 7m42s
[01:48:46.258] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:52:0)
[01:48:46.298] Build status: STARTED
[01:48:46.298] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:53:0) after 3m22s
[01:52:08.427] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:53:0)
[01:52:08.461] Build status: STARTED
[01:52:08.461] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:54:0) after 6m55s
[01:59:03.481] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:54:0)
[01:59:03.513] Build status: STARTED
[01:59:03.513] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:55:0) after 5m4s
[02:04:07.590] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:55:0)
[02:04:07.621] Build status: STARTED
[02:04:07.621] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8998429268372697872:56:0) after 4m16s
[02:06:26.647] Received PubSub notification, asking Buildbucket for the build status
[02:06:26.684] Build:
{
"id": "8832999206192202673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"number": 21226,
"createdBy": "project:chromium",
"createTime": "2021-10-18T21:29:02.425590431Z",
"startTime": "2021-10-18T21:30:45.039438Z",
"endTime": "2021-10-19T02:06:26.143012668Z",
"updateTime": "2021-10-19T02:06:26.143490418Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "57036f6778f1ede2c32e55d57d2ca6c408c14b48",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:06:26.684] Invocation finished in 4h37m25.722489992s with status FAILED