[21:23:58.421] New invocation is queued and will start shortly
[21:23:59.651] Starting the invocation (attempt 1)
[21:23:59.692] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bd16eb1095afd2e9509085275543afe99c1beff6"
[21:23:59.692] Popped gitiles commit info from properties and tags
[21:23:59.692] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:23:59.692] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:23:59.692] Buildbucket request:
{
"requestId": "8928579324531597664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd16eb1095afd2e9509085275543afe99c1beff6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8928579324531597664"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux CFI"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:24:00.436] Scheduled build:
{
"id": "8763149262457686433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"number": 26532,
"createdBy": "project:chromium",
"createTime": "2023-11-28T21:23:59.767917364Z",
"updateTime": "2023-11-28T21:23:59.767917364Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd16eb1095afd2e9509085275543afe99c1beff6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:24:00.436] Task URL: https://cr-buildbucket.appspot.com/build/8763149262457686433
[21:24:00.436] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:2:0) after 9m15s
[21:24:01.459] Received PubSub notification, asking Buildbucket for the build status
[21:24:01.489] Build status: SCHEDULED
[21:24:07.714] Received PubSub notification, asking Buildbucket for the build status
[21:24:07.747] Build status: STARTED
[21:33:15.554] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:2:0)
[21:33:15.573] Build status: STARTED
[21:33:15.573] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:5:0) after 2m53s
[21:36:08.618] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:5:0)
[21:36:08.658] Build status: STARTED
[21:36:08.658] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:6:0) after 7m54s
[21:44:02.695] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:6:0)
[21:44:02.730] Build status: STARTED
[21:44:02.730] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:7:0) after 9m39s
[21:53:41.864] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:7:0)
[21:53:41.888] Build status: STARTED
[21:53:41.888] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:8:0) after 6m0s
[21:59:41.893] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:8:0)
[21:59:41.990] Build status: STARTED
[21:59:41.990] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:9:0) after 4m45s
[22:04:27.031] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:9:0)
[22:04:27.053] Build status: STARTED
[22:04:27.053] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:10:0) after 5m28s
[22:09:55.137] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:10:0)
[22:09:55.158] Build status: STARTED
[22:09:55.158] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:11:0) after 2m36s
[22:12:31.191] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:11:0)
[22:12:31.293] Build status: STARTED
[22:12:31.293] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:12:0) after 1m24s
[22:13:55.375] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:12:0)
[22:13:55.406] Build status: STARTED
[22:13:55.406] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:13:0) after 2m48s
[22:16:43.433] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:13:0)
[22:16:43.459] Build status: STARTED
[22:16:43.459] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:14:0) after 6m8s
[22:22:51.484] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:14:0)
[22:22:51.503] Build status: STARTED
[22:22:51.503] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:15:0) after 3m4s
[22:25:55.577] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:15:0)
[22:25:55.597] Build status: STARTED
[22:25:55.597] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:16:0) after 9m10s
[22:35:05.625] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:16:0)
[22:35:05.676] Build status: STARTED
[22:35:05.676] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:17:0) after 3m30s
[22:38:35.725] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:17:0)
[22:38:35.745] Build status: STARTED
[22:38:35.745] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:18:0) after 5m40s
[22:44:15.765] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:18:0)
[22:44:15.783] Build status: STARTED
[22:44:15.783] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:19:0) after 5m23s
[22:49:38.811] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:19:0)
[22:49:38.833] Build status: STARTED
[22:49:38.833] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:20:0) after 4m7s
[22:53:45.865] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:20:0)
[22:53:45.887] Build status: STARTED
[22:53:45.887] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:21:0) after 1m14s
[22:54:59.891] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:21:0)
[22:54:59.920] Build status: STARTED
[22:54:59.920] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:22:0) after 1m50s
[22:56:49.949] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:22:0)
[22:56:49.970] Build status: STARTED
[22:56:49.970] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:23:0) after 5m12s
[23:02:02.061] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:23:0)
[23:02:02.088] Build status: STARTED
[23:02:02.088] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:24:0) after 4m59s
[23:07:01.132] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:24:0)
[23:07:01.220] Build status: STARTED
[23:07:01.220] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:25:0) after 2m15s
[23:09:16.348] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:25:0)
[23:09:16.369] Build status: STARTED
[23:09:16.369] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:26:0) after 1m16s
[23:10:32.644] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:26:0)
[23:10:32.667] Build status: STARTED
[23:10:32.667] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:27:0) after 2m45s
[23:13:17.912] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:27:0)
[23:13:17.967] Build status: STARTED
[23:13:17.967] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:28:0) after 6m21s
[23:19:38.995] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:28:0)
[23:19:39.016] Build status: STARTED
[23:19:39.016] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:29:0) after 8m46s
[23:28:25.285] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:29:0)
[23:28:25.321] Build status: STARTED
[23:28:25.321] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:30:0) after 1m20s
[23:29:45.312] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:30:0)
[23:29:45.331] Build status: STARTED
[23:29:45.331] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:31:0) after 4m17s
[23:34:02.872] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:31:0)
[23:34:02.894] Build status: STARTED
[23:34:02.894] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:32:0) after 5m49s
[23:39:52.121] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:32:0)
[23:39:52.149] Build status: STARTED
[23:39:52.149] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:33:0) after 4m22s
[23:44:14.669] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:33:0)
[23:44:14.722] Build status: STARTED
[23:44:14.722] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:34:0) after 4m31s
[23:48:45.745] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:34:0)
[23:48:45.766] Build status: STARTED
[23:48:45.766] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:35:0) after 8m51s
[23:57:36.791] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:35:0)
[23:57:36.810] Build status: STARTED
[23:57:36.810] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:36:0) after 6m58s
[00:04:35.074] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:36:0)
[00:04:35.094] Build status: STARTED
[00:04:35.094] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:37:0) after 4m10s
[00:08:45.441] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:37:0)
[00:08:45.462] Build status: STARTED
[00:08:45.462] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:38:0) after 2m56s
[00:11:41.515] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:38:0)
[00:11:41.537] Build status: STARTED
[00:11:41.538] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:39:0) after 3m58s
[00:15:39.564] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:39:0)
[00:15:39.585] Build status: STARTED
[00:15:39.585] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:40:0) after 1m59s
[00:17:38.622] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:40:0)
[00:17:38.801] Build status: STARTED
[00:17:38.801] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:41:0) after 1m5s
[00:18:43.787] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:41:0)
[00:18:43.804] Build status: STARTED
[00:18:43.804] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:42:0) after 8m39s
[00:27:22.929] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:42:0)
[00:27:22.945] Build status: STARTED
[00:27:22.945] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:43:0) after 6m19s
[00:33:41.973] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:43:0)
[00:33:42.059] Build status: STARTED
[00:33:42.059] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:44:0) after 1m52s
[00:35:34.486] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:44:0)
[00:35:34.507] Build status: STARTED
[00:35:34.507] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:45:0) after 8m33s
[00:44:07.675] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:45:0)
[00:44:07.694] Build status: STARTED
[00:44:07.694] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:46:0) after 9m48s
[00:53:55.720] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:46:0)
[00:53:55.745] Build status: STARTED
[00:53:55.745] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:47:0) after 6m51s
[01:00:46.776] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:47:0)
[01:00:46.795] Build status: STARTED
[01:00:46.795] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:48:0) after 1m19s
[01:02:05.883] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:48:0)
[01:02:05.964] Build status: STARTED
[01:02:05.965] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:49:0) after 7m17s
[01:09:23.105] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:49:0)
[01:09:23.129] Build status: STARTED
[01:09:23.129] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:50:0) after 7m13s
[01:16:36.137] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:50:0)
[01:16:36.217] Build status: STARTED
[01:16:36.217] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:51:0) after 4m18s
[01:20:54.505] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:51:0)
[01:20:54.521] Build status: STARTED
[01:20:54.521] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:52:0) after 3m40s
[01:24:34.555] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:52:0)
[01:24:34.600] Build status: STARTED
[01:24:34.600] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:53:0) after 4m19s
[01:28:53.794] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:53:0)
[01:28:53.833] Build status: STARTED
[01:28:53.833] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:54:0) after 5m9s
[01:34:02.990] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:54:0)
[01:34:03.015] Build status: STARTED
[01:34:03.015] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:55:0) after 4m22s
[01:38:25.151] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:55:0)
[01:38:25.171] Build status: STARTED
[01:38:25.171] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8928579324531597664:56:0) after 4m34s
[01:41:50.619] Received PubSub notification, asking Buildbucket for the build status
[01:41:50.639] Build:
{
"id": "8763149262457686433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"number": 26532,
"createdBy": "project:chromium",
"createTime": "2023-11-28T21:23:59.767917364Z",
"startTime": "2023-11-28T21:24:06.288765Z",
"endTime": "2023-11-29T01:41:49.599294Z",
"updateTime": "2023-11-29T01:41:49.599294Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd16eb1095afd2e9509085275543afe99c1beff6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:41:50.639] Invocation finished in 4h17m52.232787208s with status FAILED