[10:36:44.781] New invocation is queued and will start shortly
[10:36:45.817] Starting the invocation (attempt 1)
[10:36:45.849] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fccdf781d05185ecde512a3595847eb1e094439f"
[10:36:45.849] Popped gitiles commit info from properties and tags
[10:36:45.849] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:36:45.849] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:36:45.849] Buildbucket request:
{
"requestId": "8884227531017745584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fccdf781d05185ecde512a3595847eb1e094439f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8884227531017745584"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux CFI"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:36:46.381] Scheduled build:
{
"id": "8718797469176224001",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"number": 29458,
"createdBy": "project:chromium",
"createTime": "2025-04-01T10:36:45.906435055Z",
"updateTime": "2025-04-01T10:36:45.906435055Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fccdf781d05185ecde512a3595847eb1e094439f",
"ref": "refs/heads/main"
}
}
}
[10:36:46.381] Task URL: https://cr-buildbucket.appspot.com/build/8718797469176224001
[10:36:46.381] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:2:0) after 7m50s
[10:36:47.396] Received PubSub notification, asking Buildbucket for the build status
[10:36:47.419] Build status: SCHEDULED
[10:37:56.535] Received PubSub notification, asking Buildbucket for the build status
[10:37:56.559] Build status: STARTED
[10:44:36.463] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:2:0)
[10:44:36.484] Build status: STARTED
[10:44:36.484] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:5:0) after 1m29s
[10:46:05.518] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:5:0)
[10:46:05.539] Build status: STARTED
[10:46:05.539] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:6:0) after 8m27s
[10:54:32.560] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:6:0)
[10:54:32.584] Build status: STARTED
[10:54:32.584] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:7:0) after 4m10s
[10:58:42.603] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:7:0)
[10:58:42.619] Build status: STARTED
[10:58:42.619] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:8:0) after 4m8s
[11:02:50.656] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:8:0)
[11:02:50.680] Build status: STARTED
[11:02:50.680] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:9:0) after 4m15s
[11:07:05.682] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:9:0)
[11:07:05.697] Build status: STARTED
[11:07:05.697] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:10:0) after 1m3s
[11:08:08.722] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:10:0)
[11:08:08.741] Build status: STARTED
[11:08:08.741] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:11:0) after 2m45s
[11:10:53.812] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:11:0)
[11:10:53.834] Build status: STARTED
[11:10:53.834] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:12:0) after 4m51s
[11:15:44.855] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:12:0)
[11:15:44.871] Build status: STARTED
[11:15:44.871] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:13:0) after 3m26s
[11:19:10.895] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:13:0)
[11:19:10.916] Build status: STARTED
[11:19:10.916] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:14:0) after 3m6s
[11:22:16.938] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:14:0)
[11:22:16.956] Build status: STARTED
[11:22:16.956] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:15:0) after 3m4s
[11:25:21.028] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:15:0)
[11:25:21.045] Build status: STARTED
[11:25:21.045] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:16:0) after 1m5s
[11:26:26.449] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:16:0)
[11:26:26.502] Build status: STARTED
[11:26:26.502] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:17:0) after 3m55s
[11:30:21.524] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:17:0)
[11:30:21.539] Build status: STARTED
[11:30:21.539] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:18:0) after 4m9s
[11:34:30.552] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:18:0)
[11:34:30.723] Build status: STARTED
[11:34:30.723] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:19:0) after 5m59s
[11:40:29.767] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:19:0)
[11:40:29.793] Build status: STARTED
[11:40:29.793] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:20:0) after 4m4s
[11:44:33.842] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:20:0)
[11:44:33.867] Build status: STARTED
[11:44:33.867] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:21:0) after 3m33s
[11:48:06.905] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:21:0)
[11:48:06.921] Build status: STARTED
[11:48:06.921] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:22:0) after 4m10s
[11:52:16.997] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:22:0)
[11:52:17.064] Build status: STARTED
[11:52:17.064] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:23:0) after 6m17s
[11:58:34.100] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:23:0)
[11:58:34.117] Build status: STARTED
[11:58:34.117] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:24:0) after 2m2s
[12:00:36.155] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:24:0)
[12:00:36.173] Build status: STARTED
[12:00:36.173] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:25:0) after 1m23s
[12:01:59.216] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:25:0)
[12:01:59.422] Build status: STARTED
[12:01:59.422] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:26:0) after 7m38s
[12:09:37.448] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:26:0)
[12:09:37.513] Build status: STARTED
[12:09:37.513] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:27:0) after 3m42s
[12:13:19.519] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:27:0)
[12:13:19.550] Build status: STARTED
[12:13:19.550] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:28:0) after 6m32s
[12:19:51.603] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:28:0)
[12:19:51.627] Build status: STARTED
[12:19:51.627] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:29:0) after 1m23s
[12:21:14.652] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:29:0)
[12:21:14.686] Build status: STARTED
[12:21:14.686] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:30:0) after 3m2s
[12:24:16.719] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:30:0)
[12:24:16.779] Build status: STARTED
[12:24:16.779] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:31:0) after 9m55s
[12:34:11.857] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:31:0)
[12:34:11.878] Build status: STARTED
[12:34:11.878] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:32:0) after 6m36s
[12:40:48.001] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:32:0)
[12:40:48.028] Build status: STARTED
[12:40:48.028] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:33:0) after 2m38s
[12:43:26.144] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:33:0)
[12:43:26.161] Build status: STARTED
[12:43:26.161] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:34:0) after 4m51s
[12:48:17.226] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:34:0)
[12:48:17.259] Build status: STARTED
[12:48:17.259] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:35:0) after 5m57s
[12:54:14.386] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:35:0)
[12:54:14.403] Build status: STARTED
[12:54:14.403] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:36:0) after 2m20s
[12:56:34.428] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:36:0)
[12:56:34.446] Build status: STARTED
[12:56:34.446] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:37:0) after 4m17s
[13:00:51.466] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:37:0)
[13:00:51.482] Build status: STARTED
[13:00:51.482] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:38:0) after 4m2s
[13:04:53.502] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:38:0)
[13:04:53.524] Build status: STARTED
[13:04:53.524] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:39:0) after 4m4s
[13:08:57.556] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:39:0)
[13:08:57.568] Build status: STARTED
[13:08:57.568] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:40:0) after 8m59s
[13:17:56.628] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:40:0)
[13:17:56.685] Build status: STARTED
[13:17:56.685] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:41:0) after 2m14s
[13:20:10.734] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:41:0)
[13:20:10.746] Build status: STARTED
[13:20:10.746] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:42:0) after 6m59s
[13:27:09.765] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:42:0)
[13:27:09.783] Build status: STARTED
[13:27:09.783] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:43:0) after 3m1s
[13:30:10.816] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:43:0)
[13:30:10.836] Build status: STARTED
[13:30:10.836] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:44:0) after 2m23s
[13:32:33.887] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:44:0)
[13:32:33.903] Build status: STARTED
[13:32:33.903] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:45:0) after 7m57s
[13:40:30.997] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:45:0)
[13:40:31.024] Build status: STARTED
[13:40:31.024] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:46:0) after 4m42s
[13:45:13.097] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:46:0)
[13:45:13.114] Build status: STARTED
[13:45:13.114] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:47:0) after 1m55s
[13:47:08.138] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:47:0)
[13:47:08.153] Build status: STARTED
[13:47:08.153] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:48:0) after 1m49s
[13:48:57.179] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:48:0)
[13:48:57.192] Build status: STARTED
[13:48:57.192] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:49:0) after 1m29s
[13:50:26.209] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:49:0)
[13:50:26.229] Build status: STARTED
[13:50:26.229] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:50:0) after 4m39s
[13:55:05.225] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:50:0)
[13:55:05.241] Build status: STARTED
[13:55:05.241] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:51:0) after 8m30s
[14:03:35.267] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:51:0)
[14:03:35.295] Build status: STARTED
[14:03:35.295] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:52:0) after 8m42s
[14:12:17.343] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:52:0)
[14:12:17.359] Build status: STARTED
[14:12:17.360] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:53:0) after 9m29s
[14:21:46.592] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:53:0)
[14:21:46.631] Build status: STARTED
[14:21:46.631] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:54:0) after 3m21s
[14:25:07.710] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:54:0)
[14:25:07.733] Build status: STARTED
[14:25:07.733] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:55:0) after 2m33s
[14:27:40.758] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:55:0)
[14:27:40.779] Build status: STARTED
[14:27:40.779] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:56:0) after 7m39s
[14:35:19.820] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:56:0)
[14:35:19.837] Build status: STARTED
[14:35:19.837] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:57:0) after 2m2s
[14:37:21.855] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:57:0)
[14:37:21.871] Build status: STARTED
[14:37:21.871] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:58:0) after 9m6s
[14:46:27.906] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:58:0)
[14:46:27.925] Build status: STARTED
[14:46:27.925] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:59:0) after 5m47s
[14:52:14.994] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:59:0)
[14:52:15.009] Build status: STARTED
[14:52:15.009] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:60:0) after 9m55s
[15:02:10.087] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:60:0)
[15:02:10.115] Build status: STARTED
[15:02:10.115] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:61:0) after 4m27s
[15:06:37.138] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:61:0)
[15:06:37.162] Build status: STARTED
[15:06:37.162] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:62:0) after 7m55s
[15:14:32.277] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:62:0)
[15:14:32.291] Build status: STARTED
[15:14:32.291] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:63:0) after 2m9s
[15:16:41.323] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:63:0)
[15:16:41.339] Build status: STARTED
[15:16:41.339] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:64:0) after 3m39s
[15:20:20.390] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:64:0)
[15:20:20.406] Build status: STARTED
[15:20:20.406] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:65:0) after 9m1s
[15:29:21.428] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:65:0)
[15:29:21.443] Build status: STARTED
[15:29:21.443] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:66:0) after 9m25s
[15:38:46.476] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:66:0)
[15:38:46.505] Build status: STARTED
[15:38:46.505] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8884227531017745584:67:0) after 9m2s
[15:39:41.993] Received PubSub notification, asking Buildbucket for the build status
[15:39:42.007] Build:
{
"id": "8718797469176224001",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"number": 29458,
"createdBy": "project:chromium",
"createTime": "2025-04-01T10:36:45.906435055Z",
"startTime": "2025-04-01T10:37:56.356503593Z",
"endTime": "2025-04-01T15:39:41.671764145Z",
"updateTime": "2025-04-01T15:39:41.671764145Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fccdf781d05185ecde512a3595847eb1e094439f",
"ref": "refs/heads/main"
}
}
}
[15:39:42.007] Invocation finished in 5h2m57.240304502s with status FAILED