[01:59:44.186] New invocation is queued and will start shortly
[01:59:45.303] Starting the invocation (attempt 1)
[01:59:45.328] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/735aeb245ab9dfb1a393e4a56e57abb1e3305646"
[01:59:45.329] Popped gitiles commit info from properties and tags
[01:59:45.329] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:59:45.329] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:59:45.329] Buildbucket request:
{
"requestId": "8854000671680747760",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "735aeb245ab9dfb1a393e4a56e57abb1e3305646",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8854000671680747760"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux CFI"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:59:46.158] Scheduled build:
{
"id": "8688570609644729441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"number": 31529,
"createdBy": "project:chromium",
"createTime": "2026-03-01T01:59:45.507636494Z",
"updateTime": "2026-03-01T01:59:45.507636494Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "735aeb245ab9dfb1a393e4a56e57abb1e3305646",
"ref": "refs/heads/main"
}
}
}
[01:59:46.158] Task URL: https://cr-buildbucket.appspot.com/build/8688570609644729441
[01:59:46.158] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:2:0) after 6m47s
[01:59:46.985] Received PubSub notification, asking Buildbucket for the build status
[01:59:47.018] Build status: SCHEDULED
[02:00:48.965] Received PubSub notification, asking Buildbucket for the build status
[02:00:49.038] Build status: STARTED
[02:06:33.177] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:2:0)
[02:06:33.190] Build status: STARTED
[02:06:33.190] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:5:0) after 6m13s
[02:12:46.202] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:5:0)
[02:12:46.218] Build status: STARTED
[02:12:46.219] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:6:0) after 9m24s
[02:22:10.234] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:6:0)
[02:22:10.252] Build status: STARTED
[02:22:10.252] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:7:0) after 6m6s
[02:28:16.268] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:7:0)
[02:28:16.284] Build status: STARTED
[02:28:16.284] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:8:0) after 9m49s
[02:38:05.759] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:8:0)
[02:38:05.772] Build status: STARTED
[02:38:05.772] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:9:0) after 2m49s
[02:40:55.104] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:9:0)
[02:40:55.127] Build status: STARTED
[02:40:55.127] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:10:0) after 6m10s
[02:47:05.144] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:10:0)
[02:47:05.163] Build status: STARTED
[02:47:05.163] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:11:0) after 1m50s
[02:48:55.706] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:11:0)
[02:48:55.726] Build status: STARTED
[02:48:55.726] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:12:0) after 4m2s
[02:52:58.255] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:12:0)
[02:52:58.271] Build status: STARTED
[02:52:58.271] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:13:0) after 4m1s
[02:56:59.426] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:13:0)
[02:56:59.527] Build status: STARTED
[02:56:59.527] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:14:0) after 5m14s
[03:02:13.594] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:14:0)
[03:02:13.613] Build status: STARTED
[03:02:13.613] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:15:0) after 1m23s
[03:03:36.716] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:15:0)
[03:03:36.740] Build status: STARTED
[03:03:36.740] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:16:0) after 6m21s
[03:09:57.931] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:16:0)
[03:09:57.950] Build status: STARTED
[03:09:57.950] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:17:0) after 3m37s
[03:13:35.349] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:17:0)
[03:13:35.438] Build status: STARTED
[03:13:35.438] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:18:0) after 3m6s
[03:16:41.457] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:18:0)
[03:16:41.470] Build status: STARTED
[03:16:41.470] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:19:0) after 9m45s
[03:26:26.586] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:19:0)
[03:26:26.601] Build status: STARTED
[03:26:26.601] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:20:0) after 2m10s
[03:28:36.719] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:20:0)
[03:28:36.735] Build status: STARTED
[03:28:36.735] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:21:0) after 2m53s
[03:31:30.253] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:21:0)
[03:31:30.269] Build status: STARTED
[03:31:30.269] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:22:0) after 3m2s
[03:34:32.823] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:22:0)
[03:34:32.898] Build status: STARTED
[03:34:32.899] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:23:0) after 9m34s
[03:44:06.917] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:23:0)
[03:44:06.933] Build status: STARTED
[03:44:06.933] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:24:0) after 6m19s
[03:50:25.968] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:24:0)
[03:50:25.991] Build status: STARTED
[03:50:25.991] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:25:0) after 5m52s
[03:56:18.206] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:25:0)
[03:56:18.222] Build status: STARTED
[03:56:18.222] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:26:0) after 8m39s
[04:04:57.607] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:26:0)
[04:04:57.629] Build status: STARTED
[04:04:57.629] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:27:0) after 4m22s
[04:09:19.909] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:27:0)
[04:09:20.004] Build status: STARTED
[04:09:20.004] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:28:0) after 9m9s
[04:18:29.019] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:28:0)
[04:18:29.113] Build status: STARTED
[04:18:29.113] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:29:0) after 3m23s
[04:21:52.132] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:29:0)
[04:21:52.175] Build status: STARTED
[04:21:52.175] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:30:0) after 7m57s
[04:29:49.218] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:30:0)
[04:29:49.244] Build status: STARTED
[04:29:49.244] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:31:0) after 9m16s
[04:39:05.360] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:31:0)
[04:39:05.416] Build status: STARTED
[04:39:05.416] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:32:0) after 2m11s
[04:41:16.434] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:32:0)
[04:41:16.492] Build status: STARTED
[04:41:16.492] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:33:0) after 5m2s
[04:46:18.618] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:33:0)
[04:46:18.650] Build status: STARTED
[04:46:18.650] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:34:0) after 8m47s
[04:55:05.667] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:34:0)
[04:55:05.693] Build status: STARTED
[04:55:05.693] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:35:0) after 5m4s
[05:00:09.723] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:35:0)
[05:00:09.739] Build status: STARTED
[05:00:09.739] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:36:0) after 5m5s
[05:05:14.756] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:36:0)
[05:05:14.787] Build status: STARTED
[05:05:14.787] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:37:0) after 3m18s
[05:08:32.812] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:37:0)
[05:08:32.828] Build status: STARTED
[05:08:32.828] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:38:0) after 5m51s
[05:14:24.486] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:38:0)
[05:14:24.570] Build status: STARTED
[05:14:24.570] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:39:0) after 6m16s
[05:20:40.645] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:39:0)
[05:20:40.677] Build status: STARTED
[05:20:40.677] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:40:0) after 5m7s
[05:25:48.083] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:40:0)
[05:25:48.099] Build status: STARTED
[05:25:48.099] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:41:0) after 5m25s
[05:31:13.131] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:41:0)
[05:31:13.149] Build status: STARTED
[05:31:13.149] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:42:0) after 2m50s
[05:34:03.165] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:42:0)
[05:34:03.190] Build status: STARTED
[05:34:03.190] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:43:0) after 7m31s
[05:41:34.162] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:43:0)
[05:41:34.178] Build status: STARTED
[05:41:34.178] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:44:0) after 4m9s
[05:45:43.331] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:44:0)
[05:45:43.429] Build status: STARTED
[05:45:43.429] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:45:0) after 6m46s
[05:52:29.576] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:45:0)
[05:52:29.593] Build status: STARTED
[05:52:29.593] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:46:0) after 6m24s
[05:58:53.931] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:46:0)
[05:58:53.961] Build status: STARTED
[05:58:53.961] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:47:0) after 3m36s
[06:02:30.356] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:47:0)
[06:02:30.379] Build status: STARTED
[06:02:30.379] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:48:0) after 8m31s
[06:11:01.928] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:48:0)
[06:11:01.946] Build status: STARTED
[06:11:01.946] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:49:0) after 5m16s
[06:16:18.029] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:49:0)
[06:16:18.043] Build status: STARTED
[06:16:18.043] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:50:0) after 1m42s
[06:18:00.066] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:50:0)
[06:18:00.084] Build status: STARTED
[06:18:00.084] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:51:0) after 3m30s
[06:21:30.193] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:51:0)
[06:21:30.232] Build status: STARTED
[06:21:30.232] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:52:0) after 6m56s
[06:28:27.202] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:52:0)
[06:28:27.282] Build status: STARTED
[06:28:27.282] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:53:0) after 4m29s
[06:32:56.356] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:53:0)
[06:32:56.371] Build status: STARTED
[06:32:56.371] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:54:0) after 1m8s
[06:34:04.393] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:54:0)
[06:34:04.411] Build status: STARTED
[06:34:04.411] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:55:0) after 3m8s
[06:37:12.431] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:55:0)
[06:37:12.445] Build status: STARTED
[06:37:12.445] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:56:0) after 5m47s
[06:42:59.578] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:56:0)
[06:42:59.593] Build status: STARTED
[06:42:59.593] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:57:0) after 7m12s
[06:50:11.621] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:57:0)
[06:50:11.640] Build status: STARTED
[06:50:11.640] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:58:0) after 1m9s
[06:51:20.658] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:58:0)
[06:51:20.680] Build status: STARTED
[06:51:20.680] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:59:0) after 4m7s
[06:55:27.699] Handling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:59:0)
[06:55:27.729] Build status: STARTED
[06:55:27.729] Scheduling timer "check-buildbucket-build-status" (chromium/Linux CFI:8854000671680747760:60:0) after 8m4s
[07:03:02.705] Received PubSub notification, asking Buildbucket for the build status
[07:03:02.728] Build:
{
"id": "8688570609644729441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Linux CFI"
},
"number": 31529,
"createdBy": "project:chromium",
"createTime": "2026-03-01T01:59:45.507636494Z",
"startTime": "2026-03-01T02:00:48.804981224Z",
"endTime": "2026-03-01T07:02:58.906466006Z",
"updateTime": "2026-03-01T07:02:58.906466006Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "735aeb245ab9dfb1a393e4a56e57abb1e3305646",
"ref": "refs/heads/main"
}
}
}
[07:03:02.728] Invocation finished in 5h3m18.5468109s with status FAILED