[23:20:22.587] New invocation is queued and will start shortly
[23:20:23.698] Starting the invocation (attempt 1)
[23:20:23.726] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e9ac3a3b8a709cc9befba78df22782f903207ed2"
[23:20:23.726] Popped gitiles commit info from properties and tags
[23:20:23.726] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:20:23.726] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:20:23.726] Buildbucket request:
{
"requestId": "8868506212376940224",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9ac3a3b8a709cc9befba78df22782f903207ed2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8868506212376940224"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTFuchsia x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:20:24.311] Scheduled build:
{
"id": "8703076150463419729",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 26576,
"createdBy": "project:chromium",
"createTime": "2025-09-21T23:20:23.783609257Z",
"updateTime": "2025-09-21T23:20:23.783609257Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9ac3a3b8a709cc9befba78df22782f903207ed2",
"ref": "refs/heads/main"
}
}
}
[23:20:24.311] Task URL: https://cr-buildbucket.appspot.com/build/8703076150463419729
[23:20:24.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:2:0) after 2m39s
[23:20:25.275] Received PubSub notification, asking Buildbucket for the build status
[23:20:25.303] Build status: SCHEDULED
[23:21:22.616] Received PubSub notification, asking Buildbucket for the build status
[23:21:22.647] Build status: STARTED
[23:23:03.477] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:2:0)
[23:23:03.504] Build status: STARTED
[23:23:03.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:5:0) after 4m36s
[23:27:39.520] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:5:0)
[23:27:39.558] Build status: STARTED
[23:27:39.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:6:0) after 2m9s
[23:29:48.643] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:6:0)
[23:29:48.677] Build status: STARTED
[23:29:48.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:7:0) after 4m29s
[23:34:17.692] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:7:0)
[23:34:17.716] Build status: STARTED
[23:34:17.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:8:0) after 8m34s
[23:42:51.733] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:8:0)
[23:42:51.754] Build status: STARTED
[23:42:51.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:9:0) after 6m10s
[23:49:01.897] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:9:0)
[23:49:01.913] Build status: STARTED
[23:49:01.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:10:0) after 6m10s
[23:55:11.936] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:10:0)
[23:55:11.960] Build status: STARTED
[23:55:11.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:11:0) after 7m50s
[00:03:02.114] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:11:0)
[00:03:02.147] Build status: STARTED
[00:03:02.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:12:0) after 4m59s
[00:08:01.163] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:12:0)
[00:08:01.188] Build status: STARTED
[00:08:01.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:13:0) after 5m44s
[00:13:45.204] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:13:0)
[00:13:45.229] Build status: STARTED
[00:13:45.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:14:0) after 5m2s
[00:18:47.280] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:14:0)
[00:18:47.295] Build status: STARTED
[00:18:47.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:15:0) after 1m13s
[00:20:00.310] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:15:0)
[00:20:00.329] Build status: STARTED
[00:20:00.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:16:0) after 9m53s
[00:29:54.321] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:16:0)
[00:29:54.351] Build status: STARTED
[00:29:54.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:17:0) after 5m56s
[00:35:50.473] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:17:0)
[00:35:50.488] Build status: STARTED
[00:35:50.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:18:0) after 9m20s
[00:45:10.505] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:18:0)
[00:45:10.526] Build status: STARTED
[00:45:10.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:19:0) after 5m27s
[00:50:37.702] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:19:0)
[00:50:37.719] Build status: STARTED
[00:50:37.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:20:0) after 4m53s
[00:55:30.784] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:20:0)
[00:55:30.806] Build status: STARTED
[00:55:30.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:21:0) after 7m21s
[01:02:51.824] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:21:0)
[01:02:51.850] Build status: STARTED
[01:02:51.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:22:0) after 9m50s
[01:12:41.866] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:22:0)
[01:12:41.883] Build status: STARTED
[01:12:41.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:23:0) after 1m48s
[01:14:29.979] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:23:0)
[01:14:30.013] Build status: STARTED
[01:14:30.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:24:0) after 5m27s
[01:19:57.031] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:24:0)
[01:19:57.051] Build status: STARTED
[01:19:57.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:25:0) after 2m30s
[01:22:27.389] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:25:0)
[01:22:27.426] Build status: STARTED
[01:22:27.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:26:0) after 8m44s
[01:31:11.952] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:26:0)
[01:31:11.968] Build status: STARTED
[01:31:11.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:27:0) after 4m45s
[01:35:57.070] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:27:0)
[01:35:57.091] Build status: STARTED
[01:35:57.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:28:0) after 2m55s
[01:38:52.106] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:28:0)
[01:38:52.123] Build status: STARTED
[01:38:52.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:29:0) after 8m41s
[01:47:33.174] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:29:0)
[01:47:33.188] Build status: STARTED
[01:47:33.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:30:0) after 5m45s
[01:53:18.205] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:30:0)
[01:53:18.297] Build status: STARTED
[01:53:18.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:31:0) after 6m1s
[01:59:19.320] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:31:0)
[01:59:19.340] Build status: STARTED
[01:59:19.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:32:0) after 6m36s
[02:05:55.309] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:32:0)
[02:05:55.336] Build status: STARTED
[02:05:55.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:33:0) after 1m24s
[02:07:19.402] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:33:0)
[02:07:19.420] Build status: STARTED
[02:07:19.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:34:0) after 7m2s
[02:14:21.535] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:34:0)
[02:14:21.553] Build status: STARTED
[02:14:21.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:35:0) after 5m9s
[02:19:30.592] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:35:0)
[02:19:30.612] Build status: STARTED
[02:19:30.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:36:0) after 8m31s
[02:28:01.731] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:36:0)
[02:28:01.762] Build status: STARTED
[02:28:01.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:37:0) after 6m7s
[02:34:08.803] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:37:0)
[02:34:08.822] Build status: STARTED
[02:34:08.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:38:0) after 1m40s
[02:35:48.810] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:38:0)
[02:35:48.837] Build status: STARTED
[02:35:48.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:39:0) after 3m44s
[02:39:32.899] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:39:0)
[02:39:32.916] Build status: STARTED
[02:39:32.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:40:0) after 1m48s
[02:41:20.998] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:40:0)
[02:41:21.013] Build status: STARTED
[02:41:21.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:41:0) after 6m34s
[02:47:55.029] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:41:0)
[02:47:55.052] Build status: STARTED
[02:47:55.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:42:0) after 1m5s
[02:49:00.171] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:42:0)
[02:49:00.185] Build status: STARTED
[02:49:00.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:43:0) after 4m49s
[02:53:49.199] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:43:0)
[02:53:49.215] Build status: STARTED
[02:53:49.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:44:0) after 9m32s
[03:03:21.343] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:44:0)
[03:03:21.362] Build status: STARTED
[03:03:21.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:45:0) after 8m47s
[03:12:08.685] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:45:0)
[03:12:08.707] Build status: STARTED
[03:12:08.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:46:0) after 3m58s
[03:16:06.904] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:46:0)
[03:16:06.951] Build status: STARTED
[03:16:06.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:47:0) after 3m33s
[03:19:40.061] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:47:0)
[03:19:40.075] Build status: STARTED
[03:19:40.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:48:0) after 9m59s
[03:29:39.249] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:48:0)
[03:29:39.263] Build status: STARTED
[03:29:39.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:49:0) after 6m28s
[03:36:07.560] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:49:0)
[03:36:07.577] Build status: STARTED
[03:36:07.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:50:0) after 7m41s
[03:43:48.596] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:50:0)
[03:43:48.616] Build status: STARTED
[03:43:48.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:51:0) after 3m31s
[03:47:19.632] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:51:0)
[03:47:19.690] Build status: STARTED
[03:47:19.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:52:0) after 5m32s
[03:52:51.719] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:52:0)
[03:52:51.744] Build status: STARTED
[03:52:51.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:53:0) after 5m37s
[03:58:28.764] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:53:0)
[03:58:28.784] Build status: STARTED
[03:58:28.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:54:0) after 2m48s
[04:01:16.801] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:54:0)
[04:01:16.818] Build status: STARTED
[04:01:16.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:55:0) after 4m45s
[04:06:01.884] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:55:0)
[04:06:01.926] Build status: STARTED
[04:06:01.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:56:0) after 3m21s
[04:09:22.944] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:56:0)
[04:09:22.964] Build status: STARTED
[04:09:22.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:57:0) after 4m1s
[04:13:24.025] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:57:0)
[04:13:24.051] Build status: STARTED
[04:13:24.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:58:0) after 6m53s
[04:20:17.073] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:58:0)
[04:20:17.090] Build status: STARTED
[04:20:17.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:59:0) after 9m36s
[04:29:53.284] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:59:0)
[04:29:53.324] Build status: STARTED
[04:29:53.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:60:0) after 7m42s
[04:37:35.427] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:60:0)
[04:37:35.446] Build status: STARTED
[04:37:35.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:61:0) after 5m9s
[04:42:44.459] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:61:0)
[04:42:44.477] Build status: STARTED
[04:42:44.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:62:0) after 3m19s
[04:46:03.559] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:62:0)
[04:46:03.579] Build status: STARTED
[04:46:03.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:63:0) after 5m48s
[04:51:51.595] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:63:0)
[04:51:51.622] Build status: STARTED
[04:51:51.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:64:0) after 9m20s
[05:01:11.640] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:64:0)
[05:01:11.657] Build status: STARTED
[05:01:11.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:65:0) after 8m46s
[05:09:57.822] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:65:0)
[05:09:57.838] Build status: STARTED
[05:09:57.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8868506212376940224:66:0) after 9m1s
[05:11:14.047] Received PubSub notification, asking Buildbucket for the build status
[05:11:14.113] Build:
{
"id": "8703076150463419729",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 26576,
"createdBy": "project:chromium",
"createTime": "2025-09-21T23:20:23.783609257Z",
"startTime": "2025-09-21T23:21:21.846998416Z",
"endTime": "2025-09-22T05:11:13.414591697Z",
"updateTime": "2025-09-22T05:11:13.414591697Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9ac3a3b8a709cc9befba78df22782f903207ed2",
"ref": "refs/heads/main"
}
}
}
[05:11:14.113] Invocation finished in 5h50m51.539415695s with status FAILED