[14:11:04.429] New invocation is queued and will start shortly
[14:11:05.494] Starting the invocation (attempt 1)
[14:11:05.519] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/62b1f157e468d1e22a2c6536966b147b603a7393"
[14:11:05.519] Popped gitiles commit info from properties and tags
[14:11:05.519] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:11:05.519] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:11:05.519] Buildbucket request:
{
"requestId": "8878325243879132832",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "62b1f157e468d1e22a2c6536966b147b603a7393",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8878325243879132832"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:11:06.247] Scheduled build:
{
"id": "8712895182020800113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 32693,
"createdBy": "project:chromium",
"createTime": "2025-06-05T14:11:05.575829240Z",
"updateTime": "2025-06-05T14:11:05.575829240Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "62b1f157e468d1e22a2c6536966b147b603a7393",
"ref": "refs/heads/main"
}
}
}
[14:11:06.247] Task URL: https://cr-buildbucket.appspot.com/build/8712895182020800113
[14:11:06.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:2:0) after 1m42s
[14:11:07.184] Received PubSub notification, asking Buildbucket for the build status
[14:11:07.204] Build status: SCHEDULED
[14:11:45.900] Received PubSub notification, asking Buildbucket for the build status
[14:11:45.925] Build status: STARTED
[14:12:48.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:2:0)
[14:12:48.302] Build status: STARTED
[14:12:48.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:5:0) after 4m30s
[14:17:18.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:5:0)
[14:17:18.352] Build status: STARTED
[14:17:18.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:6:0) after 6m30s
[14:23:48.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:6:0)
[14:23:48.479] Build status: STARTED
[14:23:48.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:7:0) after 9m37s
[14:33:25.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:7:0)
[14:33:25.603] Build status: STARTED
[14:33:25.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:8:0) after 3m39s
[14:37:04.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:8:0)
[14:37:04.719] Build status: STARTED
[14:37:04.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:9:0) after 8m2s
[14:45:06.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:9:0)
[14:45:06.816] Build status: STARTED
[14:45:06.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:10:0) after 6m25s
[14:51:31.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:10:0)
[14:51:31.851] Build status: STARTED
[14:51:31.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:11:0) after 3m38s
[14:55:09.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:11:0)
[14:55:09.944] Build status: STARTED
[14:55:09.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:12:0) after 1m1s
[14:56:10.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:12:0)
[14:56:11.021] Build status: STARTED
[14:56:11.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:13:0) after 4m25s
[15:00:36.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:13:0)
[15:00:36.223] Build status: STARTED
[15:00:36.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:14:0) after 3m1s
[15:03:37.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:14:0)
[15:03:37.281] Build status: STARTED
[15:03:37.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:15:0) after 3m12s
[15:06:49.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:15:0)
[15:06:49.334] Build status: STARTED
[15:06:49.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:16:0) after 1m23s
[15:08:12.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:16:0)
[15:08:12.374] Build status: STARTED
[15:08:12.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:17:0) after 2m33s
[15:10:45.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:17:0)
[15:10:45.427] Build status: STARTED
[15:10:45.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:18:0) after 4m21s
[15:15:06.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:18:0)
[15:15:06.474] Build status: STARTED
[15:15:06.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:19:0) after 7m46s
[15:22:52.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:19:0)
[15:22:52.630] Build status: STARTED
[15:22:52.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:20:0) after 4m8s
[15:27:00.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:20:0)
[15:27:00.624] Build status: STARTED
[15:27:00.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:21:0) after 5m50s
[15:32:50.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:21:0)
[15:32:50.663] Build status: STARTED
[15:32:50.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:22:0) after 7m23s
[15:40:13.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:22:0)
[15:40:13.760] Build status: STARTED
[15:40:13.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:23:0) after 3m11s
[15:43:24.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:23:0)
[15:43:24.835] Build status: STARTED
[15:43:24.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:24:0) after 7m52s
[15:51:16.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:24:0)
[15:51:17.086] Build status: STARTED
[15:51:17.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:25:0) after 2m49s
[15:54:06.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:25:0)
[15:54:06.130] Build status: STARTED
[15:54:06.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:26:0) after 8m0s
[16:02:06.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:26:0)
[16:02:06.130] Build status: STARTED
[16:02:06.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:27:0) after 2m20s
[16:04:26.150] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:27:0)
[16:04:26.171] Build status: STARTED
[16:04:26.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:28:0) after 5m55s
[16:10:21.163] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:28:0)
[16:10:21.186] Build status: STARTED
[16:10:21.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:29:0) after 3m18s
[16:13:39.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:29:0)
[16:13:39.234] Build status: STARTED
[16:13:39.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:30:0) after 6m29s
[16:20:08.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:30:0)
[16:20:08.417] Build status: STARTED
[16:20:08.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:31:0) after 2m45s
[16:22:53.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:31:0)
[16:22:53.505] Build status: STARTED
[16:22:53.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:32:0) after 1m39s
[16:24:32.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:32:0)
[16:24:32.542] Build status: STARTED
[16:24:32.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:33:0) after 9m27s
[16:33:59.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:33:0)
[16:33:59.732] Build status: STARTED
[16:33:59.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:34:0) after 5m3s
[16:39:02.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:34:0)
[16:39:02.794] Build status: STARTED
[16:39:02.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:35:0) after 3m27s
[16:42:29.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:35:0)
[16:42:29.838] Build status: STARTED
[16:42:29.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:36:0) after 3m53s
[16:46:22.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:36:0)
[16:46:22.937] Build status: STARTED
[16:46:22.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:37:0) after 7m13s
[16:53:36.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:37:0)
[16:53:36.083] Build status: STARTED
[16:53:36.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:38:0) after 3m45s
[16:57:21.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:38:0)
[16:57:21.133] Build status: STARTED
[16:57:21.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:39:0) after 9m51s
[17:07:12.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:39:0)
[17:07:12.138] Build status: STARTED
[17:07:12.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:40:0) after 1m58s
[17:09:10.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:40:0)
[17:09:10.229] Build status: STARTED
[17:09:10.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:41:0) after 7m47s
[17:16:57.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:41:0)
[17:16:57.279] Build status: STARTED
[17:16:57.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:42:0) after 7m1s
[17:23:58.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:42:0)
[17:23:58.422] Build status: STARTED
[17:23:58.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:43:0) after 4m55s
[17:28:53.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:43:0)
[17:28:53.516] Build status: STARTED
[17:28:53.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:44:0) after 4m46s
[17:33:39.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:44:0)
[17:33:39.555] Build status: STARTED
[17:33:39.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:45:0) after 2m29s
[17:36:08.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:45:0)
[17:36:08.609] Build status: STARTED
[17:36:08.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:46:0) after 2m55s
[17:39:03.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:46:0)
[17:39:03.657] Build status: STARTED
[17:39:03.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:47:0) after 2m1s
[17:41:04.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:47:0)
[17:41:04.750] Build status: STARTED
[17:41:04.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:48:0) after 4m11s
[17:45:15.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:48:0)
[17:45:15.791] Build status: STARTED
[17:45:15.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:49:0) after 5m49s
[17:51:04.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:49:0)
[17:51:04.872] Build status: STARTED
[17:51:04.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:50:0) after 5m38s
[17:56:43.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:50:0)
[17:56:43.060] Build status: STARTED
[17:56:43.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:51:0) after 4m10s
[18:00:53.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:51:0)
[18:00:53.167] Build status: STARTED
[18:00:53.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:52:0) after 7m57s
[18:08:50.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:52:0)
[18:08:50.259] Build status: STARTED
[18:08:50.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:53:0) after 1m0s
[18:09:50.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:53:0)
[18:09:50.323] Build status: STARTED
[18:09:50.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:54:0) after 3m58s
[18:13:48.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:54:0)
[18:13:48.368] Build status: STARTED
[18:13:48.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:55:0) after 5m59s
[18:19:47.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:55:0)
[18:19:47.458] Build status: STARTED
[18:19:47.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:56:0) after 5m46s
[18:25:33.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:56:0)
[18:25:33.473] Build status: STARTED
[18:25:33.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:57:0) after 3m34s
[18:29:07.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:57:0)
[18:29:07.736] Build status: STARTED
[18:29:07.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:58:0) after 4m45s
[18:33:52.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:58:0)
[18:33:52.943] Build status: STARTED
[18:33:52.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:59:0) after 6m47s
[18:40:39.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:59:0)
[18:40:40.015] Build status: STARTED
[18:40:40.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:60:0) after 2m59s
[18:43:39.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:60:0)
[18:43:39.123] Build status: STARTED
[18:43:39.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:61:0) after 1m12s
[18:44:51.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:61:0)
[18:44:51.409] Build status: STARTED
[18:44:51.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:62:0) after 4m4s
[18:48:55.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:62:0)
[18:48:55.468] Build status: STARTED
[18:48:55.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:63:0) after 7m54s
[18:56:49.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:63:0)
[18:56:49.621] Build status: STARTED
[18:56:49.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:64:0) after 9m18s
[19:06:07.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:64:0)
[19:06:07.669] Build status: STARTED
[19:06:07.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:65:0) after 6m58s
[19:13:05.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:65:0)
[19:13:05.798] Build status: STARTED
[19:13:05.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8878325243879132832:66:0) after 6m19s
[19:17:34.893] Received PubSub notification, asking Buildbucket for the build status
[19:17:34.912] Build:
{
"id": "8712895182020800113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 32693,
"createdBy": "project:chromium",
"createTime": "2025-06-05T14:11:05.575829240Z",
"startTime": "2025-06-05T14:11:45.710222526Z",
"endTime": "2025-06-05T19:17:33.641834731Z",
"updateTime": "2025-06-05T19:17:33.641834731Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "62b1f157e468d1e22a2c6536966b147b603a7393",
"ref": "refs/heads/main"
}
}
}
[19:17:34.912] Invocation finished in 5h6m30.492890535s with status FAILED