[13:11:23.263] New invocation is queued and will start shortly
[13:11:24.381] Starting the invocation (attempt 1)
[13:11:24.417] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cd29afaa0c77ffe392e367e8164a3250f4072fa3"
[13:11:24.417] Popped gitiles commit info from properties and tags
[13:11:24.417] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:11:24.417] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:11:24.417] Buildbucket request:
{
"requestId": "8876879447534881776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cd29afaa0c77ffe392e367e8164a3250f4072fa3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876879447534881776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:11:25.039] Scheduled build:
{
"id": "8711449385622370561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 32841,
"createdBy": "project:chromium",
"createTime": "2025-06-21T13:11:24.466233459Z",
"updateTime": "2025-06-21T13:11:24.466233459Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cd29afaa0c77ffe392e367e8164a3250f4072fa3",
"ref": "refs/heads/main"
}
}
}
[13:11:25.039] Task URL: https://cr-buildbucket.appspot.com/build/8711449385622370561
[13:11:25.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:2:0) after 1m57s
[13:11:25.924] Received PubSub notification, asking Buildbucket for the build status
[13:11:25.948] Build status: SCHEDULED
[13:12:16.114] Received PubSub notification, asking Buildbucket for the build status
[13:12:16.136] Build status: STARTED
[13:13:22.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:2:0)
[13:13:22.112] Build status: STARTED
[13:13:22.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:5:0) after 2m54s
[13:16:16.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:5:0)
[13:16:16.164] Build status: STARTED
[13:16:16.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:6:0) after 4m36s
[13:20:52.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:6:0)
[13:20:52.248] Build status: STARTED
[13:20:52.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:7:0) after 6m55s
[13:27:47.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:7:0)
[13:27:47.259] Build status: STARTED
[13:27:47.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:8:0) after 8m37s
[13:36:24.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:8:0)
[13:36:24.506] Build status: STARTED
[13:36:24.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:9:0) after 1m56s
[13:38:20.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:9:0)
[13:38:20.637] Build status: STARTED
[13:38:20.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:10:0) after 9m12s
[13:47:32.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:10:0)
[13:47:32.774] Build status: STARTED
[13:47:32.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:11:0) after 7m40s
[13:55:13.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:11:0)
[13:55:13.118] Build status: STARTED
[13:55:13.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:12:0) after 2m11s
[13:57:24.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:12:0)
[13:57:24.145] Build status: STARTED
[13:57:24.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:13:0) after 4m7s
[14:01:31.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:13:0)
[14:01:31.733] Build status: STARTED
[14:01:31.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:14:0) after 4m39s
[14:06:10.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:14:0)
[14:06:10.926] Build status: STARTED
[14:06:10.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:15:0) after 7m16s
[14:13:26.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:15:0)
[14:13:26.995] Build status: STARTED
[14:13:26.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:16:0) after 4m33s
[14:18:00.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:16:0)
[14:18:00.045] Build status: STARTED
[14:18:00.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:17:0) after 5m22s
[14:23:22.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:17:0)
[14:23:22.197] Build status: STARTED
[14:23:22.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:18:0) after 7m7s
[14:30:29.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:18:0)
[14:30:29.937] Build status: STARTED
[14:30:29.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:19:0) after 7m55s
[14:38:24.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:19:0)
[14:38:24.973] Build status: STARTED
[14:38:24.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:20:0) after 7m10s
[14:45:34.994] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:20:0)
[14:45:35.010] Build status: STARTED
[14:45:35.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:21:0) after 8m24s
[14:53:59.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:21:0)
[14:53:59.188] Build status: STARTED
[14:53:59.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:22:0) after 3m28s
[14:57:27.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:22:0)
[14:57:27.251] Build status: STARTED
[14:57:27.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:23:0) after 6m46s
[15:04:13.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:23:0)
[15:04:13.441] Build status: STARTED
[15:04:13.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:24:0) after 5m37s
[15:09:50.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:24:0)
[15:09:50.479] Build status: STARTED
[15:09:50.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:25:0) after 9m59s
[15:19:49.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:25:0)
[15:19:49.610] Build status: STARTED
[15:19:49.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:26:0) after 2m15s
[15:22:04.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:26:0)
[15:22:04.691] Build status: STARTED
[15:22:04.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:27:0) after 5m11s
[15:27:15.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:27:0)
[15:27:15.747] Build status: STARTED
[15:27:15.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:28:0) after 9m42s
[15:36:57.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:28:0)
[15:36:57.893] Build status: STARTED
[15:36:57.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:29:0) after 4m42s
[15:41:40.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:29:0)
[15:41:40.084] Build status: STARTED
[15:41:40.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:30:0) after 6m58s
[15:48:38.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:30:0)
[15:48:38.321] Build status: STARTED
[15:48:38.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:31:0) after 2m51s
[15:51:29.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:31:0)
[15:51:29.468] Build status: STARTED
[15:51:29.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:32:0) after 1m39s
[15:53:08.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:32:0)
[15:53:08.510] Build status: STARTED
[15:53:08.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:33:0) after 8m2s
[16:01:10.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:33:0)
[16:01:10.665] Build status: STARTED
[16:01:10.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:34:0) after 9m55s
[16:11:05.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:34:0)
[16:11:05.849] Build status: STARTED
[16:11:05.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:35:0) after 6m52s
[16:17:58.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:35:0)
[16:17:58.177] Build status: STARTED
[16:17:58.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:36:0) after 9m47s
[16:27:45.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:36:0)
[16:27:45.299] Build status: STARTED
[16:27:45.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:37:0) after 4m13s
[16:31:58.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:37:0)
[16:31:58.581] Build status: STARTED
[16:31:58.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:38:0) after 5m0s
[16:36:58.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:38:0)
[16:36:58.624] Build status: STARTED
[16:36:58.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:39:0) after 7m7s
[16:44:05.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:39:0)
[16:44:05.749] Build status: STARTED
[16:44:05.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:40:0) after 3m16s
[16:47:21.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:40:0)
[16:47:21.789] Build status: STARTED
[16:47:21.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:41:0) after 8m39s
[16:56:00.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:41:0)
[16:56:00.848] Build status: STARTED
[16:56:00.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:42:0) after 2m49s
[16:58:49.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:42:0)
[16:58:49.892] Build status: STARTED
[16:58:49.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:43:0) after 2m42s
[17:01:32.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:43:0)
[17:01:32.038] Build status: STARTED
[17:01:32.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:44:0) after 9m35s
[17:11:07.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:44:0)
[17:11:07.219] Build status: STARTED
[17:11:07.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:45:0) after 4m47s
[17:15:54.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:45:0)
[17:15:54.270] Build status: STARTED
[17:15:54.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:46:0) after 8m39s
[17:24:33.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:46:0)
[17:24:33.414] Build status: STARTED
[17:24:33.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:47:0) after 1m0s
[17:25:33.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:47:0)
[17:25:33.476] Build status: STARTED
[17:25:33.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:48:0) after 7m47s
[17:33:20.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:48:0)
[17:33:20.476] Build status: STARTED
[17:33:20.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:49:0) after 9m23s
[17:42:43.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:49:0)
[17:42:43.579] Build status: STARTED
[17:42:43.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:50:0) after 7m23s
[17:50:06.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:50:0)
[17:50:06.954] Build status: STARTED
[17:50:06.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:51:0) after 2m58s
[17:53:05.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:51:0)
[17:53:05.071] Build status: STARTED
[17:53:05.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:52:0) after 5m34s
[17:58:39.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:52:0)
[17:58:39.286] Build status: STARTED
[17:58:39.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:53:0) after 5m3s
[18:03:42.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:53:0)
[18:03:42.369] Build status: STARTED
[18:03:42.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:54:0) after 9m36s
[18:13:18.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:54:0)
[18:13:18.417] Build status: STARTED
[18:13:18.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:55:0) after 7m41s
[18:20:59.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:55:0)
[18:20:59.420] Build status: STARTED
[18:20:59.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:56:0) after 3m37s
[18:24:36.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:56:0)
[18:24:36.775] Build status: STARTED
[18:24:36.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:57:0) after 6m21s
[18:30:57.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:57:0)
[18:30:57.815] Build status: STARTED
[18:30:57.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:58:0) after 1m52s
[18:32:49.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:58:0)
[18:32:49.863] Build status: STARTED
[18:32:49.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:59:0) after 7m26s
[18:40:15.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:59:0)
[18:40:15.905] Build status: STARTED
[18:40:15.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:60:0) after 8m6s
[18:48:22.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:60:0)
[18:48:22.020] Build status: STARTED
[18:48:22.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:61:0) after 4m14s
[18:52:36.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:61:0)
[18:52:36.101] Build status: STARTED
[18:52:36.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:62:0) after 3m5s
[18:55:41.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:62:0)
[18:55:41.241] Build status: STARTED
[18:55:41.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:63:0) after 8m20s
[19:04:01.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:63:0)
[19:04:01.267] Build status: STARTED
[19:04:01.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:64:0) after 5m28s
[19:09:29.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:64:0)
[19:09:29.400] Build status: STARTED
[19:09:29.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:65:0) after 3m21s
[19:12:50.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:65:0)
[19:12:50.561] Build status: STARTED
[19:12:50.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:66:0) after 5m57s
[19:18:47.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:66:0)
[19:18:47.689] Build status: STARTED
[19:18:47.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8876879447534881776:67:0) after 7m55s
[19:21:12.610] Received PubSub notification, asking Buildbucket for the build status
[19:21:12.699] Build:
{
"id": "8711449385622370561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 32841,
"createdBy": "project:chromium",
"createTime": "2025-06-21T13:11:24.466233459Z",
"startTime": "2025-06-21T13:12:15.817894631Z",
"endTime": "2025-06-21T19:21:12.307032311Z",
"updateTime": "2025-06-21T19:21:12.307032311Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cd29afaa0c77ffe392e367e8164a3250f4072fa3",
"ref": "refs/heads/main"
}
}
}
[19:21:12.699] Invocation finished in 6h9m49.440640169s with status FAILED