[11:41:36.202] New invocation is queued and will start shortly
[11:41:37.305] Starting the invocation (attempt 1)
[11:41:37.330] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7202d1aa65ec6593aa8c7a94be821a9861360df2"
[11:41:37.330] Popped gitiles commit info from properties and tags
[11:41:37.330] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:41:37.332] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:41:37.332] Buildbucket request:
{
"requestId": "8874620172119964112",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7202d1aa65ec6593aa8c7a94be821a9861360df2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874620172119964112"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:41:37.835] Scheduled build:
{
"id": "8709190110211358145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 33020,
"createdBy": "project:chromium",
"createTime": "2025-07-16T11:41:37.400185673Z",
"updateTime": "2025-07-16T11:41:37.400185673Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7202d1aa65ec6593aa8c7a94be821a9861360df2",
"ref": "refs/heads/main"
}
}
}
[11:41:37.835] Task URL: https://cr-buildbucket.appspot.com/build/8709190110211358145
[11:41:37.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:2:0) after 1m42s
[11:41:38.921] Received PubSub notification, asking Buildbucket for the build status
[11:41:38.953] Build status: SCHEDULED
[11:42:18.827] Received PubSub notification, asking Buildbucket for the build status
[11:42:18.848] Build status: STARTED
[11:43:19.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:2:0)
[11:43:19.889] Build status: STARTED
[11:43:19.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:5:0) after 6m25s
[11:49:45.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:5:0)
[11:49:45.211] Build status: STARTED
[11:49:45.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:6:0) after 4m58s
[11:54:43.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:6:0)
[11:54:43.296] Build status: STARTED
[11:54:43.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:7:0) after 3m44s
[11:58:27.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:7:0)
[11:58:27.640] Build status: STARTED
[11:58:27.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:8:0) after 3m46s
[12:02:13.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:8:0)
[12:02:13.696] Build status: STARTED
[12:02:13.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:9:0) after 6m12s
[12:08:25.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:9:0)
[12:08:25.851] Build status: STARTED
[12:08:25.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:10:0) after 1m35s
[12:10:00.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:10:0)
[12:10:00.939] Build status: STARTED
[12:10:00.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:11:0) after 5m39s
[12:15:39.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:11:0)
[12:15:39.985] Build status: STARTED
[12:15:39.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:12:0) after 4m49s
[12:20:29.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:12:0)
[12:20:29.161] Build status: STARTED
[12:20:29.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:13:0) after 5m58s
[12:26:27.220] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:13:0)
[12:26:27.236] Build status: STARTED
[12:26:27.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:14:0) after 4m55s
[12:31:22.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:14:0)
[12:31:22.622] Build status: STARTED
[12:31:22.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:15:0) after 6m6s
[12:37:28.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:15:0)
[12:37:28.766] Build status: STARTED
[12:37:28.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:16:0) after 2m10s
[12:39:39.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:16:0)
[12:39:39.102] Build status: STARTED
[12:39:39.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:17:0) after 1m3s
[12:40:42.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:17:0)
[12:40:42.362] Build status: STARTED
[12:40:42.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:18:0) after 6m55s
[12:47:37.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:18:0)
[12:47:37.734] Build status: STARTED
[12:47:37.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:19:0) after 6m5s
[12:53:42.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:19:0)
[12:53:42.828] Build status: STARTED
[12:53:42.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:20:0) after 3m14s
[12:56:56.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:20:0)
[12:56:56.888] Build status: STARTED
[12:56:56.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:21:0) after 1m26s
[12:58:23.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:21:0)
[12:58:23.156] Build status: STARTED
[12:58:23.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:22:0) after 3m42s
[13:02:05.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:22:0)
[13:02:05.222] Build status: STARTED
[13:02:05.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:23:0) after 4m39s
[13:06:44.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:23:0)
[13:06:44.264] Build status: STARTED
[13:06:44.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:24:0) after 5m24s
[13:12:08.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:24:0)
[13:12:08.352] Build status: STARTED
[13:12:08.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:25:0) after 2m17s
[13:14:25.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:25:0)
[13:14:25.417] Build status: STARTED
[13:14:25.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:26:0) after 2m47s
[13:17:12.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:26:0)
[13:17:12.573] Build status: STARTED
[13:17:12.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:27:0) after 3m24s
[13:20:36.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:27:0)
[13:20:36.630] Build status: STARTED
[13:20:36.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:28:0) after 2m12s
[13:22:48.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:28:0)
[13:22:48.686] Build status: STARTED
[13:22:48.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:29:0) after 6m57s
[13:29:45.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:29:0)
[13:29:45.734] Build status: STARTED
[13:29:45.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:30:0) after 2m26s
[13:32:11.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:30:0)
[13:32:11.815] Build status: STARTED
[13:32:11.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:31:0) after 3m35s
[13:35:46.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:31:0)
[13:35:46.919] Build status: STARTED
[13:35:46.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:32:0) after 3m5s
[13:38:51.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:32:0)
[13:38:51.911] Build status: STARTED
[13:38:51.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:33:0) after 4m16s
[13:43:07.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:33:0)
[13:43:07.941] Build status: STARTED
[13:43:07.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:34:0) after 5m22s
[13:48:30.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:34:0)
[13:48:30.036] Build status: STARTED
[13:48:30.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:35:0) after 9m35s
[13:58:05.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:35:0)
[13:58:05.084] Build status: STARTED
[13:58:05.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:36:0) after 1m14s
[13:59:19.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:36:0)
[13:59:19.329] Build status: STARTED
[13:59:19.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:37:0) after 5m7s
[14:04:26.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:37:0)
[14:04:26.395] Build status: STARTED
[14:04:26.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:38:0) after 3m23s
[14:07:49.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:38:0)
[14:07:49.467] Build status: STARTED
[14:07:49.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:39:0) after 8m10s
[14:15:59.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:39:0)
[14:15:59.547] Build status: STARTED
[14:15:59.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:40:0) after 7m22s
[14:23:21.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:40:0)
[14:23:21.632] Build status: STARTED
[14:23:21.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:41:0) after 5m45s
[14:29:06.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:41:0)
[14:29:06.715] Build status: STARTED
[14:29:06.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:42:0) after 3m38s
[14:32:44.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:42:0)
[14:32:44.775] Build status: STARTED
[14:32:44.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:43:0) after 9m6s
[14:41:50.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:43:0)
[14:41:50.835] Build status: STARTED
[14:41:50.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:44:0) after 6m57s
[14:48:47.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:44:0)
[14:48:47.981] Build status: STARTED
[14:48:47.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:45:0) after 7m21s
[14:56:09.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:45:0)
[14:56:09.287] Build status: STARTED
[14:56:09.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:46:0) after 1m13s
[14:57:22.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:46:0)
[14:57:22.449] Build status: STARTED
[14:57:22.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:47:0) after 4m12s
[15:01:34.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:47:0)
[15:01:34.563] Build status: STARTED
[15:01:34.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:48:0) after 7m2s
[15:08:36.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:48:0)
[15:08:36.625] Build status: STARTED
[15:08:36.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:49:0) after 3m38s
[15:12:14.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:49:0)
[15:12:14.736] Build status: STARTED
[15:12:14.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:50:0) after 6m2s
[15:18:16.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:50:0)
[15:18:16.841] Build status: STARTED
[15:18:16.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:51:0) after 4m16s
[15:22:32.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:51:0)
[15:22:32.936] Build status: STARTED
[15:22:32.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:52:0) after 3m10s
[15:25:42.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:52:0)
[15:25:42.975] Build status: STARTED
[15:25:42.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:53:0) after 7m57s
[15:33:39.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:53:0)
[15:33:40.174] Build status: STARTED
[15:33:40.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:54:0) after 2m28s
[15:36:08.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:54:0)
[15:36:08.348] Build status: STARTED
[15:36:08.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:55:0) after 2m2s
[15:38:10.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:55:0)
[15:38:10.402] Build status: STARTED
[15:38:10.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:56:0) after 3m19s
[15:41:29.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:56:0)
[15:41:29.500] Build status: STARTED
[15:41:29.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:57:0) after 6m20s
[15:47:49.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:57:0)
[15:47:49.570] Build status: STARTED
[15:47:49.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:58:0) after 8m29s
[15:56:18.603] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:58:0)
[15:56:18.629] Build status: STARTED
[15:56:18.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:59:0) after 3m30s
[15:59:48.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:59:0)
[15:59:48.693] Build status: STARTED
[15:59:48.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:60:0) after 6m58s
[16:06:46.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:60:0)
[16:06:46.794] Build status: STARTED
[16:06:46.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:61:0) after 8m50s
[16:15:36.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:61:0)
[16:15:36.870] Build status: STARTED
[16:15:36.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:62:0) after 7m47s
[16:23:23.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:62:0)
[16:23:23.925] Build status: STARTED
[16:23:23.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:63:0) after 7m7s
[16:30:30.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:63:0)
[16:30:30.972] Build status: STARTED
[16:30:30.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:64:0) after 9m34s
[16:40:05.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:64:0)
[16:40:05.080] Build status: STARTED
[16:40:05.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8874620172119964112:65:0) after 9m39s
[16:46:48.887] Received PubSub notification, asking Buildbucket for the build status
[16:46:48.955] Build:
{
"id": "8709190110211358145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 33020,
"createdBy": "project:chromium",
"createTime": "2025-07-16T11:41:37.400185673Z",
"startTime": "2025-07-16T11:42:18.257665785Z",
"endTime": "2025-07-16T16:46:32.915635552Z",
"updateTime": "2025-07-16T16:46:32.915635552Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7202d1aa65ec6593aa8c7a94be821a9861360df2",
"ref": "refs/heads/main"
}
}
}
[16:46:48.955] Invocation finished in 5h5m12.759272001s with status FAILED