[11:07:36.780] New invocation is queued and will start shortly
[11:07:37.877] Starting the invocation (attempt 1)
[11:07:37.904] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0b0a2ed23b4cdd0a1e6af4dfd1b41d8e7dc56046"
[11:07:37.904] Popped gitiles commit info from properties and tags
[11:07:37.904] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:07:37.905] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:07:37.905] Buildbucket request:
{
"requestId": "8870183059261513728",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b0a2ed23b4cdd0a1e6af4dfd1b41d8e7dc56046",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8870183059261513728"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:07:38.463] Scheduled build:
{
"id": "8704752997367907281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 33691,
"createdBy": "project:chromium",
"createTime": "2025-09-03T11:07:37.957178751Z",
"updateTime": "2025-09-03T11:07:37.957178751Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b0a2ed23b4cdd0a1e6af4dfd1b41d8e7dc56046",
"ref": "refs/heads/main"
}
}
}
[11:07:38.463] Task URL: https://cr-buildbucket.appspot.com/build/8704752997367907281
[11:07:38.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:2:0) after 5m6s
[11:07:40.382] Received PubSub notification, asking Buildbucket for the build status
[11:07:40.404] Build status: SCHEDULED
[11:08:44.609] Received PubSub notification, asking Buildbucket for the build status
[11:08:44.634] Build status: STARTED
[11:12:44.557] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:2:0)
[11:12:44.609] Build status: STARTED
[11:12:44.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:5:0) after 5m53s
[11:18:37.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:5:0)
[11:18:37.815] Build status: STARTED
[11:18:37.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:6:0) after 5m19s
[11:23:56.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:6:0)
[11:23:56.927] Build status: STARTED
[11:23:56.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:7:0) after 6m43s
[11:30:39.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:7:0)
[11:30:39.969] Build status: STARTED
[11:30:39.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:8:0) after 3m45s
[11:34:25.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:8:0)
[11:34:25.086] Build status: STARTED
[11:34:25.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:9:0) after 9m32s
[11:43:57.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:9:0)
[11:43:57.243] Build status: STARTED
[11:43:57.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:10:0) after 3m49s
[11:47:46.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:10:0)
[11:47:46.280] Build status: STARTED
[11:47:46.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:11:0) after 7m8s
[11:54:54.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:11:0)
[11:54:54.318] Build status: STARTED
[11:54:54.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:12:0) after 1m3s
[11:55:57.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:12:0)
[11:55:57.363] Build status: STARTED
[11:55:57.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:13:0) after 6m49s
[12:02:46.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:13:0)
[12:02:46.404] Build status: STARTED
[12:02:46.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:14:0) after 6m18s
[12:09:04.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:14:0)
[12:09:04.441] Build status: STARTED
[12:09:04.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:15:0) after 2m33s
[12:11:37.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:15:0)
[12:11:37.630] Build status: STARTED
[12:11:37.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:16:0) after 4m27s
[12:16:04.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:16:0)
[12:16:04.714] Build status: STARTED
[12:16:04.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:17:0) after 4m10s
[12:20:14.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:17:0)
[12:20:14.758] Build status: STARTED
[12:20:14.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:18:0) after 5m58s
[12:26:12.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:18:0)
[12:26:12.783] Build status: STARTED
[12:26:12.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:19:0) after 7m55s
[12:34:07.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:19:0)
[12:34:07.838] Build status: STARTED
[12:34:07.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:20:0) after 1m48s
[12:35:55.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:20:0)
[12:35:55.925] Build status: STARTED
[12:35:55.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:21:0) after 4m56s
[12:40:51.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:21:0)
[12:40:51.950] Build status: STARTED
[12:40:51.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:22:0) after 7m27s
[12:48:18.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:22:0)
[12:48:18.986] Build status: STARTED
[12:48:18.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:23:0) after 6m46s
[12:55:05.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:23:0)
[12:55:05.074] Build status: STARTED
[12:55:05.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:24:0) after 2m2s
[12:57:07.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:24:0)
[12:57:07.160] Build status: STARTED
[12:57:07.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:25:0) after 4m19s
[13:01:26.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:25:0)
[13:01:26.341] Build status: STARTED
[13:01:26.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:26:0) after 5m23s
[13:06:49.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:26:0)
[13:06:49.455] Build status: STARTED
[13:06:49.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:27:0) after 2m9s
[13:08:58.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:27:0)
[13:08:58.494] Build status: STARTED
[13:08:58.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:28:0) after 4m9s
[13:13:07.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:28:0)
[13:13:07.599] Build status: STARTED
[13:13:07.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:29:0) after 2m20s
[13:15:27.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:29:0)
[13:15:27.686] Build status: STARTED
[13:15:27.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:30:0) after 9m33s
[13:25:00.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:30:0)
[13:25:00.776] Build status: STARTED
[13:25:00.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:31:0) after 4m20s
[13:29:20.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:31:0)
[13:29:20.963] Build status: STARTED
[13:29:20.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:32:0) after 3m47s
[13:33:07.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:32:0)
[13:33:08.004] Build status: STARTED
[13:33:08.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:33:0) after 7m19s
[13:40:27.021] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:33:0)
[13:40:27.037] Build status: STARTED
[13:40:27.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:34:0) after 3m6s
[13:43:33.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:34:0)
[13:43:33.315] Build status: STARTED
[13:43:33.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:35:0) after 2m57s
[13:46:30.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:35:0)
[13:46:30.359] Build status: STARTED
[13:46:30.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:36:0) after 7m33s
[13:54:03.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:36:0)
[13:54:03.418] Build status: STARTED
[13:54:03.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:37:0) after 1m38s
[13:55:41.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:37:0)
[13:55:41.543] Build status: STARTED
[13:55:41.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:38:0) after 3m19s
[13:59:00.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:38:0)
[13:59:00.594] Build status: STARTED
[13:59:00.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:39:0) after 6m45s
[14:05:45.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:39:0)
[14:05:45.640] Build status: STARTED
[14:05:45.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:40:0) after 6m45s
[14:12:30.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:40:0)
[14:12:30.784] Build status: STARTED
[14:12:30.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:41:0) after 8m36s
[14:21:06.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:41:0)
[14:21:06.823] Build status: STARTED
[14:21:06.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:42:0) after 6m2s
[14:27:08.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:42:0)
[14:27:08.905] Build status: STARTED
[14:27:08.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:43:0) after 9m4s
[14:36:12.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:43:0)
[14:36:12.907] Build status: STARTED
[14:36:12.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:44:0) after 3m9s
[14:39:21.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:44:0)
[14:39:21.992] Build status: STARTED
[14:39:21.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:45:0) after 3m21s
[14:42:43.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:45:0)
[14:42:43.182] Build status: STARTED
[14:42:43.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:46:0) after 5m10s
[14:47:53.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:46:0)
[14:47:53.223] Build status: STARTED
[14:47:53.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:47:0) after 8m5s
[14:55:58.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:47:0)
[14:55:58.364] Build status: STARTED
[14:55:58.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:48:0) after 2m28s
[14:58:26.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:48:0)
[14:58:26.393] Build status: STARTED
[14:58:26.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:49:0) after 2m55s
[15:01:21.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:49:0)
[15:01:21.445] Build status: STARTED
[15:01:21.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:50:0) after 7m48s
[15:09:09.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:50:0)
[15:09:09.553] Build status: STARTED
[15:09:09.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:51:0) after 4m30s
[15:13:39.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:51:0)
[15:13:39.607] Build status: STARTED
[15:13:39.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:52:0) after 6m30s
[15:20:09.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:52:0)
[15:20:09.645] Build status: STARTED
[15:20:09.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:53:0) after 8m20s
[15:28:29.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:53:0)
[15:28:29.718] Build status: STARTED
[15:28:29.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:54:0) after 7m58s
[15:36:27.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:54:0)
[15:36:27.809] Build status: STARTED
[15:36:27.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:55:0) after 6m19s
[15:42:46.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:55:0)
[15:42:46.927] Build status: STARTED
[15:42:46.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:56:0) after 6m52s
[15:49:38.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:56:0)
[15:49:39.005] Build status: STARTED
[15:49:39.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:57:0) after 5m20s
[15:54:59.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:57:0)
[15:54:59.219] Build status: STARTED
[15:54:59.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:58:0) after 7m32s
[16:02:31.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:58:0)
[16:02:31.274] Build status: STARTED
[16:02:31.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:59:0) after 8m34s
[16:11:05.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:59:0)
[16:11:05.389] Build status: STARTED
[16:11:05.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870183059261513728:60:0) after 6m6s
[16:11:17.923] Received PubSub notification, asking Buildbucket for the build status
[16:11:17.952] Build:
{
"id": "8704752997367907281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 33691,
"createdBy": "project:chromium",
"createTime": "2025-09-03T11:07:37.957178751Z",
"startTime": "2025-09-03T11:08:44.221073586Z",
"endTime": "2025-09-03T16:11:17.359337753Z",
"updateTime": "2025-09-03T16:11:17.359337753Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b0a2ed23b4cdd0a1e6af4dfd1b41d8e7dc56046",
"ref": "refs/heads/main"
}
}
}
[16:11:17.952] Invocation finished in 5h3m41.18426377s with status FAILED