[22:42:34.375] New invocation is queued and will start shortly
[22:42:35.597] Starting the invocation (attempt 1)
[22:42:35.628] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1e975179a0d16208575455831bfad2fb5f40b628"
[22:42:35.628] Popped gitiles commit info from properties and tags
[22:42:35.629] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:42:35.629] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:42:35.629] Buildbucket request:
{
"requestId": "8870048739202914160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e975179a0d16208575455831bfad2fb5f40b628",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8870048739202914160"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:42:36.129] Scheduled build:
{
"id": "8704618677149899361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 33698,
"createdBy": "project:chromium",
"createTime": "2025-09-04T22:42:35.699955434Z",
"updateTime": "2025-09-04T22:42:35.699955434Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e975179a0d16208575455831bfad2fb5f40b628",
"ref": "refs/heads/main"
}
}
}
[22:42:36.129] Task URL: https://cr-buildbucket.appspot.com/build/8704618677149899361
[22:42:36.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:2:0) after 3m47s
[22:42:36.978] Received PubSub notification, asking Buildbucket for the build status
[22:42:36.993] Build status: SCHEDULED
[22:43:50.043] Received PubSub notification, asking Buildbucket for the build status
[22:43:50.082] Build status: STARTED
[22:46:23.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:2:0)
[22:46:23.167] Build status: STARTED
[22:46:23.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:5:0) after 5m4s
[22:51:27.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:5:0)
[22:51:27.300] Build status: STARTED
[22:51:27.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:6:0) after 7m35s
[22:59:02.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:6:0)
[22:59:02.374] Build status: STARTED
[22:59:02.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:7:0) after 2m28s
[23:01:30.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:7:0)
[23:01:30.423] Build status: STARTED
[23:01:30.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:8:0) after 7m9s
[23:08:39.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:8:0)
[23:08:39.488] Build status: STARTED
[23:08:39.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:9:0) after 1m28s
[23:10:07.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:9:0)
[23:10:07.540] Build status: STARTED
[23:10:07.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:10:0) after 2m10s
[23:12:17.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:10:0)
[23:12:17.654] Build status: STARTED
[23:12:17.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:11:0) after 7m56s
[23:20:13.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:11:0)
[23:20:13.721] Build status: STARTED
[23:20:13.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:12:0) after 3m47s
[23:24:00.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:12:0)
[23:24:00.758] Build status: STARTED
[23:24:00.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:13:0) after 8m11s
[23:32:11.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:13:0)
[23:32:11.832] Build status: STARTED
[23:32:11.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:14:0) after 9m18s
[23:41:29.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:14:0)
[23:41:29.885] Build status: STARTED
[23:41:29.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:15:0) after 6m43s
[23:48:12.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:15:0)
[23:48:12.951] Build status: STARTED
[23:48:12.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:16:0) after 1m32s
[23:49:45.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:16:0)
[23:49:45.048] Build status: STARTED
[23:49:45.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:17:0) after 3m46s
[23:53:31.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:17:0)
[23:53:31.105] Build status: STARTED
[23:53:31.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:18:0) after 4m50s
[23:58:21.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:18:0)
[23:58:21.156] Build status: STARTED
[23:58:21.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:19:0) after 7m17s
[00:05:38.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:19:0)
[00:05:38.199] Build status: STARTED
[00:05:38.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:20:0) after 2m27s
[00:08:05.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:20:0)
[00:08:05.197] Build status: STARTED
[00:08:05.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:21:0) after 2m9s
[00:10:14.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:21:0)
[00:10:14.299] Build status: STARTED
[00:10:14.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:22:0) after 4m39s
[00:14:53.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:22:0)
[00:14:53.437] Build status: STARTED
[00:14:53.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:23:0) after 7m59s
[00:22:52.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:23:0)
[00:22:52.541] Build status: STARTED
[00:22:52.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:24:0) after 4m20s
[00:27:12.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:24:0)
[00:27:12.662] Build status: STARTED
[00:27:12.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:25:0) after 6m30s
[00:33:42.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:25:0)
[00:33:42.776] Build status: STARTED
[00:33:42.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:26:0) after 3m43s
[00:37:25.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:26:0)
[00:37:25.918] Build status: STARTED
[00:37:25.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:27:0) after 5m5s
[00:42:30.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:27:0)
[00:42:30.986] Build status: STARTED
[00:42:30.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:28:0) after 9m18s
[00:51:49.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:28:0)
[00:51:49.094] Build status: STARTED
[00:51:49.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:29:0) after 8m15s
[01:00:04.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:29:0)
[01:00:04.157] Build status: STARTED
[01:00:04.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:30:0) after 9m43s
[01:09:47.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:30:0)
[01:09:47.194] Build status: STARTED
[01:09:47.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:31:0) after 8m53s
[01:18:40.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:31:0)
[01:18:40.233] Build status: STARTED
[01:18:40.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:32:0) after 2m35s
[01:21:15.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:32:0)
[01:21:15.321] Build status: STARTED
[01:21:15.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:33:0) after 9m9s
[01:30:24.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:33:0)
[01:30:24.366] Build status: STARTED
[01:30:24.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:34:0) after 4m26s
[01:34:50.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:34:0)
[01:34:50.427] Build status: STARTED
[01:34:50.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:35:0) after 2m3s
[01:36:53.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:35:0)
[01:36:53.445] Build status: STARTED
[01:36:53.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:36:0) after 5m17s
[01:42:10.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:36:0)
[01:42:10.479] Build status: STARTED
[01:42:10.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:37:0) after 1m11s
[01:43:21.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:37:0)
[01:43:21.522] Build status: STARTED
[01:43:21.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:38:0) after 1m6s
[01:44:27.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:38:0)
[01:44:27.675] Build status: STARTED
[01:44:27.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:39:0) after 4m41s
[01:49:08.766] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:39:0)
[01:49:08.851] Build status: STARTED
[01:49:08.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:40:0) after 5m9s
[01:54:17.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:40:0)
[01:54:17.889] Build status: STARTED
[01:54:17.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:41:0) after 7m51s
[02:02:08.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:41:0)
[02:02:09.009] Build status: STARTED
[02:02:09.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:42:0) after 5m37s
[02:07:46.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:42:0)
[02:07:46.056] Build status: STARTED
[02:07:46.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:43:0) after 7m3s
[02:14:49.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:43:0)
[02:14:49.228] Build status: STARTED
[02:14:49.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:44:0) after 7m6s
[02:21:55.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:44:0)
[02:21:55.266] Build status: STARTED
[02:21:55.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:45:0) after 1m49s
[02:23:44.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:45:0)
[02:23:44.308] Build status: STARTED
[02:23:44.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:46:0) after 9m51s
[02:33:35.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:46:0)
[02:33:35.361] Build status: STARTED
[02:33:35.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:47:0) after 8m54s
[02:42:29.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:47:0)
[02:42:29.400] Build status: STARTED
[02:42:29.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:48:0) after 3m25s
[02:45:54.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:48:0)
[02:45:54.441] Build status: STARTED
[02:45:54.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:49:0) after 5m8s
[02:51:02.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:49:0)
[02:51:02.471] Build status: STARTED
[02:51:02.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:50:0) after 7m23s
[02:58:25.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:50:0)
[02:58:25.510] Build status: STARTED
[02:58:25.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:51:0) after 9m10s
[03:07:35.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:51:0)
[03:07:35.713] Build status: STARTED
[03:07:35.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:52:0) after 1m59s
[03:09:34.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:52:0)
[03:09:34.862] Build status: STARTED
[03:09:34.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:53:0) after 7m55s
[03:17:29.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:53:0)
[03:17:29.958] Build status: STARTED
[03:17:29.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:54:0) after 7m24s
[03:24:53.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:54:0)
[03:24:54.005] Build status: STARTED
[03:24:54.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:55:0) after 6m20s
[03:31:14.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:55:0)
[03:31:14.049] Build status: STARTED
[03:31:14.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:56:0) after 7m44s
[03:38:58.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:56:0)
[03:38:58.121] Build status: STARTED
[03:38:58.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:57:0) after 3m38s
[03:42:36.141] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:57:0)
[03:42:36.176] Build status: STARTED
[03:42:36.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8870048739202914160:58:0) after 9m23s
[03:44:31.679] Received PubSub notification, asking Buildbucket for the build status
[03:44:31.698] Build:
{
"id": "8704618677149899361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 33698,
"createdBy": "project:chromium",
"createTime": "2025-09-04T22:42:35.699955434Z",
"startTime": "2025-09-04T22:43:45.777607720Z",
"endTime": "2025-09-05T03:44:29.367667657Z",
"updateTime": "2025-09-05T03:44:29.367667657Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e975179a0d16208575455831bfad2fb5f40b628",
"ref": "refs/heads/main"
}
}
}
[03:44:31.698] Invocation finished in 5h1m57.339542586s with status FAILED