[02:24:59.330] New invocation is queued and will start shortly
[02:25:00.389] Starting the invocation (attempt 1)
[02:25:00.412] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/44682f87f23386fdf6c177a934bf3da915b6e0d8"
[02:25:00.412] Popped gitiles commit info from properties and tags
[02:25:00.412] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:25:00.412] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:25:00.412] Buildbucket request:
{
"requestId": "8848744458885241456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "44682f87f23386fdf6c177a934bf3da915b6e0d8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848744458885241456"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:25:00.894] Scheduled build:
{
"id": "8683314397047380609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41417,
"createdBy": "project:chromium",
"createTime": "2026-04-28T02:25:00.463958032Z",
"updateTime": "2026-04-28T02:25:00.463958032Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "44682f87f23386fdf6c177a934bf3da915b6e0d8",
"ref": "refs/heads/main"
}
}
}
[02:25:00.894] Task URL: https://cr-buildbucket.appspot.com/build/8683314397047380609
[02:25:00.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:2:0) after 2m0s
[02:25:01.194] Received PubSub notification, asking Buildbucket for the build status
[02:25:01.209] Build status: SCHEDULED
[02:25:05.413] Received PubSub notification, asking Buildbucket for the build status
[02:25:05.433] Build status: STARTED
[02:27:00.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:2:0)
[02:27:00.918] Build status: STARTED
[02:27:00.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:5:0) after 3m4s
[02:30:04.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:5:0)
[02:30:04.946] Build status: STARTED
[02:30:04.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:6:0) after 2m30s
[02:32:34.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:6:0)
[02:32:34.935] Build status: STARTED
[02:32:34.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:7:0) after 7m21s
[02:39:55.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:7:0)
[02:39:56.027] Build status: STARTED
[02:39:56.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:8:0) after 7m40s
[02:47:36.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:8:0)
[02:47:36.064] Build status: STARTED
[02:47:36.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:9:0) after 9m51s
[02:57:27.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:9:0)
[02:57:27.111] Build status: STARTED
[02:57:27.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:10:0) after 3m20s
[03:00:47.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:10:0)
[03:00:47.207] Build status: STARTED
[03:00:47.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:11:0) after 6m51s
[03:07:38.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:11:0)
[03:07:38.239] Build status: STARTED
[03:07:38.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:12:0) after 3m59s
[03:11:37.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:12:0)
[03:11:37.264] Build status: STARTED
[03:11:37.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:13:0) after 8m26s
[03:20:03.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:13:0)
[03:20:03.344] Build status: STARTED
[03:20:03.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:14:0) after 4m0s
[03:24:03.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:14:0)
[03:24:03.375] Build status: STARTED
[03:24:03.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:15:0) after 9m42s
[03:33:45.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:15:0)
[03:33:45.408] Build status: STARTED
[03:33:45.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:16:0) after 6m16s
[03:40:01.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:16:0)
[03:40:01.491] Build status: STARTED
[03:40:01.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:17:0) after 1m58s
[03:41:59.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:17:0)
[03:41:59.553] Build status: STARTED
[03:41:59.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:18:0) after 1m26s
[03:43:25.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:18:0)
[03:43:25.608] Build status: STARTED
[03:43:25.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:19:0) after 2m13s
[03:45:38.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:19:0)
[03:45:38.664] Build status: STARTED
[03:45:38.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:20:0) after 2m30s
[03:48:08.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:20:0)
[03:48:08.751] Build status: STARTED
[03:48:08.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:21:0) after 5m45s
[03:53:53.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:21:0)
[03:53:53.732] Build status: STARTED
[03:53:53.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:22:0) after 2m56s
[03:56:49.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:22:0)
[03:56:49.770] Build status: STARTED
[03:56:49.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:23:0) after 9m32s
[04:06:21.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:23:0)
[04:06:21.953] Build status: STARTED
[04:06:21.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:24:0) after 4m23s
[04:10:44.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:24:0)
[04:10:44.987] Build status: STARTED
[04:10:44.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:25:0) after 9m45s
[04:20:30.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:25:0)
[04:20:30.020] Build status: STARTED
[04:20:30.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:26:0) after 7m16s
[04:27:46.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:26:0)
[04:27:46.115] Build status: STARTED
[04:27:46.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:27:0) after 3m7s
[04:30:53.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:27:0)
[04:30:53.229] Build status: STARTED
[04:30:53.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:28:0) after 6m54s
[04:37:47.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:28:0)
[04:37:47.332] Build status: STARTED
[04:37:47.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:29:0) after 2m58s
[04:40:45.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:29:0)
[04:40:45.396] Build status: STARTED
[04:40:45.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:30:0) after 5m47s
[04:46:32.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:30:0)
[04:46:32.433] Build status: STARTED
[04:46:32.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:31:0) after 7m37s
[04:54:09.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:31:0)
[04:54:09.464] Build status: STARTED
[04:54:09.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:32:0) after 3m57s
[04:58:06.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:32:0)
[04:58:06.653] Build status: STARTED
[04:58:06.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:33:0) after 7m27s
[05:05:33.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:33:0)
[05:05:33.689] Build status: STARTED
[05:05:33.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:34:0) after 6m30s
[05:12:03.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:34:0)
[05:12:03.735] Build status: STARTED
[05:12:03.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:35:0) after 8m16s
[05:20:19.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:35:0)
[05:20:19.742] Build status: STARTED
[05:20:19.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:36:0) after 4m7s
[05:24:26.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:36:0)
[05:24:26.798] Build status: STARTED
[05:24:26.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:37:0) after 6m12s
[05:30:38.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:37:0)
[05:30:38.859] Build status: STARTED
[05:30:38.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:38:0) after 9m8s
[05:39:46.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:38:0)
[05:39:46.897] Build status: STARTED
[05:39:46.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:39:0) after 2m39s
[05:42:25.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:39:0)
[05:42:25.937] Build status: STARTED
[05:42:25.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:40:0) after 8m45s
[05:51:10.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:40:0)
[05:51:11.052] Build status: STARTED
[05:51:11.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:41:0) after 2m58s
[05:54:09.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:41:0)
[05:54:09.349] Build status: STARTED
[05:54:09.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:42:0) after 4m51s
[05:59:00.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:42:0)
[05:59:00.447] Build status: STARTED
[05:59:00.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:43:0) after 2m7s
[06:01:07.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:43:0)
[06:01:07.486] Build status: STARTED
[06:01:07.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:44:0) after 1m31s
[06:02:38.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:44:0)
[06:02:38.514] Build status: STARTED
[06:02:38.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8848744458885241456:45:0) after 6m39s
[06:05:01.949] Received PubSub notification, asking Buildbucket for the build status
[06:05:02.004] Build:
{
"id": "8683314397047380609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41417,
"createdBy": "project:chromium",
"createTime": "2026-04-28T02:25:00.463958032Z",
"startTime": "2026-04-28T02:25:05.172832244Z",
"endTime": "2026-04-28T06:05:01.671973069Z",
"updateTime": "2026-04-28T06:05:01.671973069Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "44682f87f23386fdf6c177a934bf3da915b6e0d8",
"ref": "refs/heads/main"
}
}
}
[06:05:02.004] Invocation finished in 3h40m2.677338572s with status FAILED