[13:33:07.996] New invocation is queued and will start shortly
[13:33:09.282] Starting the invocation (attempt 1)
[13:33:09.314] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/38f613e70326ad47707cfca6a49c678f34264ec8"
[13:33:09.314] Popped gitiles commit info from properties and tags
[13:33:09.314] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:33:09.314] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:33:09.314] Buildbucket request:
{
"requestId": "8851239137932640976",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38f613e70326ad47707cfca6a49c678f34264ec8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851239137932640976"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:33:09.845] Scheduled build:
{
"id": "8685809075817732993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41163,
"createdBy": "project:chromium",
"createTime": "2026-03-31T13:33:09.392556131Z",
"updateTime": "2026-03-31T13:33:09.392556131Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38f613e70326ad47707cfca6a49c678f34264ec8",
"ref": "refs/heads/main"
}
}
}
[13:33:09.845] Task URL: https://cr-buildbucket.appspot.com/build/8685809075817732993
[13:33:09.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:2:0) after 3m45s
[13:33:10.897] Received PubSub notification, asking Buildbucket for the build status
[13:33:10.923] Build status: SCHEDULED
[13:33:51.138] Received PubSub notification, asking Buildbucket for the build status
[13:33:51.165] Build status: STARTED
[13:36:54.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:2:0)
[13:36:54.896] Build status: STARTED
[13:36:54.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:5:0) after 1m45s
[13:38:39.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:5:0)
[13:38:40.066] Build status: STARTED
[13:38:40.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:6:0) after 9m53s
[13:48:33.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:6:0)
[13:48:33.111] Build status: STARTED
[13:48:33.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:7:0) after 4m59s
[13:53:32.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:7:0)
[13:53:32.191] Build status: STARTED
[13:53:32.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:8:0) after 2m55s
[13:56:27.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:8:0)
[13:56:27.209] Build status: STARTED
[13:56:27.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:9:0) after 1m3s
[13:57:30.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:9:0)
[13:57:30.309] Build status: STARTED
[13:57:30.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:10:0) after 2m44s
[14:00:14.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:10:0)
[14:00:14.310] Build status: STARTED
[14:00:14.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:11:0) after 2m39s
[14:02:53.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:11:0)
[14:02:53.352] Build status: STARTED
[14:02:53.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:12:0) after 7m25s
[14:10:18.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:12:0)
[14:10:18.444] Build status: STARTED
[14:10:18.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:13:0) after 5m17s
[14:15:35.548] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:13:0)
[14:15:35.564] Build status: STARTED
[14:15:35.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:14:0) after 3m55s
[14:19:30.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:14:0)
[14:19:30.678] Build status: STARTED
[14:19:30.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:15:0) after 6m34s
[14:26:04.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:15:0)
[14:26:04.717] Build status: STARTED
[14:26:04.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:16:0) after 8m27s
[14:34:31.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:16:0)
[14:34:31.785] Build status: STARTED
[14:34:31.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:17:0) after 8m4s
[14:42:35.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:17:0)
[14:42:35.879] Build status: STARTED
[14:42:35.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:18:0) after 1m55s
[14:44:30.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:18:0)
[14:44:30.995] Build status: STARTED
[14:44:30.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:19:0) after 7m9s
[14:51:40.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:19:0)
[14:51:40.029] Build status: STARTED
[14:51:40.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:20:0) after 2m6s
[14:53:46.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:20:0)
[14:53:46.162] Build status: STARTED
[14:53:46.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:21:0) after 6m9s
[14:59:55.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:21:0)
[14:59:55.240] Build status: STARTED
[14:59:55.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:22:0) after 9m5s
[15:09:00.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:22:0)
[15:09:00.338] Build status: STARTED
[15:09:00.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:23:0) after 8m18s
[15:17:18.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:23:0)
[15:17:18.372] Build status: STARTED
[15:17:18.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:24:0) after 5m16s
[15:22:34.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:24:0)
[15:22:34.501] Build status: STARTED
[15:22:34.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:25:0) after 6m11s
[15:28:45.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:25:0)
[15:28:45.565] Build status: STARTED
[15:28:45.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:26:0) after 1m39s
[15:30:24.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:26:0)
[15:30:24.726] Build status: STARTED
[15:30:24.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:27:0) after 9m22s
[15:39:46.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:27:0)
[15:39:46.898] Build status: STARTED
[15:39:46.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:28:0) after 1m40s
[15:41:26.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:28:0)
[15:41:27.026] Build status: STARTED
[15:41:27.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:29:0) after 4m10s
[15:45:37.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:29:0)
[15:45:37.074] Build status: STARTED
[15:45:37.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:30:0) after 9m1s
[15:54:38.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:30:0)
[15:54:38.108] Build status: STARTED
[15:54:38.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:31:0) after 2m42s
[15:57:20.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:31:0)
[15:57:20.145] Build status: STARTED
[15:57:20.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:32:0) after 7m30s
[16:04:50.163] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:32:0)
[16:04:50.197] Build status: STARTED
[16:04:50.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:33:0) after 5m14s
[16:10:04.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:33:0)
[16:10:04.249] Build status: STARTED
[16:10:04.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:34:0) after 6m15s
[16:16:19.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:34:0)
[16:16:19.264] Build status: STARTED
[16:16:19.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:35:0) after 9m27s
[16:25:46.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:35:0)
[16:25:46.313] Build status: STARTED
[16:25:46.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:36:0) after 8m17s
[16:34:03.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:36:0)
[16:34:03.436] Build status: STARTED
[16:34:03.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:37:0) after 1m36s
[16:35:39.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:37:0)
[16:35:39.500] Build status: STARTED
[16:35:39.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:38:0) after 6m7s
[16:41:46.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:38:0)
[16:41:46.702] Build status: STARTED
[16:41:46.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:39:0) after 7m16s
[16:49:02.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:39:0)
[16:49:02.794] Build status: STARTED
[16:49:02.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:40:0) after 7m43s
[16:56:45.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:40:0)
[16:56:45.852] Build status: STARTED
[16:56:45.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851239137932640976:41:0) after 8m7s
[17:02:48.525] Received PubSub notification, asking Buildbucket for the build status
[17:02:48.544] Build:
{
"id": "8685809075817732993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41163,
"createdBy": "project:chromium",
"createTime": "2026-03-31T13:33:09.392556131Z",
"startTime": "2026-03-31T13:33:50.918250657Z",
"endTime": "2026-03-31T17:02:47.909431953Z",
"updateTime": "2026-03-31T17:02:47.909431953Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38f613e70326ad47707cfca6a49c678f34264ec8",
"ref": "refs/heads/main"
}
}
}
[17:02:48.544] Invocation finished in 3h29m40.553051083s with status FAILED