[22:30:48.334] New invocation is queued and will start shortly
[22:30:49.586] Starting the invocation (attempt 1)
[22:30:49.621] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/18ed23940157f30a375fba29de9cfcc6996cb37d"
[22:30:49.621] Popped gitiles commit info from properties and tags
[22:30:49.621] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:30:49.621] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:30:49.621] Buildbucket request:
{
"requestId": "8842870389606755824",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "18ed23940157f30a375fba29de9cfcc6996cb37d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842870389606755824"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:30:50.139] Scheduled build:
{
"id": "8677440327529117585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 42354,
"createdBy": "project:chromium",
"createTime": "2026-07-01T22:30:49.695023189Z",
"updateTime": "2026-07-01T22:30:49.695023189Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "18ed23940157f30a375fba29de9cfcc6996cb37d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:30:50.139] Task URL: https://cr-buildbucket.appspot.com/build/8677440327529117585
[22:30:50.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:2:0) after 9m6s
[22:30:51.069] Received PubSub notification, asking Buildbucket for the build status
[22:30:51.183] Build status: SCHEDULED
[22:30:55.359] Received PubSub notification, asking Buildbucket for the build status
[22:30:55.390] Build status: STARTED
[22:39:56.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:2:0)
[22:39:56.188] Build status: STARTED
[22:39:56.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:5:0) after 1m16s
[22:41:12.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:5:0)
[22:41:12.284] Build status: STARTED
[22:41:12.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:6:0) after 6m30s
[22:47:42.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:6:0)
[22:47:42.377] Build status: STARTED
[22:47:42.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:7:0) after 4m47s
[22:52:29.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:7:0)
[22:52:29.417] Build status: STARTED
[22:52:29.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:8:0) after 1m36s
[22:54:05.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:8:0)
[22:54:05.648] Build status: STARTED
[22:54:05.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:9:0) after 7m58s
[23:02:03.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:9:0)
[23:02:03.728] Build status: STARTED
[23:02:03.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:10:0) after 6m39s
[23:08:42.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:10:0)
[23:08:42.827] Build status: STARTED
[23:08:42.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:11:0) after 7m46s
[23:16:28.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:11:0)
[23:16:28.961] Build status: STARTED
[23:16:28.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:12:0) after 4m36s
[23:21:05.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:12:0)
[23:21:05.110] Build status: STARTED
[23:21:05.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:13:0) after 5m10s
[23:26:15.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:13:0)
[23:26:15.130] Build status: STARTED
[23:26:15.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:14:0) after 2m52s
[23:29:07.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:14:0)
[23:29:07.272] Build status: STARTED
[23:29:07.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:15:0) after 5m26s
[23:34:33.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:15:0)
[23:34:33.313] Build status: STARTED
[23:34:33.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:16:0) after 8m56s
[23:43:29.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:16:0)
[23:43:29.368] Build status: STARTED
[23:43:29.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:17:0) after 8m34s
[23:52:03.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:17:0)
[23:52:03.445] Build status: STARTED
[23:52:03.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:18:0) after 3m18s
[23:55:21.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:18:0)
[23:55:21.662] Build status: STARTED
[23:55:21.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:19:0) after 2m13s
[23:57:34.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:19:0)
[23:57:34.736] Build status: STARTED
[23:57:34.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:20:0) after 6m15s
[00:03:49.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:20:0)
[00:03:49.809] Build status: STARTED
[00:03:49.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:21:0) after 3m30s
[00:07:19.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:21:0)
[00:07:19.848] Build status: STARTED
[00:07:19.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:22:0) after 5m21s
[00:12:40.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:22:0)
[00:12:40.999] Build status: STARTED
[00:12:40.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:23:0) after 1m2s
[00:13:43.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:23:0)
[00:13:43.060] Build status: STARTED
[00:13:43.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:24:0) after 9m27s
[00:23:10.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:24:0)
[00:23:10.123] Build status: STARTED
[00:23:10.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:25:0) after 5m58s
[00:29:08.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:25:0)
[00:29:08.164] Build status: STARTED
[00:29:08.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:26:0) after 5m45s
[00:34:53.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:26:0)
[00:34:53.239] Build status: STARTED
[00:34:53.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:27:0) after 7m9s
[00:42:02.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:27:0)
[00:42:02.364] Build status: STARTED
[00:42:02.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:28:0) after 6m28s
[00:48:30.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:28:0)
[00:48:30.501] Build status: STARTED
[00:48:30.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:29:0) after 9m4s
[00:57:34.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:29:0)
[00:57:34.554] Build status: STARTED
[00:57:34.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:30:0) after 8m1s
[01:05:35.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:30:0)
[01:05:35.643] Build status: STARTED
[01:05:35.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:31:0) after 7m51s
[01:13:26.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:31:0)
[01:13:26.709] Build status: STARTED
[01:13:26.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:32:0) after 3m56s
[01:17:22.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:32:0)
[01:17:22.744] Build status: STARTED
[01:17:22.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:33:0) after 9m34s
[01:26:56.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:33:0)
[01:26:56.789] Build status: STARTED
[01:26:56.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:34:0) after 2m33s
[01:29:29.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:34:0)
[01:29:29.856] Build status: STARTED
[01:29:29.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:35:0) after 7m26s
[01:36:56.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:35:0)
[01:36:56.229] Build status: STARTED
[01:36:56.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:36:0) after 2m21s
[01:39:17.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:36:0)
[01:39:17.324] Build status: STARTED
[01:39:17.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:37:0) after 3m33s
[01:42:50.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:37:0)
[01:42:50.371] Build status: STARTED
[01:42:50.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:38:0) after 4m19s
[01:47:09.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:38:0)
[01:47:09.478] Build status: STARTED
[01:47:09.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:39:0) after 1m14s
[01:48:23.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:39:0)
[01:48:23.535] Build status: STARTED
[01:48:23.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:40:0) after 7m46s
[01:56:09.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:40:0)
[01:56:09.604] Build status: STARTED
[01:56:09.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:41:0) after 2m52s
[01:59:01.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:41:0)
[01:59:01.723] Build status: STARTED
[01:59:01.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:42:0) after 6m28s
[02:05:29.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:42:0)
[02:05:29.815] Build status: STARTED
[02:05:29.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:43:0) after 6m4s
[02:11:33.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:43:0)
[02:11:34.060] Build status: STARTED
[02:11:34.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:44:0) after 3m44s
[02:15:18.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:44:0)
[02:15:18.077] Build status: STARTED
[02:15:18.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:45:0) after 7m13s
[02:22:31.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:45:0)
[02:22:31.250] Build status: STARTED
[02:22:31.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:46:0) after 2m11s
[02:24:42.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:46:0)
[02:24:42.373] Build status: STARTED
[02:24:42.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:47:0) after 6m48s
[02:31:30.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:47:0)
[02:31:30.454] Build status: STARTED
[02:31:30.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:48:0) after 2m39s
[02:34:09.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:48:0)
[02:34:09.657] Build status: STARTED
[02:34:09.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:49:0) after 8m27s
[02:42:36.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:49:0)
[02:42:36.693] Build status: STARTED
[02:42:36.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:50:0) after 9m42s
[02:52:18.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:50:0)
[02:52:18.781] Build status: STARTED
[02:52:18.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:51:0) after 1m44s
[02:54:03.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:51:0)
[02:54:03.045] Build status: STARTED
[02:54:03.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:52:0) after 3m16s
[02:57:19.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:52:0)
[02:57:19.070] Build status: STARTED
[02:57:19.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8842870389606755824:53:0) after 1m24s
[02:57:27.907] Received PubSub notification, asking Buildbucket for the build status
[02:57:27.927] Build:
{
"id": "8677440327529117585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 42354,
"createdBy": "project:chromium",
"createTime": "2026-07-01T22:30:49.695023189Z",
"startTime": "2026-07-01T22:30:55.175385856Z",
"endTime": "2026-07-02T02:57:27.544957725Z",
"updateTime": "2026-07-02T02:57:27.544957725Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "18ed23940157f30a375fba29de9cfcc6996cb37d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:57:27.927] Invocation finished in 4h26m39.596799842s with status FAILED