[17:15:57.075] New invocation is queued and will start shortly
[17:15:58.399] Starting the invocation (attempt 1)
[17:15:58.430] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3cf0c8d64c7e675d83ea8e9ceb60e61777ec09da"
[17:15:58.430] Popped gitiles commit info from properties and tags
[17:15:58.430] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:15:58.430] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:15:58.430] Buildbucket request:
{
"requestId": "8875958091272948384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3cf0c8d64c7e675d83ea8e9ceb60e61777ec09da",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875958091272948384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:15:59.014] Scheduled build:
{
"id": "8710528029119957233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38734,
"createdBy": "project:chromium",
"createTime": "2025-07-01T17:15:58.499092065Z",
"updateTime": "2025-07-01T17:15:58.499092065Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3cf0c8d64c7e675d83ea8e9ceb60e61777ec09da",
"ref": "refs/heads/main"
}
}
}
[17:15:59.014] Task URL: https://cr-buildbucket.appspot.com/build/8710528029119957233
[17:15:59.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:2:0) after 4m17s
[17:16:00.076] Received PubSub notification, asking Buildbucket for the build status
[17:16:00.105] Build status: SCHEDULED
[17:16:02.744] Received PubSub notification, asking Buildbucket for the build status
[17:16:02.781] Build status: STARTED
[17:20:16.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:2:0)
[17:20:16.105] Build status: STARTED
[17:20:16.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:5:0) after 3m33s
[17:23:49.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:5:0)
[17:23:49.250] Build status: STARTED
[17:23:49.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:6:0) after 8m25s
[17:32:14.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:6:0)
[17:32:14.355] Build status: STARTED
[17:32:14.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:7:0) after 5m15s
[17:37:29.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:7:0)
[17:37:29.427] Build status: STARTED
[17:37:29.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:8:0) after 7m13s
[17:44:42.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:8:0)
[17:44:42.471] Build status: STARTED
[17:44:42.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:9:0) after 4m25s
[17:49:07.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:9:0)
[17:49:07.619] Build status: STARTED
[17:49:07.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:10:0) after 4m29s
[17:53:36.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:10:0)
[17:53:36.675] Build status: STARTED
[17:53:36.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:11:0) after 8m2s
[18:01:38.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:11:0)
[18:01:38.767] Build status: STARTED
[18:01:38.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:12:0) after 1m23s
[18:03:01.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:12:0)
[18:03:01.920] Build status: STARTED
[18:03:01.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:13:0) after 3m5s
[18:06:07.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:13:0)
[18:06:07.122] Build status: STARTED
[18:06:07.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:14:0) after 4m6s
[18:10:13.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:14:0)
[18:10:13.177] Build status: STARTED
[18:10:13.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:15:0) after 7m34s
[18:17:47.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:15:0)
[18:17:47.247] Build status: STARTED
[18:17:47.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:16:0) after 3m28s
[18:21:15.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:16:0)
[18:21:15.420] Build status: STARTED
[18:21:15.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:17:0) after 1m9s
[18:22:24.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:17:0)
[18:22:24.480] Build status: STARTED
[18:22:24.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:18:0) after 4m15s
[18:26:39.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:18:0)
[18:26:39.516] Build status: STARTED
[18:26:39.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:19:0) after 6m4s
[18:32:43.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:19:0)
[18:32:43.706] Build status: STARTED
[18:32:43.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:20:0) after 8m50s
[18:41:33.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:20:0)
[18:41:33.729] Build status: STARTED
[18:41:33.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:21:0) after 3m40s
[18:45:13.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:21:0)
[18:45:13.814] Build status: STARTED
[18:45:13.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:22:0) after 5m44s
[18:50:57.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:22:0)
[18:50:57.833] Build status: STARTED
[18:50:57.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:23:0) after 3m58s
[18:54:55.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:23:0)
[18:54:55.870] Build status: STARTED
[18:54:55.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:24:0) after 5m18s
[19:00:13.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:24:0)
[19:00:13.921] Build status: STARTED
[19:00:13.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:25:0) after 4m35s
[19:04:49.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:25:0)
[19:04:49.036] Build status: STARTED
[19:04:49.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:26:0) after 9m59s
[19:14:48.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:26:0)
[19:14:48.083] Build status: STARTED
[19:14:48.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:27:0) after 3m44s
[19:18:32.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:27:0)
[19:18:32.190] Build status: STARTED
[19:18:32.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:28:0) after 2m14s
[19:20:46.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:28:0)
[19:20:46.297] Build status: STARTED
[19:20:46.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:29:0) after 5m32s
[19:26:18.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:29:0)
[19:26:18.332] Build status: STARTED
[19:26:18.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:30:0) after 6m17s
[19:32:35.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:30:0)
[19:32:35.452] Build status: STARTED
[19:32:35.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:31:0) after 1m41s
[19:34:16.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:31:0)
[19:34:16.529] Build status: STARTED
[19:34:16.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:32:0) after 1m1s
[19:35:17.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:32:0)
[19:35:17.598] Build status: STARTED
[19:35:17.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:33:0) after 6m16s
[19:41:33.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:33:0)
[19:41:33.631] Build status: STARTED
[19:41:33.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:34:0) after 1m16s
[19:42:49.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:34:0)
[19:42:49.746] Build status: STARTED
[19:42:49.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:35:0) after 6m44s
[19:49:33.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:35:0)
[19:49:33.827] Build status: STARTED
[19:49:33.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:36:0) after 5m19s
[19:54:52.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:36:0)
[19:54:52.918] Build status: STARTED
[19:54:52.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:37:0) after 7m41s
[20:02:33.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:37:0)
[20:02:34.016] Build status: STARTED
[20:02:34.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:38:0) after 8m4s
[20:10:38.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:38:0)
[20:10:38.058] Build status: STARTED
[20:10:38.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:39:0) after 8m6s
[20:18:44.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:39:0)
[20:18:44.128] Build status: STARTED
[20:18:44.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:40:0) after 7m31s
[20:26:15.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:40:0)
[20:26:15.167] Build status: STARTED
[20:26:15.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:41:0) after 8m10s
[20:34:25.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:41:0)
[20:34:25.249] Build status: STARTED
[20:34:25.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:42:0) after 7m11s
[20:41:36.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:42:0)
[20:41:36.364] Build status: STARTED
[20:41:36.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:43:0) after 5m27s
[20:47:03.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:43:0)
[20:47:03.353] Build status: STARTED
[20:47:03.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:44:0) after 4m48s
[20:51:51.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:44:0)
[20:51:51.387] Build status: STARTED
[20:51:51.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:45:0) after 2m15s
[20:54:06.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:45:0)
[20:54:06.490] Build status: STARTED
[20:54:06.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:46:0) after 5m40s
[20:59:46.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:46:0)
[20:59:46.662] Build status: STARTED
[20:59:46.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:47:0) after 2m35s
[21:02:21.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:47:0)
[21:02:21.720] Build status: STARTED
[21:02:21.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875958091272948384:48:0) after 2m42s
[21:02:34.596] Received PubSub notification, asking Buildbucket for the build status
[21:02:34.612] Build:
{
"id": "8710528029119957233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38734,
"createdBy": "project:chromium",
"createTime": "2025-07-01T17:15:58.499092065Z",
"startTime": "2025-07-01T17:16:02.224082220Z",
"endTime": "2025-07-01T21:02:34.312015277Z",
"updateTime": "2025-07-01T21:02:34.312015277Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3cf0c8d64c7e675d83ea8e9ceb60e61777ec09da",
"ref": "refs/heads/main"
}
}
}
[21:02:34.612] Invocation finished in 3h46m37.55050044s with status FAILED