[08:01:58.767] New invocation is queued and will start shortly
[08:01:59.910] Starting the invocation (attempt 1)
[08:01:59.951] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/966c56f5acb83e52de33b269eddb041a096d1c6f"
[08:01:59.951] Popped gitiles commit info from properties and tags
[08:01:59.951] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:01:59.951] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:01:59.951] Buildbucket request:
{
"requestId": "8998751833649178624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "966c56f5acb83e52de33b269eddb041a096d1c6f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8998751833649178624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:02:00.553] Scheduled build:
{
"id": "8833321771659967297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23349,
"createdBy": "project:chromium",
"createTime": "2021-10-15T08:02:00.023790393Z",
"updateTime": "2021-10-15T08:02:00.299683283Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "966c56f5acb83e52de33b269eddb041a096d1c6f",
"ref": "refs/heads/main"
}
}
}
[08:02:00.553] Task URL: https://cr-buildbucket.appspot.com/build/8833321771659967297
[08:02:00.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:2:0) after 3m1s
[08:04:30.943] Received PubSub notification, asking Buildbucket for the build status
[08:04:30.969] Build status: STARTED
[08:05:01.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:2:0)
[08:05:01.770] Build status: STARTED
[08:05:01.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:4:0) after 1m30s
[08:06:31.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:4:0)
[08:06:31.993] Build status: STARTED
[08:06:31.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:5:0) after 8m11s
[08:14:43.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:5:0)
[08:14:43.041] Build status: STARTED
[08:14:43.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:6:0) after 9m2s
[08:23:45.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:6:0)
[08:23:45.115] Build status: STARTED
[08:23:45.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:7:0) after 6m36s
[08:30:21.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:7:0)
[08:30:21.209] Build status: STARTED
[08:30:21.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:8:0) after 9m12s
[08:39:33.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:8:0)
[08:39:33.375] Build status: STARTED
[08:39:33.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:9:0) after 4m9s
[08:43:42.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:9:0)
[08:43:42.422] Build status: STARTED
[08:43:42.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:10:0) after 4m38s
[08:48:20.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:10:0)
[08:48:20.495] Build status: STARTED
[08:48:20.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:11:0) after 2m37s
[08:50:57.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:11:0)
[08:50:57.498] Build status: STARTED
[08:50:57.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:12:0) after 7m28s
[08:58:25.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:12:0)
[08:58:25.685] Build status: STARTED
[08:58:25.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:13:0) after 7m9s
[09:05:34.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:13:0)
[09:05:34.806] Build status: STARTED
[09:05:34.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:14:0) after 9m7s
[09:14:41.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:14:0)
[09:14:41.907] Build status: STARTED
[09:14:41.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:15:0) after 8m33s
[09:23:14.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:15:0)
[09:23:14.954] Build status: STARTED
[09:23:14.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:16:0) after 8m23s
[09:31:37.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:16:0)
[09:31:38.008] Build status: STARTED
[09:31:38.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:17:0) after 1m32s
[09:33:10.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:17:0)
[09:33:10.134] Build status: STARTED
[09:33:10.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:18:0) after 9m9s
[09:42:19.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:18:0)
[09:42:19.252] Build status: STARTED
[09:42:19.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:19:0) after 4m5s
[09:46:24.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:19:0)
[09:46:24.403] Build status: STARTED
[09:46:24.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:20:0) after 2m23s
[09:48:47.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:20:0)
[09:48:47.448] Build status: STARTED
[09:48:47.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:21:0) after 6m24s
[09:55:11.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:21:0)
[09:55:11.523] Build status: STARTED
[09:55:11.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:22:0) after 8m50s
[10:04:01.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:22:0)
[10:04:01.605] Build status: STARTED
[10:04:01.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:23:0) after 2m58s
[10:06:59.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:23:0)
[10:06:59.817] Build status: STARTED
[10:06:59.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:24:0) after 4m20s
[10:11:19.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:24:0)
[10:11:19.897] Build status: STARTED
[10:11:19.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:25:0) after 1m43s
[10:13:03.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:25:0)
[10:13:03.292] Build status: STARTED
[10:13:03.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:26:0) after 5m31s
[10:18:34.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:26:0)
[10:18:34.387] Build status: STARTED
[10:18:34.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:27:0) after 9m25s
[10:27:59.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:27:0)
[10:27:59.665] Build status: STARTED
[10:27:59.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:28:0) after 5m17s
[10:33:16.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:28:0)
[10:33:16.723] Build status: STARTED
[10:33:16.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:29:0) after 6m57s
[10:40:14.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:29:0)
[10:40:14.285] Build status: STARTED
[10:40:14.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:30:0) after 7m55s
[10:48:09.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:30:0)
[10:48:09.379] Build status: STARTED
[10:48:09.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:31:0) after 7m56s
[10:56:05.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:31:0)
[10:56:05.414] Build status: STARTED
[10:56:05.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:32:0) after 7m40s
[11:03:45.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:32:0)
[11:03:45.482] Build status: STARTED
[11:03:45.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:33:0) after 6m47s
[11:10:32.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:33:0)
[11:10:32.753] Build status: STARTED
[11:10:32.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:34:0) after 4m41s
[11:15:13.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:34:0)
[11:15:13.883] Build status: STARTED
[11:15:13.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:35:0) after 5m9s
[11:20:22.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:35:0)
[11:20:22.973] Build status: STARTED
[11:20:22.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:36:0) after 7m15s
[11:27:38.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:36:0)
[11:27:38.227] Build status: STARTED
[11:27:38.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:37:0) after 9m13s
[11:36:51.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:37:0)
[11:36:51.333] Build status: STARTED
[11:36:51.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:38:0) after 6m5s
[11:42:56.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:38:0)
[11:42:56.549] Build status: STARTED
[11:42:56.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:39:0) after 5m39s
[11:48:35.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:39:0)
[11:48:35.710] Build status: STARTED
[11:48:35.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:40:0) after 2m6s
[11:50:41.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:40:0)
[11:50:41.787] Build status: STARTED
[11:50:41.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:41:0) after 8m55s
[11:59:36.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:41:0)
[11:59:36.843] Build status: STARTED
[11:59:36.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:42:0) after 5m9s
[12:04:46.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:42:0)
[12:04:46.151] Build status: STARTED
[12:04:46.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:43:0) after 9m19s
[12:14:05.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:43:0)
[12:14:05.304] Build status: STARTED
[12:14:05.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:44:0) after 2m54s
[12:16:59.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:44:0)
[12:16:59.582] Build status: STARTED
[12:16:59.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:45:0) after 4m23s
[12:21:22.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:45:0)
[12:21:22.638] Build status: STARTED
[12:21:22.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:46:0) after 1m39s
[12:23:01.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:46:0)
[12:23:01.690] Build status: STARTED
[12:23:01.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:47:0) after 8m35s
[12:31:36.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:47:0)
[12:31:36.827] Build status: STARTED
[12:31:36.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:48:0) after 3m53s
[12:35:29.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:48:0)
[12:35:29.903] Build status: STARTED
[12:35:29.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:49:0) after 7m21s
[12:42:50.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:49:0)
[12:42:50.951] Build status: STARTED
[12:42:50.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:50:0) after 5m17s
[12:48:07.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:50:0)
[12:48:08.019] Build status: STARTED
[12:48:08.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:51:0) after 1m41s
[12:49:49.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:51:0)
[12:49:49.099] Build status: STARTED
[12:49:49.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:52:0) after 1m23s
[12:51:13.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:52:0)
[12:51:13.049] Build status: STARTED
[12:51:13.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:53:0) after 2m22s
[12:53:35.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:53:0)
[12:53:35.240] Build status: STARTED
[12:53:35.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:54:0) after 7m4s
[13:00:39.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:54:0)
[13:00:39.295] Build status: STARTED
[13:00:39.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:55:0) after 5m58s
[13:06:37.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:55:0)
[13:06:37.385] Build status: STARTED
[13:06:37.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:56:0) after 1m7s
[13:07:44.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:56:0)
[13:07:44.649] Build status: STARTED
[13:07:44.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:57:0) after 8m12s
[13:15:56.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:57:0)
[13:15:56.728] Build status: STARTED
[13:15:56.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:58:0) after 2m32s
[13:18:28.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:58:0)
[13:18:28.821] Build status: STARTED
[13:18:28.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998751833649178624:59:0) after 4m39s
[13:19:30.232] Received PubSub notification, asking Buildbucket for the build status
[13:19:30.262] Build:
{
"id": "8833321771659967297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23349,
"createdBy": "project:chromium",
"createTime": "2021-10-15T08:02:00.023790393Z",
"startTime": "2021-10-15T08:04:30.212428Z",
"endTime": "2021-10-15T13:19:29.868156698Z",
"updateTime": "2021-10-15T13:19:29.868571664Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "966c56f5acb83e52de33b269eddb041a096d1c6f",
"ref": "refs/heads/main"
}
}
}
[13:19:30.262] Invocation finished in 5h17m31.519039931s with status FAILED