[09:42:14.126] New invocation is queued and will start shortly
[09:42:15.249] Starting the invocation (attempt 1)
[09:42:15.289] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/00f2d99114596c29e2e23cb629f52583a90dbc1f"
[09:42:15.289] Popped gitiles commit info from properties and tags
[09:42:15.289] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:42:15.289] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:42:15.289] Buildbucket request:
{
"requestId": "8995665229221275392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "00f2d99114596c29e2e23cb629f52583a90dbc1f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8995665229221275392"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:42:15.787] Scheduled build:
{
"id": "8830235167246319825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23573,
"createdBy": "project:chromium",
"createTime": "2021-11-18T09:42:15.377670636Z",
"updateTime": "2021-11-18T09:42:15.377670636Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "00f2d99114596c29e2e23cb629f52583a90dbc1f",
"ref": "refs/heads/main"
}
}
}
[09:42:15.787] Task URL: https://cr-buildbucket.appspot.com/build/8830235167246319825
[09:42:15.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:2:0) after 8m12s
[09:44:46.116] Received PubSub notification, asking Buildbucket for the build status
[09:44:46.152] Build status: STARTED
[09:50:27.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:2:0)
[09:50:27.924] Build status: STARTED
[09:50:27.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:4:0) after 2m5s
[09:52:32.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:4:0)
[09:52:33.038] Build status: STARTED
[09:52:33.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:5:0) after 8m33s
[10:01:06.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:5:0)
[10:01:06.045] Build status: STARTED
[10:01:06.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:6:0) after 4m2s
[10:05:08.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:6:0)
[10:05:08.316] Build status: STARTED
[10:05:08.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:7:0) after 3m44s
[10:08:52.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:7:0)
[10:08:52.377] Build status: STARTED
[10:08:52.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:8:0) after 5m37s
[10:14:29.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:8:0)
[10:14:29.457] Build status: STARTED
[10:14:29.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:9:0) after 7m5s
[10:21:34.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:9:0)
[10:21:34.517] Build status: STARTED
[10:21:34.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:10:0) after 2m58s
[10:24:32.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:10:0)
[10:24:32.871] Build status: STARTED
[10:24:32.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:11:0) after 9m29s
[10:34:01.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:11:0)
[10:34:01.985] Build status: STARTED
[10:34:01.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:12:0) after 9m27s
[10:43:29.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:12:0)
[10:43:29.129] Build status: STARTED
[10:43:29.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:13:0) after 6m0s
[10:49:29.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:13:0)
[10:49:29.319] Build status: STARTED
[10:49:29.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:14:0) after 1m28s
[10:50:57.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:14:0)
[10:50:57.564] Build status: STARTED
[10:50:57.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:15:0) after 4m42s
[10:55:39.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:15:0)
[10:55:39.620] Build status: STARTED
[10:55:39.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:16:0) after 1m53s
[10:57:32.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:16:0)
[10:57:32.678] Build status: STARTED
[10:57:32.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:17:0) after 7m50s
[11:05:22.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:17:0)
[11:05:22.732] Build status: STARTED
[11:05:22.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:18:0) after 6m29s
[11:11:51.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:18:0)
[11:11:51.791] Build status: STARTED
[11:11:51.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:19:0) after 7m15s
[11:19:06.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:19:0)
[11:19:06.905] Build status: STARTED
[11:19:06.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:20:0) after 7m41s
[11:26:47.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:20:0)
[11:26:47.979] Build status: STARTED
[11:26:47.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:21:0) after 7m28s
[11:34:16.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:21:0)
[11:34:16.098] Build status: STARTED
[11:34:16.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:22:0) after 8m20s
[11:42:36.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:22:0)
[11:42:36.153] Build status: STARTED
[11:42:36.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:23:0) after 2m50s
[11:45:26.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:23:0)
[11:45:26.209] Build status: STARTED
[11:45:26.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:24:0) after 2m40s
[11:48:06.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:24:0)
[11:48:06.364] Build status: STARTED
[11:48:06.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:25:0) after 6m30s
[11:54:36.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:25:0)
[11:54:36.422] Build status: STARTED
[11:54:36.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:26:0) after 8m51s
[12:03:27.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:26:0)
[12:03:27.568] Build status: STARTED
[12:03:27.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:27:0) after 5m22s
[12:08:49.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:27:0)
[12:08:49.802] Build status: STARTED
[12:08:49.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:28:0) after 2m55s
[12:11:44.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:28:0)
[12:11:44.880] Build status: STARTED
[12:11:44.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:29:0) after 2m22s
[12:14:07.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:29:0)
[12:14:07.228] Build status: STARTED
[12:14:07.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:30:0) after 7m32s
[12:21:39.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:30:0)
[12:21:39.285] Build status: STARTED
[12:21:39.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:31:0) after 9m53s
[12:31:32.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:31:0)
[12:31:32.444] Build status: STARTED
[12:31:32.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:32:0) after 3m47s
[12:35:19.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:32:0)
[12:35:19.511] Build status: STARTED
[12:35:19.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:33:0) after 3m58s
[12:39:17.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:33:0)
[12:39:17.604] Build status: STARTED
[12:39:17.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:34:0) after 9m18s
[12:48:35.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:34:0)
[12:48:35.904] Build status: STARTED
[12:48:35.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:35:0) after 6m30s
[12:55:05.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:35:0)
[12:55:05.975] Build status: STARTED
[12:55:05.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:36:0) after 9m56s
[13:05:02.253] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:36:0)
[13:05:02.350] Build status: STARTED
[13:05:02.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:37:0) after 9m14s
[13:14:16.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:37:0)
[13:14:16.475] Build status: STARTED
[13:14:16.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:38:0) after 4m58s
[13:19:14.502] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:38:0)
[13:19:14.532] Build status: STARTED
[13:19:14.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:39:0) after 6m33s
[13:25:47.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:39:0)
[13:25:47.904] Build status: STARTED
[13:25:47.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:40:0) after 3m59s
[13:29:46.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:40:0)
[13:29:46.985] Build status: STARTED
[13:29:46.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:41:0) after 3m59s
[13:33:46.014] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:41:0)
[13:33:46.053] Build status: STARTED
[13:33:46.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:42:0) after 8m23s
[13:42:09.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:42:0)
[13:42:09.114] Build status: STARTED
[13:42:09.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:43:0) after 8m17s
[13:50:26.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:43:0)
[13:50:26.181] Build status: STARTED
[13:50:26.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:44:0) after 4m20s
[13:54:46.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:44:0)
[13:54:46.233] Build status: STARTED
[13:54:46.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:45:0) after 5m47s
[14:00:33.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:45:0)
[14:00:33.610] Build status: STARTED
[14:00:33.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:46:0) after 7m26s
[14:07:59.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:46:0)
[14:07:59.773] Build status: STARTED
[14:07:59.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:47:0) after 9m23s
[14:17:22.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:47:0)
[14:17:22.852] Build status: STARTED
[14:17:22.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:48:0) after 9m51s
[14:27:14.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:48:0)
[14:27:14.043] Build status: STARTED
[14:27:14.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:49:0) after 6m15s
[14:33:29.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:49:0)
[14:33:29.206] Build status: STARTED
[14:33:29.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:50:0) after 7m25s
[14:40:54.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:50:0)
[14:40:54.269] Build status: STARTED
[14:40:54.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:51:0) after 3m2s
[14:43:56.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:51:0)
[14:43:56.373] Build status: STARTED
[14:43:56.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:52:0) after 5m34s
[14:49:30.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:52:0)
[14:49:30.436] Build status: STARTED
[14:49:30.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:53:0) after 4m36s
[14:54:06.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:53:0)
[14:54:06.502] Build status: STARTED
[14:54:06.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995665229221275392:54:0) after 9m47s
[15:01:43.151] Received PubSub notification, asking Buildbucket for the build status
[15:01:43.184] Build:
{
"id": "8830235167246319825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23573,
"createdBy": "project:chromium",
"createTime": "2021-11-18T09:42:15.377670636Z",
"startTime": "2021-11-18T09:44:45.446684Z",
"endTime": "2021-11-18T15:01:42.702775044Z",
"updateTime": "2021-11-18T15:01:42.702775044Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "00f2d99114596c29e2e23cb629f52583a90dbc1f",
"ref": "refs/heads/main"
}
}
}
[15:01:43.184] Invocation finished in 5h19m29.074094184s with status FAILED