[20:22:44.650] New invocation is queued and will start shortly
[20:22:45.734] Starting the invocation (attempt 1)
[20:22:45.772] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ba65ce1eb8832d3626920042cb4fe69f4f66345b"
[20:22:45.772] Popped gitiles commit info from properties and tags
[20:22:45.772] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:22:45.772] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:22:45.772] Buildbucket request:
{
"requestId": "9006134179999937392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ba65ce1eb8832d3626920042cb4fe69f4f66345b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9006134179999937392"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:22:46.664] Scheduled build:
{
"id": "8840704118048569520",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22597,
"createdBy": "project:chromium",
"createTime": "2021-07-25T20:22:45.878306Z",
"updateTime": "2021-07-25T20:22:46.539137Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ba65ce1eb8832d3626920042cb4fe69f4f66345b",
"ref": "refs/heads/main"
}
}
}
[20:22:46.664] Task URL: https://cr-buildbucket.appspot.com/build/8840704118048569520
[20:22:46.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:2:0) after 6m11s
[20:27:27.536] Received PubSub notification, asking Buildbucket for the build status
[20:27:27.579] Build status: STARTED
[20:28:57.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:2:0)
[20:28:57.940] Build status: STARTED
[20:28:57.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:4:0) after 5m21s
[20:34:18.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:4:0)
[20:34:18.990] Build status: STARTED
[20:34:18.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:5:0) after 7m6s
[20:41:25.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:5:0)
[20:41:25.102] Build status: STARTED
[20:41:25.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:6:0) after 9m41s
[20:51:06.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:6:0)
[20:51:06.353] Build status: STARTED
[20:51:06.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:7:0) after 1m41s
[20:52:47.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:7:0)
[20:52:47.558] Build status: STARTED
[20:52:47.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:8:0) after 2m51s
[20:55:38.848] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:8:0)
[20:55:38.883] Build status: STARTED
[20:55:38.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:9:0) after 7m4s
[21:02:43.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:9:0)
[21:02:43.515] Build status: STARTED
[21:02:43.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:10:0) after 1m49s
[21:04:32.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:10:0)
[21:04:32.951] Build status: STARTED
[21:04:32.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:11:0) after 1m12s
[21:05:45.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:11:0)
[21:05:45.869] Build status: STARTED
[21:05:45.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:12:0) after 5m22s
[21:11:07.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:12:0)
[21:11:07.949] Build status: STARTED
[21:11:07.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:13:0) after 2m40s
[21:13:48.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:13:0)
[21:13:48.488] Build status: STARTED
[21:13:48.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:14:0) after 8m50s
[21:22:38.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:14:0)
[21:22:38.638] Build status: STARTED
[21:22:38.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:15:0) after 7m32s
[21:30:10.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:15:0)
[21:30:10.812] Build status: STARTED
[21:30:10.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:16:0) after 4m57s
[21:35:07.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:16:0)
[21:35:07.885] Build status: STARTED
[21:35:07.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:17:0) after 7m43s
[21:42:51.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:17:0)
[21:42:51.614] Build status: STARTED
[21:42:51.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:18:0) after 5m15s
[21:48:06.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:18:0)
[21:48:06.710] Build status: STARTED
[21:48:06.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:19:0) after 3m12s
[21:51:18.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:19:0)
[21:51:19.006] Build status: STARTED
[21:51:19.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:20:0) after 9m12s
[22:00:31.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:20:0)
[22:00:31.072] Build status: STARTED
[22:00:31.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:21:0) after 8m48s
[22:09:19.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:21:0)
[22:09:19.582] Build status: STARTED
[22:09:19.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:22:0) after 5m32s
[22:14:51.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:22:0)
[22:14:51.762] Build status: STARTED
[22:14:51.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:23:0) after 4m9s
[22:19:00.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:23:0)
[22:19:00.943] Build status: STARTED
[22:19:00.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:24:0) after 8m11s
[22:27:12.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:24:0)
[22:27:12.191] Build status: STARTED
[22:27:12.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:25:0) after 3m21s
[22:30:33.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:25:0)
[22:30:33.487] Build status: STARTED
[22:30:33.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:26:0) after 7m39s
[22:38:12.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:26:0)
[22:38:12.770] Build status: STARTED
[22:38:12.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:27:0) after 9m47s
[22:47:59.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:27:0)
[22:47:59.818] Build status: STARTED
[22:47:59.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:28:0) after 2m16s
[22:50:15.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:28:0)
[22:50:15.881] Build status: STARTED
[22:50:15.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:29:0) after 7m17s
[22:57:32.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:29:0)
[22:57:32.928] Build status: STARTED
[22:57:32.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:30:0) after 3m28s
[23:01:01.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:30:0)
[23:01:01.175] Build status: STARTED
[23:01:01.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:31:0) after 9m21s
[23:10:22.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:31:0)
[23:10:22.232] Build status: STARTED
[23:10:22.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:32:0) after 6m24s
[23:16:46.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:32:0)
[23:16:46.755] Build status: STARTED
[23:16:46.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:33:0) after 6m36s
[23:23:22.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:33:0)
[23:23:22.876] Build status: STARTED
[23:23:22.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:34:0) after 8m11s
[23:31:34.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:34:0)
[23:31:34.247] Build status: STARTED
[23:31:34.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:35:0) after 2m31s
[23:34:05.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:35:0)
[23:34:05.310] Build status: STARTED
[23:34:05.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:36:0) after 5m18s
[23:39:23.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:36:0)
[23:39:23.358] Build status: STARTED
[23:39:23.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:37:0) after 9m32s
[23:48:55.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:37:0)
[23:48:55.647] Build status: STARTED
[23:48:55.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:38:0) after 8m56s
[23:57:51.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:38:0)
[23:57:51.708] Build status: STARTED
[23:57:51.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:39:0) after 7m42s
[00:05:34.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:39:0)
[00:05:34.314] Build status: STARTED
[00:05:34.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:40:0) after 5m26s
[00:11:00.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:40:0)
[00:11:00.924] Build status: STARTED
[00:11:00.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:41:0) after 1m56s
[00:12:57.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:41:0)
[00:12:57.642] Build status: STARTED
[00:12:57.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:42:0) after 2m34s
[00:15:32.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:42:0)
[00:15:32.263] Build status: STARTED
[00:15:32.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:43:0) after 8m30s
[00:24:02.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:43:0)
[00:24:02.365] Build status: STARTED
[00:24:02.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:44:0) after 9m7s
[00:33:09.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:44:0)
[00:33:09.702] Build status: STARTED
[00:33:09.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:45:0) after 5m53s
[00:39:02.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:45:0)
[00:39:02.842] Build status: STARTED
[00:39:02.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:46:0) after 6m6s
[00:45:08.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:46:0)
[00:45:08.903] Build status: STARTED
[00:45:08.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:47:0) after 7m15s
[00:52:23.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:47:0)
[00:52:23.955] Build status: STARTED
[00:52:23.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:48:0) after 8m37s
[01:01:01.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:48:0)
[01:01:01.557] Build status: STARTED
[01:01:01.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:49:0) after 4m15s
[01:05:16.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:49:0)
[01:05:16.615] Build status: STARTED
[01:05:16.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:50:0) after 8m53s
[01:14:09.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:50:0)
[01:14:09.671] Build status: STARTED
[01:14:09.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:51:0) after 9m4s
[01:23:13.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:51:0)
[01:23:13.780] Build status: STARTED
[01:23:13.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:52:0) after 9m55s
[01:33:08.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:52:0)
[01:33:08.834] Build status: STARTED
[01:33:08.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:53:0) after 2m25s
[01:35:33.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:53:0)
[01:35:33.947] Build status: STARTED
[01:35:33.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:54:0) after 5m48s
[01:41:22.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:54:0)
[01:41:22.155] Build status: STARTED
[01:41:22.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:55:0) after 8m55s
[01:50:17.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:55:0)
[01:50:17.200] Build status: STARTED
[01:50:17.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006134179999937392:56:0) after 4m32s
[01:53:36.758] Received PubSub notification, asking Buildbucket for the build status
[01:53:36.784] Build:
{
"id": "8840704118048569520",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22597,
"createdBy": "project:chromium",
"createTime": "2021-07-25T20:22:45.878306Z",
"startTime": "2021-07-25T20:27:26.983408Z",
"endTime": "2021-07-26T01:53:36.115632478Z",
"updateTime": "2021-07-26T01:53:36.115927333Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ba65ce1eb8832d3626920042cb4fe69f4f66345b",
"ref": "refs/heads/main"
}
}
}
[01:53:36.784] Invocation finished in 5h30m52.151344842s with status FAILED