[15:40:43.600] New invocation is queued and will start shortly
[15:40:44.732] Starting the invocation (attempt 1)
[15:40:44.767] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a22daf95d2b52d8de4d0e0b2df0bfb8b18f73b9a"
[15:40:44.767] Popped gitiles commit info from properties and tags
[15:40:44.767] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:40:44.767] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:40:44.767] Buildbucket request:
{
"requestId": "9013943262116397360",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a22daf95d2b52d8de4d0e0b2df0bfb8b18f73b9a",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9013943262116397360"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:40:45.928] Scheduled build:
{
"id": "8848513199866567440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22051,
"createdBy": "project:chromium",
"createTime": "2021-04-30T15:40:45.113322Z",
"updateTime": "2021-04-30T15:40:45.757699Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a22daf95d2b52d8de4d0e0b2df0bfb8b18f73b9a",
"ref": "refs/heads/master"
}
},
"canary": true
}
[15:40:45.928] Task URL: https://cr-buildbucket.appspot.com/build/8848513199866567440
[15:40:45.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:2:0) after 7m49s
[15:43:51.151] Received PubSub notification, asking Buildbucket for the build status
[15:43:51.175] Build status: STARTED
[15:48:35.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:2:0)
[15:48:35.086] Build status: STARTED
[15:48:35.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:4:0) after 2m40s
[15:51:15.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:4:0)
[15:51:15.285] Build status: STARTED
[15:51:15.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:5:0) after 1m1s
[15:52:16.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:5:0)
[15:52:16.336] Build status: STARTED
[15:52:16.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:6:0) after 5m45s
[15:58:01.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:6:0)
[15:58:01.386] Build status: STARTED
[15:58:01.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:7:0) after 6m55s
[16:04:56.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:7:0)
[16:04:56.537] Build status: STARTED
[16:04:56.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:8:0) after 8m33s
[16:13:29.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:8:0)
[16:13:29.611] Build status: STARTED
[16:13:29.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:9:0) after 1m43s
[16:15:12.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:9:0)
[16:15:12.855] Build status: STARTED
[16:15:12.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:10:0) after 6m8s
[16:21:21.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:10:0)
[16:21:21.087] Build status: STARTED
[16:21:21.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:11:0) after 9m27s
[16:30:48.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:11:0)
[16:30:48.218] Build status: STARTED
[16:30:48.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:12:0) after 8m50s
[16:39:38.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:12:0)
[16:39:38.454] Build status: STARTED
[16:39:38.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:13:0) after 7m11s
[16:46:49.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:13:0)
[16:46:49.504] Build status: STARTED
[16:46:49.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:14:0) after 9m34s
[16:56:23.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:14:0)
[16:56:23.664] Build status: STARTED
[16:56:23.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:15:0) after 8m50s
[17:05:13.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:15:0)
[17:05:13.755] Build status: STARTED
[17:05:13.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:16:0) after 6m51s
[17:12:04.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:16:0)
[17:12:04.806] Build status: STARTED
[17:12:04.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:17:0) after 3m13s
[17:15:17.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:17:0)
[17:15:17.905] Build status: STARTED
[17:15:17.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:18:0) after 2m31s
[17:17:48.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:18:0)
[17:17:48.965] Build status: STARTED
[17:17:48.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:19:0) after 1m37s
[17:19:26.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:19:0)
[17:19:26.231] Build status: STARTED
[17:19:26.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:20:0) after 3m26s
[17:22:52.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:20:0)
[17:22:52.345] Build status: STARTED
[17:22:52.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:21:0) after 8m53s
[17:31:45.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:21:0)
[17:31:45.471] Build status: STARTED
[17:31:45.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:22:0) after 5m44s
[17:37:29.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:22:0)
[17:37:29.805] Build status: STARTED
[17:37:29.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:23:0) after 5m21s
[17:42:50.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:23:0)
[17:42:50.979] Build status: STARTED
[17:42:50.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:24:0) after 1m27s
[17:44:18.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:24:0)
[17:44:18.169] Build status: STARTED
[17:44:18.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:25:0) after 7m32s
[17:51:50.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:25:0)
[17:51:50.252] Build status: STARTED
[17:51:50.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:26:0) after 6m23s
[17:58:13.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:26:0)
[17:58:13.318] Build status: STARTED
[17:58:13.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:27:0) after 6m54s
[18:05:07.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:27:0)
[18:05:07.531] Build status: STARTED
[18:05:07.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:28:0) after 7m45s
[18:12:52.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:28:0)
[18:12:52.677] Build status: STARTED
[18:12:52.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:29:0) after 3m23s
[18:16:15.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:29:0)
[18:16:15.804] Build status: STARTED
[18:16:15.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:30:0) after 9m9s
[18:25:24.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:30:0)
[18:25:24.913] Build status: STARTED
[18:25:24.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:31:0) after 1m13s
[18:26:38.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:31:0)
[18:26:38.149] Build status: STARTED
[18:26:38.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:32:0) after 2m12s
[18:28:50.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:32:0)
[18:28:50.256] Build status: STARTED
[18:28:50.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:33:0) after 3m45s
[18:32:35.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:33:0)
[18:32:35.407] Build status: STARTED
[18:32:35.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:34:0) after 5m39s
[18:38:14.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:34:0)
[18:38:14.522] Build status: STARTED
[18:38:14.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:35:0) after 1m46s
[18:40:00.548] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:35:0)
[18:40:00.606] Build status: STARTED
[18:40:00.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:36:0) after 1m29s
[18:41:29.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:36:0)
[18:41:29.740] Build status: STARTED
[18:41:29.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:37:0) after 9m7s
[18:50:36.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:37:0)
[18:50:36.800] Build status: STARTED
[18:50:36.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:38:0) after 7m52s
[18:58:28.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:38:0)
[18:58:28.907] Build status: STARTED
[18:58:28.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:39:0) after 1m2s
[18:59:30.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:39:0)
[18:59:30.958] Build status: STARTED
[18:59:30.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:40:0) after 4m41s
[19:04:11.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:40:0)
[19:04:12.002] Build status: STARTED
[19:04:12.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:41:0) after 5m30s
[19:09:42.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:41:0)
[19:09:42.055] Build status: STARTED
[19:09:42.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:42:0) after 5m3s
[19:14:45.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:42:0)
[19:14:45.119] Build status: STARTED
[19:14:45.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:43:0) after 2m32s
[19:17:17.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:43:0)
[19:17:17.568] Build status: STARTED
[19:17:17.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:44:0) after 7m7s
[19:24:24.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:44:0)
[19:24:24.617] Build status: STARTED
[19:24:24.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:45:0) after 3m37s
[19:28:01.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:45:0)
[19:28:01.899] Build status: STARTED
[19:28:01.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:46:0) after 1m21s
[19:29:23.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:46:0)
[19:29:23.195] Build status: STARTED
[19:29:23.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:47:0) after 6m47s
[19:36:10.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:47:0)
[19:36:10.306] Build status: STARTED
[19:36:10.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:48:0) after 4m47s
[19:40:57.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:48:0)
[19:40:57.404] Build status: STARTED
[19:40:57.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:49:0) after 9m21s
[19:50:18.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:49:0)
[19:50:18.874] Build status: STARTED
[19:50:18.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:50:0) after 3m50s
[19:54:08.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:50:0)
[19:54:09.045] Build status: STARTED
[19:54:09.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:51:0) after 1m24s
[19:55:33.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:51:0)
[19:55:33.222] Build status: STARTED
[19:55:33.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:52:0) after 8m16s
[20:03:49.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:52:0)
[20:03:49.392] Build status: STARTED
[20:03:49.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:53:0) after 1m4s
[20:04:53.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:53:0)
[20:04:53.574] Build status: STARTED
[20:04:53.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:54:0) after 1m26s
[20:06:19.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:54:0)
[20:06:19.632] Build status: STARTED
[20:06:19.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:55:0) after 1m41s
[20:08:00.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:55:0)
[20:08:01.039] Build status: STARTED
[20:08:01.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:56:0) after 4m3s
[20:12:04.146] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:56:0)
[20:12:04.183] Build status: STARTED
[20:12:04.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:57:0) after 5m47s
[20:17:51.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:57:0)
[20:17:51.363] Build status: STARTED
[20:17:51.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:58:0) after 8m58s
[20:26:49.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:58:0)
[20:26:49.441] Build status: STARTED
[20:26:49.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:59:0) after 1m25s
[20:28:14.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:59:0)
[20:28:14.948] Build status: STARTED
[20:28:14.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013943262116397360:60:0) after 1m33s
[20:29:31.395] Received PubSub notification, asking Buildbucket for the build status
[20:29:31.434] Build:
{
"id": "8848513199866567440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22051,
"createdBy": "project:chromium",
"createTime": "2021-04-30T15:40:45.113322Z",
"startTime": "2021-04-30T15:43:49.206095Z",
"endTime": "2021-04-30T20:29:31.043920643Z",
"updateTime": "2021-04-30T20:29:31.044305795Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a22daf95d2b52d8de4d0e0b2df0bfb8b18f73b9a",
"ref": "refs/heads/master"
}
},
"canary": true
}
[20:29:31.434] Invocation finished in 4h48m47.849634417s with status FAILED