[12:34:19.259] New invocation is queued and will start shortly
[12:34:20.456] Starting the invocation (attempt 1)
[12:34:20.490] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/dd0a2b11202ed0056690810aac7d2ed647fd8e3c"
[12:34:20.490] Popped gitiles commit info from properties and tags
[12:34:20.490] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:34:20.491] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:34:20.491] Buildbucket request:
{
"requestId": "9004714099173432496",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dd0a2b11202ed0056690810aac7d2ed647fd8e3c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9004714099173432496"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:34:21.999] Scheduled build:
{
"id": "8839284037155158945",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22909,
"createdBy": "project:chromium",
"createTime": "2021-08-10T12:34:20.553972468Z",
"updateTime": "2021-08-10T12:34:20.825201545Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dd0a2b11202ed0056690810aac7d2ed647fd8e3c",
"ref": "refs/heads/main"
}
}
}
[12:34:21.999] Task URL: https://cr-buildbucket.appspot.com/build/8839284037155158945
[12:34:21.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:2:0) after 2m55s
[12:36:44.713] Received PubSub notification, asking Buildbucket for the build status
[12:36:44.739] Build status: STARTED
[12:37:17.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:2:0)
[12:37:17.051] Build status: STARTED
[12:37:17.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:4:0) after 7m36s
[12:44:53.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:4:0)
[12:44:53.218] Build status: STARTED
[12:44:53.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:5:0) after 4m27s
[12:49:20.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:5:0)
[12:49:20.267] Build status: STARTED
[12:49:20.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:6:0) after 6m44s
[12:56:04.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:6:0)
[12:56:04.363] Build status: STARTED
[12:56:04.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:7:0) after 7m47s
[13:03:51.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:7:0)
[13:03:51.427] Build status: STARTED
[13:03:51.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:8:0) after 8m8s
[13:11:59.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:8:0)
[13:11:59.584] Build status: STARTED
[13:11:59.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:9:0) after 4m15s
[13:16:14.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:9:0)
[13:16:14.738] Build status: STARTED
[13:16:14.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:10:0) after 6m44s
[13:22:58.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:10:0)
[13:22:58.801] Build status: STARTED
[13:22:58.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:11:0) after 4m59s
[13:27:57.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:11:0)
[13:27:57.869] Build status: STARTED
[13:27:57.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:12:0) after 4m52s
[13:32:49.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:12:0)
[13:32:49.923] Build status: STARTED
[13:32:49.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:13:0) after 3m57s
[13:36:47.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:13:0)
[13:36:47.256] Build status: STARTED
[13:36:47.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:14:0) after 1m17s
[13:38:04.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:14:0)
[13:38:04.427] Build status: STARTED
[13:38:04.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:15:0) after 3m49s
[13:41:53.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:15:0)
[13:41:53.717] Build status: STARTED
[13:41:53.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:16:0) after 5m58s
[13:47:51.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:16:0)
[13:47:51.777] Build status: STARTED
[13:47:51.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:17:0) after 6m9s
[13:54:00.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:17:0)
[13:54:00.950] Build status: STARTED
[13:54:00.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:18:0) after 4m46s
[13:58:47.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:18:0)
[13:58:47.248] Build status: STARTED
[13:58:47.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:19:0) after 8m36s
[14:07:23.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:19:0)
[14:07:23.532] Build status: STARTED
[14:07:23.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:20:0) after 6m26s
[14:13:49.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:20:0)
[14:13:49.587] Build status: STARTED
[14:13:49.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:21:0) after 8m22s
[14:22:11.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:21:0)
[14:22:11.637] Build status: STARTED
[14:22:11.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:22:0) after 7m57s
[14:30:08.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:22:0)
[14:30:08.811] Build status: STARTED
[14:30:08.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:23:0) after 1m31s
[14:31:39.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:23:0)
[14:31:40.006] Build status: STARTED
[14:31:40.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:24:0) after 5m23s
[14:37:03.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:24:0)
[14:37:03.167] Build status: STARTED
[14:37:03.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:25:0) after 5m0s
[14:42:03.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:25:0)
[14:42:03.430] Build status: STARTED
[14:42:03.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:26:0) after 4m29s
[14:46:32.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:26:0)
[14:46:32.492] Build status: STARTED
[14:46:32.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:27:0) after 8m33s
[14:55:05.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:27:0)
[14:55:05.648] Build status: STARTED
[14:55:05.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:28:0) after 9m47s
[15:04:52.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:28:0)
[15:04:52.736] Build status: STARTED
[15:04:52.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:29:0) after 5m3s
[15:09:55.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:29:0)
[15:09:55.797] Build status: STARTED
[15:09:55.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:30:0) after 3m29s
[15:13:24.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:30:0)
[15:13:25.009] Build status: STARTED
[15:13:25.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:31:0) after 9m11s
[15:22:36.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:31:0)
[15:22:36.177] Build status: STARTED
[15:22:36.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:32:0) after 3m44s
[15:26:20.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:32:0)
[15:26:20.376] Build status: STARTED
[15:26:20.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:33:0) after 2m27s
[15:28:47.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:33:0)
[15:28:47.532] Build status: STARTED
[15:28:47.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:34:0) after 1m39s
[15:30:26.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:34:0)
[15:30:26.593] Build status: STARTED
[15:30:26.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:35:0) after 4m25s
[15:34:51.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:35:0)
[15:34:51.650] Build status: STARTED
[15:34:51.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:36:0) after 5m27s
[15:40:18.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:36:0)
[15:40:18.722] Build status: STARTED
[15:40:18.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:37:0) after 5m20s
[15:45:38.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:37:0)
[15:45:38.781] Build status: STARTED
[15:45:38.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:38:0) after 8m37s
[15:54:15.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:38:0)
[15:54:15.872] Build status: STARTED
[15:54:15.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:39:0) after 5m56s
[16:00:12.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:39:0)
[16:00:12.041] Build status: STARTED
[16:00:12.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:40:0) after 3m37s
[16:03:49.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:40:0)
[16:03:49.198] Build status: STARTED
[16:03:49.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:41:0) after 4m12s
[16:08:01.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:41:0)
[16:08:01.551] Build status: STARTED
[16:08:01.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:42:0) after 3m41s
[16:11:42.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:42:0)
[16:11:42.783] Build status: STARTED
[16:11:42.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:43:0) after 1m21s
[16:13:03.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:43:0)
[16:13:03.896] Build status: STARTED
[16:13:03.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:44:0) after 4m15s
[16:17:19.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:44:0)
[16:17:19.282] Build status: STARTED
[16:17:19.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:45:0) after 1m44s
[16:19:03.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:45:0)
[16:19:03.585] Build status: STARTED
[16:19:03.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:46:0) after 8m5s
[16:27:08.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:46:0)
[16:27:08.735] Build status: STARTED
[16:27:08.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:47:0) after 8m38s
[16:35:46.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:47:0)
[16:35:46.987] Build status: STARTED
[16:35:46.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:48:0) after 3m58s
[16:39:45.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:48:0)
[16:39:45.047] Build status: STARTED
[16:39:45.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:49:0) after 6m25s
[16:46:10.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:49:0)
[16:46:10.269] Build status: STARTED
[16:46:10.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:50:0) after 8m18s
[16:54:28.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:50:0)
[16:54:28.610] Build status: STARTED
[16:54:28.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:51:0) after 4m56s
[16:59:24.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:51:0)
[16:59:24.833] Build status: STARTED
[16:59:24.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:52:0) after 4m2s
[17:03:26.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:52:0)
[17:03:27.056] Build status: STARTED
[17:03:27.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:53:0) after 9m57s
[17:13:24.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:53:0)
[17:13:24.293] Build status: STARTED
[17:13:24.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:54:0) after 1m47s
[17:15:11.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:54:0)
[17:15:11.309] Build status: STARTED
[17:15:11.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:55:0) after 6m45s
[17:21:56.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:55:0)
[17:21:56.571] Build status: STARTED
[17:21:56.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:56:0) after 2m7s
[17:24:03.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:56:0)
[17:24:03.737] Build status: STARTED
[17:24:03.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:57:0) after 7m48s
[17:31:51.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:57:0)
[17:31:51.932] Build status: STARTED
[17:31:51.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:58:0) after 1m52s
[17:33:43.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:58:0)
[17:33:43.975] Build status: STARTED
[17:33:43.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:59:0) after 1m47s
[17:35:31.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:59:0)
[17:35:31.413] Build status: STARTED
[17:35:31.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:60:0) after 5m40s
[17:41:11.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:60:0)
[17:41:11.496] Build status: STARTED
[17:41:11.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:61:0) after 6m16s
[17:47:27.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:61:0)
[17:47:27.589] Build status: STARTED
[17:47:27.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:62:0) after 3m49s
[17:51:16.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:62:0)
[17:51:16.720] Build status: STARTED
[17:51:16.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:63:0) after 2m45s
[17:54:01.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:63:0)
[17:54:01.805] Build status: STARTED
[17:54:01.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004714099173432496:64:0) after 4m25s
[17:54:05.747] Received PubSub notification, asking Buildbucket for the build status
[17:54:05.815] Build:
{
"id": "8839284037155158945",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22909,
"createdBy": "project:chromium",
"createTime": "2021-08-10T12:34:20.553972468Z",
"startTime": "2021-08-10T12:36:43.797683Z",
"endTime": "2021-08-10T17:54:05.438938918Z",
"updateTime": "2021-08-10T17:54:05.439283109Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dd0a2b11202ed0056690810aac7d2ed647fd8e3c",
"ref": "refs/heads/main"
}
}
}
[17:54:05.815] Invocation finished in 5h19m46.569559313s with status FAILED