[10:10:25.481] New invocation is queued and will start shortly
[10:10:26.627] Starting the invocation (attempt 1)
[10:10:26.666] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c9897e450f98bc66ab6448b04aa8fdf10cbf16c5"
[10:10:26.667] Popped gitiles commit info from properties and tags
[10:10:26.667] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:10:26.667] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:10:26.667] Buildbucket request:
{
"requestId": "9001280467627116432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c9897e450f98bc66ab6448b04aa8fdf10cbf16c5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9001280467627116432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:10:27.372] Scheduled build:
{
"id": "8835850405597988369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23103,
"createdBy": "project:chromium",
"createTime": "2021-09-17T10:10:26.781629413Z",
"updateTime": "2021-09-17T10:10:27.085666332Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c9897e450f98bc66ab6448b04aa8fdf10cbf16c5",
"ref": "refs/heads/main"
}
}
}
[10:10:27.372] Task URL: https://cr-buildbucket.appspot.com/build/8835850405597988369
[10:10:27.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:2:0) after 4m31s
[10:14:08.802] Received PubSub notification, asking Buildbucket for the build status
[10:14:08.870] Build status: STARTED
[10:14:58.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:2:0)
[10:14:58.429] Build status: STARTED
[10:14:58.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:4:0) after 7m33s
[10:22:31.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:4:0)
[10:22:31.516] Build status: STARTED
[10:22:31.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:5:0) after 2m4s
[10:24:35.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:5:0)
[10:24:35.683] Build status: STARTED
[10:24:35.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:6:0) after 7m4s
[10:31:39.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:6:0)
[10:31:39.736] Build status: STARTED
[10:31:39.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:7:0) after 9m15s
[10:40:54.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:7:0)
[10:40:54.801] Build status: STARTED
[10:40:54.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:8:0) after 6m19s
[10:47:13.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:8:0)
[10:47:13.965] Build status: STARTED
[10:47:13.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:9:0) after 4m19s
[10:51:33.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:9:0)
[10:51:33.107] Build status: STARTED
[10:51:33.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:10:0) after 8m52s
[11:00:25.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:10:0)
[11:00:25.188] Build status: STARTED
[11:00:25.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:11:0) after 9m24s
[11:09:49.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:11:0)
[11:09:49.248] Build status: STARTED
[11:09:49.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:12:0) after 8m1s
[11:17:50.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:12:0)
[11:17:50.307] Build status: STARTED
[11:17:50.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:13:0) after 3m10s
[11:21:00.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:13:0)
[11:21:00.370] Build status: STARTED
[11:21:00.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:14:0) after 3m28s
[11:24:28.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:14:0)
[11:24:28.554] Build status: STARTED
[11:24:28.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:15:0) after 4m29s
[11:28:57.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:15:0)
[11:28:57.628] Build status: STARTED
[11:28:57.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:16:0) after 4m47s
[11:33:44.650] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:16:0)
[11:33:44.680] Build status: STARTED
[11:33:44.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:17:0) after 9m59s
[11:43:43.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:17:0)
[11:43:43.844] Build status: STARTED
[11:43:43.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:18:0) after 2m55s
[11:46:38.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:18:0)
[11:46:38.995] Build status: STARTED
[11:46:38.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:19:0) after 8m8s
[11:54:47.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:19:0)
[11:54:47.260] Build status: STARTED
[11:54:47.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:20:0) after 5m41s
[12:00:28.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:20:0)
[12:00:28.357] Build status: STARTED
[12:00:28.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:21:0) after 9m43s
[12:10:11.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:21:0)
[12:10:11.656] Build status: STARTED
[12:10:11.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:22:0) after 2m44s
[12:12:55.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:22:0)
[12:12:55.842] Build status: STARTED
[12:12:55.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:23:0) after 2m27s
[12:15:22.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:23:0)
[12:15:23.003] Build status: STARTED
[12:15:23.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:24:0) after 2m19s
[12:17:42.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:24:0)
[12:17:42.129] Build status: STARTED
[12:17:42.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:25:0) after 9m10s
[12:26:52.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:25:0)
[12:26:52.308] Build status: STARTED
[12:26:52.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:26:0) after 3m12s
[12:30:04.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:26:0)
[12:30:04.450] Build status: STARTED
[12:30:04.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:27:0) after 8m44s
[12:38:48.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:27:0)
[12:38:48.564] Build status: STARTED
[12:38:48.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:28:0) after 8m52s
[12:47:40.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:28:0)
[12:47:40.652] Build status: STARTED
[12:47:40.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:29:0) after 8m11s
[12:55:51.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:29:0)
[12:55:51.859] Build status: STARTED
[12:55:51.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:30:0) after 2m50s
[12:58:41.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:30:0)
[12:58:41.939] Build status: STARTED
[12:58:41.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:31:0) after 1m39s
[13:00:20.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:31:0)
[13:00:21.006] Build status: STARTED
[13:00:21.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:32:0) after 6m7s
[13:06:28.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:32:0)
[13:06:28.099] Build status: STARTED
[13:06:28.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:33:0) after 8m36s
[13:15:04.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:33:0)
[13:15:04.189] Build status: STARTED
[13:15:04.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:34:0) after 8m25s
[13:23:29.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:34:0)
[13:23:29.291] Build status: STARTED
[13:23:29.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:35:0) after 2m36s
[13:26:05.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:35:0)
[13:26:05.529] Build status: STARTED
[13:26:05.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:36:0) after 6m34s
[13:32:39.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:36:0)
[13:32:39.587] Build status: STARTED
[13:32:39.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:37:0) after 5m20s
[13:37:59.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:37:0)
[13:37:59.667] Build status: STARTED
[13:37:59.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:38:0) after 9m18s
[13:47:17.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:38:0)
[13:47:17.773] Build status: STARTED
[13:47:17.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:39:0) after 2m5s
[13:49:22.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:39:0)
[13:49:23.004] Build status: STARTED
[13:49:23.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:40:0) after 2m31s
[13:51:53.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:40:0)
[13:51:54.016] Build status: STARTED
[13:51:54.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:41:0) after 4m38s
[13:56:32.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:41:0)
[13:56:32.176] Build status: STARTED
[13:56:32.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:42:0) after 3m14s
[13:59:46.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:42:0)
[13:59:46.348] Build status: STARTED
[13:59:46.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:43:0) after 3m24s
[14:03:10.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:43:0)
[14:03:10.506] Build status: STARTED
[14:03:10.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:44:0) after 4m35s
[14:07:45.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:44:0)
[14:07:45.608] Build status: STARTED
[14:07:45.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:45:0) after 7m55s
[14:15:40.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:45:0)
[14:15:40.720] Build status: STARTED
[14:15:40.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:46:0) after 6m21s
[14:22:02.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:46:0)
[14:22:02.187] Build status: STARTED
[14:22:02.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:47:0) after 4m34s
[14:26:36.212] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:47:0)
[14:26:36.257] Build status: STARTED
[14:26:36.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:48:0) after 9m4s
[14:35:40.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:48:0)
[14:35:40.325] Build status: STARTED
[14:35:40.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:49:0) after 2m36s
[14:38:16.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:49:0)
[14:38:16.497] Build status: STARTED
[14:38:16.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:50:0) after 8m52s
[14:47:08.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:50:0)
[14:47:08.543] Build status: STARTED
[14:47:08.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:51:0) after 2m49s
[14:49:57.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:51:0)
[14:49:57.635] Build status: STARTED
[14:49:57.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:52:0) after 4m44s
[14:54:41.947] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:52:0)
[14:54:41.979] Build status: STARTED
[14:54:41.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:53:0) after 3m5s
[14:57:47.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:53:0)
[14:57:47.484] Build status: STARTED
[14:57:47.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:54:0) after 9m54s
[15:07:41.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:54:0)
[15:07:41.746] Build status: STARTED
[15:07:41.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:55:0) after 8m37s
[15:16:18.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:55:0)
[15:16:19.071] Build status: STARTED
[15:16:19.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:56:0) after 1m24s
[15:17:43.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:56:0)
[15:17:43.225] Build status: STARTED
[15:17:43.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:57:0) after 1m17s
[15:19:00.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:57:0)
[15:19:00.497] Build status: STARTED
[15:19:00.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:58:0) after 9m49s
[15:28:49.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:58:0)
[15:28:49.821] Build status: STARTED
[15:28:49.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:59:0) after 7m37s
[15:36:27.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:59:0)
[15:36:27.354] Build status: STARTED
[15:36:27.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:60:0) after 8m46s
[15:45:13.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:60:0)
[15:45:13.578] Build status: STARTED
[15:45:13.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001280467627116432:61:0) after 3m59s
[15:45:44.757] Received PubSub notification, asking Buildbucket for the build status
[15:45:44.800] Build:
{
"id": "8835850405597988369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23103,
"createdBy": "project:chromium",
"createTime": "2021-09-17T10:10:26.781629413Z",
"startTime": "2021-09-17T10:14:07.990364Z",
"endTime": "2021-09-17T15:45:44.269670569Z",
"updateTime": "2021-09-17T15:45:44.270761614Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c9897e450f98bc66ab6448b04aa8fdf10cbf16c5",
"ref": "refs/heads/main"
}
}
}
[15:45:44.800] Invocation finished in 5h35m19.338151876s with status FAILED