[06:18:32.312] New invocation is queued and will start shortly
[06:18:33.552] Starting the invocation (attempt 1)
[06:18:33.587] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ae44e584686b5891a82dd07e49b159f608f70003"
[06:18:33.587] Popped gitiles commit info from properties and tags
[06:18:33.587] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:18:33.588] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:18:33.588] Buildbucket request:
{
"requestId": "8960254630851327360",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae44e584686b5891a82dd07e49b159f608f70003",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8960254630851327360"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:18:34.021] Scheduled build:
{
"id": "8794824568780575857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28319,
"createdBy": "project:chromium",
"createTime": "2022-12-14T06:18:33.663652246Z",
"updateTime": "2022-12-14T06:18:33.663652246Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae44e584686b5891a82dd07e49b159f608f70003",
"ref": "refs/heads/main"
}
}
}
[06:18:34.021] Task URL: https://cr-buildbucket.appspot.com/build/8794824568780575857
[06:18:34.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:2:0) after 3m28s
[06:20:55.371] Received PubSub notification, asking Buildbucket for the build status
[06:20:55.401] Build status: STARTED
[06:22:02.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:2:0)
[06:22:02.166] Build status: STARTED
[06:22:02.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:4:0) after 4m24s
[06:26:26.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:4:0)
[06:26:26.225] Build status: STARTED
[06:26:26.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:5:0) after 3m15s
[06:29:41.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:5:0)
[06:29:41.302] Build status: STARTED
[06:29:41.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:6:0) after 9m1s
[06:38:42.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:6:0)
[06:38:42.354] Build status: STARTED
[06:38:42.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:7:0) after 5m15s
[06:43:57.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:7:0)
[06:43:57.502] Build status: STARTED
[06:43:57.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:8:0) after 2m46s
[06:46:43.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:8:0)
[06:46:43.674] Build status: STARTED
[06:46:43.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:9:0) after 8m12s
[06:54:56.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:9:0)
[06:54:56.147] Build status: STARTED
[06:54:56.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:10:0) after 6m35s
[07:01:31.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:10:0)
[07:01:31.337] Build status: STARTED
[07:01:31.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:11:0) after 8m48s
[07:10:19.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:11:0)
[07:10:19.436] Build status: STARTED
[07:10:19.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:12:0) after 8m33s
[07:18:52.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:12:0)
[07:18:52.478] Build status: STARTED
[07:18:52.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:13:0) after 3m44s
[07:22:36.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:13:0)
[07:22:36.591] Build status: STARTED
[07:22:36.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:14:0) after 2m49s
[07:25:25.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:14:0)
[07:25:25.840] Build status: STARTED
[07:25:25.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:15:0) after 7m59s
[07:33:24.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:15:0)
[07:33:24.969] Build status: STARTED
[07:33:24.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:16:0) after 6m54s
[07:40:19.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:16:0)
[07:40:19.462] Build status: STARTED
[07:40:19.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:17:0) after 6m14s
[07:46:33.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:17:0)
[07:46:33.506] Build status: STARTED
[07:46:33.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:18:0) after 6m1s
[07:52:34.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:18:0)
[07:52:34.626] Build status: STARTED
[07:52:34.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:19:0) after 6m20s
[07:58:54.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:19:0)
[07:58:54.770] Build status: STARTED
[07:58:54.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:20:0) after 5m5s
[08:03:59.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:20:0)
[08:03:59.833] Build status: STARTED
[08:03:59.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:21:0) after 1m15s
[08:05:14.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:21:0)
[08:05:15.013] Build status: STARTED
[08:05:15.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:22:0) after 9m19s
[08:14:34.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:22:0)
[08:14:34.059] Build status: STARTED
[08:14:34.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:23:0) after 5m6s
[08:19:40.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:23:0)
[08:19:40.141] Build status: STARTED
[08:19:40.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:24:0) after 7m7s
[08:26:47.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:24:0)
[08:26:47.247] Build status: STARTED
[08:26:47.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:25:0) after 2m26s
[08:29:13.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:25:0)
[08:29:13.295] Build status: STARTED
[08:29:13.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:26:0) after 5m0s
[08:34:13.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:26:0)
[08:34:13.507] Build status: STARTED
[08:34:13.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:27:0) after 6m49s
[08:41:02.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:27:0)
[08:41:02.788] Build status: STARTED
[08:41:02.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:28:0) after 3m6s
[08:44:08.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:28:0)
[08:44:08.948] Build status: STARTED
[08:44:08.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:29:0) after 2m50s
[08:46:59.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:29:0)
[08:46:59.580] Build status: STARTED
[08:46:59.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:30:0) after 7m27s
[08:54:26.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:30:0)
[08:54:26.724] Build status: STARTED
[08:54:26.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:31:0) after 8m59s
[09:03:26.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:31:0)
[09:03:26.056] Build status: STARTED
[09:03:26.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:32:0) after 3m10s
[09:06:36.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:32:0)
[09:06:36.316] Build status: STARTED
[09:06:36.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:33:0) after 1m16s
[09:07:52.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:33:0)
[09:07:52.375] Build status: STARTED
[09:07:52.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:34:0) after 8m56s
[09:16:48.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:34:0)
[09:16:48.456] Build status: STARTED
[09:16:48.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:35:0) after 6m42s
[09:23:30.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:35:0)
[09:23:30.504] Build status: STARTED
[09:23:30.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:36:0) after 8m5s
[09:31:35.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:36:0)
[09:31:35.625] Build status: STARTED
[09:31:35.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:37:0) after 4m7s
[09:35:42.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:37:0)
[09:35:42.689] Build status: STARTED
[09:35:42.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:38:0) after 1m45s
[09:37:27.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:38:0)
[09:37:28.057] Build status: STARTED
[09:37:28.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:39:0) after 3m10s
[09:40:38.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:39:0)
[09:40:38.289] Build status: STARTED
[09:40:38.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:40:0) after 5m59s
[09:46:37.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:40:0)
[09:46:37.536] Build status: STARTED
[09:46:37.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:41:0) after 5m45s
[09:52:22.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:41:0)
[09:52:22.692] Build status: STARTED
[09:52:22.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:42:0) after 7m13s
[09:59:36.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:42:0)
[09:59:36.075] Build status: STARTED
[09:59:36.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:43:0) after 3m56s
[10:03:32.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:43:0)
[10:03:32.272] Build status: STARTED
[10:03:32.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:44:0) after 5m52s
[10:09:24.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:44:0)
[10:09:24.539] Build status: STARTED
[10:09:24.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:45:0) after 3m25s
[10:12:50.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:45:0)
[10:12:50.265] Build status: STARTED
[10:12:50.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:46:0) after 5m31s
[10:18:21.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:46:0)
[10:18:21.671] Build status: STARTED
[10:18:21.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:47:0) after 1m3s
[10:19:25.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:47:0)
[10:19:25.093] Build status: STARTED
[10:19:25.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:48:0) after 7m2s
[10:26:27.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:48:0)
[10:26:27.640] Build status: STARTED
[10:26:27.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:49:0) after 3m5s
[10:29:32.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:49:0)
[10:29:32.688] Build status: STARTED
[10:29:32.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:50:0) after 2m56s
[10:32:28.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:50:0)
[10:32:28.928] Build status: STARTED
[10:32:28.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:51:0) after 1m49s
[10:34:18.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:51:0)
[10:34:18.135] Build status: STARTED
[10:34:18.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:52:0) after 4m25s
[10:38:43.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:52:0)
[10:38:43.207] Build status: STARTED
[10:38:43.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:53:0) after 8m30s
[10:47:13.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:53:0)
[10:47:13.291] Build status: STARTED
[10:47:13.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:54:0) after 1m55s
[10:49:08.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:54:0)
[10:49:08.615] Build status: STARTED
[10:49:08.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:55:0) after 3m10s
[10:52:18.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:55:0)
[10:52:18.660] Build status: STARTED
[10:52:18.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:56:0) after 7m8s
[10:59:26.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:56:0)
[10:59:26.894] Build status: STARTED
[10:59:26.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:57:0) after 6m29s
[11:05:55.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:57:0)
[11:05:55.983] Build status: STARTED
[11:05:55.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:58:0) after 3m1s
[11:08:57.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:58:0)
[11:08:57.162] Build status: STARTED
[11:08:57.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:59:0) after 8m2s
[11:16:59.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:59:0)
[11:16:59.162] Build status: STARTED
[11:16:59.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:60:0) after 2m47s
[11:19:46.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:60:0)
[11:19:46.445] Build status: STARTED
[11:19:46.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:61:0) after 2m26s
[11:22:12.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:61:0)
[11:22:12.498] Build status: STARTED
[11:22:12.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:62:0) after 3m4s
[11:25:16.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:62:0)
[11:25:16.655] Build status: STARTED
[11:25:16.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:63:0) after 3m29s
[11:28:45.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:63:0)
[11:28:45.723] Build status: STARTED
[11:28:45.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:64:0) after 5m24s
[11:34:09.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:64:0)
[11:34:09.823] Build status: STARTED
[11:34:09.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:65:0) after 7m22s
[11:41:31.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:65:0)
[11:41:32.111] Build status: STARTED
[11:41:32.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:66:0) after 5m18s
[11:46:50.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:66:0)
[11:46:50.346] Build status: STARTED
[11:46:50.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:67:0) after 9m58s
[11:56:48.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:67:0)
[11:56:48.396] Build status: STARTED
[11:56:48.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8960254630851327360:68:0) after 7m5s
[12:03:17.783] Received PubSub notification, asking Buildbucket for the build status
[12:03:17.816] Build:
{
"id": "8794824568780575857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28319,
"createdBy": "project:chromium",
"createTime": "2022-12-14T06:18:33.663652246Z",
"startTime": "2022-12-14T06:20:54.885921Z",
"endTime": "2022-12-14T12:03:17.578921575Z",
"updateTime": "2022-12-14T12:03:17.578921575Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae44e584686b5891a82dd07e49b159f608f70003",
"ref": "refs/heads/main"
}
}
}
[12:03:17.816] Invocation finished in 5h44m45.512001693s with status FAILED