[19:31:18.853] New invocation is queued and will start shortly
[19:31:20.165] Starting the invocation (attempt 1)
[19:31:20.195] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/599f35300bd9db34a36339972b0d43ff22f48418"
[19:31:20.195] Popped gitiles commit info from properties and tags
[19:31:20.195] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:31:20.195] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:31:20.195] Buildbucket request:
{
"requestId": "8951688638875562160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "599f35300bd9db34a36339972b0d43ff22f48418",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8951688638875562160"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:31:20.664] Scheduled build:
{
"id": "8786258576739824993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29093,
"createdBy": "project:chromium",
"createTime": "2023-03-18T19:31:20.267129033Z",
"updateTime": "2023-03-18T19:31:20.267129033Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "599f35300bd9db34a36339972b0d43ff22f48418",
"ref": "refs/heads/main"
}
}
}
[19:31:20.665] Task URL: https://cr-buildbucket.appspot.com/build/8786258576739824993
[19:31:20.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:2:0) after 1m14s
[19:32:34.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:2:0)
[19:32:34.689] Build status: SCHEDULED
[19:32:34.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:3:0) after 3m38s
[19:33:49.145] Received PubSub notification, asking Buildbucket for the build status
[19:33:49.168] Build status: STARTED
[19:36:12.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:3:0)
[19:36:12.777] Build status: STARTED
[19:36:12.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:5:0) after 1m3s
[19:37:15.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:5:0)
[19:37:15.959] Build status: STARTED
[19:37:15.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:6:0) after 3m19s
[19:40:34.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:6:0)
[19:40:35.014] Build status: STARTED
[19:40:35.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:7:0) after 8m32s
[19:49:07.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:7:0)
[19:49:07.060] Build status: STARTED
[19:49:07.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:8:0) after 1m4s
[19:50:11.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:8:0)
[19:50:11.114] Build status: STARTED
[19:50:11.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:9:0) after 4m55s
[19:55:06.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:9:0)
[19:55:06.158] Build status: STARTED
[19:55:06.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:10:0) after 3m47s
[19:58:53.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:10:0)
[19:58:53.368] Build status: STARTED
[19:58:53.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:11:0) after 1m45s
[20:00:38.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:11:0)
[20:00:38.881] Build status: STARTED
[20:00:38.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:12:0) after 1m53s
[20:02:31.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:12:0)
[20:02:31.926] Build status: STARTED
[20:02:31.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:13:0) after 9m8s
[20:11:40.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:13:0)
[20:11:40.065] Build status: STARTED
[20:11:40.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:14:0) after 1m17s
[20:12:57.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:14:0)
[20:12:57.111] Build status: STARTED
[20:12:57.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:15:0) after 2m28s
[20:15:25.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:15:0)
[20:15:25.152] Build status: STARTED
[20:15:25.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:16:0) after 6m43s
[20:22:08.172] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:16:0)
[20:22:08.194] Build status: STARTED
[20:22:08.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:17:0) after 2m56s
[20:25:04.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:17:0)
[20:25:04.256] Build status: STARTED
[20:25:04.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:18:0) after 7m38s
[20:32:42.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:18:0)
[20:32:42.990] Build status: STARTED
[20:32:42.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:19:0) after 8m57s
[20:41:40.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:19:0)
[20:41:40.037] Build status: STARTED
[20:41:40.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:20:0) after 6m21s
[20:48:01.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:20:0)
[20:48:01.104] Build status: STARTED
[20:48:01.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:21:0) after 6m27s
[20:54:28.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:21:0)
[20:54:28.347] Build status: STARTED
[20:54:28.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:22:0) after 5m18s
[20:59:46.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:22:0)
[20:59:46.352] Build status: STARTED
[20:59:46.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:23:0) after 7m55s
[21:07:41.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:23:0)
[21:07:41.391] Build status: STARTED
[21:07:41.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:24:0) after 5m40s
[21:13:21.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:24:0)
[21:13:21.433] Build status: STARTED
[21:13:21.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:25:0) after 9m54s
[21:23:16.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:25:0)
[21:23:16.359] Build status: STARTED
[21:23:16.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:26:0) after 2m44s
[21:26:00.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:26:0)
[21:26:00.956] Build status: STARTED
[21:26:00.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:27:0) after 3m41s
[21:29:41.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:27:0)
[21:29:42.002] Build status: STARTED
[21:29:42.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:28:0) after 6m2s
[21:35:44.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:28:0)
[21:35:44.508] Build status: STARTED
[21:35:44.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:29:0) after 2m15s
[21:38:00.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:29:0)
[21:38:00.125] Build status: STARTED
[21:38:00.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:30:0) after 3m3s
[21:41:03.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:30:0)
[21:41:03.599] Build status: STARTED
[21:41:03.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:31:0) after 4m28s
[21:45:31.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:31:0)
[21:45:31.638] Build status: STARTED
[21:45:31.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:32:0) after 8m34s
[21:54:05.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:32:0)
[21:54:05.881] Build status: STARTED
[21:54:05.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:33:0) after 3m26s
[21:57:31.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:33:0)
[21:57:31.946] Build status: STARTED
[21:57:31.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:34:0) after 8m20s
[22:05:52.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:34:0)
[22:05:52.180] Build status: STARTED
[22:05:52.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:35:0) after 9m53s
[22:15:45.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:35:0)
[22:15:45.221] Build status: STARTED
[22:15:45.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:36:0) after 8m24s
[22:24:09.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:36:0)
[22:24:09.552] Build status: STARTED
[22:24:09.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:37:0) after 4m39s
[22:28:48.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:37:0)
[22:28:48.611] Build status: STARTED
[22:28:48.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:38:0) after 9m43s
[22:38:31.766] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:38:0)
[22:38:31.787] Build status: STARTED
[22:38:31.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:39:0) after 7m56s
[22:46:27.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:39:0)
[22:46:27.832] Build status: STARTED
[22:46:27.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:40:0) after 4m9s
[22:50:36.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:40:0)
[22:50:36.956] Build status: STARTED
[22:50:36.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:41:0) after 1m48s
[22:52:25.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:41:0)
[22:52:25.144] Build status: STARTED
[22:52:25.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:42:0) after 7m36s
[23:00:01.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:42:0)
[23:00:01.203] Build status: STARTED
[23:00:01.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:43:0) after 3m3s
[23:03:04.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:43:0)
[23:03:04.383] Build status: STARTED
[23:03:04.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:44:0) after 6m25s
[23:09:29.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:44:0)
[23:09:29.400] Build status: STARTED
[23:09:29.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:45:0) after 2m7s
[23:11:36.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:45:0)
[23:11:36.441] Build status: STARTED
[23:11:36.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:46:0) after 8m49s
[23:20:25.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:46:0)
[23:20:25.502] Build status: STARTED
[23:20:25.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:47:0) after 1m1s
[23:21:26.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:47:0)
[23:21:26.548] Build status: STARTED
[23:21:26.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:48:0) after 1m10s
[23:22:36.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:48:0)
[23:22:36.599] Build status: STARTED
[23:22:36.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:49:0) after 2m29s
[23:25:05.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:49:0)
[23:25:05.668] Build status: STARTED
[23:25:05.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:50:0) after 8m13s
[23:33:18.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:50:0)
[23:33:18.811] Build status: STARTED
[23:33:18.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:51:0) after 2m11s
[23:35:29.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:51:0)
[23:35:29.886] Build status: STARTED
[23:35:29.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:52:0) after 7m32s
[23:43:01.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:52:0)
[23:43:01.997] Build status: STARTED
[23:43:01.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:53:0) after 2m7s
[23:45:09.014] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:53:0)
[23:45:09.053] Build status: STARTED
[23:45:09.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:54:0) after 6m53s
[23:52:02.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:54:0)
[23:52:02.095] Build status: STARTED
[23:52:02.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:55:0) after 6m27s
[23:58:29.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:55:0)
[23:58:29.138] Build status: STARTED
[23:58:29.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:56:0) after 5m19s
[00:03:48.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:56:0)
[00:03:48.280] Build status: STARTED
[00:03:48.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:57:0) after 2m41s
[00:06:29.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:57:0)
[00:06:29.325] Build status: STARTED
[00:06:29.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:58:0) after 6m15s
[00:12:44.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:58:0)
[00:12:44.726] Build status: STARTED
[00:12:44.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:59:0) after 9m35s
[00:22:20.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:59:0)
[00:22:20.803] Build status: STARTED
[00:22:20.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:60:0) after 8m57s
[00:31:18.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:60:0)
[00:31:18.283] Build status: STARTED
[00:31:18.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:61:0) after 7m42s
[00:39:00.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:61:0)
[00:39:00.342] Build status: STARTED
[00:39:00.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951688638875562160:62:0) after 8m47s
[00:43:25.147] Received PubSub notification, asking Buildbucket for the build status
[00:43:25.165] Build:
{
"id": "8786258576739824993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29093,
"createdBy": "project:chromium",
"createTime": "2023-03-18T19:31:20.267129033Z",
"startTime": "2023-03-18T19:33:48.640299Z",
"endTime": "2023-03-19T00:43:24.947467124Z",
"updateTime": "2023-03-19T00:43:24.947467124Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "599f35300bd9db34a36339972b0d43ff22f48418",
"ref": "refs/heads/main"
}
}
}
[00:43:25.165] Invocation finished in 5h12m6.319133339s with status FAILED