[14:31:32.155] New invocation is queued and will start shortly
[14:31:33.296] Starting the invocation (attempt 1)
[14:31:33.324] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e85e76e19aa493505fd93d9eaa56b1a8f43c44aa"
[14:31:33.324] Popped gitiles commit info from properties and tags
[14:31:33.324] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:31:33.326] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:31:33.326] Buildbucket request:
{
"requestId": "8951073320540572528",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e85e76e19aa493505fd93d9eaa56b1a8f43c44aa",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8951073320540572528"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:31:34.266] Scheduled build:
{
"id": "8785643258573954337",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29124,
"createdBy": "project:chromium",
"createTime": "2023-03-25T14:31:33.398981071Z",
"updateTime": "2023-03-25T14:31:33.398981071Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e85e76e19aa493505fd93d9eaa56b1a8f43c44aa",
"ref": "refs/heads/main"
}
}
}
[14:31:34.266] Task URL: https://cr-buildbucket.appspot.com/build/8785643258573954337
[14:31:34.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:2:0) after 9m30s
[14:34:05.636] Received PubSub notification, asking Buildbucket for the build status
[14:34:05.669] Build status: STARTED
[14:41:04.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:2:0)
[14:41:04.516] Build status: STARTED
[14:41:04.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:4:0) after 9m40s
[14:50:44.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:4:0)
[14:50:44.551] Build status: STARTED
[14:50:44.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:5:0) after 4m3s
[14:54:47.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:5:0)
[14:54:47.681] Build status: STARTED
[14:54:47.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:6:0) after 9m57s
[15:04:44.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:6:0)
[15:04:44.858] Build status: STARTED
[15:04:44.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:7:0) after 2m6s
[15:06:50.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:7:0)
[15:06:51.130] Build status: STARTED
[15:06:51.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:8:0) after 6m12s
[15:13:03.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:8:0)
[15:13:03.439] Build status: STARTED
[15:13:03.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:9:0) after 3m30s
[15:16:33.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:9:0)
[15:16:33.556] Build status: STARTED
[15:16:33.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:10:0) after 1m40s
[15:18:13.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:10:0)
[15:18:13.701] Build status: STARTED
[15:18:13.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:11:0) after 6m18s
[15:24:31.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:11:0)
[15:24:31.847] Build status: STARTED
[15:24:31.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:12:0) after 9m56s
[15:34:27.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:12:0)
[15:34:27.889] Build status: STARTED
[15:34:27.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:13:0) after 5m9s
[15:39:36.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:13:0)
[15:39:36.932] Build status: STARTED
[15:39:36.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:14:0) after 9m21s
[15:48:57.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:14:0)
[15:48:57.976] Build status: STARTED
[15:48:57.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:15:0) after 8m36s
[15:57:34.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:15:0)
[15:57:34.137] Build status: STARTED
[15:57:34.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:16:0) after 7m41s
[16:05:15.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:16:0)
[16:05:15.209] Build status: STARTED
[16:05:15.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:17:0) after 1m14s
[16:06:29.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:17:0)
[16:06:29.359] Build status: STARTED
[16:06:29.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:18:0) after 2m41s
[16:09:10.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:18:0)
[16:09:10.449] Build status: STARTED
[16:09:10.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:19:0) after 2m26s
[16:11:36.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:19:0)
[16:11:36.569] Build status: STARTED
[16:11:36.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:20:0) after 3m16s
[16:14:52.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:20:0)
[16:14:52.624] Build status: STARTED
[16:14:52.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:21:0) after 2m9s
[16:17:01.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:21:0)
[16:17:01.816] Build status: STARTED
[16:17:01.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:22:0) after 5m22s
[16:22:24.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:22:0)
[16:22:24.074] Build status: STARTED
[16:22:24.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:23:0) after 3m16s
[16:25:40.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:23:0)
[16:25:40.124] Build status: STARTED
[16:25:40.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:24:0) after 9m1s
[16:34:41.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:24:0)
[16:34:41.264] Build status: STARTED
[16:34:41.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:25:0) after 3m1s
[16:37:42.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:25:0)
[16:37:42.352] Build status: STARTED
[16:37:42.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:26:0) after 1m9s
[16:38:51.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:26:0)
[16:38:51.442] Build status: STARTED
[16:38:51.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:27:0) after 6m46s
[16:45:37.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:27:0)
[16:45:37.492] Build status: STARTED
[16:45:37.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:28:0) after 3m53s
[16:49:30.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:28:0)
[16:49:30.537] Build status: STARTED
[16:49:30.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:29:0) after 6m45s
[16:56:15.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:29:0)
[16:56:15.648] Build status: STARTED
[16:56:15.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:30:0) after 5m8s
[17:01:23.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:30:0)
[17:01:23.656] Build status: STARTED
[17:01:23.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:31:0) after 2m6s
[17:03:29.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:31:0)
[17:03:29.699] Build status: STARTED
[17:03:29.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:32:0) after 4m56s
[17:08:25.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:32:0)
[17:08:25.855] Build status: STARTED
[17:08:25.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:33:0) after 1m24s
[17:09:49.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:33:0)
[17:09:49.894] Build status: STARTED
[17:09:49.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:34:0) after 5m12s
[17:15:01.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:34:0)
[17:15:01.949] Build status: STARTED
[17:15:01.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:35:0) after 5m0s
[17:20:01.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:35:0)
[17:20:02.017] Build status: STARTED
[17:20:02.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:36:0) after 8m56s
[17:28:58.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:36:0)
[17:28:58.057] Build status: STARTED
[17:28:58.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:37:0) after 9m6s
[17:38:04.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:37:0)
[17:38:04.067] Build status: STARTED
[17:38:04.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:38:0) after 9m38s
[17:47:42.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:38:0)
[17:47:42.119] Build status: STARTED
[17:47:42.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:39:0) after 6m45s
[17:54:27.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:39:0)
[17:54:27.177] Build status: STARTED
[17:54:27.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:40:0) after 3m0s
[17:57:27.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:40:0)
[17:57:27.196] Build status: STARTED
[17:57:27.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:41:0) after 3m17s
[18:00:44.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:41:0)
[18:00:44.285] Build status: STARTED
[18:00:44.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:42:0) after 1m3s
[18:01:47.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:42:0)
[18:01:47.434] Build status: STARTED
[18:01:47.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:43:0) after 3m41s
[18:05:28.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:43:0)
[18:05:28.504] Build status: STARTED
[18:05:28.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:44:0) after 7m27s
[18:12:55.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:44:0)
[18:12:55.549] Build status: STARTED
[18:12:55.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:45:0) after 8m35s
[18:21:30.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:45:0)
[18:21:30.703] Build status: STARTED
[18:21:30.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:46:0) after 3m9s
[18:24:39.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:46:0)
[18:24:39.742] Build status: STARTED
[18:24:39.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:47:0) after 9m28s
[18:34:07.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:47:0)
[18:34:07.788] Build status: STARTED
[18:34:07.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:48:0) after 3m46s
[18:37:53.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:48:0)
[18:37:53.876] Build status: STARTED
[18:37:53.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:49:0) after 6m57s
[18:44:50.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:49:0)
[18:44:50.936] Build status: STARTED
[18:44:50.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:50:0) after 8m40s
[18:53:30.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:50:0)
[18:53:30.978] Build status: STARTED
[18:53:30.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:51:0) after 2m2s
[18:55:33.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:51:0)
[18:55:33.128] Build status: STARTED
[18:55:33.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:52:0) after 9m41s
[19:05:14.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:52:0)
[19:05:14.219] Build status: STARTED
[19:05:14.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:53:0) after 1m6s
[19:06:20.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:53:0)
[19:06:20.267] Build status: STARTED
[19:06:20.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:54:0) after 3m35s
[19:09:55.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:54:0)
[19:09:55.308] Build status: STARTED
[19:09:55.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:55:0) after 9m11s
[19:19:06.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:55:0)
[19:19:06.472] Build status: STARTED
[19:19:06.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:56:0) after 3m7s
[19:22:13.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:56:0)
[19:22:13.595] Build status: STARTED
[19:22:13.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:57:0) after 3m48s
[19:26:01.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:57:0)
[19:26:01.652] Build status: STARTED
[19:26:01.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:58:0) after 8m50s
[19:34:51.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:58:0)
[19:34:51.696] Build status: STARTED
[19:34:51.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:59:0) after 5m34s
[19:40:25.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:59:0)
[19:40:25.772] Build status: STARTED
[19:40:25.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951073320540572528:60:0) after 9m18s
[19:44:17.169] Received PubSub notification, asking Buildbucket for the build status
[19:44:17.197] Build:
{
"id": "8785643258573954337",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29124,
"createdBy": "project:chromium",
"createTime": "2023-03-25T14:31:33.398981071Z",
"startTime": "2023-03-25T14:34:04.882248Z",
"endTime": "2023-03-25T19:44:16.925997213Z",
"updateTime": "2023-03-25T19:44:16.925997213Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e85e76e19aa493505fd93d9eaa56b1a8f43c44aa",
"ref": "refs/heads/main"
}
}
}
[19:44:17.197] Invocation finished in 5h12m45.0578648s with status FAILED