[03:32:28.488] New invocation is queued and will start shortly
[03:32:29.615] Starting the invocation (attempt 1)
[03:32:29.648] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3dfda84a8f5ec0170e6d373734f18a251ae4c1d7"
[03:32:29.648] Popped gitiles commit info from properties and tags
[03:32:29.648] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:32:29.648] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:32:29.648] Buildbucket request:
{
"requestId": "8948668666981431088",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3dfda84a8f5ec0170e6d373734f18a251ae4c1d7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8948668666981431088"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:32:30.104] Scheduled build:
{
"id": "8783238605036075521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29292,
"createdBy": "project:chromium",
"createTime": "2023-04-21T03:32:29.717274848Z",
"updateTime": "2023-04-21T03:32:29.717274848Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3dfda84a8f5ec0170e6d373734f18a251ae4c1d7",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:32:30.104] Task URL: https://cr-buildbucket.appspot.com/build/8783238605036075521
[03:32:30.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:2:0) after 5m58s
[03:35:22.887] Received PubSub notification, asking Buildbucket for the build status
[03:35:22.916] Build status: STARTED
[03:38:28.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:2:0)
[03:38:28.286] Build status: STARTED
[03:38:28.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:4:0) after 6m5s
[03:44:33.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:4:0)
[03:44:33.646] Build status: STARTED
[03:44:33.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:5:0) after 4m7s
[03:48:40.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:5:0)
[03:48:40.764] Build status: STARTED
[03:48:40.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:6:0) after 3m49s
[03:52:30.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:6:0)
[03:52:30.052] Build status: STARTED
[03:52:30.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:7:0) after 9m10s
[04:01:40.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:7:0)
[04:01:40.249] Build status: STARTED
[04:01:40.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:8:0) after 2m35s
[04:04:15.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:8:0)
[04:04:15.416] Build status: STARTED
[04:04:15.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:9:0) after 1m13s
[04:05:28.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:9:0)
[04:05:28.466] Build status: STARTED
[04:05:28.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:10:0) after 8m24s
[04:13:52.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:10:0)
[04:13:52.523] Build status: STARTED
[04:13:52.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:11:0) after 6m12s
[04:20:04.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:11:0)
[04:20:04.771] Build status: STARTED
[04:20:04.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:12:0) after 2m5s
[04:22:09.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:12:0)
[04:22:09.837] Build status: STARTED
[04:22:09.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:13:0) after 5m39s
[04:27:48.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:13:0)
[04:27:49.018] Build status: STARTED
[04:27:49.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:14:0) after 9m13s
[04:37:02.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:14:0)
[04:37:02.569] Build status: STARTED
[04:37:02.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:15:0) after 6m46s
[04:43:48.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:15:0)
[04:43:48.716] Build status: STARTED
[04:43:48.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:16:0) after 2m23s
[04:46:11.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:16:0)
[04:46:11.958] Build status: STARTED
[04:46:11.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:17:0) after 9m56s
[04:56:08.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:17:0)
[04:56:08.179] Build status: STARTED
[04:56:08.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:18:0) after 4m37s
[05:00:45.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:18:0)
[05:00:45.335] Build status: STARTED
[05:00:45.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:19:0) after 4m25s
[05:05:10.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:19:0)
[05:05:10.515] Build status: STARTED
[05:05:10.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:20:0) after 8m25s
[05:13:35.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:20:0)
[05:13:35.610] Build status: STARTED
[05:13:35.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:21:0) after 1m17s
[05:14:52.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:21:0)
[05:14:52.708] Build status: STARTED
[05:14:52.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:22:0) after 3m15s
[05:18:07.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:22:0)
[05:18:07.752] Build status: STARTED
[05:18:07.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:23:0) after 5m25s
[05:23:33.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:23:0)
[05:23:33.101] Build status: STARTED
[05:23:33.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:24:0) after 7m41s
[05:31:14.124] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:24:0)
[05:31:14.146] Build status: STARTED
[05:31:14.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:25:0) after 7m46s
[05:39:00.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:25:0)
[05:39:00.194] Build status: STARTED
[05:39:00.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:26:0) after 5m9s
[05:44:09.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:26:0)
[05:44:09.459] Build status: STARTED
[05:44:09.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:27:0) after 5m9s
[05:49:18.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:27:0)
[05:49:18.513] Build status: STARTED
[05:49:18.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:28:0) after 8m26s
[05:57:44.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:28:0)
[05:57:44.671] Build status: STARTED
[05:57:44.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:29:0) after 6m17s
[06:04:01.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:29:0)
[06:04:01.970] Build status: STARTED
[06:04:01.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:30:0) after 1m53s
[06:05:55.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:30:0)
[06:05:55.205] Build status: STARTED
[06:05:55.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:31:0) after 3m5s
[06:09:00.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:31:0)
[06:09:00.407] Build status: STARTED
[06:09:00.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:32:0) after 4m11s
[06:13:11.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:32:0)
[06:13:11.615] Build status: STARTED
[06:13:11.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:33:0) after 8m52s
[06:22:03.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:33:0)
[06:22:03.663] Build status: STARTED
[06:22:03.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:34:0) after 6m59s
[06:29:02.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:34:0)
[06:29:02.726] Build status: STARTED
[06:29:02.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:35:0) after 1m3s
[06:30:05.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:35:0)
[06:30:05.829] Build status: STARTED
[06:30:05.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:36:0) after 8m13s
[06:38:18.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:36:0)
[06:38:18.979] Build status: STARTED
[06:38:18.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:37:0) after 4m23s
[06:42:42.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:37:0)
[06:42:42.106] Build status: STARTED
[06:42:42.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:38:0) after 3m21s
[06:46:03.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:38:0)
[06:46:03.229] Build status: STARTED
[06:46:03.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:39:0) after 9m26s
[06:55:29.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:39:0)
[06:55:29.277] Build status: STARTED
[06:55:29.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:40:0) after 7m26s
[07:02:55.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:40:0)
[07:02:55.346] Build status: STARTED
[07:02:55.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:41:0) after 8m6s
[07:11:01.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:41:0)
[07:11:01.389] Build status: STARTED
[07:11:01.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:42:0) after 1m22s
[07:12:23.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:42:0)
[07:12:23.634] Build status: STARTED
[07:12:23.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:43:0) after 8m1s
[07:20:24.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:43:0)
[07:20:24.704] Build status: STARTED
[07:20:24.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:44:0) after 4m39s
[07:25:03.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:44:0)
[07:25:03.752] Build status: STARTED
[07:25:03.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:45:0) after 8m26s
[07:33:29.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:45:0)
[07:33:29.912] Build status: STARTED
[07:33:29.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:46:0) after 8m0s
[07:41:29.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:46:0)
[07:41:29.965] Build status: STARTED
[07:41:29.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:47:0) after 8m27s
[07:49:56.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:47:0)
[07:49:57.001] Build status: STARTED
[07:49:57.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:48:0) after 2m43s
[07:52:40.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:48:0)
[07:52:40.235] Build status: STARTED
[07:52:40.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:49:0) after 6m40s
[07:59:20.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:49:0)
[07:59:20.484] Build status: STARTED
[07:59:20.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:50:0) after 1m45s
[08:01:05.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:50:0)
[08:01:05.576] Build status: STARTED
[08:01:05.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:51:0) after 4m45s
[08:05:50.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:51:0)
[08:05:50.743] Build status: STARTED
[08:05:50.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:52:0) after 3m18s
[08:09:08.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:52:0)
[08:09:08.918] Build status: STARTED
[08:09:08.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:53:0) after 3m20s
[08:12:29.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:53:0)
[08:12:29.189] Build status: STARTED
[08:12:29.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:54:0) after 6m5s
[08:18:34.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:54:0)
[08:18:34.478] Build status: STARTED
[08:18:34.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:55:0) after 7m19s
[08:25:53.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:55:0)
[08:25:53.591] Build status: STARTED
[08:25:53.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:56:0) after 6m12s
[08:32:05.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:56:0)
[08:32:05.641] Build status: STARTED
[08:32:05.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:57:0) after 5m34s
[08:37:39.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:57:0)
[08:37:39.753] Build status: STARTED
[08:37:39.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:58:0) after 1m13s
[08:38:52.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:58:0)
[08:38:52.816] Build status: STARTED
[08:38:52.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948668666981431088:59:0) after 8m23s
[08:47:14.017] Received PubSub notification, asking Buildbucket for the build status
[08:47:14.040] Build:
{
"id": "8783238605036075521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29292,
"createdBy": "project:chromium",
"createTime": "2023-04-21T03:32:29.717274848Z",
"startTime": "2023-04-21T03:35:20.192601Z",
"endTime": "2023-04-21T08:47:13.447328419Z",
"updateTime": "2023-04-21T08:47:13.447328419Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3dfda84a8f5ec0170e6d373734f18a251ae4c1d7",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:47:14.040] Invocation finished in 5h14m45.562294743s with status FAILED