[03:01:33.313] New invocation is queued and will start shortly
[03:01:34.423] Starting the invocation (attempt 1)
[03:01:34.452] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/30815dfa4660661e4bfde306d23245e550498a22"
[03:01:34.452] Popped gitiles commit info from properties and tags
[03:01:34.452] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:01:34.452] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:01:34.452] Buildbucket request:
{
"requestId": "8935262261249195584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "30815dfa4660661e4bfde306d23245e550498a22",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8935262261249195584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:01:35.515] Scheduled build:
{
"id": "8769832199314308769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30323,
"createdBy": "project:chromium",
"createTime": "2023-09-16T03:01:34.529773594Z",
"updateTime": "2023-09-16T03:01:34.529773594Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "30815dfa4660661e4bfde306d23245e550498a22",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:01:35.515] Task URL: https://cr-buildbucket.appspot.com/build/8769832199314308769
[03:01:35.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:2:0) after 2m24s
[03:01:36.136] Received PubSub notification, asking Buildbucket for the build status
[03:01:36.164] Build status: SCHEDULED
[03:03:59.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:2:0)
[03:03:59.715] Build status: SCHEDULED
[03:03:59.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:4:0) after 8m30s
[03:05:14.329] Received PubSub notification, asking Buildbucket for the build status
[03:05:14.347] Build status: STARTED
[03:12:29.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:4:0)
[03:12:29.844] Build status: STARTED
[03:12:29.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:6:0) after 6m12s
[03:18:41.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:6:0)
[03:18:41.889] Build status: STARTED
[03:18:41.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:7:0) after 5m11s
[03:23:53.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:7:0)
[03:23:53.147] Build status: STARTED
[03:23:53.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:8:0) after 4m6s
[03:27:59.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:8:0)
[03:27:59.415] Build status: STARTED
[03:27:59.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:9:0) after 9m50s
[03:37:49.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:9:0)
[03:37:49.455] Build status: STARTED
[03:37:49.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:10:0) after 9m31s
[03:47:20.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:10:0)
[03:47:20.522] Build status: STARTED
[03:47:20.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:11:0) after 3m19s
[03:50:39.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:11:0)
[03:50:39.674] Build status: STARTED
[03:50:39.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:12:0) after 9m41s
[04:00:20.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:12:0)
[04:00:20.823] Build status: STARTED
[04:00:20.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:13:0) after 3m6s
[04:03:26.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:13:0)
[04:03:26.946] Build status: STARTED
[04:03:26.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:14:0) after 9m15s
[04:12:42.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:14:0)
[04:12:42.144] Build status: STARTED
[04:12:42.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:15:0) after 9m4s
[04:21:46.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:15:0)
[04:21:46.185] Build status: STARTED
[04:21:46.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:16:0) after 6m2s
[04:27:48.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:16:0)
[04:27:48.230] Build status: STARTED
[04:27:48.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:17:0) after 3m13s
[04:31:01.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:17:0)
[04:31:01.266] Build status: STARTED
[04:31:01.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:18:0) after 2m34s
[04:33:35.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:18:0)
[04:33:35.437] Build status: STARTED
[04:33:35.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:19:0) after 4m0s
[04:37:35.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:19:0)
[04:37:35.509] Build status: STARTED
[04:37:35.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:20:0) after 2m30s
[04:40:05.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:20:0)
[04:40:05.556] Build status: STARTED
[04:40:05.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:21:0) after 3m4s
[04:43:09.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:21:0)
[04:43:09.634] Build status: STARTED
[04:43:09.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:22:0) after 2m56s
[04:46:05.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:22:0)
[04:46:05.678] Build status: STARTED
[04:46:05.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:23:0) after 5m47s
[04:51:52.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:23:0)
[04:51:52.908] Build status: STARTED
[04:51:52.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:24:0) after 2m18s
[04:54:11.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:24:0)
[04:54:11.159] Build status: STARTED
[04:54:11.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:25:0) after 2m20s
[04:56:31.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:25:0)
[04:56:31.245] Build status: STARTED
[04:56:31.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:26:0) after 9m40s
[05:06:11.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:26:0)
[05:06:11.430] Build status: STARTED
[05:06:11.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:27:0) after 4m9s
[05:10:20.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:27:0)
[05:10:20.641] Build status: STARTED
[05:10:20.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:28:0) after 2m18s
[05:12:38.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:28:0)
[05:12:38.684] Build status: STARTED
[05:12:38.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:29:0) after 2m5s
[05:14:43.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:29:0)
[05:14:43.676] Build status: STARTED
[05:14:43.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:30:0) after 2m11s
[05:16:54.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:30:0)
[05:16:54.717] Build status: STARTED
[05:16:54.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:31:0) after 2m30s
[05:19:24.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:31:0)
[05:19:24.893] Build status: STARTED
[05:19:24.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:32:0) after 4m35s
[05:23:59.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:32:0)
[05:23:59.979] Build status: STARTED
[05:23:59.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:33:0) after 7m49s
[05:31:49.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:33:0)
[05:31:49.280] Build status: STARTED
[05:31:49.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:34:0) after 8m19s
[05:40:08.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:34:0)
[05:40:08.404] Build status: STARTED
[05:40:08.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:35:0) after 8m51s
[05:48:59.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:35:0)
[05:48:59.653] Build status: STARTED
[05:48:59.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:36:0) after 8m50s
[05:57:49.663] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:36:0)
[05:57:49.681] Build status: STARTED
[05:57:49.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:37:0) after 5m50s
[06:03:39.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:37:0)
[06:03:39.815] Build status: STARTED
[06:03:39.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:38:0) after 1m37s
[06:05:16.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:38:0)
[06:05:16.856] Build status: STARTED
[06:05:16.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:39:0) after 8m42s
[06:13:59.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:39:0)
[06:13:59.492] Build status: STARTED
[06:13:59.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:40:0) after 3m52s
[06:17:51.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:40:0)
[06:17:51.685] Build status: STARTED
[06:17:51.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:41:0) after 8m40s
[06:26:31.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:41:0)
[06:26:31.849] Build status: STARTED
[06:26:31.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:42:0) after 1m2s
[06:27:34.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:42:0)
[06:27:34.056] Build status: STARTED
[06:27:34.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:43:0) after 9m16s
[06:36:50.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:43:0)
[06:36:50.105] Build status: STARTED
[06:36:50.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:44:0) after 8m11s
[06:45:01.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:44:0)
[06:45:01.477] Build status: STARTED
[06:45:01.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:45:0) after 8m21s
[06:53:22.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:45:0)
[06:53:22.574] Build status: STARTED
[06:53:22.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:46:0) after 9m25s
[07:02:47.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:46:0)
[07:02:47.614] Build status: STARTED
[07:02:47.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:47:0) after 8m51s
[07:11:38.639] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:47:0)
[07:11:38.663] Build status: STARTED
[07:11:38.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:48:0) after 4m53s
[07:16:31.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:48:0)
[07:16:31.712] Build status: STARTED
[07:16:31.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:49:0) after 9m21s
[07:25:52.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:49:0)
[07:25:52.814] Build status: STARTED
[07:25:52.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:50:0) after 9m8s
[07:35:00.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:50:0)
[07:35:00.972] Build status: STARTED
[07:35:00.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:51:0) after 2m8s
[07:37:09.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:51:0)
[07:37:09.142] Build status: STARTED
[07:37:09.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:52:0) after 9m23s
[07:46:32.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:52:0)
[07:46:32.204] Build status: STARTED
[07:46:32.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:53:0) after 8m55s
[07:55:27.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:53:0)
[07:55:27.260] Build status: STARTED
[07:55:27.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:54:0) after 6m57s
[08:02:24.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:54:0)
[08:02:24.301] Build status: STARTED
[08:02:24.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:55:0) after 8m42s
[08:11:06.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:55:0)
[08:11:06.450] Build status: STARTED
[08:11:06.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:56:0) after 5m4s
[08:16:10.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:56:0)
[08:16:10.495] Build status: STARTED
[08:16:10.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:57:0) after 4m7s
[08:20:17.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:57:0)
[08:20:17.594] Build status: STARTED
[08:20:17.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:58:0) after 9m57s
[08:30:14.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:58:0)
[08:30:14.669] Build status: STARTED
[08:30:14.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:59:0) after 1m28s
[08:31:42.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:59:0)
[08:31:42.997] Build status: STARTED
[08:31:42.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:60:0) after 7m40s
[08:39:23.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:60:0)
[08:39:23.030] Build status: STARTED
[08:39:23.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:61:0) after 3m30s
[08:42:53.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:61:0)
[08:42:53.086] Build status: STARTED
[08:42:53.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:62:0) after 6m52s
[08:49:45.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:62:0)
[08:49:45.279] Build status: STARTED
[08:49:45.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:63:0) after 4m43s
[08:54:28.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:63:0)
[08:54:28.361] Build status: STARTED
[08:54:28.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:64:0) after 1m37s
[08:56:05.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:64:0)
[08:56:05.614] Build status: STARTED
[08:56:05.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8935262261249195584:65:0) after 4m23s
[08:59:56.056] Received PubSub notification, asking Buildbucket for the build status
[08:59:56.082] Build:
{
"id": "8769832199314308769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30323,
"createdBy": "project:chromium",
"createTime": "2023-09-16T03:01:34.529773594Z",
"startTime": "2023-09-16T03:05:13.764983Z",
"endTime": "2023-09-16T08:59:55.820850975Z",
"updateTime": "2023-09-16T08:59:55.820850975Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "30815dfa4660661e4bfde306d23245e550498a22",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:59:56.082] Invocation finished in 5h58m22.782004544s with status FAILED