[23:14:32.294] New invocation is queued and will start shortly
[23:14:33.376] Starting the invocation (attempt 1)
[23:14:33.415] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b2d026233c9cecd1847adc8255cf156349ea135e"
[23:14:33.415] Popped gitiles commit info from properties and tags
[23:14:33.415] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:14:33.415] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:14:33.415] Buildbucket request:
{
"requestId": "8985467263309358208",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b2d026233c9cecd1847adc8255cf156349ea135e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8985467263309358208"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:14:34.168] Scheduled build:
{
"id": "8820037201401166865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 24040,
"createdBy": "project:chromium",
"createTime": "2022-03-10T23:14:33.484418723Z",
"updateTime": "2022-03-10T23:14:33.484418723Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b2d026233c9cecd1847adc8255cf156349ea135e",
"ref": "refs/heads/main"
}
},
"canary": true
}
[23:14:34.168] Task URL: https://cr-buildbucket.appspot.com/build/8820037201401166865
[23:14:34.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:2:0) after 3m3s
[23:17:37.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:2:0)
[23:17:37.288] Build status: SCHEDULED
[23:17:37.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:3:0) after 1m17s
[23:17:42.355] Received PubSub notification, asking Buildbucket for the build status
[23:17:42.375] Build status: STARTED
[23:18:54.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:3:0)
[23:18:54.339] Build status: STARTED
[23:18:54.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:5:0) after 4m35s
[23:23:29.369] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:5:0)
[23:23:29.406] Build status: STARTED
[23:23:29.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:6:0) after 3m46s
[23:27:15.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:6:0)
[23:27:15.705] Build status: STARTED
[23:27:15.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:7:0) after 6m24s
[23:33:39.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:7:0)
[23:33:39.767] Build status: STARTED
[23:33:39.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:8:0) after 5m3s
[23:38:42.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:8:0)
[23:38:42.838] Build status: STARTED
[23:38:42.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:9:0) after 9m12s
[23:47:54.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:9:0)
[23:47:54.944] Build status: STARTED
[23:47:54.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:10:0) after 6m57s
[23:54:52.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:10:0)
[23:54:52.091] Build status: STARTED
[23:54:52.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:11:0) after 7m59s
[00:02:51.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:11:0)
[00:02:51.379] Build status: STARTED
[00:02:51.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:12:0) after 2m3s
[00:04:54.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:12:0)
[00:04:54.589] Build status: STARTED
[00:04:54.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:13:0) after 6m43s
[00:11:37.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:13:0)
[00:11:37.698] Build status: STARTED
[00:11:37.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:14:0) after 4m30s
[00:16:07.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:14:0)
[00:16:08.001] Build status: STARTED
[00:16:08.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:15:0) after 5m4s
[00:21:12.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:15:0)
[00:21:12.149] Build status: STARTED
[00:21:12.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:16:0) after 3m57s
[00:25:09.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:16:0)
[00:25:09.203] Build status: STARTED
[00:25:09.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:17:0) after 5m11s
[00:30:20.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:17:0)
[00:30:20.451] Build status: STARTED
[00:30:20.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:18:0) after 1m46s
[00:32:06.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:18:0)
[00:32:06.573] Build status: STARTED
[00:32:06.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:19:0) after 6m32s
[00:38:38.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:19:0)
[00:38:38.649] Build status: STARTED
[00:38:38.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:20:0) after 2m25s
[00:41:03.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:20:0)
[00:41:03.766] Build status: STARTED
[00:41:03.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:21:0) after 1m37s
[00:42:40.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:21:0)
[00:42:40.992] Build status: STARTED
[00:42:40.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:22:0) after 6m45s
[00:49:26.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:22:0)
[00:49:26.371] Build status: STARTED
[00:49:26.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:23:0) after 7m57s
[00:57:23.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:23:0)
[00:57:23.453] Build status: STARTED
[00:57:23.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:24:0) after 9m53s
[01:07:16.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:24:0)
[01:07:16.552] Build status: STARTED
[01:07:16.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:25:0) after 9m22s
[01:16:38.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:25:0)
[01:16:38.598] Build status: STARTED
[01:16:38.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:26:0) after 4m24s
[01:21:02.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:26:0)
[01:21:02.655] Build status: STARTED
[01:21:02.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:27:0) after 4m32s
[01:25:34.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:27:0)
[01:25:34.707] Build status: STARTED
[01:25:34.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:28:0) after 6m50s
[01:32:24.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:28:0)
[01:32:24.839] Build status: STARTED
[01:32:24.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:29:0) after 4m55s
[01:37:19.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:29:0)
[01:37:19.881] Build status: STARTED
[01:37:19.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:30:0) after 3m36s
[01:40:56.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:30:0)
[01:40:56.169] Build status: STARTED
[01:40:56.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:31:0) after 7m13s
[01:48:09.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:31:0)
[01:48:09.377] Build status: STARTED
[01:48:09.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:32:0) after 1m4s
[01:49:13.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:32:0)
[01:49:13.414] Build status: STARTED
[01:49:13.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:33:0) after 8m19s
[01:57:32.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:33:0)
[01:57:32.515] Build status: STARTED
[01:57:32.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:34:0) after 2m20s
[01:59:52.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:34:0)
[01:59:52.563] Build status: STARTED
[01:59:52.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:35:0) after 1m34s
[02:01:26.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:35:0)
[02:01:26.799] Build status: STARTED
[02:01:26.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:36:0) after 7m59s
[02:09:25.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:36:0)
[02:09:25.825] Build status: STARTED
[02:09:25.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:37:0) after 8m36s
[02:18:01.974] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:37:0)
[02:18:02.081] Build status: STARTED
[02:18:02.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:38:0) after 5m53s
[02:23:55.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:38:0)
[02:23:55.147] Build status: STARTED
[02:23:55.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:39:0) after 2m6s
[02:26:01.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:39:0)
[02:26:01.305] Build status: STARTED
[02:26:01.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:40:0) after 5m16s
[02:31:17.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:40:0)
[02:31:17.299] Build status: STARTED
[02:31:17.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:41:0) after 9m50s
[02:41:07.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:41:0)
[02:41:07.386] Build status: STARTED
[02:41:07.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:42:0) after 2m20s
[02:43:27.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:42:0)
[02:43:27.429] Build status: STARTED
[02:43:27.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:43:0) after 5m55s
[02:49:22.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:43:0)
[02:49:22.487] Build status: STARTED
[02:49:22.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:44:0) after 3m21s
[02:52:43.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:44:0)
[02:52:43.764] Build status: STARTED
[02:52:43.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:45:0) after 2m14s
[02:54:57.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:45:0)
[02:54:57.949] Build status: STARTED
[02:54:57.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:46:0) after 4m39s
[02:59:36.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:46:0)
[02:59:37.019] Build status: STARTED
[02:59:37.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:47:0) after 4m0s
[03:03:37.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:47:0)
[03:03:37.233] Build status: STARTED
[03:03:37.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:48:0) after 7m56s
[03:11:33.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:48:0)
[03:11:33.443] Build status: STARTED
[03:11:33.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:49:0) after 9m15s
[03:20:48.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:49:0)
[03:20:48.541] Build status: STARTED
[03:20:48.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:50:0) after 1m14s
[03:22:02.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:50:0)
[03:22:02.669] Build status: STARTED
[03:22:02.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:51:0) after 6m34s
[03:28:36.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:51:0)
[03:28:36.751] Build status: STARTED
[03:28:36.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:52:0) after 1m47s
[03:30:23.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:52:0)
[03:30:23.802] Build status: STARTED
[03:30:23.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:53:0) after 7m38s
[03:38:01.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:53:0)
[03:38:01.987] Build status: STARTED
[03:38:01.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:54:0) after 4m28s
[03:42:29.994] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:54:0)
[03:42:30.021] Build status: STARTED
[03:42:30.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:55:0) after 6m24s
[03:48:54.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:55:0)
[03:48:54.107] Build status: STARTED
[03:48:54.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:56:0) after 4m3s
[03:52:57.220] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:56:0)
[03:52:57.253] Build status: STARTED
[03:52:57.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:57:0) after 6m29s
[03:59:26.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:57:0)
[03:59:26.409] Build status: STARTED
[03:59:26.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:58:0) after 8m0s
[04:07:26.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:58:0)
[04:07:26.586] Build status: STARTED
[04:07:26.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:59:0) after 6m19s
[04:13:45.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:59:0)
[04:13:45.691] Build status: STARTED
[04:13:45.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:60:0) after 2m38s
[04:16:23.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:60:0)
[04:16:23.776] Build status: STARTED
[04:16:23.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:61:0) after 4m19s
[04:20:42.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:61:0)
[04:20:42.824] Build status: STARTED
[04:20:42.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:62:0) after 9m43s
[04:30:25.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:62:0)
[04:30:25.887] Build status: STARTED
[04:30:25.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:63:0) after 1m31s
[04:31:56.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:63:0)
[04:31:56.942] Build status: STARTED
[04:31:56.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:64:0) after 6m39s
[04:38:36.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:64:0)
[04:38:36.185] Build status: STARTED
[04:38:36.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:65:0) after 7m51s
[04:46:27.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:65:0)
[04:46:27.348] Build status: STARTED
[04:46:27.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:66:0) after 2m29s
[04:48:56.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:66:0)
[04:48:56.399] Build status: STARTED
[04:48:56.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:67:0) after 9m13s
[04:58:09.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:67:0)
[04:58:09.616] Build status: STARTED
[04:58:09.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:68:0) after 4m13s
[05:02:22.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:68:0)
[05:02:22.659] Build status: STARTED
[05:02:22.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:69:0) after 9m6s
[05:11:28.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:69:0)
[05:11:28.750] Build status: STARTED
[05:11:28.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:70:0) after 4m45s
[05:16:13.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:70:0)
[05:16:13.796] Build status: STARTED
[05:16:13.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:71:0) after 3m20s
[05:19:34.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:71:0)
[05:19:34.130] Build status: STARTED
[05:19:34.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:72:0) after 2m0s
[05:21:34.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:72:0)
[05:21:34.218] Build status: STARTED
[05:21:34.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:73:0) after 4m36s
[05:26:10.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:73:0)
[05:26:10.517] Build status: STARTED
[05:26:10.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:74:0) after 2m52s
[05:29:02.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:74:0)
[05:29:02.802] Build status: STARTED
[05:29:02.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:75:0) after 5m52s
[05:34:54.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:75:0)
[05:34:54.878] Build status: STARTED
[05:34:54.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:76:0) after 1m25s
[05:36:20.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:76:0)
[05:36:20.055] Build status: STARTED
[05:36:20.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:77:0) after 9m12s
[05:45:32.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:77:0)
[05:45:32.312] Build status: STARTED
[05:45:32.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:78:0) after 8m20s
[05:53:52.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:78:0)
[05:53:52.365] Build status: STARTED
[05:53:52.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:79:0) after 5m35s
[05:59:27.395] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:79:0)
[05:59:27.448] Build status: STARTED
[05:59:27.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:80:0) after 3m57s
[06:03:24.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:80:0)
[06:03:24.899] Build status: STARTED
[06:03:24.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:81:0) after 1m19s
[06:04:43.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:81:0)
[06:04:43.949] Build status: STARTED
[06:04:43.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:82:0) after 6m7s
[06:10:51.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:82:0)
[06:10:51.043] Build status: STARTED
[06:10:51.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:83:0) after 5m31s
[06:16:22.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:83:0)
[06:16:22.218] Build status: STARTED
[06:16:22.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:84:0) after 9m26s
[06:25:48.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:84:0)
[06:25:48.276] Build status: STARTED
[06:25:48.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:85:0) after 9m18s
[06:35:06.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:85:0)
[06:35:06.495] Build status: STARTED
[06:35:06.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:86:0) after 3m1s
[06:38:07.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:86:0)
[06:38:07.556] Build status: STARTED
[06:38:07.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:87:0) after 5m59s
[06:44:06.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:87:0)
[06:44:06.709] Build status: STARTED
[06:44:06.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:88:0) after 2m36s
[06:46:42.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:88:0)
[06:46:42.760] Build status: STARTED
[06:46:42.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:89:0) after 2m29s
[06:49:11.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:89:0)
[06:49:12.006] Build status: STARTED
[06:49:12.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:90:0) after 2m14s
[06:51:26.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:90:0)
[06:51:26.176] Build status: STARTED
[06:51:26.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:91:0) after 5m21s
[06:56:47.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:91:0)
[06:56:47.231] Build status: STARTED
[06:56:47.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:92:0) after 6m13s
[07:03:00.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:92:0)
[07:03:00.303] Build status: STARTED
[07:03:00.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:93:0) after 1m28s
[07:04:28.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:93:0)
[07:04:28.362] Build status: STARTED
[07:04:28.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:94:0) after 9m38s
[07:14:06.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:94:0)
[07:14:06.478] Build status: STARTED
[07:14:06.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:95:0) after 2m38s
[07:16:44.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:95:0)
[07:16:44.633] Build status: STARTED
[07:16:44.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:96:0) after 8m6s
[07:24:50.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:96:0)
[07:24:50.722] Build status: STARTED
[07:24:50.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:97:0) after 2m9s
[07:26:59.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:97:0)
[07:26:59.779] Build status: STARTED
[07:26:59.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:98:0) after 7m28s
[07:34:27.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:98:0)
[07:34:27.860] Build status: STARTED
[07:34:27.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:99:0) after 8m35s
[07:43:02.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:99:0)
[07:43:02.909] Build status: STARTED
[07:43:02.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:100:0) after 2m3s
[07:45:05.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:100:0)
[07:45:05.981] Build status: STARTED
[07:45:05.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:101:0) after 1m24s
[07:46:30.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:101:0)
[07:46:30.075] Build status: STARTED
[07:46:30.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:102:0) after 6m45s
[07:53:15.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:102:0)
[07:53:15.129] Build status: STARTED
[07:53:15.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:103:0) after 3m19s
[07:56:34.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:103:0)
[07:56:34.184] Build status: STARTED
[07:56:34.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:104:0) after 3m53s
[08:00:27.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:104:0)
[08:00:27.283] Build status: STARTED
[08:00:27.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:105:0) after 6m21s
[08:06:48.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:105:0)
[08:06:48.331] Build status: STARTED
[08:06:48.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:106:0) after 9m20s
[08:16:08.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:106:0)
[08:16:08.415] Build status: STARTED
[08:16:08.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:107:0) after 5m29s
[08:21:37.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:107:0)
[08:21:37.940] Build status: STARTED
[08:21:37.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:108:0) after 3m28s
[08:25:06.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:108:0)
[08:25:06.228] Build status: STARTED
[08:25:06.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:109:0) after 9m55s
[08:35:01.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:109:0)
[08:35:01.826] Build status: STARTED
[08:35:01.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:110:0) after 1m51s
[08:36:52.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:110:0)
[08:36:53.001] Build status: STARTED
[08:36:53.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:111:0) after 2m6s
[08:38:59.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:111:0)
[08:38:59.097] Build status: STARTED
[08:38:59.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:112:0) after 1m35s
[08:40:34.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:112:0)
[08:40:34.161] Build status: STARTED
[08:40:34.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:113:0) after 1m7s
[08:41:41.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:113:0)
[08:41:41.670] Build status: STARTED
[08:41:41.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:114:0) after 1m41s
[08:43:22.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:114:0)
[08:43:22.715] Build status: STARTED
[08:43:22.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:115:0) after 5m33s
[08:48:55.742] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:115:0)
[08:48:55.772] Build status: STARTED
[08:48:55.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8985467263309358208:116:0) after 6m0s
[08:50:05.956] Received PubSub notification, asking Buildbucket for the build status
[08:50:05.991] Build:
{
"id": "8820037201401166865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 24040,
"createdBy": "project:chromium",
"createTime": "2022-03-10T23:14:33.484418723Z",
"startTime": "2022-03-10T23:17:41.281855Z",
"endTime": "2022-03-11T08:50:05.377606910Z",
"updateTime": "2022-03-11T08:50:05.377606910Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b2d026233c9cecd1847adc8255cf156349ea135e",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:50:05.991] Invocation finished in 9h35m33.711549906s with status FAILED