[05:21:46.143] New invocation is queued and will start shortly
[05:21:47.233] Starting the invocation (attempt 1)
[05:21:47.280] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5b91ae603674c0897ee64d1a61cd25f366c6921b"
[05:21:47.280] Popped gitiles commit info from properties and tags
[05:21:47.280] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:21:47.280] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:21:47.281] Buildbucket request:
{
"requestId": "9005647282652879840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b91ae603674c0897ee64d1a61cd25f366c6921b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9005647282652879840"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:21:47.858] Scheduled build:
{
"id": "8840217220706773856",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22857,
"createdBy": "project:chromium",
"createTime": "2021-07-31T05:21:47.367615Z",
"updateTime": "2021-07-31T05:21:47.790493Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b91ae603674c0897ee64d1a61cd25f366c6921b",
"ref": "refs/heads/main"
}
}
}
[05:21:47.858] Task URL: https://cr-buildbucket.appspot.com/build/8840217220706773856
[05:21:47.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:2:0) after 9m41s
[05:24:28.655] Received PubSub notification, asking Buildbucket for the build status
[05:24:28.692] Build status: STARTED
[05:31:28.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:2:0)
[05:31:28.923] Build status: STARTED
[05:31:28.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:4:0) after 9m56s
[05:41:24.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:4:0)
[05:41:24.988] Build status: STARTED
[05:41:24.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:5:0) after 4m23s
[05:45:48.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:5:0)
[05:45:48.041] Build status: STARTED
[05:45:48.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:6:0) after 9m50s
[05:55:38.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:6:0)
[05:55:38.088] Build status: STARTED
[05:55:38.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:7:0) after 9m42s
[06:05:20.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:7:0)
[06:05:20.136] Build status: STARTED
[06:05:20.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:8:0) after 6m19s
[06:11:39.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:8:0)
[06:11:39.193] Build status: STARTED
[06:11:39.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:9:0) after 2m21s
[06:14:00.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:9:0)
[06:14:00.526] Build status: STARTED
[06:14:00.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:10:0) after 3m6s
[06:17:06.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:10:0)
[06:17:06.950] Build status: STARTED
[06:17:06.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:11:0) after 9m27s
[06:26:34.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:11:0)
[06:26:34.073] Build status: STARTED
[06:26:34.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:12:0) after 4m0s
[06:30:34.395] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:12:0)
[06:30:34.434] Build status: STARTED
[06:30:34.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:13:0) after 9m4s
[06:39:38.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:13:0)
[06:39:38.483] Build status: STARTED
[06:39:38.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:14:0) after 8m24s
[06:48:02.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:14:0)
[06:48:02.556] Build status: STARTED
[06:48:02.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:15:0) after 5m23s
[06:53:25.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:15:0)
[06:53:25.640] Build status: STARTED
[06:53:25.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:16:0) after 9m13s
[07:02:38.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:16:0)
[07:02:38.701] Build status: STARTED
[07:02:38.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:17:0) after 6m51s
[07:09:29.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:17:0)
[07:09:29.760] Build status: STARTED
[07:09:29.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:18:0) after 6m50s
[07:16:19.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:18:0)
[07:16:19.814] Build status: STARTED
[07:16:19.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:19:0) after 3m53s
[07:20:12.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:19:0)
[07:20:12.868] Build status: STARTED
[07:20:12.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:20:0) after 3m34s
[07:23:46.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:20:0)
[07:23:46.943] Build status: STARTED
[07:23:46.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:21:0) after 5m22s
[07:29:09.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:21:0)
[07:29:09.114] Build status: STARTED
[07:29:09.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:22:0) after 2m49s
[07:31:58.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:22:0)
[07:31:58.325] Build status: STARTED
[07:31:58.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:23:0) after 9m25s
[07:41:23.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:23:0)
[07:41:23.375] Build status: STARTED
[07:41:23.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:24:0) after 4m11s
[07:45:34.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:24:0)
[07:45:34.429] Build status: STARTED
[07:45:34.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:25:0) after 6m23s
[07:51:57.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:25:0)
[07:51:57.499] Build status: STARTED
[07:51:57.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:26:0) after 1m4s
[07:53:01.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:26:0)
[07:53:01.566] Build status: STARTED
[07:53:01.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:27:0) after 3m29s
[07:56:30.585] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:27:0)
[07:56:30.615] Build status: STARTED
[07:56:30.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:28:0) after 8m46s
[08:05:16.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:28:0)
[08:05:16.690] Build status: STARTED
[08:05:16.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:29:0) after 4m26s
[08:09:42.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:29:0)
[08:09:42.826] Build status: STARTED
[08:09:42.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:30:0) after 7m54s
[08:17:36.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:30:0)
[08:17:36.884] Build status: STARTED
[08:17:36.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:31:0) after 8m58s
[08:26:35.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:31:0)
[08:26:35.077] Build status: STARTED
[08:26:35.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:32:0) after 6m11s
[08:32:46.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:32:0)
[08:32:46.279] Build status: STARTED
[08:32:46.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:33:0) after 5m50s
[08:38:36.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:33:0)
[08:38:36.404] Build status: STARTED
[08:38:36.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:34:0) after 4m6s
[08:42:42.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:34:0)
[08:42:42.490] Build status: STARTED
[08:42:42.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:35:0) after 3m25s
[08:46:07.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:35:0)
[08:46:07.545] Build status: STARTED
[08:46:07.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:36:0) after 7m25s
[08:53:33.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:36:0)
[08:53:33.034] Build status: STARTED
[08:53:33.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:37:0) after 3m56s
[08:57:29.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:37:0)
[08:57:29.318] Build status: STARTED
[08:57:29.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:38:0) after 7m52s
[09:05:21.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:38:0)
[09:05:21.774] Build status: STARTED
[09:05:21.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:39:0) after 3m21s
[09:08:42.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:39:0)
[09:08:42.881] Build status: STARTED
[09:08:42.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:40:0) after 1m14s
[09:09:57.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:40:0)
[09:09:57.558] Build status: STARTED
[09:09:57.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:41:0) after 5m32s
[09:15:29.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:41:0)
[09:15:29.903] Build status: STARTED
[09:15:29.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:42:0) after 5m48s
[09:21:18.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:42:0)
[09:21:18.196] Build status: STARTED
[09:21:18.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:43:0) after 1m25s
[09:22:43.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:43:0)
[09:22:43.514] Build status: STARTED
[09:22:43.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:44:0) after 1m55s
[09:24:38.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:44:0)
[09:24:38.656] Build status: STARTED
[09:24:38.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:45:0) after 7m43s
[09:32:21.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:45:0)
[09:32:21.900] Build status: STARTED
[09:32:21.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:46:0) after 1m12s
[09:33:34.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:46:0)
[09:33:34.504] Build status: STARTED
[09:33:34.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:47:0) after 2m16s
[09:35:51.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:47:0)
[09:35:51.184] Build status: STARTED
[09:35:51.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:48:0) after 9m0s
[09:44:51.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:48:0)
[09:44:51.691] Build status: STARTED
[09:44:51.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:49:0) after 4m29s
[09:49:20.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:49:0)
[09:49:20.877] Build status: STARTED
[09:49:20.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:50:0) after 3m37s
[09:52:57.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:50:0)
[09:52:57.931] Build status: STARTED
[09:52:57.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:51:0) after 5m51s
[09:58:48.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:51:0)
[09:58:48.998] Build status: STARTED
[09:58:48.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:52:0) after 4m40s
[10:03:29.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:52:0)
[10:03:29.102] Build status: STARTED
[10:03:29.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:53:0) after 4m32s
[10:08:01.292] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:53:0)
[10:08:01.326] Build status: STARTED
[10:08:01.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:54:0) after 2m50s
[10:10:51.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:54:0)
[10:10:51.787] Build status: STARTED
[10:10:51.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:55:0) after 7m48s
[10:18:40.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:55:0)
[10:18:40.373] Build status: STARTED
[10:18:40.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:56:0) after 4m14s
[10:22:54.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:56:0)
[10:22:54.437] Build status: STARTED
[10:22:54.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:57:0) after 5m14s
[10:28:08.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:57:0)
[10:28:08.745] Build status: STARTED
[10:28:08.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:58:0) after 6m39s
[10:34:47.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:58:0)
[10:34:47.942] Build status: STARTED
[10:34:47.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:59:0) after 6m21s
[10:41:09.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:59:0)
[10:41:09.690] Build status: STARTED
[10:41:09.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:60:0) after 1m3s
[10:42:13.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:60:0)
[10:42:13.406] Build status: STARTED
[10:42:13.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005647282652879840:61:0) after 1m59s
[10:42:41.899] Received PubSub notification, asking Buildbucket for the build status
[10:42:41.935] Build:
{
"id": "8840217220706773856",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22857,
"createdBy": "project:chromium",
"createTime": "2021-07-31T05:21:47.367615Z",
"startTime": "2021-07-31T05:24:27.697703Z",
"endTime": "2021-07-31T10:42:41.277409599Z",
"updateTime": "2021-07-31T10:42:41.277828739Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b91ae603674c0897ee64d1a61cd25f366c6921b",
"ref": "refs/heads/main"
}
}
}
[10:42:41.935] Invocation finished in 5h20m55.807394324s with status FAILED