[15:13:36.196] New invocation is queued and will start shortly
[15:13:37.267] Starting the invocation (attempt 1)
[15:13:37.297] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/75a6094e1a1f50c16e6864f500510f38db56fc4a"
[15:13:37.297] Popped gitiles commit info from properties and tags
[15:13:37.297] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:13:37.297] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:13:37.297] Buildbucket request:
{
"requestId": "9004885271931627584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "75a6094e1a1f50c16e6864f500510f38db56fc4a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9004885271931627584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:13:37.985] Scheduled build:
{
"id": "8839455210051273409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22901,
"createdBy": "project:chromium",
"createTime": "2021-08-08T15:13:37.358261034Z",
"updateTime": "2021-08-08T15:13:37.645421202Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "75a6094e1a1f50c16e6864f500510f38db56fc4a",
"ref": "refs/heads/main"
}
}
}
[15:13:37.985] Task URL: https://cr-buildbucket.appspot.com/build/8839455210051273409
[15:13:37.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:2:0) after 4m26s
[15:16:15.420] Received PubSub notification, asking Buildbucket for the build status
[15:16:15.453] Build status: STARTED
[15:18:04.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:2:0)
[15:18:04.046] Build status: STARTED
[15:18:04.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:4:0) after 3m23s
[15:21:28.292] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:4:0)
[15:21:28.318] Build status: STARTED
[15:21:28.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:5:0) after 2m40s
[15:24:08.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:5:0)
[15:24:08.782] Build status: STARTED
[15:24:08.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:6:0) after 6m17s
[15:30:26.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:6:0)
[15:30:26.354] Build status: STARTED
[15:30:26.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:7:0) after 4m51s
[15:35:17.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:7:0)
[15:35:17.535] Build status: STARTED
[15:35:17.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:8:0) after 9m9s
[15:44:27.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:8:0)
[15:44:27.063] Build status: STARTED
[15:44:27.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:9:0) after 8m25s
[15:52:52.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:9:0)
[15:52:52.276] Build status: STARTED
[15:52:52.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:10:0) after 7m2s
[15:59:54.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:10:0)
[15:59:54.324] Build status: STARTED
[15:59:54.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:11:0) after 9m1s
[16:08:55.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:11:0)
[16:08:55.432] Build status: STARTED
[16:08:55.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:12:0) after 1m54s
[16:10:49.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:12:0)
[16:10:49.527] Build status: STARTED
[16:10:49.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:13:0) after 7m52s
[16:18:41.548] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:13:0)
[16:18:41.574] Build status: STARTED
[16:18:41.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:14:0) after 8m51s
[16:27:32.740] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:14:0)
[16:27:32.767] Build status: STARTED
[16:27:32.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:15:0) after 5m45s
[16:33:17.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:15:0)
[16:33:17.990] Build status: STARTED
[16:33:17.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:16:0) after 6m38s
[16:39:56.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:16:0)
[16:39:56.074] Build status: STARTED
[16:39:56.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:17:0) after 8m53s
[16:48:49.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:17:0)
[16:48:49.122] Build status: STARTED
[16:48:49.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:18:0) after 8m7s
[16:56:56.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:18:0)
[16:56:56.165] Build status: STARTED
[16:56:56.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:19:0) after 7m44s
[17:04:40.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:19:0)
[17:04:40.221] Build status: STARTED
[17:04:40.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:20:0) after 5m16s
[17:09:56.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:20:0)
[17:09:56.274] Build status: STARTED
[17:09:56.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:21:0) after 3m58s
[17:13:54.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:21:0)
[17:13:54.518] Build status: STARTED
[17:13:54.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:22:0) after 5m43s
[17:19:37.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:22:0)
[17:19:37.939] Build status: STARTED
[17:19:37.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:23:0) after 9m31s
[17:29:08.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:23:0)
[17:29:08.998] Build status: STARTED
[17:29:08.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:24:0) after 8m59s
[17:38:08.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:24:0)
[17:38:08.807] Build status: STARTED
[17:38:08.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:25:0) after 6m36s
[17:44:44.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:25:0)
[17:44:44.870] Build status: STARTED
[17:44:44.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:26:0) after 1m27s
[17:46:11.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:26:0)
[17:46:11.921] Build status: STARTED
[17:46:11.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:27:0) after 7m3s
[17:53:14.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:27:0)
[17:53:14.968] Build status: STARTED
[17:53:14.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:28:0) after 3m20s
[17:56:35.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:28:0)
[17:56:35.058] Build status: STARTED
[17:56:35.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:29:0) after 7m52s
[18:04:27.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:29:0)
[18:04:27.116] Build status: STARTED
[18:04:27.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:30:0) after 3m23s
[18:07:50.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:30:0)
[18:07:50.319] Build status: STARTED
[18:07:50.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:31:0) after 4m9s
[18:11:59.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:31:0)
[18:11:59.374] Build status: STARTED
[18:11:59.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:32:0) after 4m42s
[18:16:41.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:32:0)
[18:16:41.421] Build status: STARTED
[18:16:41.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:33:0) after 8m3s
[18:24:44.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:33:0)
[18:24:44.469] Build status: STARTED
[18:24:44.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:34:0) after 4m38s
[18:29:22.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:34:0)
[18:29:22.537] Build status: STARTED
[18:29:22.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:35:0) after 4m24s
[18:33:46.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:35:0)
[18:33:46.947] Build status: STARTED
[18:33:46.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:36:0) after 9m58s
[18:43:44.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:36:0)
[18:43:45.016] Build status: STARTED
[18:43:45.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:37:0) after 1m28s
[18:45:13.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:37:0)
[18:45:13.064] Build status: STARTED
[18:45:13.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:38:0) after 1m8s
[18:46:21.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:38:0)
[18:46:21.217] Build status: STARTED
[18:46:21.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:39:0) after 5m47s
[18:52:08.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:39:0)
[18:52:08.291] Build status: STARTED
[18:52:08.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:40:0) after 7m46s
[18:59:54.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:40:0)
[18:59:54.339] Build status: STARTED
[18:59:54.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:41:0) after 4m25s
[19:04:19.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:41:0)
[19:04:19.428] Build status: STARTED
[19:04:19.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:42:0) after 9m30s
[19:13:49.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:42:0)
[19:13:49.703] Build status: STARTED
[19:13:49.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:43:0) after 1m57s
[19:15:46.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:43:0)
[19:15:46.757] Build status: STARTED
[19:15:46.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:44:0) after 1m15s
[19:17:01.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:44:0)
[19:17:01.834] Build status: STARTED
[19:17:01.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:45:0) after 4m26s
[19:21:27.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:45:0)
[19:21:27.883] Build status: STARTED
[19:21:27.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:46:0) after 1m2s
[19:22:29.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:46:0)
[19:22:30.106] Build status: STARTED
[19:22:30.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:47:0) after 1m42s
[19:24:12.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:47:0)
[19:24:12.169] Build status: STARTED
[19:24:12.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:48:0) after 5m30s
[19:29:42.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:48:0)
[19:29:42.216] Build status: STARTED
[19:29:42.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:49:0) after 5m35s
[19:35:17.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:49:0)
[19:35:17.271] Build status: STARTED
[19:35:17.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:50:0) after 7m0s
[19:42:17.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:50:0)
[19:42:17.554] Build status: STARTED
[19:42:17.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:51:0) after 2m32s
[19:44:49.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:51:0)
[19:44:49.900] Build status: STARTED
[19:44:49.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:52:0) after 3m27s
[19:48:16.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:52:0)
[19:48:16.958] Build status: STARTED
[19:48:16.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:53:0) after 8m42s
[19:56:58.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:53:0)
[19:56:59.015] Build status: STARTED
[19:56:59.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:54:0) after 1m19s
[19:58:18.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:54:0)
[19:58:18.369] Build status: STARTED
[19:58:18.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:55:0) after 7m37s
[20:05:55.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:55:0)
[20:05:55.594] Build status: STARTED
[20:05:55.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:56:0) after 5m52s
[20:11:47.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:56:0)
[20:11:47.643] Build status: STARTED
[20:11:47.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:57:0) after 5m57s
[20:17:44.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:57:0)
[20:17:44.701] Build status: STARTED
[20:17:44.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:58:0) after 2m24s
[20:20:08.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:58:0)
[20:20:08.879] Build status: STARTED
[20:20:08.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:59:0) after 8m3s
[20:28:11.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:59:0)
[20:28:11.947] Build status: STARTED
[20:28:11.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:60:0) after 4m31s
[20:32:43.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:60:0)
[20:32:43.150] Build status: STARTED
[20:32:43.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:61:0) after 1m56s
[20:34:39.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:61:0)
[20:34:39.207] Build status: STARTED
[20:34:39.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004885271931627584:62:0) after 8m15s
[20:36:42.169] Received PubSub notification, asking Buildbucket for the build status
[20:36:42.198] Build:
{
"id": "8839455210051273409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22901,
"createdBy": "project:chromium",
"createTime": "2021-08-08T15:13:37.358261034Z",
"startTime": "2021-08-08T15:16:14.698469Z",
"endTime": "2021-08-08T20:36:41.737798314Z",
"updateTime": "2021-08-08T20:36:41.738150410Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "75a6094e1a1f50c16e6864f500510f38db56fc4a",
"ref": "refs/heads/main"
}
}
}
[20:36:42.198] Invocation finished in 5h23m6.016660065s with status FAILED