[21:38:03.145] New invocation is queued and will start shortly
[21:38:04.229] Starting the invocation (attempt 1)
[21:38:04.266] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d5b258d7e19379ddeb7b39ceb0002b0ac002db14"
[21:38:04.266] Popped gitiles commit info from properties and tags
[21:38:04.266] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:38:04.266] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:38:04.267] Buildbucket request:
{
"requestId": "9014283168989855392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d5b258d7e19379ddeb7b39ceb0002b0ac002db14",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9014283168989855392"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:38:04.832] Scheduled build:
{
"id": "8848853107058798144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22025,
"createdBy": "project:chromium",
"createTime": "2021-04-26T21:38:04.354843Z",
"updateTime": "2021-04-26T21:38:04.759257Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d5b258d7e19379ddeb7b39ceb0002b0ac002db14",
"ref": "refs/heads/master"
}
}
}
[21:38:04.832] Task URL: https://cr-buildbucket.appspot.com/build/8848853107058798144
[21:38:04.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:2:0) after 4m34s
[21:41:18.215] Received PubSub notification, asking Buildbucket for the build status
[21:41:18.245] Build status: STARTED
[21:42:38.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:2:0)
[21:42:38.978] Build status: STARTED
[21:42:38.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:4:0) after 7m58s
[21:50:37.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:4:0)
[21:50:37.130] Build status: STARTED
[21:50:37.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:5:0) after 3m48s
[21:54:25.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:5:0)
[21:54:25.545] Build status: STARTED
[21:54:25.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:6:0) after 1m45s
[21:56:10.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:6:0)
[21:56:10.864] Build status: STARTED
[21:56:10.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:7:0) after 6m39s
[22:02:50.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:7:0)
[22:02:50.055] Build status: STARTED
[22:02:50.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:8:0) after 2m27s
[22:05:17.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:8:0)
[22:05:17.361] Build status: STARTED
[22:05:17.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:9:0) after 5m29s
[22:10:46.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:9:0)
[22:10:46.686] Build status: STARTED
[22:10:46.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:10:0) after 1m50s
[22:12:36.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:10:0)
[22:12:36.989] Build status: STARTED
[22:12:36.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:11:0) after 7m30s
[22:20:07.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:11:0)
[22:20:07.069] Build status: STARTED
[22:20:07.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:12:0) after 5m29s
[22:25:36.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:12:0)
[22:25:36.213] Build status: STARTED
[22:25:36.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:13:0) after 6m17s
[22:31:53.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:13:0)
[22:31:53.263] Build status: STARTED
[22:31:53.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:14:0) after 4m48s
[22:36:41.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:14:0)
[22:36:41.522] Build status: STARTED
[22:36:41.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:15:0) after 9m29s
[22:46:10.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:15:0)
[22:46:10.613] Build status: STARTED
[22:46:10.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:16:0) after 3m37s
[22:49:47.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:16:0)
[22:49:47.645] Build status: STARTED
[22:49:47.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:17:0) after 7m32s
[22:57:19.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:17:0)
[22:57:19.900] Build status: STARTED
[22:57:19.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:18:0) after 8m42s
[23:06:01.974] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:18:0)
[23:06:01.999] Build status: STARTED
[23:06:01.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:19:0) after 6m18s
[23:12:20.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:19:0)
[23:12:20.060] Build status: STARTED
[23:12:20.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:20:0) after 9m24s
[23:21:44.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:20:0)
[23:21:44.145] Build status: STARTED
[23:21:44.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:21:0) after 2m43s
[23:24:27.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:21:0)
[23:24:27.190] Build status: STARTED
[23:24:27.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:22:0) after 2m51s
[23:27:18.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:22:0)
[23:27:18.368] Build status: STARTED
[23:27:18.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:23:0) after 1m8s
[23:28:26.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:23:0)
[23:28:26.547] Build status: STARTED
[23:28:26.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:24:0) after 9m13s
[23:37:39.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:24:0)
[23:37:39.605] Build status: STARTED
[23:37:39.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:25:0) after 7m12s
[23:44:51.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:25:0)
[23:44:51.831] Build status: STARTED
[23:44:51.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:26:0) after 7m5s
[23:51:56.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:26:0)
[23:51:56.848] Build status: STARTED
[23:51:56.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:27:0) after 2m48s
[23:54:44.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:27:0)
[23:54:44.900] Build status: STARTED
[23:54:44.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:28:0) after 5m35s
[00:00:20.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:28:0)
[00:00:20.549] Build status: STARTED
[00:00:20.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:29:0) after 9m49s
[00:10:09.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:29:0)
[00:10:09.631] Build status: STARTED
[00:10:09.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:30:0) after 8m10s
[00:18:19.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:30:0)
[00:18:19.775] Build status: STARTED
[00:18:19.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:31:0) after 4m40s
[00:22:59.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:31:0)
[00:23:00.016] Build status: STARTED
[00:23:00.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:32:0) after 8m59s
[00:31:59.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:32:0)
[00:31:59.100] Build status: STARTED
[00:31:59.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:33:0) after 2m19s
[00:34:18.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:33:0)
[00:34:18.260] Build status: STARTED
[00:34:18.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:34:0) after 5m49s
[00:40:07.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:34:0)
[00:40:07.332] Build status: STARTED
[00:40:07.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:35:0) after 3m33s
[00:43:40.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:35:0)
[00:43:40.593] Build status: STARTED
[00:43:40.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:36:0) after 7m18s
[00:50:58.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:36:0)
[00:50:58.733] Build status: STARTED
[00:50:58.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:37:0) after 3m15s
[00:54:13.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:37:0)
[00:54:13.808] Build status: STARTED
[00:54:13.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:38:0) after 9m52s
[01:04:05.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:38:0)
[01:04:05.858] Build status: STARTED
[01:04:05.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:39:0) after 6m51s
[01:10:56.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:39:0)
[01:10:56.918] Build status: STARTED
[01:10:56.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:40:0) after 8m52s
[01:19:48.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:40:0)
[01:19:48.992] Build status: STARTED
[01:19:48.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:41:0) after 8m11s
[01:28:00.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:41:0)
[01:28:00.178] Build status: STARTED
[01:28:00.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:42:0) after 6m13s
[01:34:13.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:42:0)
[01:34:13.336] Build status: STARTED
[01:34:13.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:43:0) after 1m5s
[01:35:18.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:43:0)
[01:35:18.403] Build status: STARTED
[01:35:18.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:44:0) after 4m44s
[01:40:02.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:44:0)
[01:40:02.584] Build status: STARTED
[01:40:02.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:45:0) after 2m56s
[01:42:58.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:45:0)
[01:42:58.905] Build status: STARTED
[01:42:58.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:46:0) after 6m51s
[01:49:50.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:46:0)
[01:49:50.117] Build status: STARTED
[01:49:50.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:47:0) after 3m33s
[01:53:23.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:47:0)
[01:53:23.231] Build status: STARTED
[01:53:23.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:48:0) after 1m57s
[01:55:20.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:48:0)
[01:55:20.343] Build status: STARTED
[01:55:20.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:49:0) after 9m50s
[02:05:10.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:49:0)
[02:05:10.399] Build status: STARTED
[02:05:10.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:50:0) after 7m38s
[02:12:48.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:50:0)
[02:12:48.722] Build status: STARTED
[02:12:48.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:51:0) after 3m42s
[02:16:30.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:51:0)
[02:16:30.801] Build status: STARTED
[02:16:30.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014283168989855392:52:0) after 7m55s
[02:23:09.739] Received PubSub notification, asking Buildbucket for the build status
[02:23:09.772] Build:
{
"id": "8848853107058798144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22025,
"createdBy": "project:chromium",
"createTime": "2021-04-26T21:38:04.354843Z",
"startTime": "2021-04-26T21:41:17.521502Z",
"endTime": "2021-04-27T02:23:08.877510788Z",
"updateTime": "2021-04-27T02:23:08.894929630Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d5b258d7e19379ddeb7b39ceb0002b0ac002db14",
"ref": "refs/heads/master"
}
}
}
[02:23:09.772] Invocation finished in 4h45m6.642706262s with status FAILED