[06:01:44.704] New invocation is queued and will start shortly
[06:01:45.890] Starting the invocation (attempt 1)
[06:01:45.920] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cbeef00418b19f59ca6a1cf596a42a43915cde4f"
[06:01:45.920] Popped gitiles commit info from properties and tags
[06:01:45.920] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:01:45.920] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:01:45.921] Buildbucket request:
{
"requestId": "9002926858590230432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cbeef00418b19f59ca6a1cf596a42a43915cde4f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9002926858590230432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:01:46.405] Scheduled build:
{
"id": "8837496796574718257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23021,
"createdBy": "project:chromium",
"createTime": "2021-08-30T06:01:45.992255832Z",
"updateTime": "2021-08-30T06:01:46.236505538Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cbeef00418b19f59ca6a1cf596a42a43915cde4f",
"ref": "refs/heads/main"
}
}
}
[06:01:46.405] Task URL: https://cr-buildbucket.appspot.com/build/8837496796574718257
[06:01:46.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:2:0) after 3m36s
[06:04:12.527] Received PubSub notification, asking Buildbucket for the build status
[06:04:12.560] Build status: STARTED
[06:05:22.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:2:0)
[06:05:22.452] Build status: STARTED
[06:05:22.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:4:0) after 2m40s
[06:08:02.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:4:0)
[06:08:02.641] Build status: STARTED
[06:08:02.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:5:0) after 5m32s
[06:13:34.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:5:0)
[06:13:34.783] Build status: STARTED
[06:13:34.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:6:0) after 1m51s
[06:15:26.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:6:0)
[06:15:26.325] Build status: STARTED
[06:15:26.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:7:0) after 8m59s
[06:24:25.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:7:0)
[06:24:25.468] Build status: STARTED
[06:24:25.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:8:0) after 3m5s
[06:27:30.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:8:0)
[06:27:30.589] Build status: STARTED
[06:27:30.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:9:0) after 5m24s
[06:32:54.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:9:0)
[06:32:54.767] Build status: STARTED
[06:32:54.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:10:0) after 2m18s
[06:35:12.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:10:0)
[06:35:12.935] Build status: STARTED
[06:35:12.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:11:0) after 4m3s
[06:39:16.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:11:0)
[06:39:16.346] Build status: STARTED
[06:39:16.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:12:0) after 4m45s
[06:44:01.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:12:0)
[06:44:01.584] Build status: STARTED
[06:44:01.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:13:0) after 8m3s
[06:52:04.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:13:0)
[06:52:04.727] Build status: STARTED
[06:52:04.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:14:0) after 6m43s
[06:58:47.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:14:0)
[06:58:47.919] Build status: STARTED
[06:58:47.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:15:0) after 4m18s
[07:03:06.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:15:0)
[07:03:06.090] Build status: STARTED
[07:03:06.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:16:0) after 6m14s
[07:09:20.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:16:0)
[07:09:20.139] Build status: STARTED
[07:09:20.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:17:0) after 3m9s
[07:12:29.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:17:0)
[07:12:29.201] Build status: STARTED
[07:12:29.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:18:0) after 4m49s
[07:17:18.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:18:0)
[07:17:18.284] Build status: STARTED
[07:17:18.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:19:0) after 5m16s
[07:22:34.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:19:0)
[07:22:34.442] Build status: STARTED
[07:22:34.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:20:0) after 9m37s
[07:32:11.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:20:0)
[07:32:11.491] Build status: STARTED
[07:32:11.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:21:0) after 5m20s
[07:37:31.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:21:0)
[07:37:31.533] Build status: STARTED
[07:37:31.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:22:0) after 5m1s
[07:42:32.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:22:0)
[07:42:32.646] Build status: STARTED
[07:42:32.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:23:0) after 7m35s
[07:50:07.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:23:0)
[07:50:07.904] Build status: STARTED
[07:50:07.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:24:0) after 4m37s
[07:54:44.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:24:0)
[07:54:44.942] Build status: STARTED
[07:54:44.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:25:0) after 5m33s
[08:00:18.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:25:0)
[08:00:18.307] Build status: STARTED
[08:00:18.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:26:0) after 4m9s
[08:04:27.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:26:0)
[08:04:27.440] Build status: STARTED
[08:04:27.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:27:0) after 6m16s
[08:10:43.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:27:0)
[08:10:43.503] Build status: STARTED
[08:10:43.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:28:0) after 5m0s
[08:15:43.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:28:0)
[08:15:43.642] Build status: STARTED
[08:15:43.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:29:0) after 8m9s
[08:23:52.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:29:0)
[08:23:52.766] Build status: STARTED
[08:23:52.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:30:0) after 7m54s
[08:31:46.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:30:0)
[08:31:46.932] Build status: STARTED
[08:31:46.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:31:0) after 9m29s
[08:41:15.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:31:0)
[08:41:16.021] Build status: STARTED
[08:41:16.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:32:0) after 4m21s
[08:45:37.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:32:0)
[08:45:37.095] Build status: STARTED
[08:45:37.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:33:0) after 7m48s
[08:53:25.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:33:0)
[08:53:25.385] Build status: STARTED
[08:53:25.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:34:0) after 9m12s
[09:02:37.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:34:0)
[09:02:37.440] Build status: STARTED
[09:02:37.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:35:0) after 8m16s
[09:10:53.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:35:0)
[09:10:53.488] Build status: STARTED
[09:10:53.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:36:0) after 2m18s
[09:13:11.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:36:0)
[09:13:11.736] Build status: STARTED
[09:13:11.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:37:0) after 1m15s
[09:14:26.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:37:0)
[09:14:27.016] Build status: STARTED
[09:14:27.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:38:0) after 7m15s
[09:21:42.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:38:0)
[09:21:42.073] Build status: STARTED
[09:21:42.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:39:0) after 1m56s
[09:23:38.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:39:0)
[09:23:38.185] Build status: STARTED
[09:23:38.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:40:0) after 6m51s
[09:30:29.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:40:0)
[09:30:29.332] Build status: STARTED
[09:30:29.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:41:0) after 6m5s
[09:36:34.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:41:0)
[09:36:34.398] Build status: STARTED
[09:36:34.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:42:0) after 6m47s
[09:43:21.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:42:0)
[09:43:21.452] Build status: STARTED
[09:43:21.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:43:0) after 1m20s
[09:44:41.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:43:0)
[09:44:41.507] Build status: STARTED
[09:44:41.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:44:0) after 5m40s
[09:50:21.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:44:0)
[09:50:21.673] Build status: STARTED
[09:50:21.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:45:0) after 5m53s
[09:56:14.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:45:0)
[09:56:14.726] Build status: STARTED
[09:56:14.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:46:0) after 5m18s
[10:01:32.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:46:0)
[10:01:32.798] Build status: STARTED
[10:01:32.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:47:0) after 8m23s
[10:09:55.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:47:0)
[10:09:55.867] Build status: STARTED
[10:09:55.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:48:0) after 9m52s
[10:19:47.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:48:0)
[10:19:47.915] Build status: STARTED
[10:19:47.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:49:0) after 4m41s
[10:24:29.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:49:0)
[10:24:29.072] Build status: STARTED
[10:24:29.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:50:0) after 4m35s
[10:29:04.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:50:0)
[10:29:04.127] Build status: STARTED
[10:29:04.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:51:0) after 9m14s
[10:38:18.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:51:0)
[10:38:18.354] Build status: STARTED
[10:38:18.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:52:0) after 4m58s
[10:43:16.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:52:0)
[10:43:16.656] Build status: STARTED
[10:43:16.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:53:0) after 4m20s
[10:47:36.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:53:0)
[10:47:36.873] Build status: STARTED
[10:47:36.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:54:0) after 6m42s
[10:54:18.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:54:0)
[10:54:18.930] Build status: STARTED
[10:54:18.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:55:0) after 9m19s
[11:03:38.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:55:0)
[11:03:38.240] Build status: STARTED
[11:03:38.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:56:0) after 8m28s
[11:12:06.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:56:0)
[11:12:06.364] Build status: STARTED
[11:12:06.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:57:0) after 6m7s
[11:18:13.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:57:0)
[11:18:13.511] Build status: STARTED
[11:18:13.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002926858590230432:58:0) after 8m52s
[11:20:52.609] Received PubSub notification, asking Buildbucket for the build status
[11:20:52.655] Build:
{
"id": "8837496796574718257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23021,
"createdBy": "project:chromium",
"createTime": "2021-08-30T06:01:45.992255832Z",
"startTime": "2021-08-30T06:04:11.991978Z",
"endTime": "2021-08-30T11:20:52.028254091Z",
"updateTime": "2021-08-30T11:20:52.028792167Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cbeef00418b19f59ca6a1cf596a42a43915cde4f",
"ref": "refs/heads/main"
}
}
}
[11:20:52.655] Invocation finished in 5h19m7.96887161s with status FAILED