[21:46:16.628] New invocation is queued and will start shortly
[21:46:17.662] Starting the invocation (attempt 1)
[21:46:17.694] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e7ed165e8f505cc12efd15e116287772e992272f"
[21:46:17.694] Popped gitiles commit info from properties and tags
[21:46:17.694] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:46:17.695] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:46:17.695] Buildbucket request:
{
"requestId": "8944613584368007840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e7ed165e8f505cc12efd15e116287772e992272f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8944613584368007840"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:46:18.179] Scheduled build:
{
"id": "8779183522487700961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29560,
"createdBy": "project:chromium",
"createTime": "2023-06-04T21:46:17.794280106Z",
"updateTime": "2023-06-04T21:46:17.794280106Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e7ed165e8f505cc12efd15e116287772e992272f",
"ref": "refs/heads/main"
}
}
}
[21:46:18.179] Task URL: https://cr-buildbucket.appspot.com/build/8779183522487700961
[21:46:18.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:2:0) after 7m49s
[21:49:13.985] Received PubSub notification, asking Buildbucket for the build status
[21:49:14.003] Build status: STARTED
[21:54:07.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:2:0)
[21:54:07.361] Build status: STARTED
[21:54:07.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:4:0) after 2m1s
[21:56:08.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:4:0)
[21:56:08.447] Build status: STARTED
[21:56:08.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:5:0) after 2m53s
[21:59:01.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:5:0)
[21:59:01.503] Build status: STARTED
[21:59:01.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:6:0) after 8m4s
[22:07:05.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:6:0)
[22:07:05.727] Build status: STARTED
[22:07:05.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:7:0) after 3m9s
[22:10:14.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:7:0)
[22:10:14.779] Build status: STARTED
[22:10:14.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:8:0) after 7m26s
[22:17:40.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:8:0)
[22:17:40.817] Build status: STARTED
[22:17:40.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:9:0) after 6m46s
[22:24:26.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:9:0)
[22:24:26.859] Build status: STARTED
[22:24:26.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:10:0) after 3m34s
[22:28:00.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:10:0)
[22:28:00.891] Build status: STARTED
[22:28:00.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:11:0) after 2m16s
[22:30:16.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:11:0)
[22:30:16.937] Build status: STARTED
[22:30:16.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:12:0) after 6m21s
[22:36:38.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:12:0)
[22:36:38.051] Build status: STARTED
[22:36:38.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:13:0) after 8m48s
[22:45:26.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:13:0)
[22:45:26.891] Build status: STARTED
[22:45:26.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:14:0) after 6m40s
[22:52:07.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:14:0)
[22:52:07.939] Build status: STARTED
[22:52:07.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:15:0) after 4m22s
[22:56:29.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:15:0)
[22:56:30.008] Build status: STARTED
[22:56:30.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:16:0) after 6m7s
[23:02:37.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:16:0)
[23:02:37.626] Build status: STARTED
[23:02:37.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:17:0) after 7m5s
[23:09:42.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:17:0)
[23:09:42.667] Build status: STARTED
[23:09:42.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:18:0) after 7m43s
[23:17:26.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:18:0)
[23:17:26.321] Build status: STARTED
[23:17:26.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:19:0) after 7m19s
[23:24:45.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:19:0)
[23:24:45.422] Build status: STARTED
[23:24:45.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:20:0) after 6m14s
[23:30:59.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:20:0)
[23:30:59.584] Build status: STARTED
[23:30:59.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:21:0) after 6m28s
[23:37:27.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:21:0)
[23:37:27.642] Build status: STARTED
[23:37:27.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:22:0) after 5m56s
[23:43:23.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:22:0)
[23:43:23.673] Build status: STARTED
[23:43:23.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:23:0) after 8m27s
[23:51:50.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:23:0)
[23:51:50.705] Build status: STARTED
[23:51:50.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:24:0) after 8m48s
[00:00:38.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:24:0)
[00:00:38.746] Build status: STARTED
[00:00:38.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:25:0) after 4m16s
[00:04:54.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:25:0)
[00:04:54.856] Build status: STARTED
[00:04:54.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:26:0) after 1m7s
[00:06:01.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:26:0)
[00:06:01.906] Build status: STARTED
[00:06:01.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:27:0) after 2m44s
[00:08:46.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:27:0)
[00:08:46.142] Build status: STARTED
[00:08:46.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:28:0) after 2m32s
[00:11:18.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:28:0)
[00:11:18.274] Build status: STARTED
[00:11:18.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:29:0) after 1m18s
[00:12:36.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:29:0)
[00:12:36.441] Build status: STARTED
[00:12:36.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:30:0) after 5m28s
[00:18:04.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:30:0)
[00:18:04.618] Build status: STARTED
[00:18:04.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:31:0) after 1m0s
[00:19:04.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:31:0)
[00:19:04.652] Build status: STARTED
[00:19:04.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:32:0) after 5m55s
[00:24:59.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:32:0)
[00:24:59.726] Build status: STARTED
[00:24:59.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:33:0) after 8m49s
[00:33:48.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:33:0)
[00:33:48.762] Build status: STARTED
[00:33:48.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:34:0) after 6m28s
[00:40:16.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:34:0)
[00:40:16.874] Build status: STARTED
[00:40:16.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:35:0) after 5m46s
[00:46:02.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:35:0)
[00:46:02.924] Build status: STARTED
[00:46:02.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:36:0) after 9m15s
[00:55:17.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:36:0)
[00:55:17.964] Build status: STARTED
[00:55:17.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:37:0) after 8m30s
[01:03:48.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:37:0)
[01:03:48.139] Build status: STARTED
[01:03:48.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:38:0) after 6m33s
[01:10:21.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:38:0)
[01:10:21.175] Build status: STARTED
[01:10:21.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:39:0) after 5m30s
[01:15:51.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:39:0)
[01:15:51.231] Build status: STARTED
[01:15:51.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:40:0) after 5m34s
[01:21:25.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:40:0)
[01:21:25.268] Build status: STARTED
[01:21:25.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:41:0) after 3m17s
[01:24:42.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:41:0)
[01:24:42.646] Build status: STARTED
[01:24:42.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:42:0) after 1m26s
[01:26:08.663] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:42:0)
[01:26:08.683] Build status: STARTED
[01:26:08.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:43:0) after 3m27s
[01:29:35.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:43:0)
[01:29:35.745] Build status: STARTED
[01:29:35.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:44:0) after 7m59s
[01:37:34.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:44:0)
[01:37:34.911] Build status: STARTED
[01:37:34.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:45:0) after 4m31s
[01:42:05.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:45:0)
[01:42:05.953] Build status: STARTED
[01:42:05.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:46:0) after 5m31s
[01:47:37.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:46:0)
[01:47:37.060] Build status: STARTED
[01:47:37.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:47:0) after 4m18s
[01:51:55.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:47:0)
[01:51:55.272] Build status: STARTED
[01:51:55.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:48:0) after 6m9s
[01:58:04.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:48:0)
[01:58:04.332] Build status: STARTED
[01:58:04.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:49:0) after 3m43s
[02:01:47.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:49:0)
[02:01:47.365] Build status: STARTED
[02:01:47.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:50:0) after 6m26s
[02:08:13.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:50:0)
[02:08:13.403] Build status: STARTED
[02:08:13.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:51:0) after 9m54s
[02:18:07.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:51:0)
[02:18:07.439] Build status: STARTED
[02:18:07.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:52:0) after 9m37s
[02:27:44.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:52:0)
[02:27:44.474] Build status: STARTED
[02:27:44.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:53:0) after 3m57s
[02:31:41.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:53:0)
[02:31:41.652] Build status: STARTED
[02:31:41.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:54:0) after 9m22s
[02:41:03.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:54:0)
[02:41:03.789] Build status: STARTED
[02:41:03.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:55:0) after 6m44s
[02:47:47.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:55:0)
[02:47:47.833] Build status: STARTED
[02:47:47.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:56:0) after 4m52s
[02:52:39.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:56:0)
[02:52:39.870] Build status: STARTED
[02:52:39.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:57:0) after 3m36s
[02:56:15.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:57:0)
[02:56:15.922] Build status: STARTED
[02:56:15.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:58:0) after 4m32s
[03:00:47.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:58:0)
[03:00:47.972] Build status: STARTED
[03:00:47.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8944613584368007840:59:0) after 8m19s
[03:01:03.987] Received PubSub notification, asking Buildbucket for the build status
[03:01:04.013] Build:
{
"id": "8779183522487700961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29560,
"createdBy": "project:chromium",
"createTime": "2023-06-04T21:46:17.794280106Z",
"startTime": "2023-06-04T21:49:13.374200Z",
"endTime": "2023-06-05T03:01:03.722872806Z",
"updateTime": "2023-06-05T03:01:03.722872806Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e7ed165e8f505cc12efd15e116287772e992272f",
"ref": "refs/heads/main"
}
}
}
[03:01:04.014] Invocation finished in 5h14m47.39634298s with status FAILED