[20:35:08.671] New invocation is queued and will start shortly
[20:35:09.770] Starting the invocation (attempt 1)
[20:35:09.803] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/21df2fd6a5560807730df9b97d4c2f2e19883251"
[20:35:09.803] Popped gitiles commit info from properties and tags
[20:35:09.803] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:35:09.803] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:35:09.803] Buildbucket request:
{
"requestId": "9013834141979349856",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "21df2fd6a5560807730df9b97d4c2f2e19883251",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9013834141979349856"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:35:10.366] Scheduled build:
{
"id": "8848404080037873440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22057,
"createdBy": "project:chromium",
"createTime": "2021-05-01T20:35:09.891347Z",
"updateTime": "2021-05-01T20:35:10.294743Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "21df2fd6a5560807730df9b97d4c2f2e19883251",
"ref": "refs/heads/master"
}
}
}
[20:35:10.366] Task URL: https://cr-buildbucket.appspot.com/build/8848404080037873440
[20:35:10.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:2:0) after 6m21s
[20:38:16.438] Received PubSub notification, asking Buildbucket for the build status
[20:38:16.467] Build status: STARTED
[20:41:31.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:2:0)
[20:41:31.484] Build status: STARTED
[20:41:31.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:4:0) after 3m36s
[20:45:07.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:4:0)
[20:45:07.600] Build status: STARTED
[20:45:07.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:5:0) after 6m24s
[20:51:31.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:5:0)
[20:51:31.649] Build status: STARTED
[20:51:31.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:6:0) after 8m52s
[21:00:23.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:6:0)
[21:00:23.796] Build status: STARTED
[21:00:23.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:7:0) after 2m42s
[21:03:05.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:7:0)
[21:03:05.839] Build status: STARTED
[21:03:05.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:8:0) after 7m7s
[21:10:12.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:8:0)
[21:10:12.889] Build status: STARTED
[21:10:12.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:9:0) after 1m9s
[21:11:21.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:9:0)
[21:11:21.932] Build status: STARTED
[21:11:21.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:10:0) after 7m26s
[21:18:48.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:10:0)
[21:18:48.055] Build status: STARTED
[21:18:48.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:11:0) after 7m45s
[21:26:33.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:11:0)
[21:26:33.120] Build status: STARTED
[21:26:33.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:12:0) after 9m8s
[21:35:41.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:12:0)
[21:35:41.164] Build status: STARTED
[21:35:41.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:13:0) after 2m22s
[21:38:03.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:13:0)
[21:38:03.209] Build status: STARTED
[21:38:03.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:14:0) after 3m9s
[21:41:12.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:14:0)
[21:41:12.267] Build status: STARTED
[21:41:12.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:15:0) after 5m10s
[21:46:22.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:15:0)
[21:46:22.417] Build status: STARTED
[21:46:22.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:16:0) after 7m16s
[21:53:38.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:16:0)
[21:53:38.830] Build status: STARTED
[21:53:38.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:17:0) after 6m48s
[22:00:26.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:17:0)
[22:00:26.913] Build status: STARTED
[22:00:26.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:18:0) after 4m56s
[22:05:22.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:18:0)
[22:05:22.956] Build status: STARTED
[22:05:22.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:19:0) after 1m35s
[22:06:57.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:19:0)
[22:06:57.992] Build status: STARTED
[22:06:57.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:20:0) after 2m31s
[22:09:29.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:20:0)
[22:09:29.067] Build status: STARTED
[22:09:29.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:21:0) after 6m38s
[22:16:07.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:21:0)
[22:16:07.183] Build status: STARTED
[22:16:07.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:22:0) after 5m23s
[22:21:30.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:22:0)
[22:21:30.227] Build status: STARTED
[22:21:30.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:23:0) after 6m56s
[22:28:26.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:23:0)
[22:28:26.459] Build status: STARTED
[22:28:26.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:24:0) after 3m10s
[22:31:36.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:24:0)
[22:31:36.698] Build status: STARTED
[22:31:36.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:25:0) after 2m45s
[22:34:21.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:25:0)
[22:34:21.747] Build status: STARTED
[22:34:21.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:26:0) after 3m6s
[22:37:27.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:26:0)
[22:37:27.874] Build status: STARTED
[22:37:27.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:27:0) after 9m55s
[22:47:23.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:27:0)
[22:47:23.555] Build status: STARTED
[22:47:23.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:28:0) after 1m21s
[22:48:44.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:28:0)
[22:48:44.598] Build status: STARTED
[22:48:44.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:29:0) after 6m24s
[22:55:08.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:29:0)
[22:55:08.641] Build status: STARTED
[22:55:08.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:30:0) after 3m37s
[22:58:45.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:30:0)
[22:58:45.685] Build status: STARTED
[22:58:45.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:31:0) after 6m51s
[23:05:36.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:31:0)
[23:05:37.030] Build status: STARTED
[23:05:37.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:32:0) after 5m6s
[23:10:43.055] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:32:0)
[23:10:43.196] Build status: STARTED
[23:10:43.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:33:0) after 4m49s
[23:15:32.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:33:0)
[23:15:32.445] Build status: STARTED
[23:15:32.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:34:0) after 2m2s
[23:17:34.523] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:34:0)
[23:17:34.555] Build status: STARTED
[23:17:34.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:35:0) after 9m56s
[23:27:30.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:35:0)
[23:27:30.601] Build status: STARTED
[23:27:30.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:36:0) after 3m40s
[23:31:10.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:36:0)
[23:31:10.712] Build status: STARTED
[23:31:10.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:37:0) after 7m39s
[23:38:49.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:37:0)
[23:38:49.857] Build status: STARTED
[23:38:49.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:38:0) after 5m26s
[23:44:16.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:38:0)
[23:44:16.151] Build status: STARTED
[23:44:16.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:39:0) after 6m8s
[23:50:24.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:39:0)
[23:50:24.213] Build status: STARTED
[23:50:24.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:40:0) after 3m30s
[23:53:54.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:40:0)
[23:53:54.310] Build status: STARTED
[23:53:54.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:41:0) after 6m57s
[00:00:51.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:41:0)
[00:00:51.386] Build status: STARTED
[00:00:51.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:42:0) after 9m35s
[00:10:26.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:42:0)
[00:10:26.668] Build status: STARTED
[00:10:26.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:43:0) after 2m56s
[00:13:22.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:43:0)
[00:13:22.753] Build status: STARTED
[00:13:22.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:44:0) after 7m50s
[00:21:12.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:44:0)
[00:21:12.834] Build status: STARTED
[00:21:12.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:45:0) after 4m32s
[00:25:44.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:45:0)
[00:25:44.946] Build status: STARTED
[00:25:44.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:46:0) after 6m9s
[00:31:53.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:46:0)
[00:31:54.001] Build status: STARTED
[00:31:54.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:47:0) after 7m39s
[00:39:33.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:47:0)
[00:39:33.145] Build status: STARTED
[00:39:33.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:48:0) after 8m22s
[00:47:55.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:48:0)
[00:47:55.903] Build status: STARTED
[00:47:55.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:49:0) after 5m23s
[00:53:19.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:49:0)
[00:53:19.325] Build status: STARTED
[00:53:19.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:50:0) after 5m8s
[00:58:27.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:50:0)
[00:58:27.369] Build status: STARTED
[00:58:27.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:51:0) after 2m35s
[01:01:02.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:51:0)
[01:01:02.587] Build status: STARTED
[01:01:02.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:52:0) after 8m50s
[01:09:52.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:52:0)
[01:09:52.695] Build status: STARTED
[01:09:52.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:53:0) after 2m47s
[01:12:39.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:53:0)
[01:12:39.892] Build status: STARTED
[01:12:39.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:54:0) after 3m32s
[01:16:11.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:54:0)
[01:16:12.008] Build status: STARTED
[01:16:12.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:55:0) after 1m31s
[01:17:43.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:55:0)
[01:17:43.114] Build status: STARTED
[01:17:43.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:56:0) after 4m8s
[01:21:51.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:56:0)
[01:21:51.158] Build status: STARTED
[01:21:51.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:57:0) after 2m5s
[01:23:56.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:57:0)
[01:23:56.197] Build status: STARTED
[01:23:56.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013834141979349856:58:0) after 7m54s
[01:25:06.350] Received PubSub notification, asking Buildbucket for the build status
[01:25:06.373] Build:
{
"id": "8848404080037873440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22057,
"createdBy": "project:chromium",
"createTime": "2021-05-01T20:35:09.891347Z",
"startTime": "2021-05-01T20:38:15.852778Z",
"endTime": "2021-05-02T01:25:06.037414826Z",
"updateTime": "2021-05-02T01:25:06.037793233Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "21df2fd6a5560807730df9b97d4c2f2e19883251",
"ref": "refs/heads/master"
}
}
}
[01:25:06.373] Invocation finished in 4h49m57.717492213s with status FAILED