[23:13:05.020] New invocation is queued and will start shortly
[23:13:06.463] Starting the invocation (attempt 1)
[23:13:06.501] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f93b7d9489bf83a233a6ecb2dea7f457005da0f9"
[23:13:06.501] Popped gitiles commit info from properties and tags
[23:13:06.501] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:13:06.501] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:13:06.501] Buildbucket request:
{
"requestId": "9015183159803373776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f93b7d9489bf83a233a6ecb2dea7f457005da0f9",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015183159803373776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:13:07.996] Scheduled build:
{
"id": "8849753096540169392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21940,
"createdBy": "project:chromium",
"createTime": "2021-04-16T23:13:07.500318Z",
"updateTime": "2021-04-16T23:13:07.927879Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f93b7d9489bf83a233a6ecb2dea7f457005da0f9",
"ref": "refs/heads/master"
}
}
}
[23:13:07.997] Task URL: https://cr-buildbucket.appspot.com/build/8849753096540169392
[23:13:07.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:2:0) after 1m11s
[23:14:18.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:2:0)
[23:14:19.004] Build status: SCHEDULED
[23:14:19.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:3:0) after 4m59s
[23:16:03.427] Received PubSub notification, asking Buildbucket for the build status
[23:16:03.528] Build status: STARTED
[23:19:18.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:3:0)
[23:19:18.452] Build status: STARTED
[23:19:18.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:5:0) after 1m17s
[23:20:35.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:5:0)
[23:20:35.637] Build status: STARTED
[23:20:35.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:6:0) after 2m22s
[23:22:57.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:6:0)
[23:22:57.722] Build status: STARTED
[23:22:57.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:7:0) after 4m51s
[23:27:48.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:7:0)
[23:27:48.774] Build status: STARTED
[23:27:48.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:8:0) after 2m25s
[23:30:13.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:8:0)
[23:30:13.928] Build status: STARTED
[23:30:13.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:9:0) after 7m52s
[23:38:06.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:9:0)
[23:38:06.121] Build status: STARTED
[23:38:06.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:10:0) after 1m36s
[23:39:42.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:10:0)
[23:39:42.307] Build status: STARTED
[23:39:42.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:11:0) after 5m9s
[23:44:51.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:11:0)
[23:44:51.437] Build status: STARTED
[23:44:51.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:12:0) after 3m40s
[23:48:31.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:12:0)
[23:48:31.609] Build status: STARTED
[23:48:31.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:13:0) after 8m21s
[23:56:52.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:13:0)
[23:56:52.886] Build status: STARTED
[23:56:52.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:14:0) after 2m45s
[23:59:38.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:14:0)
[23:59:38.034] Build status: STARTED
[23:59:38.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:15:0) after 1m30s
[00:01:08.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:15:0)
[00:01:08.113] Build status: STARTED
[00:01:08.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:16:0) after 6m33s
[00:07:41.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:16:0)
[00:07:41.656] Build status: STARTED
[00:07:41.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:17:0) after 7m35s
[00:15:16.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:17:0)
[00:15:16.890] Build status: STARTED
[00:15:16.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:18:0) after 4m48s
[00:20:05.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:18:0)
[00:20:05.043] Build status: STARTED
[00:20:05.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:19:0) after 6m32s
[00:26:37.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:19:0)
[00:26:37.342] Build status: STARTED
[00:26:37.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:20:0) after 6m35s
[00:33:12.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:20:0)
[00:33:12.401] Build status: STARTED
[00:33:12.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:21:0) after 5m51s
[00:39:03.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:21:0)
[00:39:03.643] Build status: STARTED
[00:39:03.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:22:0) after 7m47s
[00:46:50.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:22:0)
[00:46:50.846] Build status: STARTED
[00:46:50.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:23:0) after 4m34s
[00:51:25.163] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:23:0)
[00:51:25.199] Build status: STARTED
[00:51:25.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:24:0) after 7m11s
[00:58:36.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:24:0)
[00:58:36.213] Build status: STARTED
[00:58:36.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:25:0) after 7m57s
[01:06:33.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:25:0)
[01:06:33.390] Build status: STARTED
[01:06:33.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:26:0) after 7m50s
[01:14:23.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:26:0)
[01:14:23.438] Build status: STARTED
[01:14:23.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:27:0) after 3m4s
[01:17:27.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:27:0)
[01:17:27.485] Build status: STARTED
[01:17:27.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:28:0) after 9m59s
[01:27:26.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:28:0)
[01:27:26.567] Build status: STARTED
[01:27:26.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:29:0) after 9m52s
[01:37:18.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:29:0)
[01:37:18.648] Build status: STARTED
[01:37:18.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:30:0) after 1m23s
[01:38:41.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:30:0)
[01:38:41.694] Build status: STARTED
[01:38:41.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:31:0) after 5m3s
[01:43:44.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:31:0)
[01:43:44.821] Build status: STARTED
[01:43:44.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:32:0) after 5m38s
[01:49:22.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:32:0)
[01:49:22.870] Build status: STARTED
[01:49:22.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:33:0) after 4m54s
[01:54:16.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:33:0)
[01:54:16.919] Build status: STARTED
[01:54:16.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:34:0) after 5m46s
[02:00:02.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:34:0)
[02:00:02.991] Build status: STARTED
[02:00:02.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:35:0) after 5m30s
[02:05:33.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:35:0)
[02:05:33.039] Build status: STARTED
[02:05:33.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:36:0) after 4m17s
[02:09:50.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:36:0)
[02:09:50.150] Build status: STARTED
[02:09:50.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:37:0) after 4m42s
[02:14:32.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:37:0)
[02:14:32.303] Build status: STARTED
[02:14:32.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:38:0) after 2m39s
[02:17:11.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:38:0)
[02:17:11.555] Build status: STARTED
[02:17:11.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:39:0) after 3m24s
[02:20:35.585] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:39:0)
[02:20:35.610] Build status: STARTED
[02:20:35.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:40:0) after 6m52s
[02:27:27.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:40:0)
[02:27:27.682] Build status: STARTED
[02:27:27.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:41:0) after 3m52s
[02:31:19.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:41:0)
[02:31:19.750] Build status: STARTED
[02:31:19.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:42:0) after 9m25s
[02:40:44.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:42:0)
[02:40:44.915] Build status: STARTED
[02:40:44.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:43:0) after 2m4s
[02:42:48.936] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:43:0)
[02:42:48.962] Build status: STARTED
[02:42:48.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:44:0) after 1m5s
[02:43:54.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:44:0)
[02:43:54.208] Build status: STARTED
[02:43:54.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:45:0) after 1m6s
[02:45:00.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:45:0)
[02:45:00.422] Build status: STARTED
[02:45:00.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:46:0) after 9m20s
[02:54:20.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:46:0)
[02:54:20.748] Build status: STARTED
[02:54:20.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:47:0) after 5m49s
[03:00:09.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:47:0)
[03:00:09.877] Build status: STARTED
[03:00:09.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:48:0) after 5m10s
[03:05:19.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:48:0)
[03:05:19.938] Build status: STARTED
[03:05:19.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:49:0) after 4m27s
[03:09:46.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:49:0)
[03:09:46.993] Build status: STARTED
[03:09:46.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:50:0) after 5m40s
[03:15:27.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:50:0)
[03:15:27.236] Build status: STARTED
[03:15:27.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:51:0) after 1m20s
[03:16:47.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:51:0)
[03:16:47.390] Build status: STARTED
[03:16:47.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:52:0) after 3m12s
[03:19:59.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:52:0)
[03:19:59.519] Build status: STARTED
[03:19:59.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:53:0) after 2m45s
[03:22:44.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:53:0)
[03:22:44.581] Build status: STARTED
[03:22:44.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:54:0) after 9m16s
[03:32:00.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:54:0)
[03:32:00.672] Build status: STARTED
[03:32:00.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:55:0) after 8m3s
[03:40:03.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:55:0)
[03:40:03.757] Build status: STARTED
[03:40:03.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:56:0) after 3m30s
[03:43:33.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:56:0)
[03:43:33.814] Build status: STARTED
[03:43:33.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:57:0) after 4m51s
[03:48:24.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:57:0)
[03:48:24.867] Build status: STARTED
[03:48:24.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:58:0) after 2m41s
[03:51:05.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:58:0)
[03:51:05.927] Build status: STARTED
[03:51:05.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:59:0) after 1m9s
[03:52:14.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:59:0)
[03:52:15.003] Build status: STARTED
[03:52:15.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015183159803373776:60:0) after 6m11s
[03:54:33.268] Received PubSub notification, asking Buildbucket for the build status
[03:54:33.299] Build:
{
"id": "8849753096540169392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21940,
"createdBy": "project:chromium",
"createTime": "2021-04-16T23:13:07.500318Z",
"startTime": "2021-04-16T23:16:02.733742Z",
"endTime": "2021-04-17T03:54:32.866868111Z",
"updateTime": "2021-04-17T03:54:32.867192339Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f93b7d9489bf83a233a6ecb2dea7f457005da0f9",
"ref": "refs/heads/master"
}
}
}
[03:54:33.299] Invocation finished in 4h41m28.293341251s with status FAILED