[20:15:57.032] New invocation is queued and will start shortly
[20:15:58.126] Starting the invocation (attempt 1)
[20:15:58.195] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3f9d049db84d518fcd44de35859e32f4ce19e658"
[20:15:58.195] Popped gitiles commit info from properties and tags
[20:15:58.195] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:15:58.195] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:15:58.195] Buildbucket request:
{
"requestId": "9016100273742685744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f9d049db84d518fcd44de35859e32f4ce19e658",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9016100273742685744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:15:58.939] Scheduled build:
{
"id": "8850670211626838800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21883,
"createdBy": "project:chromium",
"createTime": "2021-04-06T20:15:58.397842Z",
"updateTime": "2021-04-06T20:15:58.859861Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f9d049db84d518fcd44de35859e32f4ce19e658",
"ref": "refs/heads/master"
}
}
}
[20:15:58.939] Task URL: https://cr-buildbucket.appspot.com/build/8850670211626838800
[20:15:58.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:2:0) after 5m18s
[20:16:15.713] Received PubSub notification, asking Buildbucket for the build status
[20:16:15.740] Build status: STARTED
[20:21:17.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:2:0)
[20:21:17.498] Build status: STARTED
[20:21:17.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:4:0) after 6m52s
[20:28:09.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:4:0)
[20:28:09.786] Build status: STARTED
[20:28:09.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:5:0) after 7m0s
[20:35:09.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:5:0)
[20:35:09.841] Build status: STARTED
[20:35:09.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:6:0) after 2m23s
[20:37:32.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:6:0)
[20:37:32.890] Build status: STARTED
[20:37:32.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:7:0) after 6m34s
[20:44:06.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:7:0)
[20:44:07.029] Build status: STARTED
[20:44:07.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:8:0) after 4m26s
[20:48:33.382] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:8:0)
[20:48:33.414] Build status: STARTED
[20:48:33.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:9:0) after 6m12s
[20:54:45.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:9:0)
[20:54:45.463] Build status: STARTED
[20:54:45.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:10:0) after 3m37s
[20:58:22.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:10:0)
[20:58:22.470] Build status: STARTED
[20:58:22.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:11:0) after 3m56s
[21:02:18.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:11:0)
[21:02:18.676] Build status: STARTED
[21:02:18.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:12:0) after 6m36s
[21:08:54.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:12:0)
[21:08:54.804] Build status: STARTED
[21:08:54.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:13:0) after 7m29s
[21:16:23.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:13:0)
[21:16:23.955] Build status: STARTED
[21:16:23.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:14:0) after 6m38s
[21:23:02.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:14:0)
[21:23:02.150] Build status: STARTED
[21:23:02.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:15:0) after 1m10s
[21:24:12.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:15:0)
[21:24:12.455] Build status: STARTED
[21:24:12.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:16:0) after 9m14s
[21:33:26.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:16:0)
[21:33:26.503] Build status: STARTED
[21:33:26.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:17:0) after 6m53s
[21:40:19.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:17:0)
[21:40:19.597] Build status: STARTED
[21:40:19.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:18:0) after 9m15s
[21:49:34.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:18:0)
[21:49:34.701] Build status: STARTED
[21:49:34.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:19:0) after 3m44s
[21:53:18.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:19:0)
[21:53:18.897] Build status: STARTED
[21:53:18.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:20:0) after 3m29s
[21:56:47.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:20:0)
[21:56:47.957] Build status: STARTED
[21:56:47.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:21:0) after 7m38s
[22:04:25.982] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:21:0)
[22:04:26.013] Build status: STARTED
[22:04:26.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:22:0) after 1m3s
[22:05:29.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:22:0)
[22:05:29.183] Build status: STARTED
[22:05:29.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:23:0) after 6m30s
[22:11:59.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:23:0)
[22:11:59.276] Build status: STARTED
[22:11:59.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:24:0) after 9m30s
[22:21:29.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:24:0)
[22:21:29.564] Build status: STARTED
[22:21:29.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:25:0) after 1m31s
[22:23:00.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:25:0)
[22:23:01.002] Build status: STARTED
[22:23:01.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:26:0) after 2m10s
[22:25:11.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:26:0)
[22:25:11.102] Build status: STARTED
[22:25:11.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:27:0) after 5m43s
[22:30:54.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:27:0)
[22:30:54.154] Build status: STARTED
[22:30:54.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:28:0) after 6m56s
[22:37:50.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:28:0)
[22:37:50.204] Build status: STARTED
[22:37:50.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:29:0) after 8m37s
[22:46:27.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:29:0)
[22:46:27.285] Build status: STARTED
[22:46:27.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:30:0) after 4m6s
[22:50:33.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:30:0)
[22:50:33.345] Build status: STARTED
[22:50:33.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:31:0) after 2m17s
[22:52:50.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:31:0)
[22:52:50.424] Build status: STARTED
[22:52:50.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:32:0) after 3m36s
[22:56:26.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:32:0)
[22:56:26.617] Build status: STARTED
[22:56:26.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:33:0) after 8m9s
[23:04:35.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:33:0)
[23:04:35.671] Build status: STARTED
[23:04:35.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:34:0) after 6m7s
[23:10:42.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:34:0)
[23:10:42.797] Build status: STARTED
[23:10:42.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:35:0) after 8m56s
[23:19:38.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:35:0)
[23:19:38.868] Build status: STARTED
[23:19:38.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:36:0) after 9m10s
[23:28:48.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:36:0)
[23:28:48.973] Build status: STARTED
[23:28:48.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:37:0) after 3m11s
[23:32:00.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:37:0)
[23:32:00.081] Build status: STARTED
[23:32:00.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:38:0) after 2m53s
[23:34:53.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:38:0)
[23:34:53.222] Build status: STARTED
[23:34:53.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:39:0) after 6m59s
[23:41:52.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:39:0)
[23:41:52.274] Build status: STARTED
[23:41:52.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:40:0) after 6m13s
[23:48:05.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:40:0)
[23:48:05.690] Build status: STARTED
[23:48:05.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:41:0) after 6m31s
[23:54:36.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:41:0)
[23:54:36.928] Build status: STARTED
[23:54:36.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:42:0) after 6m33s
[00:01:10.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:42:0)
[00:01:10.256] Build status: STARTED
[00:01:10.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:43:0) after 4m59s
[00:06:09.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:43:0)
[00:06:09.504] Build status: STARTED
[00:06:09.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:44:0) after 3m31s
[00:09:40.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:44:0)
[00:09:40.573] Build status: STARTED
[00:09:40.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:45:0) after 5m46s
[00:15:26.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:45:0)
[00:15:26.753] Build status: STARTED
[00:15:26.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:46:0) after 3m46s
[00:19:12.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:46:0)
[00:19:12.979] Build status: STARTED
[00:19:12.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:47:0) after 9m39s
[00:28:52.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:47:0)
[00:28:52.096] Build status: STARTED
[00:28:52.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:48:0) after 1m41s
[00:30:33.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:48:0)
[00:30:33.423] Build status: STARTED
[00:30:33.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:49:0) after 2m6s
[00:32:39.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:49:0)
[00:32:39.445] Build status: STARTED
[00:32:39.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:50:0) after 3m0s
[00:35:39.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:50:0)
[00:35:39.513] Build status: STARTED
[00:35:39.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:51:0) after 5m19s
[00:40:58.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:51:0)
[00:40:58.643] Build status: STARTED
[00:40:58.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:52:0) after 7m38s
[00:48:36.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:52:0)
[00:48:36.785] Build status: STARTED
[00:48:36.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:53:0) after 8m9s
[00:56:45.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:53:0)
[00:56:45.904] Build status: STARTED
[00:56:45.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:54:0) after 2m30s
[00:59:15.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:54:0)
[00:59:16.021] Build status: STARTED
[00:59:16.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:55:0) after 5m32s
[01:04:48.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:55:0)
[01:04:48.077] Build status: STARTED
[01:04:48.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:56:0) after 8m3s
[01:12:51.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:56:0)
[01:12:51.435] Build status: STARTED
[01:12:51.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016100273742685744:57:0) after 6m48s
[01:15:01.618] Received PubSub notification, asking Buildbucket for the build status
[01:15:01.646] Build:
{
"id": "8850670211626838800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21883,
"createdBy": "project:chromium",
"createTime": "2021-04-06T20:15:58.397842Z",
"startTime": "2021-04-06T20:16:14.563218Z",
"endTime": "2021-04-07T01:15:01.052558695Z",
"updateTime": "2021-04-07T01:15:01.055417927Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f9d049db84d518fcd44de35859e32f4ce19e658",
"ref": "refs/heads/master"
}
}
}
[01:15:01.646] Invocation finished in 4h59m4.650476038s with status FAILED