[16:36:16.207] New invocation is queued and will start shortly
[16:36:17.354] Starting the invocation (attempt 1)
[16:36:17.404] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/10e76b9d067504a4c116004ac97b195cbb52b999"
[16:36:17.404] Popped gitiles commit info from properties and tags
[16:36:17.404] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:36:17.404] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:36:17.405] Buildbucket request:
{
"requestId": "8996454553118795536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10e76b9d067504a4c116004ac97b195cbb52b999",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8996454553118795536"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:36:18.064] Scheduled build:
{
"id": "8831024491101844465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23532,
"createdBy": "project:chromium",
"createTime": "2021-11-09T16:36:17.489004634Z",
"updateTime": "2021-11-09T16:36:17.489004634Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10e76b9d067504a4c116004ac97b195cbb52b999",
"ref": "refs/heads/main"
}
}
}
[16:36:18.064] Task URL: https://cr-buildbucket.appspot.com/build/8831024491101844465
[16:36:18.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:2:0) after 6m31s
[16:38:44.761] Received PubSub notification, asking Buildbucket for the build status
[16:38:44.788] Build status: STARTED
[16:42:49.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:2:0)
[16:42:49.165] Build status: STARTED
[16:42:49.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:4:0) after 8m16s
[16:51:05.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:4:0)
[16:51:05.469] Build status: STARTED
[16:51:05.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:5:0) after 4m18s
[16:55:23.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:5:0)
[16:55:23.622] Build status: STARTED
[16:55:23.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:6:0) after 5m48s
[17:01:11.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:6:0)
[17:01:11.939] Build status: STARTED
[17:01:11.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:7:0) after 1m49s
[17:03:01.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:7:0)
[17:03:01.115] Build status: STARTED
[17:03:01.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:8:0) after 3m56s
[17:06:57.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:8:0)
[17:06:57.169] Build status: STARTED
[17:06:57.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:9:0) after 5m58s
[17:12:55.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:9:0)
[17:12:55.428] Build status: STARTED
[17:12:55.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:10:0) after 3m29s
[17:16:24.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:10:0)
[17:16:24.495] Build status: STARTED
[17:16:24.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:11:0) after 2m2s
[17:18:26.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:11:0)
[17:18:26.654] Build status: STARTED
[17:18:26.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:12:0) after 8m30s
[17:26:56.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:12:0)
[17:26:56.796] Build status: STARTED
[17:26:56.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:13:0) after 6m37s
[17:33:34.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:13:0)
[17:33:34.124] Build status: STARTED
[17:33:34.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:14:0) after 6m37s
[17:40:11.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:14:0)
[17:40:11.213] Build status: STARTED
[17:40:11.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:15:0) after 7m6s
[17:47:17.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:15:0)
[17:47:17.381] Build status: STARTED
[17:47:17.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:16:0) after 6m52s
[17:54:09.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:16:0)
[17:54:09.436] Build status: STARTED
[17:54:09.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:17:0) after 6m11s
[18:00:20.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:17:0)
[18:00:20.676] Build status: STARTED
[18:00:20.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:18:0) after 8m39s
[18:08:59.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:18:0)
[18:08:59.815] Build status: STARTED
[18:08:59.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:19:0) after 4m33s
[18:13:32.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:19:0)
[18:13:32.993] Build status: STARTED
[18:13:32.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:20:0) after 5m7s
[18:18:40.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:20:0)
[18:18:40.372] Build status: STARTED
[18:18:40.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:21:0) after 6m33s
[18:25:13.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:21:0)
[18:25:13.518] Build status: STARTED
[18:25:13.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:22:0) after 1m40s
[18:26:53.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:22:0)
[18:26:53.744] Build status: STARTED
[18:26:53.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:23:0) after 2m12s
[18:29:05.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:23:0)
[18:29:05.806] Build status: STARTED
[18:29:05.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:24:0) after 5m8s
[18:34:13.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:24:0)
[18:34:13.863] Build status: STARTED
[18:34:13.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:25:0) after 7m53s
[18:42:06.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:25:0)
[18:42:06.928] Build status: STARTED
[18:42:06.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:26:0) after 2m9s
[18:44:15.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:26:0)
[18:44:16.005] Build status: STARTED
[18:44:16.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:27:0) after 2m51s
[18:47:07.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:27:0)
[18:47:07.111] Build status: STARTED
[18:47:07.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:28:0) after 6m36s
[18:53:43.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:28:0)
[18:53:43.188] Build status: STARTED
[18:53:43.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:29:0) after 1m59s
[18:55:42.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:29:0)
[18:55:42.247] Build status: STARTED
[18:55:42.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:30:0) after 5m3s
[19:00:45.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:30:0)
[19:00:45.339] Build status: STARTED
[19:00:45.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:31:0) after 5m45s
[19:06:30.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:31:0)
[19:06:30.455] Build status: STARTED
[19:06:30.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:32:0) after 4m55s
[19:11:25.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:32:0)
[19:11:25.527] Build status: STARTED
[19:11:25.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:33:0) after 7m12s
[19:18:37.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:33:0)
[19:18:37.654] Build status: STARTED
[19:18:37.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:34:0) after 2m44s
[19:21:21.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:34:0)
[19:21:21.768] Build status: STARTED
[19:21:21.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:35:0) after 6m48s
[19:28:09.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:35:0)
[19:28:09.826] Build status: STARTED
[19:28:09.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:36:0) after 3m56s
[19:32:05.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:36:0)
[19:32:05.984] Build status: STARTED
[19:32:05.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:37:0) after 4m45s
[19:36:51.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:37:0)
[19:36:51.201] Build status: STARTED
[19:36:51.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:38:0) after 1m32s
[19:38:23.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:38:0)
[19:38:23.327] Build status: STARTED
[19:38:23.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:39:0) after 8m0s
[19:46:23.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:39:0)
[19:46:23.511] Build status: STARTED
[19:46:23.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:40:0) after 6m34s
[19:52:57.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:40:0)
[19:52:57.745] Build status: STARTED
[19:52:57.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:41:0) after 9m42s
[20:02:39.781] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:41:0)
[20:02:39.816] Build status: STARTED
[20:02:39.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:42:0) after 4m37s
[20:07:18.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:42:0)
[20:07:18.345] Build status: STARTED
[20:07:18.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:43:0) after 3m41s
[20:10:59.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:43:0)
[20:10:59.413] Build status: STARTED
[20:10:59.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:44:0) after 9m52s
[20:20:51.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:44:0)
[20:20:51.497] Build status: STARTED
[20:20:51.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:45:0) after 6m32s
[20:27:23.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:45:0)
[20:27:23.681] Build status: STARTED
[20:27:23.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:46:0) after 1m18s
[20:28:41.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:46:0)
[20:28:41.898] Build status: STARTED
[20:28:41.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:47:0) after 7m22s
[20:36:04.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:47:0)
[20:36:04.080] Build status: STARTED
[20:36:04.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:48:0) after 9m48s
[20:45:52.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:48:0)
[20:45:52.437] Build status: STARTED
[20:45:52.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:49:0) after 5m2s
[20:50:54.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:49:0)
[20:50:54.512] Build status: STARTED
[20:50:54.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:50:0) after 3m49s
[20:54:43.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:50:0)
[20:54:43.692] Build status: STARTED
[20:54:43.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:51:0) after 6m26s
[21:01:09.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:51:0)
[21:01:09.883] Build status: STARTED
[21:01:09.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:52:0) after 7m40s
[21:08:49.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:52:0)
[21:08:49.958] Build status: STARTED
[21:08:49.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:53:0) after 2m51s
[21:11:40.982] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:53:0)
[21:11:41.049] Build status: STARTED
[21:11:41.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:54:0) after 6m23s
[21:18:04.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:54:0)
[21:18:04.540] Build status: STARTED
[21:18:04.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:55:0) after 6m12s
[21:24:16.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:55:0)
[21:24:16.605] Build status: STARTED
[21:24:16.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:56:0) after 6m37s
[21:30:53.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:56:0)
[21:30:53.679] Build status: STARTED
[21:30:53.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:57:0) after 9m5s
[21:39:58.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:57:0)
[21:39:59.030] Build status: STARTED
[21:39:59.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:58:0) after 2m49s
[21:42:48.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:58:0)
[21:42:48.352] Build status: STARTED
[21:42:48.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:59:0) after 7m37s
[21:50:25.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:59:0)
[21:50:25.586] Build status: STARTED
[21:50:25.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:60:0) after 5m51s
[21:56:17.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:60:0)
[21:56:17.181] Build status: STARTED
[21:56:17.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996454553118795536:61:0) after 2m1s
[21:56:33.441] Received PubSub notification, asking Buildbucket for the build status
[21:56:33.478] Build:
{
"id": "8831024491101844465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23532,
"createdBy": "project:chromium",
"createTime": "2021-11-09T16:36:17.489004634Z",
"startTime": "2021-11-09T16:38:44.209245Z",
"endTime": "2021-11-09T21:56:32.977334412Z",
"updateTime": "2021-11-09T21:56:32.977334412Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10e76b9d067504a4c116004ac97b195cbb52b999",
"ref": "refs/heads/main"
}
}
}
[21:56:33.478] Invocation finished in 5h20m17.295195409s with status FAILED