[15:25:17.083] New invocation is queued and will start shortly
[15:25:18.598] Starting the invocation (attempt 1)
[15:25:18.666] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0d7031be16a14a0be27d606c989a8b9fc47c4724"
[15:25:18.666] Popped gitiles commit info from properties and tags
[15:25:18.666] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:25:18.666] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:25:18.666] Buildbucket request:
{
"requestId": "8996912004073180752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d7031be16a14a0be27d606c989a8b9fc47c4724",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8996912004073180752"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:25:20.719] Scheduled build:
{
"id": "8831481941504948321",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23509,
"createdBy": "project:chromium",
"createTime": "2021-11-04T15:25:18.789328352Z",
"updateTime": "2021-11-04T15:25:18.789328352Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d7031be16a14a0be27d606c989a8b9fc47c4724",
"ref": "refs/heads/main"
}
}
}
[15:25:20.719] Task URL: https://cr-buildbucket.appspot.com/build/8831481941504948321
[15:25:20.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:2:0) after 7m3s
[15:27:56.805] Received PubSub notification, asking Buildbucket for the build status
[15:27:56.886] Build status: STARTED
[15:32:23.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:2:0)
[15:32:23.825] Build status: STARTED
[15:32:23.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:4:0) after 6m8s
[15:38:31.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:4:0)
[15:38:31.944] Build status: STARTED
[15:38:31.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:5:0) after 3m42s
[15:42:13.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:5:0)
[15:42:14.024] Build status: STARTED
[15:42:14.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:6:0) after 1m39s
[15:43:53.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:6:0)
[15:43:53.088] Build status: STARTED
[15:43:53.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:7:0) after 3m25s
[15:47:18.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:7:0)
[15:47:18.161] Build status: STARTED
[15:47:18.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:8:0) after 1m5s
[15:48:23.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:8:0)
[15:48:23.469] Build status: STARTED
[15:48:23.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:9:0) after 2m16s
[15:50:39.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:9:0)
[15:50:39.781] Build status: STARTED
[15:50:39.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:10:0) after 9m0s
[15:59:39.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:10:0)
[15:59:39.869] Build status: STARTED
[15:59:39.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:11:0) after 1m7s
[16:00:46.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:11:0)
[16:00:46.965] Build status: STARTED
[16:00:46.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:12:0) after 1m27s
[16:02:14.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:12:0)
[16:02:14.134] Build status: STARTED
[16:02:14.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:13:0) after 3m20s
[16:05:34.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:13:0)
[16:05:34.317] Build status: STARTED
[16:05:34.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:14:0) after 1m25s
[16:06:59.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:14:0)
[16:06:59.375] Build status: STARTED
[16:06:59.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:15:0) after 2m5s
[16:09:04.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:15:0)
[16:09:04.519] Build status: STARTED
[16:09:04.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:16:0) after 4m18s
[16:13:22.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:16:0)
[16:13:22.677] Build status: STARTED
[16:13:22.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:17:0) after 2m40s
[16:16:02.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:17:0)
[16:16:02.858] Build status: STARTED
[16:16:02.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:18:0) after 9m39s
[16:25:41.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:18:0)
[16:25:41.957] Build status: STARTED
[16:25:41.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:19:0) after 9m19s
[16:35:01.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:19:0)
[16:35:01.188] Build status: STARTED
[16:35:01.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:20:0) after 9m2s
[16:44:03.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:20:0)
[16:44:03.571] Build status: STARTED
[16:44:03.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:21:0) after 1m11s
[16:45:14.595] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:21:0)
[16:45:14.631] Build status: STARTED
[16:45:14.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:22:0) after 6m3s
[16:51:17.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:22:0)
[16:51:17.644] Build status: STARTED
[16:51:17.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:23:0) after 7m12s
[16:58:29.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:23:0)
[16:58:29.702] Build status: STARTED
[16:58:29.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:24:0) after 9m5s
[17:07:34.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:24:0)
[17:07:34.923] Build status: STARTED
[17:07:34.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:25:0) after 7m9s
[17:14:44.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:25:0)
[17:14:44.173] Build status: STARTED
[17:14:44.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:26:0) after 8m24s
[17:23:08.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:26:0)
[17:23:08.225] Build status: STARTED
[17:23:08.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:27:0) after 2m42s
[17:25:50.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:27:0)
[17:25:50.287] Build status: STARTED
[17:25:50.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:28:0) after 1m28s
[17:27:18.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:28:0)
[17:27:18.450] Build status: STARTED
[17:27:18.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:29:0) after 9m52s
[17:37:10.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:29:0)
[17:37:10.596] Build status: STARTED
[17:37:10.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:30:0) after 8m5s
[17:45:15.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:30:0)
[17:45:16.011] Build status: STARTED
[17:45:16.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:31:0) after 2m10s
[17:47:26.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:31:0)
[17:47:26.109] Build status: STARTED
[17:47:26.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:32:0) after 7m1s
[17:54:27.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:32:0)
[17:54:27.628] Build status: STARTED
[17:54:27.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:33:0) after 4m38s
[17:59:05.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:33:0)
[17:59:05.877] Build status: STARTED
[17:59:05.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:34:0) after 4m31s
[18:03:36.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:34:0)
[18:03:36.975] Build status: STARTED
[18:03:36.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:35:0) after 6m3s
[18:09:40.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:35:0)
[18:09:40.578] Build status: STARTED
[18:09:40.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:36:0) after 4m52s
[18:14:32.750] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:36:0)
[18:14:32.785] Build status: STARTED
[18:14:32.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:37:0) after 3m47s
[18:18:19.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:37:0)
[18:18:19.981] Build status: STARTED
[18:18:19.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:38:0) after 8m22s
[18:26:42.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:38:0)
[18:26:42.042] Build status: STARTED
[18:26:42.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:39:0) after 7m16s
[18:33:58.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:39:0)
[18:33:58.158] Build status: STARTED
[18:33:58.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:40:0) after 5m25s
[18:39:23.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:40:0)
[18:39:23.212] Build status: STARTED
[18:39:23.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:41:0) after 3m16s
[18:42:39.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:41:0)
[18:42:39.285] Build status: STARTED
[18:42:39.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:42:0) after 5m7s
[18:47:46.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:42:0)
[18:47:46.390] Build status: STARTED
[18:47:46.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:43:0) after 5m4s
[18:52:50.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:43:0)
[18:52:50.904] Build status: STARTED
[18:52:50.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:44:0) after 7m34s
[19:00:25.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:44:0)
[19:00:25.133] Build status: STARTED
[19:00:25.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:45:0) after 6m8s
[19:06:33.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:45:0)
[19:06:33.400] Build status: STARTED
[19:06:33.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:46:0) after 7m16s
[19:13:49.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:46:0)
[19:13:49.532] Build status: STARTED
[19:13:49.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:47:0) after 8m49s
[19:22:38.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:47:0)
[19:22:38.591] Build status: STARTED
[19:22:38.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:48:0) after 3m18s
[19:25:56.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:48:0)
[19:25:56.645] Build status: STARTED
[19:25:56.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:49:0) after 6m37s
[19:32:33.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:49:0)
[19:32:33.702] Build status: STARTED
[19:32:33.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:50:0) after 4m45s
[19:37:18.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:50:0)
[19:37:18.815] Build status: STARTED
[19:37:18.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:51:0) after 3m3s
[19:40:21.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:51:0)
[19:40:21.958] Build status: STARTED
[19:40:21.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:52:0) after 4m5s
[19:44:27.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:52:0)
[19:44:27.108] Build status: STARTED
[19:44:27.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:53:0) after 5m4s
[19:49:31.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:53:0)
[19:49:31.251] Build status: STARTED
[19:49:31.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:54:0) after 8m15s
[19:57:46.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:54:0)
[19:57:46.385] Build status: STARTED
[19:57:46.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:55:0) after 8m42s
[20:06:28.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:55:0)
[20:06:28.438] Build status: STARTED
[20:06:28.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:56:0) after 6m19s
[20:12:47.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:56:0)
[20:12:47.495] Build status: STARTED
[20:12:47.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:57:0) after 9m12s
[20:21:59.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:57:0)
[20:21:59.610] Build status: STARTED
[20:21:59.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:58:0) after 6m16s
[20:28:15.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:58:0)
[20:28:15.674] Build status: STARTED
[20:28:15.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:59:0) after 4m51s
[20:33:06.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:59:0)
[20:33:06.733] Build status: STARTED
[20:33:06.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:60:0) after 6m33s
[20:39:39.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:60:0)
[20:39:39.817] Build status: STARTED
[20:39:39.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996912004073180752:61:0) after 9m6s
[20:47:24.359] Received PubSub notification, asking Buildbucket for the build status
[20:47:24.394] Build:
{
"id": "8831481941504948321",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23509,
"createdBy": "project:chromium",
"createTime": "2021-11-04T15:25:18.789328352Z",
"startTime": "2021-11-04T15:27:56.463009114Z",
"endTime": "2021-11-04T20:47:23.748553417Z",
"updateTime": "2021-11-04T20:47:23.748553417Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d7031be16a14a0be27d606c989a8b9fc47c4724",
"ref": "refs/heads/main"
}
}
}
[20:47:24.394] Invocation finished in 5h22m7.438427434s with status FAILED