[06:36:23.292] New invocation is queued and will start shortly
[06:36:24.378] Starting the invocation (attempt 1)
[06:36:24.412] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f25aacedc333c15972a1bc0b795d00da69b3b370"
[06:36:24.412] Popped gitiles commit info from properties and tags
[06:36:24.412] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:36:24.412] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:36:24.413] Buildbucket request:
{
"requestId": "9005461394090201184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f25aacedc333c15972a1bc0b795d00da69b3b370",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9005461394090201184"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:36:24.871] Scheduled build:
{
"id": "8840031332190694641",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22867,
"createdBy": "project:chromium",
"createTime": "2021-08-02T06:36:24.471968312Z",
"updateTime": "2021-08-02T06:36:24.704826838Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f25aacedc333c15972a1bc0b795d00da69b3b370",
"ref": "refs/heads/main"
}
}
}
[06:36:24.871] Task URL: https://cr-buildbucket.appspot.com/build/8840031332190694641
[06:36:24.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:2:0) after 5m35s
[06:39:00.884] Received PubSub notification, asking Buildbucket for the build status
[06:39:00.909] Build status: STARTED
[06:41:59.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:2:0)
[06:41:59.934] Build status: STARTED
[06:41:59.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:4:0) after 3m14s
[06:45:13.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:4:0)
[06:45:13.991] Build status: STARTED
[06:45:13.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:5:0) after 1m46s
[06:47:00.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:5:0)
[06:47:00.049] Build status: STARTED
[06:47:00.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:6:0) after 1m2s
[06:48:02.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:6:0)
[06:48:02.108] Build status: STARTED
[06:48:02.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:7:0) after 7m25s
[06:55:27.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:7:0)
[06:55:27.177] Build status: STARTED
[06:55:27.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:8:0) after 8m33s
[07:04:00.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:8:0)
[07:04:00.239] Build status: STARTED
[07:04:00.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:9:0) after 6m17s
[07:10:17.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:9:0)
[07:10:17.285] Build status: STARTED
[07:10:17.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:10:0) after 6m33s
[07:16:50.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:10:0)
[07:16:50.397] Build status: STARTED
[07:16:50.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:11:0) after 7m46s
[07:24:36.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:11:0)
[07:24:36.574] Build status: STARTED
[07:24:36.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:12:0) after 5m18s
[07:29:54.595] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:12:0)
[07:29:54.632] Build status: STARTED
[07:29:54.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:13:0) after 9m1s
[07:38:55.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:13:0)
[07:38:55.669] Build status: STARTED
[07:38:55.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:14:0) after 9m4s
[07:47:59.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:14:0)
[07:47:59.870] Build status: STARTED
[07:47:59.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:15:0) after 4m13s
[07:52:12.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:15:0)
[07:52:12.959] Build status: STARTED
[07:52:12.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:16:0) after 1m51s
[07:54:05.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:16:0)
[07:54:05.410] Build status: STARTED
[07:54:05.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:17:0) after 3m6s
[07:57:11.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:17:0)
[07:57:12.023] Build status: STARTED
[07:57:12.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:18:0) after 9m33s
[08:06:45.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:18:0)
[08:06:45.101] Build status: STARTED
[08:06:45.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:19:0) after 4m44s
[08:11:29.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:19:0)
[08:11:29.176] Build status: STARTED
[08:11:29.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:20:0) after 4m57s
[08:16:26.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:20:0)
[08:16:26.331] Build status: STARTED
[08:16:26.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:21:0) after 3m23s
[08:19:49.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:21:0)
[08:19:49.383] Build status: STARTED
[08:19:49.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:22:0) after 4m59s
[08:24:48.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:22:0)
[08:24:48.452] Build status: STARTED
[08:24:48.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:23:0) after 8m11s
[08:32:59.477] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:23:0)
[08:32:59.507] Build status: STARTED
[08:32:59.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:24:0) after 1m2s
[08:34:01.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:24:0)
[08:34:01.623] Build status: STARTED
[08:34:01.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:25:0) after 8m20s
[08:42:21.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:25:0)
[08:42:22.512] Build status: STARTED
[08:42:22.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:26:0) after 3m3s
[08:45:25.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:26:0)
[08:45:25.727] Build status: STARTED
[08:45:25.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:27:0) after 6m31s
[08:51:56.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:27:0)
[08:51:56.835] Build status: STARTED
[08:51:56.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:28:0) after 9m52s
[09:01:48.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:28:0)
[09:01:49.006] Build status: STARTED
[09:01:49.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:29:0) after 8m15s
[09:10:04.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:29:0)
[09:10:04.300] Build status: STARTED
[09:10:04.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:30:0) after 7m18s
[09:17:22.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:30:0)
[09:17:22.350] Build status: STARTED
[09:17:22.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:31:0) after 7m50s
[09:25:13.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:31:0)
[09:25:13.339] Build status: STARTED
[09:25:13.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:32:0) after 9m28s
[09:34:41.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:32:0)
[09:34:41.787] Build status: STARTED
[09:34:41.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:33:0) after 5m36s
[09:40:17.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:33:0)
[09:40:17.836] Build status: STARTED
[09:40:17.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:34:0) after 2m8s
[09:42:25.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:34:0)
[09:42:25.899] Build status: STARTED
[09:42:25.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:35:0) after 4m57s
[09:47:23.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:35:0)
[09:47:23.160] Build status: STARTED
[09:47:23.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:36:0) after 2m19s
[09:49:42.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:36:0)
[09:49:42.223] Build status: STARTED
[09:49:42.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:37:0) after 8m48s
[09:58:30.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:37:0)
[09:58:30.517] Build status: STARTED
[09:58:30.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:38:0) after 8m50s
[10:07:20.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:38:0)
[10:07:20.576] Build status: STARTED
[10:07:20.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:39:0) after 3m55s
[10:11:15.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:39:0)
[10:11:15.642] Build status: STARTED
[10:11:15.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:40:0) after 1m58s
[10:13:13.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:40:0)
[10:13:13.765] Build status: STARTED
[10:13:13.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:41:0) after 8m52s
[10:22:05.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:41:0)
[10:22:05.914] Build status: STARTED
[10:22:05.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:42:0) after 6m44s
[10:28:49.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:42:0)
[10:28:50.005] Build status: STARTED
[10:28:50.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:43:0) after 9m36s
[10:38:26.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:43:0)
[10:38:26.064] Build status: STARTED
[10:38:26.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:44:0) after 1m7s
[10:39:33.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:44:0)
[10:39:33.130] Build status: STARTED
[10:39:33.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:45:0) after 8m53s
[10:48:26.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:45:0)
[10:48:26.298] Build status: STARTED
[10:48:26.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:46:0) after 5m52s
[10:54:18.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:46:0)
[10:54:18.363] Build status: STARTED
[10:54:18.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:47:0) after 9m14s
[11:03:32.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:47:0)
[11:03:32.541] Build status: STARTED
[11:03:32.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:48:0) after 4m58s
[11:08:30.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:48:0)
[11:08:30.624] Build status: STARTED
[11:08:30.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:49:0) after 8m43s
[11:17:13.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:49:0)
[11:17:13.686] Build status: STARTED
[11:17:13.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:50:0) after 9m5s
[11:26:18.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:50:0)
[11:26:18.744] Build status: STARTED
[11:26:18.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:51:0) after 7m12s
[11:33:30.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:51:0)
[11:33:30.890] Build status: STARTED
[11:33:30.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:52:0) after 7m53s
[11:41:23.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:52:0)
[11:41:23.979] Build status: STARTED
[11:41:23.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:53:0) after 6m30s
[11:47:53.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:53:0)
[11:47:54.001] Build status: STARTED
[11:47:54.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:54:0) after 5m21s
[11:53:15.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:54:0)
[11:53:15.058] Build status: STARTED
[11:53:15.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:55:0) after 5m43s
[11:58:58.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:55:0)
[11:58:58.240] Build status: STARTED
[11:58:58.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:56:0) after 7m23s
[12:06:21.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:56:0)
[12:06:21.443] Build status: STARTED
[12:06:21.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005461394090201184:57:0) after 9m29s
[12:06:25.808] Received PubSub notification, asking Buildbucket for the build status
[12:06:25.864] Build:
{
"id": "8840031332190694641",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22867,
"createdBy": "project:chromium",
"createTime": "2021-08-02T06:36:24.471968312Z",
"startTime": "2021-08-02T06:39:00.510748Z",
"endTime": "2021-08-02T12:06:25.119051138Z",
"updateTime": "2021-08-02T12:06:25.157406507Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f25aacedc333c15972a1bc0b795d00da69b3b370",
"ref": "refs/heads/main"
}
}
}
[12:06:25.864] Invocation finished in 5h30m2.587722858s with status FAILED