[10:33:34.550] New invocation is queued and will start shortly
[10:33:35.658] Starting the invocation (attempt 1)
[10:33:35.689] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/86376c7a5be0d53e9a81e304248e1f18691863b1"
[10:33:35.689] Popped gitiles commit info from properties and tags
[10:33:35.689] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:33:35.690] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:33:35.690] Buildbucket request:
{
"requestId": "9003090950415046624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "86376c7a5be0d53e9a81e304248e1f18691863b1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9003090950415046624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:33:36.183] Scheduled build:
{
"id": "8837660888489139489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23013,
"createdBy": "project:chromium",
"createTime": "2021-08-28T10:33:35.747426913Z",
"updateTime": "2021-08-28T10:33:35.996329700Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "86376c7a5be0d53e9a81e304248e1f18691863b1",
"ref": "refs/heads/main"
}
}
}
[10:33:36.183] Task URL: https://cr-buildbucket.appspot.com/build/8837660888489139489
[10:33:36.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:2:0) after 7m56s
[10:36:04.100] Received PubSub notification, asking Buildbucket for the build status
[10:36:04.133] Build status: STARTED
[10:41:32.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:2:0)
[10:41:32.327] Build status: STARTED
[10:41:32.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:4:0) after 3m15s
[10:44:47.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:4:0)
[10:44:47.375] Build status: STARTED
[10:44:47.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:5:0) after 4m9s
[10:48:56.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:5:0)
[10:48:56.435] Build status: STARTED
[10:48:56.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:6:0) after 1m23s
[10:50:19.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:6:0)
[10:50:19.590] Build status: STARTED
[10:50:19.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:7:0) after 2m35s
[10:52:54.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:7:0)
[10:52:54.768] Build status: STARTED
[10:52:54.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:8:0) after 5m4s
[10:57:58.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:8:0)
[10:57:58.823] Build status: STARTED
[10:57:58.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:9:0) after 1m12s
[10:59:10.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:9:0)
[10:59:10.882] Build status: STARTED
[10:59:10.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:10:0) after 9m6s
[11:08:16.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:10:0)
[11:08:16.963] Build status: STARTED
[11:08:16.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:11:0) after 4m17s
[11:12:34.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:11:0)
[11:12:34.081] Build status: STARTED
[11:12:34.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:12:0) after 6m18s
[11:18:52.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:12:0)
[11:18:52.127] Build status: STARTED
[11:18:52.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:13:0) after 1m24s
[11:20:16.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:13:0)
[11:20:16.183] Build status: STARTED
[11:20:16.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:14:0) after 6m28s
[11:26:44.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:14:0)
[11:26:44.355] Build status: STARTED
[11:26:44.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:15:0) after 5m53s
[11:32:37.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:15:0)
[11:32:37.504] Build status: STARTED
[11:32:37.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:16:0) after 4m14s
[11:36:51.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:16:0)
[11:36:51.587] Build status: STARTED
[11:36:51.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:17:0) after 9m4s
[11:45:55.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:17:0)
[11:45:55.806] Build status: STARTED
[11:45:55.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:18:0) after 8m43s
[11:54:39.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:18:0)
[11:54:39.697] Build status: STARTED
[11:54:39.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:19:0) after 9m40s
[12:04:19.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:19:0)
[12:04:19.746] Build status: STARTED
[12:04:19.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:20:0) after 6m10s
[12:10:29.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:20:0)
[12:10:29.794] Build status: STARTED
[12:10:29.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:21:0) after 9m33s
[12:20:03.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:21:0)
[12:20:03.078] Build status: STARTED
[12:20:03.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:22:0) after 4m0s
[12:24:04.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:22:0)
[12:24:04.122] Build status: STARTED
[12:24:04.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:23:0) after 9m56s
[12:34:00.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:23:0)
[12:34:00.845] Build status: STARTED
[12:34:00.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:24:0) after 9m55s
[12:43:55.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:24:0)
[12:43:55.982] Build status: STARTED
[12:43:55.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:25:0) after 5m24s
[12:49:20.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:25:0)
[12:49:20.887] Build status: STARTED
[12:49:20.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:26:0) after 9m33s
[12:58:53.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:26:0)
[12:58:53.938] Build status: STARTED
[12:58:53.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:27:0) after 9m14s
[13:08:08.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:27:0)
[13:08:08.083] Build status: STARTED
[13:08:08.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:28:0) after 5m29s
[13:13:37.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:28:0)
[13:13:37.136] Build status: STARTED
[13:13:37.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:29:0) after 6m49s
[13:20:26.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:29:0)
[13:20:26.191] Build status: STARTED
[13:20:26.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:30:0) after 5m10s
[13:25:36.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:30:0)
[13:25:36.235] Build status: STARTED
[13:25:36.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:31:0) after 1m16s
[13:26:52.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:31:0)
[13:26:52.282] Build status: STARTED
[13:26:52.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:32:0) after 1m14s
[13:28:06.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:32:0)
[13:28:06.330] Build status: STARTED
[13:28:06.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:33:0) after 5m10s
[13:33:16.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:33:0)
[13:33:16.395] Build status: STARTED
[13:33:16.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:34:0) after 2m39s
[13:35:55.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:34:0)
[13:35:55.491] Build status: STARTED
[13:35:55.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:35:0) after 5m31s
[13:41:26.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:35:0)
[13:41:26.599] Build status: STARTED
[13:41:26.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:36:0) after 1m51s
[13:43:17.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:36:0)
[13:43:17.749] Build status: STARTED
[13:43:17.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:37:0) after 7m51s
[13:51:09.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:37:0)
[13:51:09.339] Build status: STARTED
[13:51:09.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:38:0) after 4m49s
[13:55:58.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:38:0)
[13:55:58.528] Build status: STARTED
[13:55:58.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:39:0) after 1m50s
[13:57:48.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:39:0)
[13:57:48.944] Build status: STARTED
[13:57:48.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:40:0) after 4m23s
[14:02:11.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:40:0)
[14:02:12.013] Build status: STARTED
[14:02:12.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:41:0) after 4m26s
[14:06:38.267] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:41:0)
[14:06:38.294] Build status: STARTED
[14:06:38.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:42:0) after 5m37s
[14:12:15.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:42:0)
[14:12:15.502] Build status: STARTED
[14:12:15.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:43:0) after 9m56s
[14:22:11.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:43:0)
[14:22:11.563] Build status: STARTED
[14:22:11.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:44:0) after 4m46s
[14:26:58.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:44:0)
[14:26:58.193] Build status: STARTED
[14:26:58.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:45:0) after 8m36s
[14:35:35.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:45:0)
[14:35:35.226] Build status: STARTED
[14:35:35.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:46:0) after 9m49s
[14:45:24.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:46:0)
[14:45:24.289] Build status: STARTED
[14:45:24.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:47:0) after 8m43s
[14:54:07.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:47:0)
[14:54:07.336] Build status: STARTED
[14:54:07.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:48:0) after 4m2s
[14:58:09.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:48:0)
[14:58:09.460] Build status: STARTED
[14:58:09.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:49:0) after 4m31s
[15:02:40.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:49:0)
[15:02:40.895] Build status: STARTED
[15:02:40.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:50:0) after 9m36s
[15:12:16.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:50:0)
[15:12:16.937] Build status: STARTED
[15:12:16.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:51:0) after 5m23s
[15:17:39.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:51:0)
[15:17:40.056] Build status: STARTED
[15:17:40.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:52:0) after 6m56s
[15:24:36.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:52:0)
[15:24:36.568] Build status: STARTED
[15:24:36.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:53:0) after 3m30s
[15:28:06.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:53:0)
[15:28:06.640] Build status: STARTED
[15:28:06.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:54:0) after 1m31s
[15:29:37.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:54:0)
[15:29:37.893] Build status: STARTED
[15:29:37.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:55:0) after 4m26s
[15:34:03.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:55:0)
[15:34:03.986] Build status: STARTED
[15:34:03.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:56:0) after 5m47s
[15:39:51.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:56:0)
[15:39:51.271] Build status: STARTED
[15:39:51.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:57:0) after 3m35s
[15:43:26.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:57:0)
[15:43:26.599] Build status: STARTED
[15:43:26.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:58:0) after 4m24s
[15:47:50.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:58:0)
[15:47:50.934] Build status: STARTED
[15:47:50.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:59:0) after 4m35s
[15:52:25.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:59:0)
[15:52:25.995] Build status: STARTED
[15:52:25.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:60:0) after 4m37s
[15:57:03.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:60:0)
[15:57:03.052] Build status: STARTED
[15:57:03.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:61:0) after 8m34s
[16:05:37.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:61:0)
[16:05:37.157] Build status: STARTED
[16:05:37.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:62:0) after 7m21s
[16:12:58.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:62:0)
[16:12:58.324] Build status: STARTED
[16:12:58.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:63:0) after 5m41s
[16:18:39.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:63:0)
[16:18:39.693] Build status: STARTED
[16:18:39.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:64:0) after 8m24s
[16:27:03.811] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:64:0)
[16:27:03.847] Build status: STARTED
[16:27:03.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:65:0) after 7m21s
[16:34:24.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:65:0)
[16:34:24.904] Build status: STARTED
[16:34:24.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:66:0) after 5m2s
[16:39:26.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:66:0)
[16:39:26.928] Build status: STARTED
[16:39:26.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003090950415046624:67:0) after 5m12s
[16:42:50.464] Received PubSub notification, asking Buildbucket for the build status
[16:42:50.497] Build:
{
"id": "8837660888489139489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23013,
"createdBy": "project:chromium",
"createTime": "2021-08-28T10:33:35.747426913Z",
"startTime": "2021-08-28T10:36:02.450741Z",
"endTime": "2021-08-28T16:42:50.195873936Z",
"updateTime": "2021-08-28T16:42:50.196314536Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "86376c7a5be0d53e9a81e304248e1f18691863b1",
"ref": "refs/heads/main"
}
}
}
[16:42:50.497] Invocation finished in 6h9m15.969255934s with status FAILED