[20:16:40.479] New invocation is queued and will start shortly
[20:16:41.597] Starting the invocation (attempt 1)
[20:16:41.631] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/10809a135aae457d379ec30ae896cdfb43f522c1"
[20:16:41.631] Popped gitiles commit info from properties and tags
[20:16:41.631] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:16:41.632] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:16:41.632] Buildbucket request:
{
"requestId": "8906477898824988432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10809a135aae457d379ec30ae896cdfb43f522c1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8906477898824988432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:16:42.290] Scheduled build:
{
"id": "8741047836882275153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 33591,
"createdBy": "project:chromium",
"createTime": "2024-07-29T20:16:41.694964219Z",
"updateTime": "2024-07-29T20:16:41.694964219Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10809a135aae457d379ec30ae896cdfb43f522c1",
"ref": "refs/heads/main"
}
}
}
[20:16:42.290] Task URL: https://cr-buildbucket.appspot.com/build/8741047836882275153
[20:16:42.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:2:0) after 5m14s
[20:16:43.179] Received PubSub notification, asking Buildbucket for the build status
[20:16:43.195] Build status: SCHEDULED
[20:18:03.744] Received PubSub notification, asking Buildbucket for the build status
[20:18:03.765] Build status: STARTED
[20:21:56.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:2:0)
[20:21:56.339] Build status: STARTED
[20:21:56.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:5:0) after 9m27s
[20:31:23.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:5:0)
[20:31:23.376] Build status: STARTED
[20:31:23.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:6:0) after 4m17s
[20:35:40.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:6:0)
[20:35:40.391] Build status: STARTED
[20:35:40.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:7:0) after 2m55s
[20:38:35.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:7:0)
[20:38:35.452] Build status: STARTED
[20:38:35.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:8:0) after 9m6s
[20:47:41.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:8:0)
[20:47:41.492] Build status: STARTED
[20:47:41.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:9:0) after 7m19s
[20:55:00.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:9:0)
[20:55:00.566] Build status: STARTED
[20:55:00.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:10:0) after 3m6s
[20:58:06.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:10:0)
[20:58:06.607] Build status: STARTED
[20:58:06.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:11:0) after 7m51s
[21:05:57.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:11:0)
[21:05:57.708] Build status: STARTED
[21:05:57.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:12:0) after 6m42s
[21:12:39.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:12:0)
[21:12:39.793] Build status: STARTED
[21:12:39.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:13:0) after 6m59s
[21:19:38.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:13:0)
[21:19:38.861] Build status: STARTED
[21:19:38.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:14:0) after 3m57s
[21:23:35.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:14:0)
[21:23:35.949] Build status: STARTED
[21:23:35.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:15:0) after 9m7s
[21:32:42.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:15:0)
[21:32:42.987] Build status: STARTED
[21:32:42.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:16:0) after 2m13s
[21:34:56.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:16:0)
[21:34:56.080] Build status: STARTED
[21:34:56.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:17:0) after 3m37s
[21:38:33.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:17:0)
[21:38:33.327] Build status: STARTED
[21:38:33.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:18:0) after 4m48s
[21:43:21.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:18:0)
[21:43:21.392] Build status: STARTED
[21:43:21.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:19:0) after 9m49s
[21:53:10.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:19:0)
[21:53:10.461] Build status: STARTED
[21:53:10.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:20:0) after 6m21s
[21:59:31.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:20:0)
[21:59:31.619] Build status: STARTED
[21:59:31.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:21:0) after 6m11s
[22:05:42.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:21:0)
[22:05:42.726] Build status: STARTED
[22:05:42.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:22:0) after 5m10s
[22:10:52.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:22:0)
[22:10:52.767] Build status: STARTED
[22:10:52.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:23:0) after 5m42s
[22:16:34.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:23:0)
[22:16:34.887] Build status: STARTED
[22:16:34.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:24:0) after 8m43s
[22:25:17.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:24:0)
[22:25:17.931] Build status: STARTED
[22:25:17.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:25:0) after 4m27s
[22:29:44.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:25:0)
[22:29:44.969] Build status: STARTED
[22:29:44.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:26:0) after 6m29s
[22:36:13.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:26:0)
[22:36:14.062] Build status: STARTED
[22:36:14.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:27:0) after 8m26s
[22:44:40.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:27:0)
[22:44:40.188] Build status: STARTED
[22:44:40.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:28:0) after 7m16s
[22:51:56.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:28:0)
[22:51:56.291] Build status: STARTED
[22:51:56.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:29:0) after 4m19s
[22:56:15.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:29:0)
[22:56:15.360] Build status: STARTED
[22:56:15.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:30:0) after 9m28s
[23:05:43.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:30:0)
[23:05:43.396] Build status: STARTED
[23:05:43.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:31:0) after 9m9s
[23:14:52.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:31:0)
[23:14:52.553] Build status: STARTED
[23:14:52.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:32:0) after 1m0s
[23:15:52.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:32:0)
[23:15:52.588] Build status: STARTED
[23:15:52.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:33:0) after 1m50s
[23:17:42.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:33:0)
[23:17:42.691] Build status: STARTED
[23:17:42.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:34:0) after 4m28s
[23:22:10.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:34:0)
[23:22:10.782] Build status: STARTED
[23:22:10.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:35:0) after 5m20s
[23:27:30.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:35:0)
[23:27:30.836] Build status: STARTED
[23:27:30.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:36:0) after 8m30s
[23:36:00.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:36:0)
[23:36:00.959] Build status: STARTED
[23:36:00.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:37:0) after 4m55s
[23:40:56.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:37:0)
[23:40:56.135] Build status: STARTED
[23:40:56.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:38:0) after 7m56s
[23:48:52.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:38:0)
[23:48:52.190] Build status: STARTED
[23:48:52.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:39:0) after 3m50s
[23:52:42.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:39:0)
[23:52:42.352] Build status: STARTED
[23:52:42.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:40:0) after 3m46s
[23:56:28.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:40:0)
[23:56:28.445] Build status: STARTED
[23:56:28.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:41:0) after 3m23s
[23:59:51.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:41:0)
[23:59:51.487] Build status: STARTED
[23:59:51.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:42:0) after 4m42s
[00:04:33.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:42:0)
[00:04:33.600] Build status: STARTED
[00:04:33.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:43:0) after 4m49s
[00:09:22.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:43:0)
[00:09:22.603] Build status: STARTED
[00:09:22.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:44:0) after 9m6s
[00:18:28.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:44:0)
[00:18:28.734] Build status: STARTED
[00:18:28.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:45:0) after 7m47s
[00:26:15.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:45:0)
[00:26:15.877] Build status: STARTED
[00:26:15.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:46:0) after 1m25s
[00:27:40.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:46:0)
[00:27:40.962] Build status: STARTED
[00:27:40.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:47:0) after 2m45s
[00:30:26.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:47:0)
[00:30:26.114] Build status: STARTED
[00:30:26.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:48:0) after 9m3s
[00:39:29.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:48:0)
[00:39:29.226] Build status: STARTED
[00:39:29.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:49:0) after 1m44s
[00:41:13.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:49:0)
[00:41:13.237] Build status: STARTED
[00:41:13.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:50:0) after 5m46s
[00:46:59.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:50:0)
[00:46:59.234] Build status: STARTED
[00:46:59.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:51:0) after 9m40s
[00:56:39.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:51:0)
[00:56:39.279] Build status: STARTED
[00:56:39.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:52:0) after 4m50s
[01:01:29.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:52:0)
[01:01:29.290] Build status: STARTED
[01:01:29.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:53:0) after 2m47s
[01:04:16.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:53:0)
[01:04:16.328] Build status: STARTED
[01:04:16.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:54:0) after 3m32s
[01:07:48.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:54:0)
[01:07:48.399] Build status: STARTED
[01:07:48.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:55:0) after 4m32s
[01:12:20.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:55:0)
[01:12:20.534] Build status: STARTED
[01:12:20.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:56:0) after 9m2s
[01:21:22.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:56:0)
[01:21:22.625] Build status: STARTED
[01:21:22.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:57:0) after 8m17s
[01:29:39.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:57:0)
[01:29:39.664] Build status: STARTED
[01:29:39.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:58:0) after 5m12s
[01:34:51.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:58:0)
[01:34:51.754] Build status: STARTED
[01:34:51.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:59:0) after 4m35s
[01:39:26.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:59:0)
[01:39:26.753] Build status: STARTED
[01:39:26.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:60:0) after 2m59s
[01:42:25.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:60:0)
[01:42:25.812] Build status: STARTED
[01:42:25.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:61:0) after 8m24s
[01:50:49.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:61:0)
[01:50:49.843] Build status: STARTED
[01:50:49.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:62:0) after 4m40s
[01:55:29.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:62:0)
[01:55:29.942] Build status: STARTED
[01:55:29.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:63:0) after 6m21s
[02:01:51.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:63:0)
[02:01:51.036] Build status: STARTED
[02:01:51.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:64:0) after 5m15s
[02:07:06.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:64:0)
[02:07:06.386] Build status: STARTED
[02:07:06.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8906477898824988432:65:0) after 8m7s
[02:11:04.321] Received PubSub notification, asking Buildbucket for the build status
[02:11:04.342] Build:
{
"id": "8741047836882275153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 33591,
"createdBy": "project:chromium",
"createTime": "2024-07-29T20:16:41.694964219Z",
"startTime": "2024-07-29T20:18:03.475377986Z",
"endTime": "2024-07-30T02:11:04.043697393Z",
"updateTime": "2024-07-30T02:11:04.043697393Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10809a135aae457d379ec30ae896cdfb43f522c1",
"ref": "refs/heads/main"
}
}
}
[02:11:04.342] Invocation finished in 5h54m23.884126833s with status FAILED