[21:26:59.294] New invocation is queued and will start shortly
[21:27:02.237] Starting the invocation (attempt 1)
[21:27:02.278] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9c9b447d42d75143d1e8641ccef3f15b0f792d77"
[21:27:02.278] Popped gitiles commit info from properties and tags
[21:27:02.278] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:27:02.281] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:27:02.281] Buildbucket request:
{
"requestId": "8953946285460540832",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9c9b447d42d75143d1e8641ccef3f15b0f792d77",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953946285460540832"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:27:02.941] Scheduled build:
{
"id": "8788516221493797649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28978,
"createdBy": "project:chromium",
"createTime": "2023-02-21T21:27:02.449366217Z",
"updateTime": "2023-02-21T21:27:02.449366217Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9c9b447d42d75143d1e8641ccef3f15b0f792d77",
"ref": "refs/heads/main"
}
}
}
[21:27:02.941] Task URL: https://cr-buildbucket.appspot.com/build/8788516221493797649
[21:27:02.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:2:0) after 8m21s
[21:29:30.704] Received PubSub notification, asking Buildbucket for the build status
[21:29:30.796] Build status: STARTED
[21:35:23.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:2:0)
[21:35:23.991] Build status: STARTED
[21:35:23.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:4:0) after 8m18s
[21:43:42.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:4:0)
[21:43:42.194] Build status: STARTED
[21:43:42.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:5:0) after 5m43s
[21:49:25.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:5:0)
[21:49:25.239] Build status: STARTED
[21:49:25.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:6:0) after 6m31s
[21:55:56.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:6:0)
[21:55:56.256] Build status: STARTED
[21:55:56.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:7:0) after 2m58s
[21:58:54.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:7:0)
[21:58:54.460] Build status: STARTED
[21:58:54.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:8:0) after 5m39s
[22:04:33.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:8:0)
[22:04:33.632] Build status: STARTED
[22:04:33.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:9:0) after 5m49s
[22:10:22.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:9:0)
[22:10:22.782] Build status: STARTED
[22:10:22.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:10:0) after 7m27s
[22:17:49.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:10:0)
[22:17:49.872] Build status: STARTED
[22:17:49.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:11:0) after 9m25s
[22:27:14.947] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:11:0)
[22:27:15.047] Build status: STARTED
[22:27:15.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:12:0) after 9m26s
[22:36:41.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:12:0)
[22:36:41.223] Build status: STARTED
[22:36:41.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:13:0) after 9m4s
[22:45:45.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:13:0)
[22:45:45.309] Build status: STARTED
[22:45:45.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:14:0) after 7m45s
[22:53:30.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:14:0)
[22:53:30.448] Build status: STARTED
[22:53:30.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:15:0) after 9m27s
[23:02:57.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:15:0)
[23:02:57.694] Build status: STARTED
[23:02:57.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:16:0) after 4m30s
[23:07:27.766] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:16:0)
[23:07:27.782] Build status: STARTED
[23:07:27.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:17:0) after 2m21s
[23:09:48.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:17:0)
[23:09:48.970] Build status: STARTED
[23:09:48.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:18:0) after 6m46s
[23:16:35.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:18:0)
[23:16:35.193] Build status: STARTED
[23:16:35.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:19:0) after 1m46s
[23:18:21.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:19:0)
[23:18:21.241] Build status: STARTED
[23:18:21.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:20:0) after 4m47s
[23:23:08.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:20:0)
[23:23:08.289] Build status: STARTED
[23:23:08.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:21:0) after 4m16s
[23:27:24.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:21:0)
[23:27:24.352] Build status: STARTED
[23:27:24.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:22:0) after 1m31s
[23:28:55.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:22:0)
[23:28:55.451] Build status: STARTED
[23:28:55.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:23:0) after 4m7s
[23:33:02.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:23:0)
[23:33:02.531] Build status: STARTED
[23:33:02.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:24:0) after 6m5s
[23:39:07.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:24:0)
[23:39:07.586] Build status: STARTED
[23:39:07.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:25:0) after 9m3s
[23:48:10.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:25:0)
[23:48:10.777] Build status: STARTED
[23:48:10.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:26:0) after 1m3s
[23:49:14.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:26:0)
[23:49:14.027] Build status: STARTED
[23:49:14.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:27:0) after 2m18s
[23:51:32.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:27:0)
[23:51:32.264] Build status: STARTED
[23:51:32.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:28:0) after 2m7s
[23:53:39.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:28:0)
[23:53:39.313] Build status: STARTED
[23:53:39.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:29:0) after 7m56s
[00:01:35.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:29:0)
[00:01:35.537] Build status: STARTED
[00:01:35.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:30:0) after 3m53s
[00:05:28.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:30:0)
[00:05:28.589] Build status: STARTED
[00:05:28.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:31:0) after 3m2s
[00:08:30.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:31:0)
[00:08:30.975] Build status: STARTED
[00:08:30.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:32:0) after 1m23s
[00:09:53.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:32:0)
[00:09:54.042] Build status: STARTED
[00:09:54.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:33:0) after 4m0s
[00:13:54.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:33:0)
[00:13:54.136] Build status: STARTED
[00:13:54.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:34:0) after 2m6s
[00:16:00.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:34:0)
[00:16:00.348] Build status: STARTED
[00:16:00.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:35:0) after 4m3s
[00:20:03.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:35:0)
[00:20:03.453] Build status: STARTED
[00:20:03.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:36:0) after 3m21s
[00:23:24.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:36:0)
[00:23:24.548] Build status: STARTED
[00:23:24.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:37:0) after 5m2s
[00:28:26.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:37:0)
[00:28:26.646] Build status: STARTED
[00:28:26.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:38:0) after 8m42s
[00:37:08.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:38:0)
[00:37:08.671] Build status: STARTED
[00:37:08.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:39:0) after 6m52s
[00:44:00.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:39:0)
[00:44:00.811] Build status: STARTED
[00:44:00.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:40:0) after 8m39s
[00:52:39.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:40:0)
[00:52:39.872] Build status: STARTED
[00:52:39.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:41:0) after 8m9s
[01:00:49.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:41:0)
[01:00:49.162] Build status: STARTED
[01:00:49.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:42:0) after 3m49s
[01:04:38.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:42:0)
[01:04:38.203] Build status: STARTED
[01:04:38.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:43:0) after 1m5s
[01:05:43.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:43:0)
[01:05:43.259] Build status: STARTED
[01:05:43.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:44:0) after 1m5s
[01:06:48.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:44:0)
[01:06:48.375] Build status: STARTED
[01:06:48.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:45:0) after 6m7s
[01:12:55.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:45:0)
[01:12:55.447] Build status: STARTED
[01:12:55.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:46:0) after 6m25s
[01:19:20.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:46:0)
[01:19:20.528] Build status: STARTED
[01:19:20.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:47:0) after 3m27s
[01:22:47.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:47:0)
[01:22:47.650] Build status: STARTED
[01:22:47.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:48:0) after 8m38s
[01:31:25.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:48:0)
[01:31:25.697] Build status: STARTED
[01:31:25.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:49:0) after 7m32s
[01:38:57.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:49:0)
[01:38:57.751] Build status: STARTED
[01:38:57.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:50:0) after 6m19s
[01:45:16.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:50:0)
[01:45:16.876] Build status: STARTED
[01:45:16.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:51:0) after 3m32s
[01:48:49.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:51:0)
[01:48:49.127] Build status: STARTED
[01:48:49.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:52:0) after 4m32s
[01:53:21.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:52:0)
[01:53:21.171] Build status: STARTED
[01:53:21.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:53:0) after 4m45s
[01:58:06.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:53:0)
[01:58:06.262] Build status: STARTED
[01:58:06.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:54:0) after 6m38s
[02:04:44.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:54:0)
[02:04:44.283] Build status: STARTED
[02:04:44.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:55:0) after 8m42s
[02:13:26.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:55:0)
[02:13:26.602] Build status: STARTED
[02:13:26.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:56:0) after 5m7s
[02:18:33.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:56:0)
[02:18:33.659] Build status: STARTED
[02:18:33.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:57:0) after 8m41s
[02:27:14.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:57:0)
[02:27:14.708] Build status: STARTED
[02:27:14.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:58:0) after 4m29s
[02:31:43.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:58:0)
[02:31:43.778] Build status: STARTED
[02:31:43.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:59:0) after 8m6s
[02:39:49.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:59:0)
[02:39:49.898] Build status: STARTED
[02:39:49.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953946285460540832:60:0) after 4m55s
[02:41:56.276] Received PubSub notification, asking Buildbucket for the build status
[02:41:56.298] Build:
{
"id": "8788516221493797649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28978,
"createdBy": "project:chromium",
"createTime": "2023-02-21T21:27:02.449366217Z",
"startTime": "2023-02-21T21:29:28.702595Z",
"endTime": "2023-02-22T02:41:55.892350495Z",
"updateTime": "2023-02-22T02:41:55.892350495Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9c9b447d42d75143d1e8641ccef3f15b0f792d77",
"ref": "refs/heads/main"
}
}
}
[02:41:56.298] Invocation finished in 5h14m57.014793871s with status FAILED