[14:09:28.447] New invocation is queued and will start shortly
[14:09:29.583] Starting the invocation (attempt 1)
[14:09:29.632] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/399e6bd55da05534478495528b88b93d8fde461d"
[14:09:29.632] Popped gitiles commit info from properties and tags
[14:09:29.632] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:09:29.633] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:09:29.633] Buildbucket request:
{
"requestId": "8948628590447460416",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "399e6bd55da05534478495528b88b93d8fde461d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8948628590447460416"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:09:30.285] Scheduled build:
{
"id": "8783198528402722401",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29294,
"createdBy": "project:chromium",
"createTime": "2023-04-21T14:09:29.773173949Z",
"updateTime": "2023-04-21T14:09:29.773173949Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "399e6bd55da05534478495528b88b93d8fde461d",
"ref": "refs/heads/main"
}
}
}
[14:09:30.285] Task URL: https://cr-buildbucket.appspot.com/build/8783198528402722401
[14:09:30.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:2:0) after 2m59s
[14:12:18.898] Received PubSub notification, asking Buildbucket for the build status
[14:12:18.926] Build status: STARTED
[14:12:29.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:2:0)
[14:12:29.425] Build status: STARTED
[14:12:29.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:4:0) after 4m9s
[14:16:38.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:4:0)
[14:16:38.492] Build status: STARTED
[14:16:38.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:5:0) after 1m30s
[14:18:08.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:5:0)
[14:18:08.535] Build status: STARTED
[14:18:08.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:6:0) after 9m35s
[14:27:43.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:6:0)
[14:27:43.576] Build status: STARTED
[14:27:43.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:7:0) after 1m32s
[14:29:15.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:7:0)
[14:29:15.757] Build status: STARTED
[14:29:15.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:8:0) after 3m13s
[14:32:28.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:8:0)
[14:32:28.916] Build status: STARTED
[14:32:28.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:9:0) after 9m46s
[14:42:15.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:9:0)
[14:42:15.284] Build status: STARTED
[14:42:15.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:10:0) after 2m3s
[14:44:18.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:10:0)
[14:44:18.574] Build status: STARTED
[14:44:18.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:11:0) after 5m8s
[14:49:26.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:11:0)
[14:49:26.611] Build status: STARTED
[14:49:26.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:12:0) after 1m12s
[14:50:38.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:12:0)
[14:50:38.625] Build status: STARTED
[14:50:38.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:13:0) after 9m45s
[15:00:23.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:13:0)
[15:00:23.754] Build status: STARTED
[15:00:23.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:14:0) after 9m57s
[15:10:20.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:14:0)
[15:10:20.926] Build status: STARTED
[15:10:20.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:15:0) after 9m43s
[15:20:04.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:15:0)
[15:20:04.081] Build status: STARTED
[15:20:04.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:16:0) after 6m37s
[15:26:41.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:16:0)
[15:26:41.213] Build status: STARTED
[15:26:41.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:17:0) after 7m41s
[15:34:22.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:17:0)
[15:34:22.477] Build status: STARTED
[15:34:22.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:18:0) after 5m51s
[15:40:13.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:18:0)
[15:40:13.618] Build status: STARTED
[15:40:13.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:19:0) after 9m58s
[15:50:12.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:19:0)
[15:50:12.074] Build status: STARTED
[15:50:12.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:20:0) after 1m54s
[15:52:06.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:20:0)
[15:52:06.200] Build status: STARTED
[15:52:06.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:21:0) after 3m2s
[15:55:08.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:21:0)
[15:55:08.343] Build status: STARTED
[15:55:08.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:22:0) after 6m38s
[16:01:46.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:22:0)
[16:01:46.401] Build status: STARTED
[16:01:46.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:23:0) after 7m48s
[16:09:35.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:23:0)
[16:09:35.464] Build status: STARTED
[16:09:35.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:24:0) after 7m13s
[16:16:48.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:24:0)
[16:16:48.589] Build status: STARTED
[16:16:48.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:25:0) after 9m22s
[16:26:10.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:25:0)
[16:26:10.863] Build status: STARTED
[16:26:10.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:26:0) after 1m6s
[16:27:17.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:26:0)
[16:27:17.316] Build status: STARTED
[16:27:17.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:27:0) after 2m26s
[16:29:43.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:27:0)
[16:29:43.473] Build status: STARTED
[16:29:43.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:28:0) after 5m15s
[16:34:58.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:28:0)
[16:34:58.731] Build status: STARTED
[16:34:58.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:29:0) after 9m49s
[16:44:47.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:29:0)
[16:44:47.792] Build status: STARTED
[16:44:47.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:30:0) after 8m46s
[16:53:33.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:30:0)
[16:53:33.835] Build status: STARTED
[16:53:33.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:31:0) after 5m44s
[16:59:17.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:31:0)
[16:59:17.880] Build status: STARTED
[16:59:17.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:32:0) after 3m38s
[17:02:55.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:32:0)
[17:02:55.954] Build status: STARTED
[17:02:55.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:33:0) after 2m43s
[17:05:38.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:33:0)
[17:05:39.025] Build status: STARTED
[17:05:39.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:34:0) after 5m15s
[17:10:54.150] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:34:0)
[17:10:54.434] Build status: STARTED
[17:10:54.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:35:0) after 9m14s
[17:20:08.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:35:0)
[17:20:08.483] Build status: STARTED
[17:20:08.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:36:0) after 4m31s
[17:24:39.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:36:0)
[17:24:39.889] Build status: STARTED
[17:24:39.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:37:0) after 7m19s
[17:31:58.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:37:0)
[17:31:59.033] Build status: STARTED
[17:31:59.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:38:0) after 6m2s
[17:38:01.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:38:0)
[17:38:01.311] Build status: STARTED
[17:38:01.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:39:0) after 5m37s
[17:43:38.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:39:0)
[17:43:38.449] Build status: STARTED
[17:43:38.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:40:0) after 1m52s
[17:45:30.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:40:0)
[17:45:30.692] Build status: STARTED
[17:45:30.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:41:0) after 6m17s
[17:51:47.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:41:0)
[17:51:47.863] Build status: STARTED
[17:51:47.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:42:0) after 2m16s
[17:54:03.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:42:0)
[17:54:03.929] Build status: STARTED
[17:54:03.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:43:0) after 5m18s
[17:59:21.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:43:0)
[17:59:21.982] Build status: STARTED
[17:59:21.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:44:0) after 3m42s
[18:03:04.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:44:0)
[18:03:04.140] Build status: STARTED
[18:03:04.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:45:0) after 8m52s
[18:11:56.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:45:0)
[18:11:56.138] Build status: STARTED
[18:11:56.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:46:0) after 5m40s
[18:17:36.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:46:0)
[18:17:36.197] Build status: STARTED
[18:17:36.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:47:0) after 7m24s
[18:25:00.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:47:0)
[18:25:00.386] Build status: STARTED
[18:25:00.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:48:0) after 6m59s
[18:31:59.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:48:0)
[18:31:59.574] Build status: STARTED
[18:31:59.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:49:0) after 4m8s
[18:36:07.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:49:0)
[18:36:07.885] Build status: STARTED
[18:36:07.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:50:0) after 8m30s
[18:44:38.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:50:0)
[18:44:38.111] Build status: STARTED
[18:44:38.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:51:0) after 6m6s
[18:50:44.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:51:0)
[18:50:44.287] Build status: STARTED
[18:50:44.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:52:0) after 2m15s
[18:52:59.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:52:0)
[18:52:59.590] Build status: STARTED
[18:52:59.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:53:0) after 7m52s
[19:00:51.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:53:0)
[19:00:51.638] Build status: STARTED
[19:00:51.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:54:0) after 1m32s
[19:02:23.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:54:0)
[19:02:23.957] Build status: STARTED
[19:02:23.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:55:0) after 3m14s
[19:05:38.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:55:0)
[19:05:38.049] Build status: STARTED
[19:05:38.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:56:0) after 7m54s
[19:13:32.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:56:0)
[19:13:32.121] Build status: STARTED
[19:13:32.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:57:0) after 5m42s
[19:19:14.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:57:0)
[19:19:14.500] Build status: STARTED
[19:19:14.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:58:0) after 5m22s
[19:24:36.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:58:0)
[19:24:36.542] Build status: STARTED
[19:24:36.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:59:0) after 3m29s
[19:28:05.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:59:0)
[19:28:05.694] Build status: STARTED
[19:28:05.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:60:0) after 3m45s
[19:31:50.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:60:0)
[19:31:50.863] Build status: STARTED
[19:31:50.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948628590447460416:61:0) after 5m46s
[19:35:10.149] Received PubSub notification, asking Buildbucket for the build status
[19:35:10.171] Build:
{
"id": "8783198528402722401",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29294,
"createdBy": "project:chromium",
"createTime": "2023-04-21T14:09:29.773173949Z",
"startTime": "2023-04-21T14:12:18.369470Z",
"endTime": "2023-04-21T19:35:09.871513994Z",
"updateTime": "2023-04-21T19:35:09.871513994Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "399e6bd55da05534478495528b88b93d8fde461d",
"ref": "refs/heads/main"
}
}
}
[19:35:10.171] Invocation finished in 5h25m41.7312351s with status FAILED