[22:56:09.605] New invocation is queued and will start shortly
[22:56:11.033] Starting the invocation (attempt 1)
[22:56:11.079] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/562da0429607eef4600ac92a5d3ca01d6dbd3483"
[22:56:11.079] Popped gitiles commit info from properties and tags
[22:56:11.080] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:56:11.080] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:56:11.080] Buildbucket request:
{
"requestId": "8875483702350361040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "562da0429607eef4600ac92a5d3ca01d6dbd3483",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875483702350361040"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:56:11.591] Scheduled build:
{
"id": "8710053640078668625",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38767,
"createdBy": "project:chromium",
"createTime": "2025-07-06T22:56:11.144065105Z",
"updateTime": "2025-07-06T22:56:11.144065105Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "562da0429607eef4600ac92a5d3ca01d6dbd3483",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:56:11.591] Task URL: https://cr-buildbucket.appspot.com/build/8710053640078668625
[22:56:11.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:2:0) after 8m23s
[22:56:12.586] Received PubSub notification, asking Buildbucket for the build status
[22:56:12.607] Build status: SCHEDULED
[22:56:15.004] Received PubSub notification, asking Buildbucket for the build status
[22:56:15.047] Build status: STARTED
[23:04:34.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:2:0)
[23:04:34.630] Build status: STARTED
[23:04:34.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:5:0) after 9m27s
[23:14:01.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:5:0)
[23:14:01.869] Build status: STARTED
[23:14:01.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:6:0) after 5m51s
[23:19:52.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:6:0)
[23:19:52.946] Build status: STARTED
[23:19:52.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:7:0) after 5m38s
[23:25:30.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:7:0)
[23:25:30.985] Build status: STARTED
[23:25:30.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:8:0) after 6m39s
[23:32:09.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:8:0)
[23:32:10.005] Build status: STARTED
[23:32:10.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:9:0) after 9m6s
[23:41:16.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:9:0)
[23:41:16.378] Build status: STARTED
[23:41:16.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:10:0) after 9m5s
[23:50:21.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:10:0)
[23:50:21.405] Build status: STARTED
[23:50:21.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:11:0) after 1m10s
[23:51:31.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:11:0)
[23:51:31.445] Build status: STARTED
[23:51:31.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:12:0) after 2m27s
[23:53:58.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:12:0)
[23:53:58.489] Build status: STARTED
[23:53:58.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:13:0) after 5m33s
[23:59:31.603] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:13:0)
[23:59:31.639] Build status: STARTED
[23:59:31.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:14:0) after 3m7s
[00:02:38.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:14:0)
[00:02:38.816] Build status: STARTED
[00:02:38.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:15:0) after 5m17s
[00:07:56.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:15:0)
[00:07:56.098] Build status: STARTED
[00:07:56.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:16:0) after 6m37s
[00:14:33.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:16:0)
[00:14:33.431] Build status: STARTED
[00:14:33.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:17:0) after 7m9s
[00:21:42.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:17:0)
[00:21:42.629] Build status: STARTED
[00:21:42.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:18:0) after 5m54s
[00:27:36.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:18:0)
[00:27:36.851] Build status: STARTED
[00:27:36.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:19:0) after 7m27s
[00:35:03.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:19:0)
[00:35:03.894] Build status: STARTED
[00:35:03.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:20:0) after 9m4s
[00:44:07.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:20:0)
[00:44:07.933] Build status: STARTED
[00:44:07.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:21:0) after 7m20s
[00:51:27.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:21:0)
[00:51:27.996] Build status: STARTED
[00:51:27.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:22:0) after 4m51s
[00:56:19.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:22:0)
[00:56:21.631] Build status: STARTED
[00:56:21.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:23:0) after 3m39s
[01:00:00.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:23:0)
[01:00:00.931] Build status: STARTED
[01:00:00.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:24:0) after 5m52s
[01:05:53.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:24:0)
[01:05:53.222] Build status: STARTED
[01:05:53.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:25:0) after 9m17s
[01:15:10.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:25:0)
[01:15:10.526] Build status: STARTED
[01:15:10.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:26:0) after 9m12s
[01:24:22.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:26:0)
[01:24:22.994] Build status: STARTED
[01:24:22.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:27:0) after 4m7s
[01:28:30.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:27:0)
[01:28:30.900] Build status: STARTED
[01:28:30.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:28:0) after 2m24s
[01:30:55.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:28:0)
[01:30:55.073] Build status: STARTED
[01:30:55.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:29:0) after 7m50s
[01:38:45.089] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:29:0)
[01:38:45.110] Build status: STARTED
[01:38:45.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:30:0) after 7m7s
[01:45:52.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:30:0)
[01:45:52.214] Build status: STARTED
[01:45:52.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:31:0) after 8m13s
[01:54:05.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:31:0)
[01:54:05.424] Build status: STARTED
[01:54:05.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:32:0) after 8m47s
[02:02:52.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:32:0)
[02:02:52.572] Build status: STARTED
[02:02:52.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:33:0) after 2m36s
[02:05:28.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:33:0)
[02:05:28.724] Build status: STARTED
[02:05:28.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:34:0) after 4m47s
[02:10:15.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:34:0)
[02:10:15.846] Build status: STARTED
[02:10:15.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:35:0) after 3m41s
[02:13:56.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:35:0)
[02:13:56.982] Build status: STARTED
[02:13:56.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:36:0) after 7m43s
[02:21:40.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:36:0)
[02:21:40.128] Build status: STARTED
[02:21:40.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:37:0) after 8m6s
[02:29:46.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:37:0)
[02:29:46.170] Build status: STARTED
[02:29:46.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:38:0) after 4m24s
[02:34:10.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:38:0)
[02:34:10.605] Build status: STARTED
[02:34:10.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:39:0) after 1m54s
[02:36:04.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:39:0)
[02:36:04.741] Build status: STARTED
[02:36:04.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875483702350361040:40:0) after 8m21s
[02:41:27.144] Received PubSub notification, asking Buildbucket for the build status
[02:41:27.173] Build:
{
"id": "8710053640078668625",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38767,
"createdBy": "project:chromium",
"createTime": "2025-07-06T22:56:11.144065105Z",
"startTime": "2025-07-06T22:56:14.768605050Z",
"endTime": "2025-07-07T02:41:26.766786776Z",
"updateTime": "2025-07-07T02:41:26.766786776Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "562da0429607eef4600ac92a5d3ca01d6dbd3483",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:41:27.173] Invocation finished in 3h45m17.578475747s with status FAILED