[07:08:45.684] New invocation is queued and will start shortly
[07:08:46.884] Starting the invocation (attempt 1)
[07:08:46.912] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/620f26d220052db33f1eb0d93712b49ef9b7b7bf"
[07:08:46.912] Popped gitiles commit info from properties and tags
[07:08:46.912] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:08:46.912] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:08:46.912] Buildbucket request:
{
"requestId": "8860232420200610448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "620f26d220052db33f1eb0d93712b49ef9b7b7bf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860232420200610448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:08:47.321] Scheduled build:
{
"id": "8694802358208059233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40303,
"createdBy": "project:chromium",
"createTime": "2025-12-22T07:08:46.956555706Z",
"updateTime": "2025-12-22T07:08:46.956555706Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "620f26d220052db33f1eb0d93712b49ef9b7b7bf",
"ref": "refs/heads/main"
}
}
}
[07:08:47.321] Task URL: https://cr-buildbucket.appspot.com/build/8694802358208059233
[07:08:47.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:2:0) after 8m9s
[07:08:48.299] Received PubSub notification, asking Buildbucket for the build status
[07:08:48.324] Build status: SCHEDULED
[07:10:03.084] Received PubSub notification, asking Buildbucket for the build status
[07:10:03.151] Build status: STARTED
[07:16:56.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:2:0)
[07:16:56.362] Build status: STARTED
[07:16:56.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:5:0) after 2m19s
[07:19:15.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:5:0)
[07:19:15.395] Build status: STARTED
[07:19:15.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:6:0) after 2m50s
[07:22:05.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:6:0)
[07:22:05.556] Build status: STARTED
[07:22:05.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:7:0) after 3m2s
[07:25:07.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:7:0)
[07:25:07.941] Build status: STARTED
[07:25:07.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:8:0) after 8m43s
[07:33:51.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:8:0)
[07:33:51.285] Build status: STARTED
[07:33:51.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:9:0) after 1m50s
[07:35:41.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:9:0)
[07:35:41.588] Build status: STARTED
[07:35:41.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:10:0) after 9m13s
[07:44:54.600] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:10:0)
[07:44:54.624] Build status: STARTED
[07:44:54.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:11:0) after 5m45s
[07:50:39.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:11:0)
[07:50:39.793] Build status: STARTED
[07:50:39.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:12:0) after 8m22s
[07:59:01.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:12:0)
[07:59:01.859] Build status: STARTED
[07:59:01.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:13:0) after 8m44s
[08:07:45.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:13:0)
[08:07:45.967] Build status: STARTED
[08:07:45.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:14:0) after 7m20s
[08:15:06.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:14:0)
[08:15:06.093] Build status: STARTED
[08:15:06.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:15:0) after 1m30s
[08:16:36.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:15:0)
[08:16:36.403] Build status: STARTED
[08:16:36.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:16:0) after 2m22s
[08:18:58.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:16:0)
[08:18:58.579] Build status: STARTED
[08:18:58.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:17:0) after 5m22s
[08:24:20.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:17:0)
[08:24:20.720] Build status: STARTED
[08:24:20.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:18:0) after 2m5s
[08:26:25.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:18:0)
[08:26:25.783] Build status: STARTED
[08:26:25.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:19:0) after 3m13s
[08:29:38.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:19:0)
[08:29:38.825] Build status: STARTED
[08:29:38.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:20:0) after 1m9s
[08:30:47.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:20:0)
[08:30:47.876] Build status: STARTED
[08:30:47.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:21:0) after 7m41s
[08:38:29.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:21:0)
[08:38:29.105] Build status: STARTED
[08:38:29.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:22:0) after 2m52s
[08:41:21.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:22:0)
[08:41:21.126] Build status: STARTED
[08:41:21.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:23:0) after 6m45s
[08:48:06.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:23:0)
[08:48:06.255] Build status: STARTED
[08:48:06.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:24:0) after 1m34s
[08:49:40.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:24:0)
[08:49:40.294] Build status: STARTED
[08:49:40.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:25:0) after 8m18s
[08:57:58.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:25:0)
[08:57:58.430] Build status: STARTED
[08:57:58.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:26:0) after 9m0s
[09:06:58.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:26:0)
[09:06:58.537] Build status: STARTED
[09:06:58.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:27:0) after 6m21s
[09:13:19.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:27:0)
[09:13:19.924] Build status: STARTED
[09:13:19.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:28:0) after 3m45s
[09:17:05.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:28:0)
[09:17:05.202] Build status: STARTED
[09:17:05.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:29:0) after 6m48s
[09:23:53.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:29:0)
[09:23:53.627] Build status: STARTED
[09:23:53.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:30:0) after 8m32s
[09:32:25.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:30:0)
[09:32:25.694] Build status: STARTED
[09:32:25.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:31:0) after 5m56s
[09:38:21.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:31:0)
[09:38:21.990] Build status: STARTED
[09:38:21.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:32:0) after 3m23s
[09:41:45.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:32:0)
[09:41:45.032] Build status: STARTED
[09:41:45.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:33:0) after 4m55s
[09:46:40.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:33:0)
[09:46:40.149] Build status: STARTED
[09:46:40.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:34:0) after 3m51s
[09:50:31.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:34:0)
[09:50:31.587] Build status: STARTED
[09:50:31.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:35:0) after 9m46s
[10:00:17.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:35:0)
[10:00:17.802] Build status: STARTED
[10:00:17.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:36:0) after 4m15s
[10:04:32.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:36:0)
[10:04:32.839] Build status: STARTED
[10:04:32.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:37:0) after 5m59s
[10:10:31.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:37:0)
[10:10:31.933] Build status: STARTED
[10:10:31.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:38:0) after 5m15s
[10:15:46.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:38:0)
[10:15:46.982] Build status: STARTED
[10:15:46.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:39:0) after 7m59s
[10:23:45.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:39:0)
[10:23:46.007] Build status: STARTED
[10:23:46.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:40:0) after 4m7s
[10:27:53.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:40:0)
[10:27:53.041] Build status: STARTED
[10:27:53.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:41:0) after 5m20s
[10:33:13.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:41:0)
[10:33:13.082] Build status: STARTED
[10:33:13.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:42:0) after 8m29s
[10:41:42.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:42:0)
[10:41:42.197] Build status: STARTED
[10:41:42.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:43:0) after 1m40s
[10:43:22.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:43:0)
[10:43:22.232] Build status: STARTED
[10:43:22.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:44:0) after 3m55s
[10:47:17.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:44:0)
[10:47:17.637] Build status: STARTED
[10:47:17.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:45:0) after 6m14s
[10:53:31.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:45:0)
[10:53:31.794] Build status: STARTED
[10:53:31.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:46:0) after 5m29s
[10:59:00.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:46:0)
[10:59:00.933] Build status: STARTED
[10:59:00.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:47:0) after 8m37s
[11:07:37.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:47:0)
[11:07:37.962] Build status: STARTED
[11:07:37.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:48:0) after 7m6s
[11:14:44.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:48:0)
[11:14:44.099] Build status: STARTED
[11:14:44.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:49:0) after 5m23s
[11:20:07.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:49:0)
[11:20:07.562] Build status: STARTED
[11:20:07.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:50:0) after 1m5s
[11:21:12.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:50:0)
[11:21:12.688] Build status: STARTED
[11:21:12.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:51:0) after 9m30s
[11:30:42.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:51:0)
[11:30:42.724] Build status: STARTED
[11:30:42.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8860232420200610448:52:0) after 7m59s
[11:38:15.096] Received PubSub notification, asking Buildbucket for the build status
[11:38:15.108] Build:
{
"id": "8694802358208059233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 40303,
"createdBy": "project:chromium",
"createTime": "2025-12-22T07:08:46.956555706Z",
"startTime": "2025-12-22T07:10:02.919075350Z",
"endTime": "2025-12-22T11:38:14.674444042Z",
"updateTime": "2025-12-22T11:38:14.674444042Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "620f26d220052db33f1eb0d93712b49ef9b7b7bf",
"ref": "refs/heads/main"
}
}
}
[11:38:15.108] Invocation finished in 4h29m29.435783958s with status FAILED