[04:17:02.100] New invocation is queued and will start shortly
[04:17:03.149] Starting the invocation (attempt 1)
[04:17:03.175] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a2e251c1b97782e43f3860671ebd58f331cebfe9"
[04:17:03.176] Popped gitiles commit info from properties and tags
[04:17:03.176] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:17:03.176] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:17:03.176] Buildbucket request:
{
"requestId": "8877637841831636032",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a2e251c1b97782e43f3860671ebd58f331cebfe9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877637841831636032"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:17:03.650] Scheduled build:
{
"id": "8712207779987325521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38490,
"createdBy": "project:chromium",
"createTime": "2025-06-13T04:17:03.239173841Z",
"updateTime": "2025-06-13T04:17:03.239173841Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a2e251c1b97782e43f3860671ebd58f331cebfe9",
"ref": "refs/heads/main"
}
}
}
[04:17:03.650] Task URL: https://cr-buildbucket.appspot.com/build/8712207779987325521
[04:17:03.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:2:0) after 4m25s
[04:17:04.709] Received PubSub notification, asking Buildbucket for the build status
[04:17:04.750] Build status: SCHEDULED
[04:17:08.893] Received PubSub notification, asking Buildbucket for the build status
[04:17:08.938] Build status: STARTED
[04:21:28.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:2:0)
[04:21:28.819] Build status: STARTED
[04:21:28.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:5:0) after 2m2s
[04:23:30.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:5:0)
[04:23:30.971] Build status: STARTED
[04:23:30.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:6:0) after 6m24s
[04:29:55.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:6:0)
[04:29:55.064] Build status: STARTED
[04:29:55.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:7:0) after 4m10s
[04:34:05.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:7:0)
[04:34:05.129] Build status: STARTED
[04:34:05.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:8:0) after 9m27s
[04:43:32.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:8:0)
[04:43:32.259] Build status: STARTED
[04:43:32.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:9:0) after 4m14s
[04:47:46.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:9:0)
[04:47:46.348] Build status: STARTED
[04:47:46.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:10:0) after 2m22s
[04:50:08.369] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:10:0)
[04:50:08.399] Build status: STARTED
[04:50:08.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:11:0) after 9m30s
[04:59:38.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:11:0)
[04:59:38.484] Build status: STARTED
[04:59:38.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:12:0) after 1m9s
[05:00:47.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:12:0)
[05:00:47.587] Build status: STARTED
[05:00:47.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:13:0) after 3m37s
[05:04:24.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:13:0)
[05:04:24.624] Build status: STARTED
[05:04:24.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:14:0) after 2m6s
[05:06:30.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:14:0)
[05:06:30.704] Build status: STARTED
[05:06:30.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:15:0) after 2m59s
[05:09:29.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:15:0)
[05:09:29.777] Build status: STARTED
[05:09:29.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:16:0) after 1m50s
[05:11:19.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:16:0)
[05:11:19.865] Build status: STARTED
[05:11:19.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:17:0) after 2m22s
[05:13:41.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:17:0)
[05:13:41.922] Build status: STARTED
[05:13:41.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:18:0) after 5m2s
[05:18:43.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:18:0)
[05:18:43.992] Build status: STARTED
[05:18:43.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:19:0) after 8m51s
[05:27:35.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:19:0)
[05:27:35.044] Build status: STARTED
[05:27:35.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:20:0) after 4m33s
[05:32:08.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:20:0)
[05:32:08.084] Build status: STARTED
[05:32:08.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:21:0) after 9m16s
[05:41:24.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:21:0)
[05:41:24.130] Build status: STARTED
[05:41:24.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:22:0) after 7m34s
[05:48:58.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:22:0)
[05:48:58.167] Build status: STARTED
[05:48:58.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:23:0) after 3m15s
[05:52:13.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:23:0)
[05:52:13.265] Build status: STARTED
[05:52:13.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:24:0) after 4m25s
[05:56:38.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:24:0)
[05:56:38.371] Build status: STARTED
[05:56:38.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:25:0) after 1m12s
[05:57:50.477] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:25:0)
[05:57:50.578] Build status: STARTED
[05:57:50.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:26:0) after 4m17s
[06:02:07.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:26:0)
[06:02:07.697] Build status: STARTED
[06:02:07.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:27:0) after 9m16s
[06:11:23.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:27:0)
[06:11:23.748] Build status: STARTED
[06:11:23.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:28:0) after 8m32s
[06:19:55.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:28:0)
[06:19:55.824] Build status: STARTED
[06:19:55.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:29:0) after 8m52s
[06:28:47.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:29:0)
[06:28:47.903] Build status: STARTED
[06:28:47.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:30:0) after 7m51s
[06:36:38.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:30:0)
[06:36:38.955] Build status: STARTED
[06:36:38.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:31:0) after 6m7s
[06:42:46.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:31:0)
[06:42:46.090] Build status: STARTED
[06:42:46.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:32:0) after 9m30s
[06:52:16.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:32:0)
[06:52:16.251] Build status: STARTED
[06:52:16.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:33:0) after 9m54s
[07:02:10.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:33:0)
[07:02:10.292] Build status: STARTED
[07:02:10.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:34:0) after 1m8s
[07:03:18.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:34:0)
[07:03:18.387] Build status: STARTED
[07:03:18.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:35:0) after 2m21s
[07:05:39.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:35:0)
[07:05:39.429] Build status: STARTED
[07:05:39.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:36:0) after 4m37s
[07:10:16.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:36:0)
[07:10:16.525] Build status: STARTED
[07:10:16.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:37:0) after 5m3s
[07:15:19.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:37:0)
[07:15:19.743] Build status: STARTED
[07:15:19.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:38:0) after 6m23s
[07:21:42.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:38:0)
[07:21:42.846] Build status: STARTED
[07:21:42.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:39:0) after 5m15s
[07:26:57.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:39:0)
[07:26:57.954] Build status: STARTED
[07:26:57.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:40:0) after 6m56s
[07:33:54.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:40:0)
[07:33:54.085] Build status: STARTED
[07:33:54.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:41:0) after 2m0s
[07:35:54.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:41:0)
[07:35:54.237] Build status: STARTED
[07:35:54.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:42:0) after 8m56s
[07:44:50.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:42:0)
[07:44:50.640] Build status: STARTED
[07:44:50.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:43:0) after 2m57s
[07:47:47.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:43:0)
[07:47:47.782] Build status: STARTED
[07:47:47.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:44:0) after 4m7s
[07:51:54.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:44:0)
[07:51:54.902] Build status: STARTED
[07:51:54.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:45:0) after 7m58s
[07:59:53.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:45:0)
[07:59:53.249] Build status: STARTED
[07:59:53.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:46:0) after 2m34s
[08:02:27.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:46:0)
[08:02:27.379] Build status: STARTED
[08:02:27.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8877637841831636032:47:0) after 4m24s
[08:03:21.917] Received PubSub notification, asking Buildbucket for the build status
[08:03:21.935] Build:
{
"id": "8712207779987325521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38490,
"createdBy": "project:chromium",
"createTime": "2025-06-13T04:17:03.239173841Z",
"startTime": "2025-06-13T04:17:08.455039836Z",
"endTime": "2025-06-13T08:03:21.218455499Z",
"updateTime": "2025-06-13T08:03:21.218455499Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a2e251c1b97782e43f3860671ebd58f331cebfe9",
"ref": "refs/heads/main"
}
}
}
[08:03:21.935] Invocation finished in 3h46m19.839262401s with status FAILED