[07:49:35.274] New invocation is queued and will start shortly
[07:49:36.395] Starting the invocation (attempt 1)
[07:49:36.439] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f83144824db224f58d84a6fd7507c856cdb169c1"
[07:49:36.439] Popped gitiles commit info from properties and tags
[07:49:36.439] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:49:36.439] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:49:36.440] Buildbucket request:
{
"requestId": "8872641636009609712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f83144824db224f58d84a6fd7507c856cdb169c1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8872641636009609712"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:49:36.940] Scheduled build:
{
"id": "8707211574074748289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 33121,
"createdBy": "project:chromium",
"createTime": "2025-08-07T07:49:36.497811037Z",
"updateTime": "2025-08-07T07:49:36.497811037Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f83144824db224f58d84a6fd7507c856cdb169c1",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:49:36.940] Task URL: https://cr-buildbucket.appspot.com/build/8707211574074748289
[07:49:36.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:2:0) after 8m9s
[07:49:37.922] Received PubSub notification, asking Buildbucket for the build status
[07:49:37.955] Build status: SCHEDULED
[07:50:40.537] Received PubSub notification, asking Buildbucket for the build status
[07:50:40.582] Build status: STARTED
[07:57:45.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:2:0)
[07:57:46.022] Build status: STARTED
[07:57:46.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:5:0) after 7m48s
[08:05:34.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:5:0)
[08:05:34.261] Build status: STARTED
[08:05:34.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:6:0) after 9m47s
[08:15:21.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:6:0)
[08:15:21.329] Build status: STARTED
[08:15:21.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:7:0) after 3m48s
[08:19:09.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:7:0)
[08:19:09.394] Build status: STARTED
[08:19:09.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:8:0) after 7m4s
[08:26:13.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:8:0)
[08:26:13.436] Build status: STARTED
[08:26:13.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:9:0) after 7m20s
[08:33:33.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:9:0)
[08:33:33.482] Build status: STARTED
[08:33:33.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:10:0) after 4m51s
[08:38:24.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:10:0)
[08:38:24.572] Build status: STARTED
[08:38:24.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:11:0) after 2m58s
[08:41:22.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:11:0)
[08:41:22.635] Build status: STARTED
[08:41:22.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:12:0) after 1m19s
[08:42:41.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:12:0)
[08:42:41.678] Build status: STARTED
[08:42:41.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:13:0) after 5m0s
[08:47:41.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:13:0)
[08:47:41.712] Build status: STARTED
[08:47:41.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:14:0) after 4m45s
[08:52:26.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:14:0)
[08:52:26.756] Build status: STARTED
[08:52:26.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:15:0) after 2m23s
[08:54:49.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:15:0)
[08:54:49.800] Build status: STARTED
[08:54:49.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:16:0) after 5m38s
[09:00:28.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:16:0)
[09:00:28.065] Build status: STARTED
[09:00:28.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:17:0) after 6m34s
[09:07:02.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:17:0)
[09:07:02.139] Build status: STARTED
[09:07:02.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:18:0) after 2m45s
[09:09:47.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:18:0)
[09:09:47.226] Build status: STARTED
[09:09:47.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:19:0) after 5m16s
[09:15:03.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:19:0)
[09:15:03.362] Build status: STARTED
[09:15:03.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:20:0) after 7m21s
[09:22:24.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:20:0)
[09:22:24.495] Build status: STARTED
[09:22:24.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:21:0) after 9m47s
[09:32:11.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:21:0)
[09:32:11.530] Build status: STARTED
[09:32:11.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:22:0) after 1m16s
[09:33:27.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:22:0)
[09:33:27.573] Build status: STARTED
[09:33:27.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:23:0) after 8m53s
[09:42:20.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:23:0)
[09:42:20.725] Build status: STARTED
[09:42:20.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:24:0) after 5m35s
[09:47:55.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:24:0)
[09:47:55.764] Build status: STARTED
[09:47:55.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:25:0) after 3m46s
[09:51:41.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:25:0)
[09:51:41.775] Build status: STARTED
[09:51:41.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:26:0) after 6m14s
[09:57:55.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:26:0)
[09:57:55.807] Build status: STARTED
[09:57:55.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:27:0) after 2m18s
[10:00:13.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:27:0)
[10:00:13.845] Build status: STARTED
[10:00:13.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:28:0) after 8m39s
[10:08:52.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:28:0)
[10:08:52.871] Build status: STARTED
[10:08:52.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:29:0) after 8m6s
[10:16:58.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:29:0)
[10:16:58.884] Build status: STARTED
[10:16:58.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:30:0) after 9m2s
[10:26:00.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:30:0)
[10:26:00.913] Build status: STARTED
[10:26:00.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:31:0) after 9m33s
[10:35:33.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:31:0)
[10:35:33.945] Build status: STARTED
[10:35:33.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:32:0) after 3m26s
[10:38:59.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:32:0)
[10:38:59.996] Build status: STARTED
[10:38:59.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:33:0) after 6m41s
[10:45:41.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:33:0)
[10:45:41.027] Build status: STARTED
[10:45:41.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:34:0) after 2m38s
[10:48:19.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:34:0)
[10:48:19.145] Build status: STARTED
[10:48:19.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:35:0) after 2m11s
[10:50:30.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:35:0)
[10:50:30.216] Build status: STARTED
[10:50:30.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:36:0) after 1m9s
[10:51:39.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:36:0)
[10:51:39.345] Build status: STARTED
[10:51:39.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:37:0) after 4m52s
[10:56:31.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:37:0)
[10:56:31.387] Build status: STARTED
[10:56:31.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:38:0) after 5m9s
[11:01:40.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:38:0)
[11:01:40.555] Build status: STARTED
[11:01:40.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:39:0) after 6m38s
[11:08:18.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:39:0)
[11:08:18.659] Build status: STARTED
[11:08:18.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:40:0) after 8m29s
[11:16:47.774] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:40:0)
[11:16:47.789] Build status: STARTED
[11:16:47.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:41:0) after 2m50s
[11:19:37.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:41:0)
[11:19:37.834] Build status: STARTED
[11:19:37.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:42:0) after 6m36s
[11:26:13.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:42:0)
[11:26:13.931] Build status: STARTED
[11:26:13.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:43:0) after 1m23s
[11:27:36.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:43:0)
[11:27:37.089] Build status: STARTED
[11:27:37.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:44:0) after 9m12s
[11:36:49.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:44:0)
[11:36:49.128] Build status: STARTED
[11:36:49.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:45:0) after 3m5s
[11:39:54.150] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:45:0)
[11:39:54.166] Build status: STARTED
[11:39:54.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:46:0) after 5m47s
[11:45:41.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:46:0)
[11:45:41.211] Build status: STARTED
[11:45:41.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:47:0) after 1m10s
[11:46:51.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:47:0)
[11:46:51.293] Build status: STARTED
[11:46:51.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:48:0) after 1m9s
[11:48:00.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:48:0)
[11:48:00.299] Build status: STARTED
[11:48:00.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:49:0) after 8m8s
[11:56:08.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:49:0)
[11:56:08.375] Build status: STARTED
[11:56:08.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:50:0) after 1m17s
[11:57:25.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:50:0)
[11:57:25.413] Build status: STARTED
[11:57:25.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:51:0) after 2m34s
[11:59:59.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:51:0)
[11:59:59.457] Build status: STARTED
[11:59:59.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:52:0) after 5m52s
[12:05:51.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:52:0)
[12:05:51.501] Build status: STARTED
[12:05:51.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:53:0) after 1m42s
[12:07:33.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:53:0)
[12:07:33.570] Build status: STARTED
[12:07:33.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:54:0) after 1m18s
[12:08:51.600] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:54:0)
[12:08:51.623] Build status: STARTED
[12:08:51.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:55:0) after 3m41s
[12:12:32.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:55:0)
[12:12:32.666] Build status: STARTED
[12:12:32.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:56:0) after 9m11s
[12:21:43.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:56:0)
[12:21:43.822] Build status: STARTED
[12:21:43.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:57:0) after 1m0s
[12:22:43.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:57:0)
[12:22:43.951] Build status: STARTED
[12:22:43.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:58:0) after 6m45s
[12:29:29.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:58:0)
[12:29:29.036] Build status: STARTED
[12:29:29.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:59:0) after 3m29s
[12:32:58.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:59:0)
[12:32:58.156] Build status: STARTED
[12:32:58.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:60:0) after 8m21s
[12:41:19.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:60:0)
[12:41:19.214] Build status: STARTED
[12:41:19.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:61:0) after 9m54s
[12:51:13.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:61:0)
[12:51:13.274] Build status: STARTED
[12:51:13.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8872641636009609712:62:0) after 9m51s
[12:55:12.757] Received PubSub notification, asking Buildbucket for the build status
[12:55:12.774] Build:
{
"id": "8707211574074748289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 33121,
"createdBy": "project:chromium",
"createTime": "2025-08-07T07:49:36.497811037Z",
"startTime": "2025-08-07T07:50:40.310273915Z",
"endTime": "2025-08-07T12:55:11.553483035Z",
"updateTime": "2025-08-07T12:55:11.553483035Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f83144824db224f58d84a6fd7507c856cdb169c1",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:55:12.774] Invocation finished in 5h5m37.505796201s with status FAILED