[09:39:35.496] New invocation is queued and will start shortly
[09:39:37.624] Starting the invocation (attempt 1)
[09:39:37.654] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3cb4a9b0f0c8bdba69c51b181ad0fca3f2d22caf"
[09:39:37.654] Popped gitiles commit info from properties and tags
[09:39:37.654] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:39:37.654] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:39:37.654] Buildbucket request:
{
"requestId": "8867651882022190192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3cb4a9b0f0c8bdba69c51b181ad0fca3f2d22caf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867651882022190192"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:39:38.241] Scheduled build:
{
"id": "8702221819032571761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 38001,
"createdBy": "project:chromium",
"createTime": "2025-10-01T09:39:37.726313615Z",
"updateTime": "2025-10-01T09:39:37.726313615Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3cb4a9b0f0c8bdba69c51b181ad0fca3f2d22caf",
"ref": "refs/heads/main"
}
}
}
[09:39:38.241] Task URL: https://cr-buildbucket.appspot.com/build/8702221819032571761
[09:39:38.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:2:0) after 7m36s
[09:39:39.242] Received PubSub notification, asking Buildbucket for the build status
[09:39:39.292] Build status: SCHEDULED
[09:40:42.579] Received PubSub notification, asking Buildbucket for the build status
[09:40:42.598] Build status: STARTED
[09:47:14.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:2:0)
[09:47:14.274] Build status: STARTED
[09:47:14.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:5:0) after 7m53s
[09:55:07.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:5:0)
[09:55:07.304] Build status: STARTED
[09:55:07.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:6:0) after 9m51s
[10:04:58.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:6:0)
[10:04:58.338] Build status: STARTED
[10:04:58.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:7:0) after 6m33s
[10:11:31.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:7:0)
[10:11:31.448] Build status: STARTED
[10:11:31.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:8:0) after 5m26s
[10:16:57.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:8:0)
[10:16:57.667] Build status: STARTED
[10:16:57.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:9:0) after 7m55s
[10:24:52.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:9:0)
[10:24:52.702] Build status: STARTED
[10:24:52.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:10:0) after 1m26s
[10:26:18.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:10:0)
[10:26:18.747] Build status: STARTED
[10:26:18.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:11:0) after 5m42s
[10:32:00.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:11:0)
[10:32:00.840] Build status: STARTED
[10:32:00.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:12:0) after 2m41s
[10:34:41.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:12:0)
[10:34:41.950] Build status: STARTED
[10:34:41.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:13:0) after 5m27s
[10:40:09.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:13:0)
[10:40:09.041] Build status: STARTED
[10:40:09.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:14:0) after 4m2s
[10:44:11.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:14:0)
[10:44:11.093] Build status: STARTED
[10:44:11.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:15:0) after 5m30s
[10:49:41.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:15:0)
[10:49:41.155] Build status: STARTED
[10:49:41.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:16:0) after 4m42s
[10:54:23.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:16:0)
[10:54:23.180] Build status: STARTED
[10:54:23.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:17:0) after 1m28s
[10:55:51.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:17:0)
[10:55:51.351] Build status: STARTED
[10:55:51.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:18:0) after 1m27s
[10:57:18.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:18:0)
[10:57:18.360] Build status: STARTED
[10:57:18.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:19:0) after 9m54s
[11:07:12.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:19:0)
[11:07:12.460] Build status: STARTED
[11:07:12.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:20:0) after 6m24s
[11:13:36.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:20:0)
[11:13:36.503] Build status: STARTED
[11:13:36.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:21:0) after 3m42s
[11:17:18.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:21:0)
[11:17:18.543] Build status: STARTED
[11:17:18.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:22:0) after 9m13s
[11:26:31.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:22:0)
[11:26:31.598] Build status: STARTED
[11:26:31.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:23:0) after 7m13s
[11:33:44.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:23:0)
[11:33:44.601] Build status: STARTED
[11:33:44.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:24:0) after 9m19s
[11:43:03.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:24:0)
[11:43:03.655] Build status: STARTED
[11:43:03.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:25:0) after 2m44s
[11:45:47.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:25:0)
[11:45:47.688] Build status: STARTED
[11:45:47.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:26:0) after 6m6s
[11:51:53.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:26:0)
[11:51:53.696] Build status: STARTED
[11:51:53.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:27:0) after 1m19s
[11:53:12.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:27:0)
[11:53:12.716] Build status: STARTED
[11:53:12.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:28:0) after 6m49s
[12:00:01.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:28:0)
[12:00:01.754] Build status: STARTED
[12:00:01.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:29:0) after 6m23s
[12:06:24.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:29:0)
[12:06:24.853] Build status: STARTED
[12:06:24.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:30:0) after 2m56s
[12:09:20.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:30:0)
[12:09:20.905] Build status: STARTED
[12:09:20.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:31:0) after 2m6s
[12:11:26.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:31:0)
[12:11:26.960] Build status: STARTED
[12:11:26.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:32:0) after 5m54s
[12:17:21.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:32:0)
[12:17:21.075] Build status: STARTED
[12:17:21.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:33:0) after 4m8s
[12:21:29.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:33:0)
[12:21:29.262] Build status: STARTED
[12:21:29.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:34:0) after 8m53s
[12:30:22.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:34:0)
[12:30:22.297] Build status: STARTED
[12:30:22.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:35:0) after 3m23s
[12:33:45.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:35:0)
[12:33:45.334] Build status: STARTED
[12:33:45.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:36:0) after 9m47s
[12:43:32.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:36:0)
[12:43:32.428] Build status: STARTED
[12:43:32.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:37:0) after 8m58s
[12:52:30.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:37:0)
[12:52:30.613] Build status: STARTED
[12:52:30.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:38:0) after 1m6s
[12:53:36.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:38:0)
[12:53:36.664] Build status: STARTED
[12:53:36.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:39:0) after 2m17s
[12:55:53.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:39:0)
[12:55:53.659] Build status: STARTED
[12:55:53.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:40:0) after 3m50s
[12:59:43.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:40:0)
[12:59:43.656] Build status: STARTED
[12:59:43.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:41:0) after 3m46s
[13:03:29.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:41:0)
[13:03:29.655] Build status: STARTED
[13:03:29.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:42:0) after 6m29s
[13:09:58.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:42:0)
[13:09:58.748] Build status: STARTED
[13:09:58.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:43:0) after 2m1s
[13:11:59.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:43:0)
[13:11:59.787] Build status: STARTED
[13:11:59.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:44:0) after 5m4s
[13:17:03.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:44:0)
[13:17:03.823] Build status: STARTED
[13:17:03.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:45:0) after 2m21s
[13:19:24.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:45:0)
[13:19:24.951] Build status: STARTED
[13:19:24.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:46:0) after 2m55s
[13:22:19.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:46:0)
[13:22:19.988] Build status: STARTED
[13:22:19.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:47:0) after 4m46s
[13:27:06.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:47:0)
[13:27:06.103] Build status: STARTED
[13:27:06.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:48:0) after 3m39s
[13:30:45.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:48:0)
[13:30:45.260] Build status: STARTED
[13:30:45.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:49:0) after 8m56s
[13:39:41.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:49:0)
[13:39:41.348] Build status: STARTED
[13:39:41.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:50:0) after 8m32s
[13:48:13.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:50:0)
[13:48:13.503] Build status: STARTED
[13:48:13.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:51:0) after 1m34s
[13:49:47.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:51:0)
[13:49:47.539] Build status: STARTED
[13:49:47.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:52:0) after 9m6s
[13:58:53.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:52:0)
[13:58:53.572] Build status: STARTED
[13:58:53.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:53:0) after 6m23s
[14:05:16.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:53:0)
[14:05:16.690] Build status: STARTED
[14:05:16.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:54:0) after 3m28s
[14:08:44.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:54:0)
[14:08:44.731] Build status: STARTED
[14:08:44.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:55:0) after 3m48s
[14:12:32.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:55:0)
[14:12:32.827] Build status: STARTED
[14:12:32.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:56:0) after 9m28s
[14:22:00.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:56:0)
[14:22:00.920] Build status: STARTED
[14:22:00.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:57:0) after 6m22s
[14:28:22.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:57:0)
[14:28:22.950] Build status: STARTED
[14:28:22.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:58:0) after 7m53s
[14:36:15.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:58:0)
[14:36:15.985] Build status: STARTED
[14:36:15.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:59:0) after 6m16s
[14:42:32.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:59:0)
[14:42:32.133] Build status: STARTED
[14:42:32.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867651882022190192:60:0) after 8m9s
[14:47:10.342] Received PubSub notification, asking Buildbucket for the build status
[14:47:10.356] Build:
{
"id": "8702221819032571761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 38001,
"createdBy": "project:chromium",
"createTime": "2025-10-01T09:39:37.726313615Z",
"startTime": "2025-10-01T09:40:42.326897507Z",
"endTime": "2025-10-01T14:47:10.005726650Z",
"updateTime": "2025-10-01T14:47:10.005726650Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3cb4a9b0f0c8bdba69c51b181ad0fca3f2d22caf",
"ref": "refs/heads/main"
}
}
}
[14:47:10.356] Invocation finished in 5h7m34.865268026s with status FAILED