[16:33:49.014] New invocation is queued and will start shortly
[16:33:50.378] Starting the invocation (attempt 1)
[16:33:50.413] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/948ab3beb0b7c296d6675a520f4195797732ab3f"
[16:33:50.413] Popped gitiles commit info from properties and tags
[16:33:50.413] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:33:50.413] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:33:50.413] Buildbucket request:
{
"requestId": "8867172836392746304",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "948ab3beb0b7c296d6675a520f4195797732ab3f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867172836392746304"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:33:51.288] Scheduled build:
{
"id": "8701742774020526257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 38116,
"createdBy": "project:chromium",
"createTime": "2025-10-06T16:33:50.650945910Z",
"updateTime": "2025-10-06T16:33:50.650945910Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "948ab3beb0b7c296d6675a520f4195797732ab3f",
"ref": "refs/heads/main"
}
}
}
[16:33:51.288] Task URL: https://cr-buildbucket.appspot.com/build/8701742774020526257
[16:33:51.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:2:0) after 7m19s
[16:34:03.429] Received PubSub notification, asking Buildbucket for the build status
[16:34:03.489] Build status: SCHEDULED
[16:34:39.709] Received PubSub notification, asking Buildbucket for the build status
[16:34:39.731] Build status: STARTED
[16:41:10.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:2:0)
[16:41:10.506] Build status: STARTED
[16:41:10.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:5:0) after 7m17s
[16:48:27.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:5:0)
[16:48:27.645] Build status: STARTED
[16:48:27.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:6:0) after 5m9s
[16:53:36.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:6:0)
[16:53:36.746] Build status: STARTED
[16:53:36.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:7:0) after 3m26s
[16:57:02.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:7:0)
[16:57:02.887] Build status: STARTED
[16:57:02.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:8:0) after 5m54s
[17:02:56.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:8:0)
[17:02:56.935] Build status: STARTED
[17:02:56.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:9:0) after 9m4s
[17:12:00.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:9:0)
[17:12:00.968] Build status: STARTED
[17:12:00.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:10:0) after 8m46s
[17:20:46.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:10:0)
[17:20:46.998] Build status: STARTED
[17:20:46.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:11:0) after 7m6s
[17:27:53.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:11:0)
[17:27:53.090] Build status: STARTED
[17:27:53.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:12:0) after 4m26s
[17:32:19.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:12:0)
[17:32:19.134] Build status: STARTED
[17:32:19.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:13:0) after 8m8s
[17:40:27.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:13:0)
[17:40:27.181] Build status: STARTED
[17:40:27.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:14:0) after 4m2s
[17:44:29.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:14:0)
[17:44:29.214] Build status: STARTED
[17:44:29.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:15:0) after 8m48s
[17:53:17.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:15:0)
[17:53:17.246] Build status: STARTED
[17:53:17.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:16:0) after 9m40s
[18:02:57.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:16:0)
[18:02:57.282] Build status: STARTED
[18:02:57.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:17:0) after 1m28s
[18:04:25.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:17:0)
[18:04:25.373] Build status: STARTED
[18:04:25.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:18:0) after 9m18s
[18:13:43.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:18:0)
[18:13:43.415] Build status: STARTED
[18:13:43.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:19:0) after 9m27s
[18:23:10.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:19:0)
[18:23:10.450] Build status: STARTED
[18:23:10.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:20:0) after 9m5s
[18:32:15.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:20:0)
[18:32:15.547] Build status: STARTED
[18:32:15.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:21:0) after 6m42s
[18:38:57.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:21:0)
[18:38:57.584] Build status: STARTED
[18:38:57.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:22:0) after 9m38s
[18:48:35.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:22:0)
[18:48:35.576] Build status: STARTED
[18:48:35.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:23:0) after 1m45s
[18:50:20.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:23:0)
[18:50:20.660] Build status: STARTED
[18:50:20.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:24:0) after 1m37s
[18:51:57.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:24:0)
[18:51:57.748] Build status: STARTED
[18:51:57.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:25:0) after 9m29s
[19:01:26.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:25:0)
[19:01:26.796] Build status: STARTED
[19:01:26.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:26:0) after 9m39s
[19:11:05.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:26:0)
[19:11:05.919] Build status: STARTED
[19:11:05.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:27:0) after 3m3s
[19:14:09.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:27:0)
[19:14:09.148] Build status: STARTED
[19:14:09.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:28:0) after 7m23s
[19:21:32.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:28:0)
[19:21:32.341] Build status: STARTED
[19:21:32.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:29:0) after 4m10s
[19:25:42.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:29:0)
[19:25:42.456] Build status: STARTED
[19:25:42.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:30:0) after 8m2s
[19:33:44.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:30:0)
[19:33:44.564] Build status: STARTED
[19:33:44.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:31:0) after 8m19s
[19:42:03.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:31:0)
[19:42:03.696] Build status: STARTED
[19:42:03.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:32:0) after 5m20s
[19:47:23.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:32:0)
[19:47:23.779] Build status: STARTED
[19:47:23.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:33:0) after 6m35s
[19:53:58.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:33:0)
[19:53:58.864] Build status: STARTED
[19:53:58.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:34:0) after 7m5s
[20:01:03.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:34:0)
[20:01:04.001] Build status: STARTED
[20:01:04.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:35:0) after 5m39s
[20:06:43.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:35:0)
[20:06:43.092] Build status: STARTED
[20:06:43.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:36:0) after 2m38s
[20:09:21.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:36:0)
[20:09:21.482] Build status: STARTED
[20:09:21.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:37:0) after 1m12s
[20:10:33.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:37:0)
[20:10:33.663] Build status: STARTED
[20:10:33.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:38:0) after 9m16s
[20:19:49.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:38:0)
[20:19:49.879] Build status: STARTED
[20:19:49.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:39:0) after 5m28s
[20:25:17.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:39:0)
[20:25:17.961] Build status: STARTED
[20:25:17.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:40:0) after 9m44s
[20:35:01.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:40:0)
[20:35:02.002] Build status: STARTED
[20:35:02.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:41:0) after 2m56s
[20:37:58.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:41:0)
[20:37:58.061] Build status: STARTED
[20:37:58.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:42:0) after 1m43s
[20:39:41.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:42:0)
[20:39:41.250] Build status: STARTED
[20:39:41.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:43:0) after 6m6s
[20:45:47.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:43:0)
[20:45:47.717] Build status: STARTED
[20:45:47.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:44:0) after 4m32s
[20:50:19.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:44:0)
[20:50:19.785] Build status: STARTED
[20:50:19.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:45:0) after 7m25s
[20:57:44.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:45:0)
[20:57:44.830] Build status: STARTED
[20:57:44.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:46:0) after 7m46s
[21:05:30.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:46:0)
[21:05:30.915] Build status: STARTED
[21:05:30.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:47:0) after 4m59s
[21:10:30.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:47:0)
[21:10:30.053] Build status: STARTED
[21:10:30.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867172836392746304:48:0) after 2m27s
[21:11:04.467] Received PubSub notification, asking Buildbucket for the build status
[21:11:04.484] Build:
{
"id": "8701742774020526257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 38116,
"createdBy": "project:chromium",
"createTime": "2025-10-06T16:33:50.650945910Z",
"startTime": "2025-10-06T16:34:38.224474551Z",
"endTime": "2025-10-06T21:11:04.113665925Z",
"updateTime": "2025-10-06T21:11:04.113665925Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "948ab3beb0b7c296d6675a520f4195797732ab3f",
"ref": "refs/heads/main"
}
}
}
[21:11:04.484] Invocation finished in 4h37m15.478717363s with status FAILED