[10:23:30.191] New invocation is queued and will start shortly
[10:23:31.275] Starting the invocation (attempt 1)
[10:23:31.300] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/19c8744974e75e336fa91b96334e9c98e3050aff"
[10:23:31.300] Popped gitiles commit info from properties and tags
[10:23:31.300] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:23:31.301] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:23:31.301] Buildbucket request:
{
"requestId": "8853063007753935936",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "19c8744974e75e336fa91b96334e9c98e3050aff",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853063007753935936"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac (dbg)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:23:31.963] Scheduled build:
{
"id": "8687632945841826209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"number": 39606,
"createdBy": "project:chromium",
"createTime": "2026-03-11T10:23:31.393724907Z",
"updateTime": "2026-03-11T10:23:31.393724907Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "19c8744974e75e336fa91b96334e9c98e3050aff",
"ref": "refs/heads/main"
}
}
}
[10:23:31.964] Task URL: https://cr-buildbucket.appspot.com/build/8687632945841826209
[10:23:31.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:2:0) after 1m36s
[10:23:32.874] Received PubSub notification, asking Buildbucket for the build status
[10:23:32.890] Build status: SCHEDULED
[10:24:28.351] Received PubSub notification, asking Buildbucket for the build status
[10:24:28.371] Build status: STARTED
[10:25:07.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:2:0)
[10:25:08.018] Build status: STARTED
[10:25:08.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:5:0) after 4m31s
[10:29:39.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:5:0)
[10:29:39.138] Build status: STARTED
[10:29:39.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:6:0) after 6m12s
[10:35:51.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:6:0)
[10:35:51.183] Build status: STARTED
[10:35:51.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:7:0) after 9m6s
[10:44:57.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:7:0)
[10:44:57.222] Build status: STARTED
[10:44:57.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:8:0) after 7m42s
[10:52:39.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:8:0)
[10:52:39.266] Build status: STARTED
[10:52:39.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:9:0) after 6m25s
[10:59:04.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:9:0)
[10:59:04.349] Build status: STARTED
[10:59:04.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:10:0) after 9m34s
[11:08:38.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:10:0)
[11:08:38.397] Build status: STARTED
[11:08:38.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:11:0) after 9m35s
[11:18:13.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:11:0)
[11:18:13.564] Build status: STARTED
[11:18:13.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:12:0) after 4m44s
[11:22:57.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:12:0)
[11:22:57.633] Build status: STARTED
[11:22:57.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:13:0) after 6m22s
[11:29:19.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:13:0)
[11:29:19.759] Build status: STARTED
[11:29:19.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:14:0) after 4m11s
[11:33:30.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:14:0)
[11:33:30.910] Build status: STARTED
[11:33:30.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:15:0) after 7m56s
[11:41:26.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:15:0)
[11:41:27.005] Build status: STARTED
[11:41:27.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:16:0) after 4m32s
[11:45:59.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:16:0)
[11:45:59.061] Build status: STARTED
[11:45:59.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:17:0) after 5m8s
[11:51:07.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:17:0)
[11:51:07.175] Build status: STARTED
[11:51:07.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:18:0) after 7m53s
[11:59:00.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:18:0)
[11:59:00.212] Build status: STARTED
[11:59:00.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:19:0) after 7m5s
[12:06:05.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:19:0)
[12:06:05.300] Build status: STARTED
[12:06:05.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:20:0) after 5m38s
[12:11:43.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:20:0)
[12:11:43.358] Build status: STARTED
[12:11:43.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:21:0) after 7m38s
[12:19:21.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:21:0)
[12:19:21.400] Build status: STARTED
[12:19:21.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:22:0) after 4m47s
[12:24:08.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:22:0)
[12:24:08.564] Build status: STARTED
[12:24:08.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:23:0) after 5m50s
[12:29:58.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:23:0)
[12:29:58.602] Build status: STARTED
[12:29:58.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:24:0) after 5m32s
[12:35:30.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:24:0)
[12:35:30.693] Build status: STARTED
[12:35:30.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:25:0) after 3m4s
[12:38:34.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:25:0)
[12:38:34.735] Build status: STARTED
[12:38:34.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:26:0) after 6m24s
[12:44:58.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:26:0)
[12:44:58.849] Build status: STARTED
[12:44:58.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:27:0) after 4m17s
[12:49:15.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:27:0)
[12:49:15.966] Build status: STARTED
[12:49:15.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:28:0) after 5m15s
[12:54:31.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:28:0)
[12:54:31.059] Build status: STARTED
[12:54:31.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:29:0) after 3m27s
[12:57:58.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:29:0)
[12:57:58.100] Build status: STARTED
[12:57:58.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:30:0) after 2m36s
[13:00:34.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:30:0)
[13:00:34.320] Build status: STARTED
[13:00:34.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:31:0) after 1m23s
[13:01:57.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:31:0)
[13:01:57.385] Build status: STARTED
[13:01:57.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:32:0) after 9m53s
[13:11:50.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:32:0)
[13:11:50.552] Build status: STARTED
[13:11:50.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:33:0) after 6m12s
[13:18:02.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:33:0)
[13:18:02.718] Build status: STARTED
[13:18:02.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:34:0) after 3m54s
[13:21:56.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:34:0)
[13:21:56.803] Build status: STARTED
[13:21:56.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:35:0) after 7m42s
[13:29:38.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:35:0)
[13:29:38.915] Build status: STARTED
[13:29:38.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:36:0) after 6m11s
[13:35:49.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:36:0)
[13:35:50.064] Build status: STARTED
[13:35:50.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:37:0) after 9m51s
[13:45:41.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:37:0)
[13:45:41.229] Build status: STARTED
[13:45:41.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:38:0) after 3m34s
[13:49:15.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:38:0)
[13:49:15.302] Build status: STARTED
[13:49:15.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:39:0) after 4m0s
[13:53:15.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:39:0)
[13:53:15.369] Build status: STARTED
[13:53:15.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:40:0) after 3m10s
[13:56:25.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:40:0)
[13:56:25.407] Build status: STARTED
[13:56:25.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:41:0) after 6m2s
[14:02:27.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:41:0)
[14:02:27.500] Build status: STARTED
[14:02:27.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:42:0) after 8m6s
[14:10:33.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:42:0)
[14:10:33.545] Build status: STARTED
[14:10:33.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:43:0) after 1m13s
[14:11:46.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:43:0)
[14:11:46.614] Build status: STARTED
[14:11:46.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:44:0) after 9m28s
[14:21:14.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:44:0)
[14:21:14.904] Build status: STARTED
[14:21:14.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:45:0) after 9m47s
[14:31:01.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:45:0)
[14:31:02.013] Build status: STARTED
[14:31:02.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:46:0) after 6m40s
[14:37:42.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:46:0)
[14:37:42.042] Build status: STARTED
[14:37:42.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:47:0) after 8m7s
[14:45:49.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:47:0)
[14:45:49.240] Build status: STARTED
[14:45:49.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:48:0) after 3m37s
[14:49:26.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:48:0)
[14:49:26.513] Build status: STARTED
[14:49:26.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:49:0) after 9m25s
[14:58:51.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:49:0)
[14:58:51.616] Build status: STARTED
[14:58:51.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:50:0) after 1m13s
[15:00:04.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:50:0)
[15:00:04.663] Build status: STARTED
[15:00:04.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:51:0) after 2m47s
[15:02:51.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:51:0)
[15:02:51.845] Build status: STARTED
[15:02:51.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:52:0) after 9m47s
[15:12:38.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:52:0)
[15:12:38.937] Build status: STARTED
[15:12:38.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:53:0) after 1m51s
[15:14:30.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:53:0)
[15:14:30.033] Build status: STARTED
[15:14:30.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:54:0) after 3m37s
[15:18:07.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:54:0)
[15:18:07.050] Build status: STARTED
[15:18:07.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:55:0) after 8m1s
[15:26:08.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:55:0)
[15:26:08.194] Build status: STARTED
[15:26:08.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:56:0) after 8m10s
[15:34:18.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:56:0)
[15:34:18.283] Build status: STARTED
[15:34:18.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:57:0) after 6m34s
[15:40:52.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:57:0)
[15:40:52.374] Build status: STARTED
[15:40:52.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:58:0) after 1m20s
[15:42:12.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:58:0)
[15:42:12.420] Build status: STARTED
[15:42:12.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:59:0) after 9m16s
[15:51:28.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:59:0)
[15:51:28.613] Build status: STARTED
[15:51:28.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:60:0) after 7m43s
[15:59:11.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:60:0)
[15:59:11.661] Build status: STARTED
[15:59:11.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:61:0) after 1m40s
[16:00:51.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:61:0)
[16:00:51.707] Build status: STARTED
[16:00:51.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:62:0) after 3m7s
[16:03:58.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:62:0)
[16:03:58.814] Build status: STARTED
[16:03:58.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:63:0) after 9m25s
[16:13:23.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:63:0)
[16:13:23.867] Build status: STARTED
[16:13:23.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:64:0) after 8m41s
[16:22:04.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:64:0)
[16:22:04.904] Build status: STARTED
[16:22:04.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853063007753935936:65:0) after 7m55s
[16:28:01.894] Received PubSub notification, asking Buildbucket for the build status
[16:28:01.912] Build:
{
"id": "8687632945841826209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"number": 39606,
"createdBy": "project:chromium",
"createTime": "2026-03-11T10:23:31.393724907Z",
"startTime": "2026-03-11T10:24:28.177840898Z",
"endTime": "2026-03-11T16:28:01.518853172Z",
"updateTime": "2026-03-11T16:28:01.518853172Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "19c8744974e75e336fa91b96334e9c98e3050aff",
"ref": "refs/heads/main"
}
}
}
[16:28:01.912] Invocation finished in 6h4m31.725965129s with status FAILED