[10:10:47.576] New invocation is queued and will start shortly
[10:10:48.748] Starting the invocation (attempt 1)
[10:10:48.774] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/af5c87d6f12201c647343aff5c1616466144fbfb"
[10:10:48.774] Popped gitiles commit info from properties and tags
[10:10:48.774] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:10:48.774] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:10:48.774] Buildbucket request:
{
"requestId": "8851523658993904128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af5c87d6f12201c647343aff5c1616466144fbfb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851523658993904128"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac (dbg)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:10:49.634] Scheduled build:
{
"id": "8686093597030635185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"number": 39866,
"createdBy": "project:chromium",
"createTime": "2026-03-28T10:10:48.819068451Z",
"updateTime": "2026-03-28T10:10:48.819068451Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af5c87d6f12201c647343aff5c1616466144fbfb",
"ref": "refs/heads/main"
}
}
}
[10:10:49.634] Task URL: https://cr-buildbucket.appspot.com/build/8686093597030635185
[10:10:49.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:2:0) after 5m36s
[10:10:50.275] Received PubSub notification, asking Buildbucket for the build status
[10:10:50.303] Build status: SCHEDULED
[10:11:27.348] Received PubSub notification, asking Buildbucket for the build status
[10:11:27.364] Build status: STARTED
[10:16:25.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:2:0)
[10:16:25.920] Build status: STARTED
[10:16:25.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:5:0) after 8m49s
[10:25:15.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:5:0)
[10:25:15.235] Build status: STARTED
[10:25:15.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:6:0) after 8m16s
[10:33:31.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:6:0)
[10:33:31.323] Build status: STARTED
[10:33:31.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:7:0) after 4m20s
[10:37:51.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:7:0)
[10:37:51.467] Build status: STARTED
[10:37:51.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:8:0) after 2m42s
[10:40:33.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:8:0)
[10:40:33.759] Build status: STARTED
[10:40:33.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:9:0) after 7m46s
[10:48:19.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:9:0)
[10:48:19.795] Build status: STARTED
[10:48:19.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:10:0) after 2m12s
[10:50:31.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:10:0)
[10:50:31.839] Build status: STARTED
[10:50:31.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:11:0) after 1m29s
[10:52:00.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:11:0)
[10:52:00.947] Build status: STARTED
[10:52:00.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:12:0) after 4m15s
[10:56:15.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:12:0)
[10:56:15.978] Build status: STARTED
[10:56:15.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:13:0) after 6m25s
[11:02:41.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:13:0)
[11:02:41.064] Build status: STARTED
[11:02:41.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:14:0) after 6m49s
[11:09:30.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:14:0)
[11:09:30.292] Build status: STARTED
[11:09:30.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:15:0) after 3m23s
[11:12:53.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:15:0)
[11:12:53.336] Build status: STARTED
[11:12:53.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:16:0) after 5m24s
[11:18:17.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:16:0)
[11:18:17.405] Build status: STARTED
[11:18:17.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:17:0) after 5m6s
[11:23:23.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:17:0)
[11:23:23.557] Build status: STARTED
[11:23:23.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:18:0) after 3m13s
[11:26:36.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:18:0)
[11:26:36.995] Build status: STARTED
[11:26:36.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:19:0) after 5m58s
[11:32:35.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:19:0)
[11:32:35.091] Build status: STARTED
[11:32:35.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:20:0) after 6m10s
[11:38:45.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:20:0)
[11:38:45.121] Build status: STARTED
[11:38:45.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:21:0) after 1m37s
[11:40:22.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:21:0)
[11:40:22.153] Build status: STARTED
[11:40:22.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:22:0) after 6m26s
[11:46:48.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:22:0)
[11:46:48.381] Build status: STARTED
[11:46:48.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:23:0) after 2m2s
[11:48:50.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:23:0)
[11:48:50.417] Build status: STARTED
[11:48:50.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:24:0) after 9m49s
[11:58:39.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:24:0)
[11:58:39.558] Build status: STARTED
[11:58:39.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:25:0) after 1m13s
[11:59:52.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:25:0)
[11:59:52.588] Build status: STARTED
[11:59:52.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:26:0) after 5m15s
[12:05:07.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:26:0)
[12:05:07.638] Build status: STARTED
[12:05:07.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:27:0) after 9m1s
[12:14:08.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:27:0)
[12:14:08.723] Build status: STARTED
[12:14:08.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:28:0) after 8m28s
[12:22:36.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:28:0)
[12:22:36.997] Build status: STARTED
[12:22:36.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:29:0) after 7m41s
[12:30:18.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:29:0)
[12:30:18.185] Build status: STARTED
[12:30:18.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:30:0) after 7m1s
[12:37:19.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:30:0)
[12:37:19.394] Build status: STARTED
[12:37:19.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:31:0) after 6m10s
[12:43:29.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:31:0)
[12:43:29.436] Build status: STARTED
[12:43:29.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:32:0) after 3m51s
[12:47:20.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:32:0)
[12:47:20.632] Build status: STARTED
[12:47:20.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:33:0) after 7m28s
[12:54:49.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:33:0)
[12:54:49.122] Build status: STARTED
[12:54:49.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:34:0) after 8m12s
[13:03:01.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:34:0)
[13:03:01.170] Build status: STARTED
[13:03:01.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:35:0) after 8m33s
[13:11:34.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:35:0)
[13:11:34.206] Build status: STARTED
[13:11:34.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:36:0) after 9m6s
[13:20:40.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:36:0)
[13:20:40.374] Build status: STARTED
[13:20:40.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:37:0) after 1m9s
[13:21:49.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:37:0)
[13:21:49.405] Build status: STARTED
[13:21:49.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:38:0) after 6m9s
[13:27:58.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:38:0)
[13:27:58.415] Build status: STARTED
[13:27:58.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:39:0) after 5m58s
[13:33:56.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:39:0)
[13:33:56.588] Build status: STARTED
[13:33:56.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:40:0) after 4m24s
[13:38:20.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:40:0)
[13:38:20.691] Build status: STARTED
[13:38:20.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:41:0) after 2m20s
[13:40:40.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:41:0)
[13:40:40.755] Build status: STARTED
[13:40:40.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:42:0) after 2m12s
[13:42:52.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:42:0)
[13:42:52.992] Build status: STARTED
[13:42:52.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:43:0) after 7m39s
[13:50:32.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:43:0)
[13:50:32.024] Build status: STARTED
[13:50:32.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:44:0) after 9m56s
[14:00:28.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:44:0)
[14:00:28.071] Build status: STARTED
[14:00:28.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:45:0) after 3m3s
[14:03:31.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:45:0)
[14:03:31.368] Build status: STARTED
[14:03:31.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:46:0) after 7m10s
[14:10:41.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:46:0)
[14:10:41.521] Build status: STARTED
[14:10:41.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:47:0) after 3m28s
[14:14:09.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:47:0)
[14:14:09.597] Build status: STARTED
[14:14:09.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:48:0) after 9m17s
[14:23:27.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:48:0)
[14:23:27.334] Build status: STARTED
[14:23:27.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:49:0) after 9m37s
[14:33:04.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:49:0)
[14:33:04.702] Build status: STARTED
[14:33:04.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:50:0) after 9m55s
[14:42:59.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:50:0)
[14:42:59.858] Build status: STARTED
[14:42:59.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:51:0) after 2m19s
[14:45:19.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:51:0)
[14:45:19.058] Build status: STARTED
[14:45:19.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:52:0) after 8m5s
[14:53:24.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:52:0)
[14:53:24.110] Build status: STARTED
[14:53:24.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:53:0) after 6m7s
[14:59:31.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:53:0)
[14:59:31.247] Build status: STARTED
[14:59:31.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:54:0) after 8m12s
[15:07:43.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:54:0)
[15:07:43.285] Build status: STARTED
[15:07:43.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:55:0) after 1m55s
[15:09:38.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:55:0)
[15:09:38.319] Build status: STARTED
[15:09:38.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:56:0) after 6m52s
[15:16:30.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:56:0)
[15:16:30.582] Build status: STARTED
[15:16:30.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:57:0) after 1m25s
[15:17:55.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:57:0)
[15:17:55.798] Build status: STARTED
[15:17:55.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:58:0) after 5m57s
[15:23:52.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:58:0)
[15:23:52.836] Build status: STARTED
[15:23:52.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:59:0) after 7m50s
[15:31:42.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:59:0)
[15:31:42.906] Build status: STARTED
[15:31:42.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:60:0) after 7m21s
[15:39:04.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:60:0)
[15:39:04.074] Build status: STARTED
[15:39:04.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:61:0) after 9m18s
[15:48:22.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:61:0)
[15:48:22.307] Build status: STARTED
[15:48:22.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:62:0) after 4m12s
[15:52:34.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:62:0)
[15:52:34.436] Build status: STARTED
[15:52:34.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:63:0) after 4m13s
[15:56:47.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:63:0)
[15:56:47.601] Build status: STARTED
[15:56:47.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:64:0) after 1m25s
[15:58:12.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:64:0)
[15:58:12.707] Build status: STARTED
[15:58:12.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:65:0) after 2m8s
[16:00:20.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:65:0)
[16:00:20.877] Build status: STARTED
[16:00:20.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:66:0) after 1m22s
[16:01:42.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:66:0)
[16:01:42.986] Build status: STARTED
[16:01:42.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:67:0) after 6m36s
[16:08:19.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:67:0)
[16:08:19.236] Build status: STARTED
[16:08:19.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851523658993904128:68:0) after 6m1s
[16:10:07.232] Received PubSub notification, asking Buildbucket for the build status
[16:10:07.261] Build:
{
"id": "8686093597030635185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"number": 39866,
"createdBy": "project:chromium",
"createTime": "2026-03-28T10:10:48.819068451Z",
"startTime": "2026-03-28T10:11:26.946206337Z",
"endTime": "2026-03-28T16:10:06.902988620Z",
"updateTime": "2026-03-28T16:10:06.902988620Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af5c87d6f12201c647343aff5c1616466144fbfb",
"ref": "refs/heads/main"
}
}
}
[16:10:07.261] Invocation finished in 5h59m19.697282042s with status FAILED