[04:00:08.752] New invocation is queued and will start shortly
[04:00:10.429] Starting the invocation (attempt 1)
[04:00:10.453] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/261807f5b5f62dc5b756a542de8a89a40f2dcffd"
[04:00:10.453] Popped gitiles commit info from properties and tags
[04:00:10.454] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:10.454] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:10.454] Buildbucket request:
{
"requestId": "8851456381114116864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-fuzz-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "261807f5b5f62dc5b756a542de8a89a40f2dcffd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851456381114116864"
},
{
"key": "scheduler_job_id",
"value": "chromium/linux-fuzz-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:11.315] Scheduled build:
{
"id": "8686026318614487121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-fuzz-coverage"
},
"number": 1261,
"createdBy": "project:chromium",
"createTime": "2026-03-29T04:00:10.516084661Z",
"updateTime": "2026-03-29T04:00:10.516084661Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "261807f5b5f62dc5b756a542de8a89a40f2dcffd",
"ref": "refs/heads/main"
}
}
}
[04:00:11.315] Task URL: https://cr-buildbucket.appspot.com/build/8686026318614487121
[04:00:11.315] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:2:0) after 6m55s
[04:00:12.039] Received PubSub notification, asking Buildbucket for the build status
[04:00:12.054] Build status: SCHEDULED
[04:00:17.773] Received PubSub notification, asking Buildbucket for the build status
[04:00:17.797] Build status: STARTED
[04:07:06.476] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:2:0)
[04:07:06.497] Build status: STARTED
[04:07:06.497] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:5:0) after 8m32s
[04:15:38.579] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:5:0)
[04:15:38.594] Build status: STARTED
[04:15:38.594] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:6:0) after 1m58s
[04:17:36.785] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:6:0)
[04:17:36.804] Build status: STARTED
[04:17:36.804] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:7:0) after 9m56s
[04:27:32.926] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:7:0)
[04:27:32.942] Build status: STARTED
[04:27:32.942] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:8:0) after 8m18s
[04:35:50.961] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:8:0)
[04:35:50.978] Build status: STARTED
[04:35:50.978] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:9:0) after 6m20s
[04:42:11.001] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:9:0)
[04:42:11.034] Build status: STARTED
[04:42:11.034] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:10:0) after 8m14s
[04:50:25.146] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:10:0)
[04:50:25.163] Build status: STARTED
[04:50:25.163] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:11:0) after 7m47s
[04:58:12.179] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:11:0)
[04:58:12.202] Build status: STARTED
[04:58:12.202] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:12:0) after 8m2s
[05:06:14.215] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:12:0)
[05:06:14.232] Build status: STARTED
[05:06:14.232] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:13:0) after 7m22s
[05:13:36.205] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:13:0)
[05:13:36.222] Build status: STARTED
[05:13:36.222] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:14:0) after 3m31s
[05:17:07.438] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:14:0)
[05:17:07.456] Build status: STARTED
[05:17:07.457] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:15:0) after 5m1s
[05:22:08.470] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:15:0)
[05:22:08.511] Build status: STARTED
[05:22:08.511] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:16:0) after 7m12s
[05:29:20.557] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:16:0)
[05:29:20.574] Build status: STARTED
[05:29:20.574] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:17:0) after 2m36s
[05:31:56.689] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:17:0)
[05:31:56.728] Build status: STARTED
[05:31:56.728] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:18:0) after 1m37s
[05:33:33.990] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:18:0)
[05:33:34.050] Build status: STARTED
[05:33:34.050] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:19:0) after 1m47s
[05:35:21.173] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:19:0)
[05:35:21.199] Build status: STARTED
[05:35:21.199] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:20:0) after 8m42s
[05:44:03.629] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:20:0)
[05:44:03.644] Build status: STARTED
[05:44:03.644] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:21:0) after 9m53s
[05:53:56.658] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:21:0)
[05:53:56.675] Build status: STARTED
[05:53:56.675] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:22:0) after 7m47s
[06:01:43.702] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:22:0)
[06:01:43.722] Build status: STARTED
[06:01:43.722] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:23:0) after 2m57s
[06:04:40.771] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:23:0)
[06:04:40.801] Build status: STARTED
[06:04:40.801] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:24:0) after 7m34s
[06:12:15.044] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:24:0)
[06:12:15.062] Build status: STARTED
[06:12:15.062] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:25:0) after 8m22s
[06:20:37.895] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:25:0)
[06:20:37.911] Build status: STARTED
[06:20:37.911] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:26:0) after 9m37s
[06:30:15.428] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:26:0)
[06:30:15.446] Build status: STARTED
[06:30:15.446] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:27:0) after 5m43s
[06:35:58.744] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:27:0)
[06:35:58.762] Build status: STARTED
[06:35:58.763] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:28:0) after 3m58s
[06:39:56.898] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:28:0)
[06:39:56.992] Build status: STARTED
[06:39:56.992] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:29:0) after 8m0s
[06:47:57.010] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:29:0)
[06:47:57.027] Build status: STARTED
[06:47:57.027] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:30:0) after 8m11s
[06:56:08.563] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:30:0)
[06:56:08.583] Build status: STARTED
[06:56:08.583] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:31:0) after 1m15s
[06:57:23.716] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:31:0)
[06:57:23.737] Build status: STARTED
[06:57:23.737] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:32:0) after 7m44s
[07:05:07.717] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:32:0)
[07:05:07.731] Build status: STARTED
[07:05:07.731] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:33:0) after 2m57s
[07:08:04.764] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:33:0)
[07:08:04.782] Build status: STARTED
[07:08:04.782] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:34:0) after 8m48s
[07:16:52.942] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:34:0)
[07:16:53.010] Build status: STARTED
[07:16:53.010] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:35:0) after 7m37s
[07:24:30.026] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:35:0)
[07:24:30.042] Build status: STARTED
[07:24:30.042] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:36:0) after 2m1s
[07:26:31.181] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:36:0)
[07:26:31.196] Build status: STARTED
[07:26:31.197] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:37:0) after 1m5s
[07:27:36.254] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:37:0)
[07:27:36.273] Build status: STARTED
[07:27:36.273] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:38:0) after 7m49s
[07:35:25.388] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:38:0)
[07:35:25.405] Build status: STARTED
[07:35:25.405] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:39:0) after 3m6s
[07:38:31.418] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:39:0)
[07:38:31.441] Build status: STARTED
[07:38:31.441] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:40:0) after 1m3s
[07:39:34.556] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:40:0)
[07:39:34.575] Build status: STARTED
[07:39:34.575] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:41:0) after 7m0s
[07:46:34.590] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:41:0)
[07:46:34.605] Build status: STARTED
[07:46:34.605] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:42:0) after 2m22s
[07:48:56.915] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:42:0)
[07:48:56.929] Build status: STARTED
[07:48:56.929] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:43:0) after 5m45s
[07:54:41.947] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:43:0)
[07:54:41.967] Build status: STARTED
[07:54:41.967] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:44:0) after 8m18s
[08:02:59.970] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:44:0)
[08:02:59.999] Build status: STARTED
[08:02:59.999] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:45:0) after 9m58s
[08:12:58.018] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:45:0)
[08:12:58.052] Build status: STARTED
[08:12:58.052] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:46:0) after 6m21s
[08:19:19.232] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:46:0)
[08:19:19.256] Build status: STARTED
[08:19:19.256] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:47:0) after 4m28s
[08:23:47.291] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:47:0)
[08:23:47.307] Build status: STARTED
[08:23:47.307] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:48:0) after 6m10s
[08:29:57.376] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:48:0)
[08:29:57.396] Build status: STARTED
[08:29:57.396] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:49:0) after 3m36s
[08:33:33.412] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:49:0)
[08:33:33.431] Build status: STARTED
[08:33:33.431] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:50:0) after 5m6s
[08:38:39.462] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:50:0)
[08:38:39.482] Build status: STARTED
[08:38:39.482] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:51:0) after 5m55s
[08:44:35.067] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:51:0)
[08:44:35.106] Build status: STARTED
[08:44:35.106] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:52:0) after 2m31s
[08:47:06.329] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:52:0)
[08:47:06.347] Build status: STARTED
[08:47:06.347] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:53:0) after 9m46s
[08:56:52.411] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:53:0)
[08:56:52.434] Build status: STARTED
[08:56:52.434] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:54:0) after 8m32s
[09:05:24.764] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:54:0)
[09:05:24.788] Build status: STARTED
[09:05:24.788] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:55:0) after 6m34s
[09:11:59.018] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:55:0)
[09:11:59.035] Build status: STARTED
[09:11:59.035] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:56:0) after 9m26s
[09:21:25.318] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:56:0)
[09:21:25.333] Build status: STARTED
[09:21:25.333] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:57:0) after 3m56s
[09:25:21.426] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:57:0)
[09:25:21.445] Build status: STARTED
[09:25:21.446] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:58:0) after 4m57s
[09:30:19.012] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:58:0)
[09:30:19.030] Build status: STARTED
[09:30:19.030] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:59:0) after 3m9s
[09:33:28.189] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:59:0)
[09:33:28.224] Build status: STARTED
[09:33:28.225] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:60:0) after 8m4s
[09:41:32.277] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:60:0)
[09:41:32.301] Build status: STARTED
[09:41:32.301] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:61:0) after 5m27s
[09:46:59.342] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:61:0)
[09:46:59.364] Build status: STARTED
[09:46:59.364] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:62:0) after 7m38s
[09:54:37.618] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:62:0)
[09:54:37.652] Build status: STARTED
[09:54:37.652] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:63:0) after 9m29s
[10:04:06.670] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:63:0)
[10:04:06.689] Build status: STARTED
[10:04:06.689] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:64:0) after 2m34s
[10:06:40.784] Handling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:64:0)
[10:06:40.804] Build status: STARTED
[10:06:40.804] Scheduling timer "check-buildbucket-build-status" (chromium/linux-fuzz-coverage:8851456381114116864:65:0) after 4m31s
[10:07:47.736] Received PubSub notification, asking Buildbucket for the build status
[10:07:47.761] Build:
{
"id": "8686026318614487121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-fuzz-coverage"
},
"number": 1261,
"createdBy": "project:chromium",
"createTime": "2026-03-29T04:00:10.516084661Z",
"startTime": "2026-03-29T04:00:16.765094429Z",
"endTime": "2026-03-29T10:07:45.527852709Z",
"updateTime": "2026-03-29T10:07:45.527852709Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "261807f5b5f62dc5b756a542de8a89a40f2dcffd",
"ref": "refs/heads/main"
}
}
}
[10:07:47.761] Invocation finished in 6h7m39.012531765s with status FAILED