[11:37:22.357] New invocation is queued and will start shortly
[11:37:23.415] Starting the invocation (attempt 1)
[11:37:23.444] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/77a0b8b49613ad643cd2aaa6d0a2a9fbbd3c7a8b"
[11:37:23.445] Popped gitiles commit info from properties and tags
[11:37:23.445] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:37:23.445] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:37:23.445] Buildbucket request:
{
"requestId": "8850612242203511568",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "77a0b8b49613ad643cd2aaa6d0a2a9fbbd3c7a8b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850612242203511568"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:37:23.897] Scheduled build:
{
"id": "8685182180337956289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30022,
"createdBy": "project:chromium",
"createTime": "2026-04-07T11:37:23.510469935Z",
"updateTime": "2026-04-07T11:37:23.510469935Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "77a0b8b49613ad643cd2aaa6d0a2a9fbbd3c7a8b",
"ref": "refs/heads/main"
}
}
}
[11:37:23.897] Task URL: https://cr-buildbucket.appspot.com/build/8685182180337956289
[11:37:23.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:2:0) after 3m19s
[11:37:33.379] Received PubSub notification, asking Buildbucket for the build status
[11:37:33.405] Build status: SCHEDULED
[11:38:16.338] Received PubSub notification, asking Buildbucket for the build status
[11:38:16.357] Build status: STARTED
[11:40:43.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:2:0)
[11:40:43.071] Build status: STARTED
[11:40:43.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:5:0) after 8m32s
[11:49:15.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:5:0)
[11:49:15.125] Build status: STARTED
[11:49:15.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:6:0) after 7m48s
[11:57:03.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:6:0)
[11:57:03.212] Build status: STARTED
[11:57:03.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:7:0) after 4m36s
[12:01:39.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:7:0)
[12:01:39.235] Build status: STARTED
[12:01:39.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:8:0) after 9m54s
[12:11:33.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:8:0)
[12:11:33.398] Build status: STARTED
[12:11:33.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:9:0) after 1m30s
[12:13:03.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:9:0)
[12:13:03.444] Build status: STARTED
[12:13:03.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:10:0) after 4m42s
[12:17:45.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:10:0)
[12:17:45.575] Build status: STARTED
[12:17:45.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:11:0) after 4m3s
[12:21:48.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:11:0)
[12:21:48.735] Build status: STARTED
[12:21:48.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:12:0) after 1m32s
[12:23:20.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:12:0)
[12:23:20.997] Build status: STARTED
[12:23:20.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:13:0) after 2m32s
[12:25:53.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:13:0)
[12:25:53.139] Build status: STARTED
[12:25:53.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:14:0) after 8m55s
[12:34:48.163] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:14:0)
[12:34:48.186] Build status: STARTED
[12:34:48.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:15:0) after 7m11s
[12:41:59.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:15:0)
[12:41:59.311] Build status: STARTED
[12:41:59.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:16:0) after 3m24s
[12:45:23.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:16:0)
[12:45:23.394] Build status: STARTED
[12:45:23.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:17:0) after 6m46s
[12:52:09.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:17:0)
[12:52:09.668] Build status: STARTED
[12:52:09.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:18:0) after 4m58s
[12:57:07.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:18:0)
[12:57:07.686] Build status: STARTED
[12:57:07.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:19:0) after 1m28s
[12:58:35.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:19:0)
[12:58:35.717] Build status: STARTED
[12:58:35.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:20:0) after 9m20s
[13:07:55.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:20:0)
[13:07:55.822] Build status: STARTED
[13:07:55.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:21:0) after 2m13s
[13:10:08.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:21:0)
[13:10:08.979] Build status: STARTED
[13:10:08.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:22:0) after 1m24s
[13:11:32.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:22:0)
[13:11:32.989] Build status: STARTED
[13:11:32.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:23:0) after 9m32s
[13:21:05.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:23:0)
[13:21:05.088] Build status: STARTED
[13:21:05.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:24:0) after 3m0s
[13:24:05.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:24:0)
[13:24:05.162] Build status: STARTED
[13:24:05.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:25:0) after 5m18s
[13:29:23.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:25:0)
[13:29:23.199] Build status: STARTED
[13:29:23.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:26:0) after 1m22s
[13:30:45.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:26:0)
[13:30:45.286] Build status: STARTED
[13:30:45.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:27:0) after 9m0s
[13:39:45.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:27:0)
[13:39:45.359] Build status: STARTED
[13:39:45.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:28:0) after 9m59s
[13:49:44.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:28:0)
[13:49:44.517] Build status: STARTED
[13:49:44.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:29:0) after 4m51s
[13:54:35.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:29:0)
[13:54:35.601] Build status: STARTED
[13:54:35.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:30:0) after 9m16s
[14:03:51.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:30:0)
[14:03:51.680] Build status: STARTED
[14:03:51.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:31:0) after 4m55s
[14:08:46.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:31:0)
[14:08:46.717] Build status: STARTED
[14:08:46.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:32:0) after 6m27s
[14:15:13.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:32:0)
[14:15:13.756] Build status: STARTED
[14:15:13.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:33:0) after 3m3s
[14:18:16.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:33:0)
[14:18:16.906] Build status: STARTED
[14:18:16.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:34:0) after 7m29s
[14:25:45.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:34:0)
[14:25:45.945] Build status: STARTED
[14:25:45.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:35:0) after 8m33s
[14:34:19.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:35:0)
[14:34:19.042] Build status: STARTED
[14:34:19.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:36:0) after 5m56s
[14:40:15.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:36:0)
[14:40:15.091] Build status: STARTED
[14:40:15.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:37:0) after 9m9s
[14:49:24.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:37:0)
[14:49:24.157] Build status: STARTED
[14:49:24.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:38:0) after 2m31s
[14:51:55.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:38:0)
[14:51:55.200] Build status: STARTED
[14:51:55.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850612242203511568:39:0) after 2m30s
[14:52:09.593] Received PubSub notification, asking Buildbucket for the build status
[14:52:09.612] Build:
{
"id": "8685182180337956289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30022,
"createdBy": "project:chromium",
"createTime": "2026-04-07T11:37:23.510469935Z",
"startTime": "2026-04-07T11:38:16.182444172Z",
"endTime": "2026-04-07T14:52:09.345752881Z",
"updateTime": "2026-04-07T14:52:09.345752881Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "77a0b8b49613ad643cd2aaa6d0a2a9fbbd3c7a8b",
"ref": "refs/heads/main"
}
}
}
[14:52:09.612] Invocation finished in 3h14m47.265477121s with status FAILED