[21:13:38.060] New invocation is queued and will start shortly
[21:13:39.123] Starting the invocation (attempt 1)
[21:13:39.146] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/325529b70527af42ee93487b2352f42a51cedef4"
[21:13:39.146] Popped gitiles commit info from properties and tags
[21:13:39.146] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:13:39.146] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:13:39.146] Buildbucket request:
{
"requestId": "8850847777847345264",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "325529b70527af42ee93487b2352f42a51cedef4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850847777847345264"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:13:39.929] Scheduled build:
{
"id": "8685417715971736417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29992,
"createdBy": "project:chromium",
"createTime": "2026-04-04T21:13:39.225402138Z",
"updateTime": "2026-04-04T21:13:39.225402138Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "325529b70527af42ee93487b2352f42a51cedef4",
"ref": "refs/heads/main"
}
}
}
[21:13:39.929] Task URL: https://cr-buildbucket.appspot.com/build/8685417715971736417
[21:13:39.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:2:0) after 9m54s
[21:13:40.641] Received PubSub notification, asking Buildbucket for the build status
[21:13:40.666] Build status: SCHEDULED
[21:14:41.935] Received PubSub notification, asking Buildbucket for the build status
[21:14:41.976] Build status: STARTED
[21:23:33.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:2:0)
[21:23:33.982] Build status: STARTED
[21:23:33.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:5:0) after 4m29s
[21:28:02.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:5:0)
[21:28:03.016] Build status: STARTED
[21:28:03.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:6:0) after 9m46s
[21:37:49.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:6:0)
[21:37:49.197] Build status: STARTED
[21:37:49.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:7:0) after 5m19s
[21:43:08.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:7:0)
[21:43:08.235] Build status: STARTED
[21:43:08.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:8:0) after 4m24s
[21:47:32.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:8:0)
[21:47:32.284] Build status: STARTED
[21:47:32.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:9:0) after 9m8s
[21:56:40.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:9:0)
[21:56:40.343] Build status: STARTED
[21:56:40.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:10:0) after 1m21s
[21:58:01.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:10:0)
[21:58:01.405] Build status: STARTED
[21:58:01.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:11:0) after 7m22s
[22:05:23.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:11:0)
[22:05:23.444] Build status: STARTED
[22:05:23.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:12:0) after 9m33s
[22:14:56.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:12:0)
[22:14:56.476] Build status: STARTED
[22:14:56.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:13:0) after 2m37s
[22:17:33.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:13:0)
[22:17:33.568] Build status: STARTED
[22:17:33.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:14:0) after 7m7s
[22:24:40.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:14:0)
[22:24:40.655] Build status: STARTED
[22:24:40.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:15:0) after 2m44s
[22:27:24.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:15:0)
[22:27:24.692] Build status: STARTED
[22:27:24.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:16:0) after 2m46s
[22:30:10.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:16:0)
[22:30:10.726] Build status: STARTED
[22:30:10.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:17:0) after 9m55s
[22:40:05.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:17:0)
[22:40:05.911] Build status: STARTED
[22:40:05.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:18:0) after 6m43s
[22:46:48.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:18:0)
[22:46:48.950] Build status: STARTED
[22:46:48.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:19:0) after 9m7s
[22:55:56.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:19:0)
[22:55:56.669] Build status: STARTED
[22:55:56.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:20:0) after 2m19s
[22:58:15.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:20:0)
[22:58:15.742] Build status: STARTED
[22:58:15.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:21:0) after 1m50s
[23:00:05.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:21:0)
[23:00:05.789] Build status: STARTED
[23:00:05.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:22:0) after 6m55s
[23:07:00.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:22:0)
[23:07:00.823] Build status: STARTED
[23:07:00.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:23:0) after 3m49s
[23:10:50.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:23:0)
[23:10:50.077] Build status: STARTED
[23:10:50.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:24:0) after 8m21s
[23:19:11.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:24:0)
[23:19:11.208] Build status: STARTED
[23:19:11.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:25:0) after 8m3s
[23:27:14.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:25:0)
[23:27:14.243] Build status: STARTED
[23:27:14.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:26:0) after 7m49s
[23:35:03.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:26:0)
[23:35:03.523] Build status: STARTED
[23:35:03.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:27:0) after 6m27s
[23:41:30.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:27:0)
[23:41:30.554] Build status: STARTED
[23:41:30.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:28:0) after 4m31s
[23:46:01.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:28:0)
[23:46:01.588] Build status: STARTED
[23:46:01.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:29:0) after 7m5s
[23:53:06.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:29:0)
[23:53:06.871] Build status: STARTED
[23:53:06.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:30:0) after 2m19s
[23:55:26.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:30:0)
[23:55:26.085] Build status: STARTED
[23:55:26.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:31:0) after 9m39s
[00:05:05.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:31:0)
[00:05:05.138] Build status: STARTED
[00:05:05.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850847777847345264:32:0) after 6m22s
[00:05:51.199] Received PubSub notification, asking Buildbucket for the build status
[00:05:51.216] Build:
{
"id": "8685417715971736417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29992,
"createdBy": "project:chromium",
"createTime": "2026-04-04T21:13:39.225402138Z",
"startTime": "2026-04-04T21:14:41.696375743Z",
"endTime": "2026-04-05T00:05:50.783640949Z",
"updateTime": "2026-04-05T00:05:50.783640949Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "325529b70527af42ee93487b2352f42a51cedef4",
"ref": "refs/heads/main"
}
}
}
[00:05:51.216] Invocation finished in 2h52m13.162763873s with status FAILED