[05:42:12.631] New invocation is queued and will start shortly
[05:42:13.703] Starting the invocation (attempt 1)
[05:42:13.728] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5c2d9996316971d5b4fdd556f77200d44e78a77d"
[05:42:13.728] Popped gitiles commit info from properties and tags
[05:42:13.728] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:42:13.728] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:42:13.729] Buildbucket request:
{
"requestId": "8850815780999150688",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c2d9996316971d5b4fdd556f77200d44e78a77d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850815780999150688"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:42:14.885] Scheduled build:
{
"id": "8685385718968421633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29995,
"createdBy": "project:chromium",
"createTime": "2026-04-05T05:42:13.946610296Z",
"updateTime": "2026-04-05T05:42:13.946610296Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c2d9996316971d5b4fdd556f77200d44e78a77d",
"ref": "refs/heads/main"
}
}
}
[05:42:14.885] Task URL: https://cr-buildbucket.appspot.com/build/8685385718968421633
[05:42:14.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:2:0) after 3m55s
[05:42:15.868] Received PubSub notification, asking Buildbucket for the build status
[05:42:15.889] Build status: SCHEDULED
[05:43:23.855] Received PubSub notification, asking Buildbucket for the build status
[05:43:23.899] Build status: STARTED
[05:46:09.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:2:0)
[05:46:09.941] Build status: STARTED
[05:46:09.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:5:0) after 9m21s
[05:55:30.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:5:0)
[05:55:30.971] Build status: STARTED
[05:55:30.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:6:0) after 7m32s
[06:03:02.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:6:0)
[06:03:03.005] Build status: STARTED
[06:03:03.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:7:0) after 7m5s
[06:10:08.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:7:0)
[06:10:08.100] Build status: STARTED
[06:10:08.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:8:0) after 8m30s
[06:18:38.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:8:0)
[06:18:38.191] Build status: STARTED
[06:18:38.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:9:0) after 2m32s
[06:21:10.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:9:0)
[06:21:10.240] Build status: STARTED
[06:21:10.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:10:0) after 1m22s
[06:22:32.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:10:0)
[06:22:32.297] Build status: STARTED
[06:22:32.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:11:0) after 9m13s
[06:31:45.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:11:0)
[06:31:45.323] Build status: STARTED
[06:31:45.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:12:0) after 2m45s
[06:34:30.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:12:0)
[06:34:30.470] Build status: STARTED
[06:34:30.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:13:0) after 9m48s
[06:44:18.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:13:0)
[06:44:18.539] Build status: STARTED
[06:44:18.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:14:0) after 1m30s
[06:45:48.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:14:0)
[06:45:48.654] Build status: STARTED
[06:45:48.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:15:0) after 5m45s
[06:51:33.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:15:0)
[06:51:33.688] Build status: STARTED
[06:51:33.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:16:0) after 9m58s
[07:01:32.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:16:0)
[07:01:32.301] Build status: STARTED
[07:01:32.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:17:0) after 5m22s
[07:06:54.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:17:0)
[07:06:54.331] Build status: STARTED
[07:06:54.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:18:0) after 8m31s
[07:15:25.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:18:0)
[07:15:25.358] Build status: STARTED
[07:15:25.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:19:0) after 5m21s
[07:20:46.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:19:0)
[07:20:46.421] Build status: STARTED
[07:20:46.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:20:0) after 8m33s
[07:29:19.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:20:0)
[07:29:19.459] Build status: STARTED
[07:29:19.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:21:0) after 1m54s
[07:31:13.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:21:0)
[07:31:13.505] Build status: STARTED
[07:31:13.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:22:0) after 2m45s
[07:33:58.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:22:0)
[07:33:58.806] Build status: STARTED
[07:33:58.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:23:0) after 8m52s
[07:42:50.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:23:0)
[07:42:50.873] Build status: STARTED
[07:42:50.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:24:0) after 7m47s
[07:50:37.887] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:24:0)
[07:50:37.902] Build status: STARTED
[07:50:37.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:25:0) after 9m33s
[08:00:10.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:25:0)
[08:00:10.949] Build status: STARTED
[08:00:10.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:26:0) after 2m43s
[08:02:53.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:26:0)
[08:02:53.965] Build status: STARTED
[08:02:53.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:27:0) after 1m37s
[08:04:31.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:27:0)
[08:04:31.201] Build status: STARTED
[08:04:31.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:28:0) after 3m25s
[08:07:56.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:28:0)
[08:07:56.197] Build status: STARTED
[08:07:56.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:29:0) after 7m29s
[08:15:25.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:29:0)
[08:15:25.217] Build status: STARTED
[08:15:25.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:30:0) after 5m25s
[08:20:50.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:30:0)
[08:20:50.350] Build status: STARTED
[08:20:50.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:31:0) after 3m56s
[08:24:46.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:31:0)
[08:24:46.904] Build status: STARTED
[08:24:46.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:32:0) after 1m15s
[08:26:02.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:32:0)
[08:26:02.071] Build status: STARTED
[08:26:02.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850815780999150688:33:0) after 8m37s
[08:33:10.770] Received PubSub notification, asking Buildbucket for the build status
[08:33:10.785] Build:
{
"id": "8685385718968421633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29995,
"createdBy": "project:chromium",
"createTime": "2026-04-05T05:42:13.946610296Z",
"startTime": "2026-04-05T05:43:17.059829386Z",
"endTime": "2026-04-05T08:33:09.543860556Z",
"updateTime": "2026-04-05T08:33:09.543860556Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c2d9996316971d5b4fdd556f77200d44e78a77d",
"ref": "refs/heads/main"
}
}
}
[08:33:10.785] Invocation finished in 2h50m58.159871905s with status FAILED