[04:04:28.435] New invocation is queued and will start shortly
[04:04:29.833] Starting the invocation (attempt 1)
[04:04:29.858] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/30a004c128a86aa8d898f64b1bc2a1f67645734e"
[04:04:29.858] Popped gitiles commit info from properties and tags
[04:04:29.858] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:04:29.858] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:04:29.858] Buildbucket request:
{
"requestId": "8858250881301796800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "30a004c128a86aa8d898f64b1bc2a1f67645734e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8858250881301796800"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:04:30.894] Scheduled build:
{
"id": "8692820819072348449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 28902,
"createdBy": "project:chromium",
"createTime": "2026-01-13T04:04:29.937303331Z",
"updateTime": "2026-01-13T04:04:29.937303331Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "30a004c128a86aa8d898f64b1bc2a1f67645734e",
"ref": "refs/heads/main"
}
}
}
[04:04:30.894] Task URL: https://cr-buildbucket.appspot.com/build/8692820819072348449
[04:04:30.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:2:0) after 7m17s
[04:04:31.704] Received PubSub notification, asking Buildbucket for the build status
[04:04:31.718] Build status: SCHEDULED
[04:05:41.731] Received PubSub notification, asking Buildbucket for the build status
[04:05:41.748] Build status: STARTED
[04:11:47.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:2:0)
[04:11:47.971] Build status: STARTED
[04:11:47.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:5:0) after 4m13s
[04:16:00.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:5:0)
[04:16:01.016] Build status: STARTED
[04:16:01.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:6:0) after 8m0s
[04:24:01.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:6:0)
[04:24:01.049] Build status: STARTED
[04:24:01.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:7:0) after 1m33s
[04:25:34.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:7:0)
[04:25:34.082] Build status: STARTED
[04:25:34.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:8:0) after 4m29s
[04:30:03.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:8:0)
[04:30:03.113] Build status: STARTED
[04:30:03.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:9:0) after 7m26s
[04:37:29.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:9:0)
[04:37:29.273] Build status: STARTED
[04:37:29.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:10:0) after 6m40s
[04:44:09.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:10:0)
[04:44:09.344] Build status: STARTED
[04:44:09.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:11:0) after 7m18s
[04:51:27.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:11:0)
[04:51:27.594] Build status: STARTED
[04:51:27.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:12:0) after 6m8s
[04:57:35.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:12:0)
[04:57:35.632] Build status: STARTED
[04:57:35.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:13:0) after 1m27s
[04:59:02.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:13:0)
[04:59:02.714] Build status: STARTED
[04:59:02.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:14:0) after 7m39s
[05:06:41.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:14:0)
[05:06:41.760] Build status: STARTED
[05:06:41.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:15:0) after 2m50s
[05:09:31.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:15:0)
[05:09:31.794] Build status: STARTED
[05:09:31.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:16:0) after 2m58s
[05:12:29.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:16:0)
[05:12:29.846] Build status: STARTED
[05:12:29.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:17:0) after 7m25s
[05:19:54.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:17:0)
[05:19:54.960] Build status: STARTED
[05:19:54.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:18:0) after 2m19s
[05:22:14.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:18:0)
[05:22:14.029] Build status: STARTED
[05:22:14.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:19:0) after 1m21s
[05:23:35.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:19:0)
[05:23:35.068] Build status: STARTED
[05:23:35.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:20:0) after 1m26s
[05:25:01.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:20:0)
[05:25:01.170] Build status: STARTED
[05:25:01.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:21:0) after 7m8s
[05:32:09.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:21:0)
[05:32:09.420] Build status: STARTED
[05:32:09.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:22:0) after 3m43s
[05:35:52.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:22:0)
[05:35:52.496] Build status: STARTED
[05:35:52.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:23:0) after 2m5s
[05:37:57.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:23:0)
[05:37:57.597] Build status: STARTED
[05:37:57.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:24:0) after 7m26s
[05:45:23.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:24:0)
[05:45:23.614] Build status: STARTED
[05:45:23.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:25:0) after 3m38s
[05:49:01.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:25:0)
[05:49:01.645] Build status: STARTED
[05:49:01.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:26:0) after 2m0s
[05:51:01.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:26:0)
[05:51:01.806] Build status: STARTED
[05:51:01.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:27:0) after 5m44s
[05:56:45.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:27:0)
[05:56:45.883] Build status: STARTED
[05:56:45.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:28:0) after 2m54s
[05:59:39.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:28:0)
[05:59:39.935] Build status: STARTED
[05:59:39.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:29:0) after 9m39s
[06:09:19.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:29:0)
[06:09:19.094] Build status: STARTED
[06:09:19.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:30:0) after 9m34s
[06:18:53.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:30:0)
[06:18:53.181] Build status: STARTED
[06:18:53.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:31:0) after 7m3s
[06:25:56.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:31:0)
[06:25:56.169] Build status: STARTED
[06:25:56.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:32:0) after 3m52s
[06:29:48.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:32:0)
[06:29:48.227] Build status: STARTED
[06:29:48.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:33:0) after 1m44s
[06:31:32.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:33:0)
[06:31:32.414] Build status: STARTED
[06:31:32.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:34:0) after 3m12s
[06:34:44.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:34:0)
[06:34:44.488] Build status: STARTED
[06:34:44.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:35:0) after 9m40s
[06:44:24.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:35:0)
[06:44:24.561] Build status: STARTED
[06:44:24.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:36:0) after 3m9s
[06:47:33.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:36:0)
[06:47:33.600] Build status: STARTED
[06:47:33.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:37:0) after 8m38s
[06:56:11.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:37:0)
[06:56:11.665] Build status: STARTED
[06:56:11.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:38:0) after 6m10s
[07:02:21.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:38:0)
[07:02:21.705] Build status: STARTED
[07:02:21.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:39:0) after 8m36s
[07:10:57.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:39:0)
[07:10:57.747] Build status: STARTED
[07:10:57.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8858250881301796800:40:0) after 4m40s
[07:15:17.561] Received PubSub notification, asking Buildbucket for the build status
[07:15:17.578] Build:
{
"id": "8692820819072348449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 28902,
"createdBy": "project:chromium",
"createTime": "2026-01-13T04:04:29.937303331Z",
"startTime": "2026-01-13T04:05:41.514205070Z",
"endTime": "2026-01-13T07:15:17.304318863Z",
"updateTime": "2026-01-13T07:15:17.304318863Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "30a004c128a86aa8d898f64b1bc2a1f67645734e",
"ref": "refs/heads/main"
}
}
}
[07:15:17.578] Invocation finished in 3h10m49.1510412s with status FAILED