[21:32:10.253] New invocation is queued and will start shortly
[21:32:11.324] Starting the invocation (attempt 1)
[21:32:11.350] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d1db08eb05edf3464d3eb53a50208dd2c768a311"
[21:32:11.350] Popped gitiles commit info from properties and tags
[21:32:11.350] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:32:11.350] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:32:11.350] Buildbucket request:
{
"requestId": "8848581687466732864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1db08eb05edf3464d3eb53a50208dd2c768a311",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848581687466732864"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:32:11.829] Scheduled build:
{
"id": "8683151625589034673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30351,
"createdBy": "project:chromium",
"createTime": "2026-04-29T21:32:11.422169514Z",
"updateTime": "2026-04-29T21:32:11.422169514Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1db08eb05edf3464d3eb53a50208dd2c768a311",
"ref": "refs/heads/main"
}
}
}
[21:32:11.829] Task URL: https://cr-buildbucket.appspot.com/build/8683151625589034673
[21:32:11.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:2:0) after 4m55s
[21:32:11.927] Received PubSub notification, asking Buildbucket for the build status
[21:32:11.975] Build status: SCHEDULED
[21:32:16.446] Received PubSub notification, asking Buildbucket for the build status
[21:32:16.464] Build status: STARTED
[21:37:06.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:2:0)
[21:37:06.872] Build status: STARTED
[21:37:06.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:5:0) after 6m2s
[21:43:08.897] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:5:0)
[21:43:08.920] Build status: STARTED
[21:43:08.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:6:0) after 9m32s
[21:52:41.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:6:0)
[21:52:41.125] Build status: STARTED
[21:52:41.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:7:0) after 8m26s
[22:01:07.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:7:0)
[22:01:07.492] Build status: STARTED
[22:01:07.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:8:0) after 4m11s
[22:05:19.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:8:0)
[22:05:19.019] Build status: STARTED
[22:05:19.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:9:0) after 2m6s
[22:07:25.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:9:0)
[22:07:25.078] Build status: STARTED
[22:07:25.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:10:0) after 7m56s
[22:15:21.136] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:10:0)
[22:15:21.156] Build status: STARTED
[22:15:21.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:11:0) after 9m0s
[22:24:21.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:11:0)
[22:24:21.262] Build status: STARTED
[22:24:21.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:12:0) after 2m13s
[22:26:34.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:12:0)
[22:26:34.297] Build status: STARTED
[22:26:34.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:13:0) after 3m46s
[22:30:20.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:13:0)
[22:30:20.375] Build status: STARTED
[22:30:20.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:14:0) after 8m3s
[22:38:23.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:14:0)
[22:38:23.410] Build status: STARTED
[22:38:23.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:15:0) after 5m35s
[22:43:58.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:15:0)
[22:43:58.585] Build status: STARTED
[22:43:58.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:16:0) after 3m50s
[22:47:48.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:16:0)
[22:47:48.626] Build status: STARTED
[22:47:48.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:17:0) after 9m21s
[22:57:09.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:17:0)
[22:57:09.802] Build status: STARTED
[22:57:09.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:18:0) after 7m21s
[23:04:30.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:18:0)
[23:04:30.838] Build status: STARTED
[23:04:30.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:19:0) after 4m40s
[23:09:10.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:19:0)
[23:09:11.010] Build status: STARTED
[23:09:11.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:20:0) after 2m24s
[23:11:35.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:20:0)
[23:11:35.068] Build status: STARTED
[23:11:35.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:21:0) after 8m55s
[23:20:30.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:21:0)
[23:20:30.117] Build status: STARTED
[23:20:30.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:22:0) after 3m0s
[23:23:30.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:22:0)
[23:23:30.147] Build status: STARTED
[23:23:30.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:23:0) after 2m8s
[23:25:38.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:23:0)
[23:25:38.506] Build status: STARTED
[23:25:38.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:24:0) after 1m19s
[23:26:57.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:24:0)
[23:26:57.649] Build status: STARTED
[23:26:57.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:25:0) after 9m43s
[23:36:40.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:25:0)
[23:36:40.866] Build status: STARTED
[23:36:40.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:26:0) after 7m36s
[23:44:16.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:26:0)
[23:44:17.071] Build status: STARTED
[23:44:17.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:27:0) after 2m44s
[23:47:01.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:27:0)
[23:47:01.249] Build status: STARTED
[23:47:01.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:28:0) after 4m56s
[23:51:57.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:28:0)
[23:51:57.270] Build status: STARTED
[23:51:57.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:29:0) after 6m27s
[23:58:24.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:29:0)
[23:58:24.386] Build status: STARTED
[23:58:24.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:30:0) after 5m20s
[00:03:44.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:30:0)
[00:03:44.423] Build status: STARTED
[00:03:44.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:31:0) after 7m36s
[00:11:20.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:31:0)
[00:11:20.594] Build status: STARTED
[00:11:20.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:32:0) after 9m6s
[00:20:26.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:32:0)
[00:20:26.778] Build status: STARTED
[00:20:26.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:33:0) after 9m37s
[00:30:03.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:33:0)
[00:30:03.982] Build status: STARTED
[00:30:03.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:34:0) after 1m11s
[00:31:15.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:34:0)
[00:31:15.182] Build status: STARTED
[00:31:15.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:35:0) after 9m56s
[00:41:11.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:35:0)
[00:41:11.328] Build status: STARTED
[00:41:11.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:36:0) after 3m12s
[00:44:23.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:36:0)
[00:44:23.374] Build status: STARTED
[00:44:23.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:37:0) after 7m49s
[00:52:12.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:37:0)
[00:52:12.498] Build status: STARTED
[00:52:12.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:38:0) after 5m35s
[00:57:47.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:38:0)
[00:57:47.669] Build status: STARTED
[00:57:47.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:39:0) after 2m17s
[01:00:04.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:39:0)
[01:00:05.021] Build status: STARTED
[01:00:05.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:40:0) after 4m7s
[01:04:12.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:40:0)
[01:04:12.173] Build status: STARTED
[01:04:12.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:41:0) after 8m32s
[01:12:44.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:41:0)
[01:12:44.265] Build status: STARTED
[01:12:44.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848581687466732864:42:0) after 6m10s
[01:16:45.893] Received PubSub notification, asking Buildbucket for the build status
[01:16:45.915] Build:
{
"id": "8683151625589034673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30351,
"createdBy": "project:chromium",
"createTime": "2026-04-29T21:32:11.422169514Z",
"startTime": "2026-04-29T21:32:16.263988474Z",
"endTime": "2026-04-30T01:16:45.625434749Z",
"updateTime": "2026-04-30T01:16:45.625434749Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1db08eb05edf3464d3eb53a50208dd2c768a311",
"ref": "refs/heads/main"
}
}
}
[01:16:45.915] Invocation finished in 3h44m35.667455296s with status FAILED