[17:59:00.558] New invocation is queued and will start shortly
[17:59:06.370] Starting the invocation (attempt 1)
[17:59:06.399] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b0fbb438d48152d8ef139020a8fa78965afbf4a9"
[17:59:06.399] Popped gitiles commit info from properties and tags
[17:59:06.400] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:59:06.400] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:59:06.400] Buildbucket request:
{
"requestId": "8848504501467121888",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b0fbb438d48152d8ef139020a8fa78965afbf4a9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848504501467121888"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:59:06.951] Scheduled build:
{
"id": "8683074434595693505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30361,
"createdBy": "project:chromium",
"createTime": "2026-04-30T17:59:06.490399573Z",
"updateTime": "2026-04-30T17:59:06.490399573Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b0fbb438d48152d8ef139020a8fa78965afbf4a9",
"ref": "refs/heads/main"
}
}
}
[17:59:06.951] Task URL: https://cr-buildbucket.appspot.com/build/8683074434595693505
[17:59:06.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:2:0) after 3m24s
[17:59:07.967] Received PubSub notification, asking Buildbucket for the build status
[17:59:07.984] Build status: SCHEDULED
[18:00:08.659] Received PubSub notification, asking Buildbucket for the build status
[18:00:08.687] Build status: STARTED
[18:02:30.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:2:0)
[18:02:30.989] Build status: STARTED
[18:02:30.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:5:0) after 7m59s
[18:10:30.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:5:0)
[18:10:30.212] Build status: STARTED
[18:10:30.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:6:0) after 6m14s
[18:16:44.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:6:0)
[18:16:44.305] Build status: STARTED
[18:16:44.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:7:0) after 1m55s
[18:18:39.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:7:0)
[18:18:39.338] Build status: STARTED
[18:18:39.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:8:0) after 2m57s
[18:21:36.486] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:8:0)
[18:21:36.502] Build status: STARTED
[18:21:36.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:9:0) after 9m53s
[18:31:29.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:9:0)
[18:31:29.540] Build status: STARTED
[18:31:29.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:10:0) after 8m54s
[18:40:23.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:10:0)
[18:40:23.580] Build status: STARTED
[18:40:23.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:11:0) after 6m43s
[18:47:06.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:11:0)
[18:47:06.676] Build status: STARTED
[18:47:06.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:12:0) after 7m30s
[18:54:36.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:12:0)
[18:54:36.779] Build status: STARTED
[18:54:36.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:13:0) after 3m4s
[18:57:40.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:13:0)
[18:57:40.847] Build status: STARTED
[18:57:40.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:14:0) after 2m9s
[18:59:49.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:14:0)
[18:59:49.923] Build status: STARTED
[18:59:49.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:15:0) after 2m9s
[19:01:59.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:15:0)
[19:01:59.024] Build status: STARTED
[19:01:59.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:16:0) after 7m14s
[19:09:13.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:16:0)
[19:09:13.116] Build status: STARTED
[19:09:13.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:17:0) after 3m43s
[19:12:56.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:17:0)
[19:12:56.205] Build status: STARTED
[19:12:56.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:18:0) after 5m24s
[19:18:20.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:18:0)
[19:18:20.291] Build status: STARTED
[19:18:20.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:19:0) after 4m4s
[19:22:24.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:19:0)
[19:22:24.326] Build status: STARTED
[19:22:24.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:20:0) after 2m47s
[19:25:11.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:20:0)
[19:25:11.440] Build status: STARTED
[19:25:11.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:21:0) after 5m14s
[19:30:25.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:21:0)
[19:30:25.519] Build status: STARTED
[19:30:25.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:22:0) after 2m35s
[19:33:00.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:22:0)
[19:33:00.564] Build status: STARTED
[19:33:00.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:23:0) after 6m36s
[19:39:36.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:23:0)
[19:39:36.677] Build status: STARTED
[19:39:36.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:24:0) after 4m39s
[19:44:15.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:24:0)
[19:44:15.718] Build status: STARTED
[19:44:15.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:25:0) after 8m16s
[19:52:31.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:25:0)
[19:52:31.753] Build status: STARTED
[19:52:31.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:26:0) after 6m32s
[19:59:03.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:26:0)
[19:59:03.903] Build status: STARTED
[19:59:03.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:27:0) after 3m14s
[20:02:18.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:27:0)
[20:02:18.077] Build status: STARTED
[20:02:18.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:28:0) after 7m0s
[20:09:18.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:28:0)
[20:09:18.344] Build status: STARTED
[20:09:18.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:29:0) after 5m5s
[20:14:23.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:29:0)
[20:14:23.482] Build status: STARTED
[20:14:23.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:30:0) after 7m13s
[20:21:36.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:30:0)
[20:21:36.531] Build status: STARTED
[20:21:36.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:31:0) after 8m32s
[20:30:08.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:31:0)
[20:30:08.611] Build status: STARTED
[20:30:08.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:32:0) after 9m19s
[20:39:27.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:32:0)
[20:39:27.679] Build status: STARTED
[20:39:27.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:33:0) after 6m14s
[20:45:41.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:33:0)
[20:45:41.773] Build status: STARTED
[20:45:41.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:34:0) after 3m27s
[20:49:08.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:34:0)
[20:49:08.859] Build status: STARTED
[20:49:08.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:35:0) after 7m25s
[20:56:34.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:35:0)
[20:56:34.041] Build status: STARTED
[20:56:34.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:36:0) after 5m47s
[21:02:21.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:36:0)
[21:02:21.183] Build status: STARTED
[21:02:21.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:37:0) after 2m53s
[21:05:14.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:37:0)
[21:05:14.226] Build status: STARTED
[21:05:14.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:38:0) after 3m45s
[21:08:59.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:38:0)
[21:08:59.268] Build status: STARTED
[21:08:59.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:39:0) after 4m33s
[21:13:32.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:39:0)
[21:13:32.325] Build status: STARTED
[21:13:32.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:40:0) after 9m59s
[21:23:31.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:40:0)
[21:23:31.364] Build status: STARTED
[21:23:31.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:41:0) after 5m32s
[21:29:03.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:41:0)
[21:29:03.442] Build status: STARTED
[21:29:03.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:42:0) after 2m4s
[21:31:07.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:42:0)
[21:31:07.530] Build status: STARTED
[21:31:07.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848504501467121888:43:0) after 2m51s
[21:33:51.408] Received PubSub notification, asking Buildbucket for the build status
[21:33:51.430] Build:
{
"id": "8683074434595693505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30361,
"createdBy": "project:chromium",
"createTime": "2026-04-30T17:59:06.490399573Z",
"startTime": "2026-04-30T18:00:08.380589901Z",
"endTime": "2026-04-30T21:33:50.734424089Z",
"updateTime": "2026-04-30T21:33:50.734424089Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b0fbb438d48152d8ef139020a8fa78965afbf4a9",
"ref": "refs/heads/main"
}
}
}
[21:33:51.430] Invocation finished in 3h34m50.877154685s with status FAILED