[04:40:52.980] New invocation is queued and will start shortly
[04:40:53.989] Starting the invocation (attempt 1)
[04:40:54.018] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/80204a07951b2b562462880896a7981521ff87a0"
[04:40:54.018] Popped gitiles commit info from properties and tags
[04:40:54.018] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:40:54.018] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:40:54.019] Buildbucket request:
{
"requestId": "8846923969839005536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80204a07951b2b562462880896a7981521ff87a0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8846923969839005536"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:40:54.477] Scheduled build:
{
"id": "8681493908040039233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30569,
"createdBy": "project:chromium",
"createTime": "2026-05-18T04:40:54.072560065Z",
"updateTime": "2026-05-18T04:40:54.072560065Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80204a07951b2b562462880896a7981521ff87a0",
"ref": "refs/heads/main"
}
}
}
[04:40:54.477] Task URL: https://cr-buildbucket.appspot.com/build/8681493908040039233
[04:40:54.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:2:0) after 1m43s
[04:40:55.499] Received PubSub notification, asking Buildbucket for the build status
[04:40:55.517] Build status: SCHEDULED
[04:42:00.155] Received PubSub notification, asking Buildbucket for the build status
[04:42:00.173] Build status: STARTED
[04:42:37.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:2:0)
[04:42:37.591] Build status: STARTED
[04:42:37.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:5:0) after 4m42s
[04:47:19.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:5:0)
[04:47:19.723] Build status: STARTED
[04:47:19.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:6:0) after 4m28s
[04:51:47.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:6:0)
[04:51:47.772] Build status: STARTED
[04:51:47.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:7:0) after 1m20s
[04:53:07.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:7:0)
[04:53:07.899] Build status: STARTED
[04:53:07.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:8:0) after 4m28s
[04:57:35.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:8:0)
[04:57:36.001] Build status: STARTED
[04:57:36.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:9:0) after 9m54s
[05:07:30.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:9:0)
[05:07:30.096] Build status: STARTED
[05:07:30.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:10:0) after 9m24s
[05:16:54.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:10:0)
[05:16:54.162] Build status: STARTED
[05:16:54.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:11:0) after 8m37s
[05:25:31.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:11:0)
[05:25:31.301] Build status: STARTED
[05:25:31.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:12:0) after 2m31s
[05:28:02.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:12:0)
[05:28:02.727] Build status: STARTED
[05:28:02.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:13:0) after 9m46s
[05:37:48.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:13:0)
[05:37:48.904] Build status: STARTED
[05:37:48.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:14:0) after 8m59s
[05:46:47.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:14:0)
[05:46:48.001] Build status: STARTED
[05:46:48.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:15:0) after 3m50s
[05:50:38.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:15:0)
[05:50:38.143] Build status: STARTED
[05:50:38.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:16:0) after 7m46s
[05:58:24.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:16:0)
[05:58:24.366] Build status: STARTED
[05:58:24.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:17:0) after 4m7s
[06:02:31.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:17:0)
[06:02:31.413] Build status: STARTED
[06:02:31.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:18:0) after 4m51s
[06:07:22.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:18:0)
[06:07:22.451] Build status: STARTED
[06:07:22.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:19:0) after 3m12s
[06:10:34.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:19:0)
[06:10:34.496] Build status: STARTED
[06:10:34.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:20:0) after 4m24s
[06:14:58.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:20:0)
[06:14:58.498] Build status: STARTED
[06:14:58.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:21:0) after 3m53s
[06:18:51.735] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:21:0)
[06:18:51.756] Build status: STARTED
[06:18:51.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:22:0) after 2m47s
[06:21:38.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:22:0)
[06:21:38.935] Build status: STARTED
[06:21:38.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:23:0) after 3m20s
[06:24:58.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:23:0)
[06:24:58.965] Build status: STARTED
[06:24:58.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:24:0) after 9m14s
[06:34:13.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:24:0)
[06:34:13.060] Build status: STARTED
[06:34:13.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:25:0) after 1m50s
[06:36:03.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:25:0)
[06:36:03.416] Build status: STARTED
[06:36:03.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:26:0) after 8m15s
[06:44:18.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:26:0)
[06:44:18.449] Build status: STARTED
[06:44:18.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:27:0) after 8m36s
[06:52:54.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:27:0)
[06:52:54.479] Build status: STARTED
[06:52:54.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:28:0) after 3m25s
[06:56:19.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:28:0)
[06:56:19.747] Build status: STARTED
[06:56:19.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:29:0) after 4m47s
[07:01:06.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:29:0)
[07:01:06.899] Build status: STARTED
[07:01:06.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:30:0) after 3m53s
[07:05:00.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:30:0)
[07:05:00.190] Build status: STARTED
[07:05:00.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:31:0) after 2m19s
[07:07:19.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:31:0)
[07:07:19.237] Build status: STARTED
[07:07:19.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:32:0) after 3m17s
[07:10:36.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:32:0)
[07:10:36.393] Build status: STARTED
[07:10:36.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:33:0) after 7m11s
[07:17:47.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:33:0)
[07:17:47.579] Build status: STARTED
[07:17:47.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:34:0) after 2m25s
[07:20:12.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:34:0)
[07:20:12.779] Build status: STARTED
[07:20:12.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:35:0) after 6m24s
[07:26:36.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:35:0)
[07:26:36.894] Build status: STARTED
[07:26:36.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:36:0) after 2m52s
[07:29:28.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:36:0)
[07:29:29.418] Build status: STARTED
[07:29:29.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:37:0) after 8m53s
[07:38:22.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:37:0)
[07:38:22.661] Build status: STARTED
[07:38:22.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8846923969839005536:38:0) after 8m11s
[07:38:43.274] Received PubSub notification, asking Buildbucket for the build status
[07:38:43.290] Build:
{
"id": "8681493908040039233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30569,
"createdBy": "project:chromium",
"createTime": "2026-05-18T04:40:54.072560065Z",
"startTime": "2026-05-18T04:41:59.996187223Z",
"endTime": "2026-05-18T07:38:42.778812201Z",
"updateTime": "2026-05-18T07:38:42.778812201Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80204a07951b2b562462880896a7981521ff87a0",
"ref": "refs/heads/main"
}
}
}
[07:38:43.290] Invocation finished in 2h57m50.317046254s with status FAILED