[20:18:02.789] New invocation is queued and will start shortly
[20:18:03.998] Starting the invocation (attempt 1)
[20:18:04.021] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8f84a8b7cddba92491ac40a8484d379a803348b0"
[20:18:04.021] Popped gitiles commit info from properties and tags
[20:18:04.021] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:18:04.021] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:18:04.021] Buildbucket request:
{
"requestId": "8850760678172783216",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f84a8b7cddba92491ac40a8484d379a803348b0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850760678172783216"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:18:04.691] Scheduled build:
{
"id": "8685330616160491521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30002,
"createdBy": "project:chromium",
"createTime": "2026-04-05T20:18:04.078134381Z",
"updateTime": "2026-04-05T20:18:04.078134381Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f84a8b7cddba92491ac40a8484d379a803348b0",
"ref": "refs/heads/main"
}
}
}
[20:18:04.691] Task URL: https://cr-buildbucket.appspot.com/build/8685330616160491521
[20:18:04.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:2:0) after 6m20s
[20:18:08.173] Received PubSub notification, asking Buildbucket for the build status
[20:18:08.197] Build status: SCHEDULED
[20:18:29.425] Received PubSub notification, asking Buildbucket for the build status
[20:18:29.448] Build status: STARTED
[20:24:25.070] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:2:0)
[20:24:25.087] Build status: STARTED
[20:24:25.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:5:0) after 4m59s
[20:29:24.171] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:5:0)
[20:29:24.188] Build status: STARTED
[20:29:24.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:6:0) after 2m17s
[20:31:41.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:6:0)
[20:31:41.330] Build status: STARTED
[20:31:41.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:7:0) after 1m32s
[20:33:13.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:7:0)
[20:33:13.351] Build status: STARTED
[20:33:13.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:8:0) after 2m13s
[20:35:26.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:8:0)
[20:35:26.392] Build status: STARTED
[20:35:26.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:9:0) after 6m15s
[20:41:41.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:9:0)
[20:41:41.432] Build status: STARTED
[20:41:41.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:10:0) after 9m26s
[20:51:07.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:10:0)
[20:51:07.476] Build status: STARTED
[20:51:07.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:11:0) after 5m13s
[20:56:20.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:11:0)
[20:56:20.500] Build status: STARTED
[20:56:20.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:12:0) after 7m15s
[21:03:35.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:12:0)
[21:03:35.877] Build status: STARTED
[21:03:35.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:13:0) after 8m53s
[21:12:28.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:13:0)
[21:12:28.943] Build status: STARTED
[21:12:28.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:14:0) after 4m38s
[21:17:06.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:14:0)
[21:17:06.994] Build status: STARTED
[21:17:06.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:15:0) after 8m46s
[21:25:53.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:15:0)
[21:25:53.156] Build status: STARTED
[21:25:53.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:16:0) after 1m23s
[21:27:16.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:16:0)
[21:27:16.299] Build status: STARTED
[21:27:16.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:17:0) after 3m20s
[21:30:36.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:17:0)
[21:30:36.456] Build status: STARTED
[21:30:36.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:18:0) after 7m14s
[21:37:50.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:18:0)
[21:37:50.491] Build status: STARTED
[21:37:50.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:19:0) after 9m16s
[21:47:06.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:19:0)
[21:47:06.557] Build status: STARTED
[21:47:06.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:20:0) after 5m13s
[21:52:19.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:20:0)
[21:52:19.605] Build status: STARTED
[21:52:19.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:21:0) after 7m52s
[22:00:11.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:21:0)
[22:00:11.710] Build status: STARTED
[22:00:11.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:22:0) after 6m40s
[22:06:51.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:22:0)
[22:06:51.786] Build status: STARTED
[22:06:51.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:23:0) after 4m27s
[22:11:18.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:23:0)
[22:11:18.959] Build status: STARTED
[22:11:18.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:24:0) after 6m14s
[22:17:32.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:24:0)
[22:17:33.072] Build status: STARTED
[22:17:33.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:25:0) after 1m10s
[22:18:43.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:25:0)
[22:18:43.127] Build status: STARTED
[22:18:43.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:26:0) after 4m6s
[22:22:49.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:26:0)
[22:22:49.130] Build status: STARTED
[22:22:49.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:27:0) after 5m3s
[22:27:52.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:27:0)
[22:27:52.189] Build status: STARTED
[22:27:52.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:28:0) after 3m46s
[22:31:38.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:28:0)
[22:31:38.293] Build status: STARTED
[22:31:38.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:29:0) after 4m2s
[22:35:40.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:29:0)
[22:35:40.412] Build status: STARTED
[22:35:40.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:30:0) after 7m32s
[22:43:12.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:30:0)
[22:43:12.644] Build status: STARTED
[22:43:12.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:31:0) after 2m18s
[22:45:30.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:31:0)
[22:45:30.651] Build status: STARTED
[22:45:30.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:32:0) after 6m9s
[22:51:39.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:32:0)
[22:51:39.756] Build status: STARTED
[22:51:39.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:33:0) after 2m40s
[22:54:19.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:33:0)
[22:54:19.789] Build status: STARTED
[22:54:19.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:34:0) after 6m17s
[23:00:36.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:34:0)
[23:00:36.820] Build status: STARTED
[23:00:36.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850760678172783216:35:0) after 4m7s
[23:04:26.645] Received PubSub notification, asking Buildbucket for the build status
[23:04:26.665] Build:
{
"id": "8685330616160491521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30002,
"createdBy": "project:chromium",
"createTime": "2026-04-05T20:18:04.078134381Z",
"startTime": "2026-04-05T20:18:27.777664399Z",
"endTime": "2026-04-05T23:04:26.392224964Z",
"updateTime": "2026-04-05T23:04:26.392224964Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f84a8b7cddba92491ac40a8484d379a803348b0",
"ref": "refs/heads/main"
}
}
}
[23:04:26.665] Invocation finished in 2h46m23.888259865s with status FAILED