[20:43:56.901] New invocation is queued and will start shortly
[20:43:59.374] Starting the invocation (attempt 1)
[20:43:59.401] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/739bc8e98d0fb0b2ac2b9d5ebbefbc89eae63786"
[20:43:59.401] Popped gitiles commit info from properties and tags
[20:43:59.401] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:43:59.401] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:43:59.401] Buildbucket request:
{
"requestId": "8839796815623913152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "739bc8e98d0fb0b2ac2b9d5ebbefbc89eae63786",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8839796815623913152"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:44:00.064] Scheduled build:
{
"id": "8674366752270525121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32021,
"createdBy": "project:chromium",
"createTime": "2026-08-04T20:43:59.479411256Z",
"updateTime": "2026-08-04T20:43:59.479411256Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "739bc8e98d0fb0b2ac2b9d5ebbefbc89eae63786",
"ref": "refs/heads/main"
}
}
}
[20:44:00.064] Task URL: https://cr-buildbucket.appspot.com/build/8674366752270525121
[20:44:00.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:2:0) after 1m58s
[20:44:05.492] Received PubSub notification, asking Buildbucket for the build status
[20:44:05.537] Build status: SCHEDULED
[20:44:17.685] Received PubSub notification, asking Buildbucket for the build status
[20:44:17.743] Build status: STARTED
[20:45:58.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:2:0)
[20:45:58.125] Build status: STARTED
[20:45:58.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:5:0) after 3m21s
[20:49:19.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:5:0)
[20:49:19.201] Build status: STARTED
[20:49:19.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:6:0) after 1m36s
[20:50:55.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:6:0)
[20:50:55.201] Build status: STARTED
[20:50:55.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:7:0) after 5m27s
[20:56:22.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:7:0)
[20:56:22.275] Build status: STARTED
[20:56:22.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:8:0) after 8m42s
[21:05:04.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:8:0)
[21:05:04.380] Build status: STARTED
[21:05:04.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:9:0) after 1m57s
[21:07:01.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:9:0)
[21:07:01.623] Build status: STARTED
[21:07:01.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:10:0) after 5m30s
[21:12:31.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:10:0)
[21:12:31.695] Build status: STARTED
[21:12:31.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:11:0) after 9m46s
[21:22:17.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:11:0)
[21:22:17.800] Build status: STARTED
[21:22:17.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:12:0) after 2m27s
[21:24:44.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:12:0)
[21:24:44.872] Build status: STARTED
[21:24:44.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:13:0) after 7m54s
[21:32:38.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:13:0)
[21:32:38.920] Build status: STARTED
[21:32:38.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:14:0) after 3m48s
[21:36:27.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:14:0)
[21:36:27.066] Build status: STARTED
[21:36:27.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:15:0) after 4m55s
[21:41:22.070] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:15:0)
[21:41:22.092] Build status: STARTED
[21:41:22.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:16:0) after 7m26s
[21:48:48.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:16:0)
[21:48:48.164] Build status: STARTED
[21:48:48.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:17:0) after 9m55s
[21:58:43.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:17:0)
[21:58:43.280] Build status: STARTED
[21:58:43.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:18:0) after 1m45s
[22:00:28.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:18:0)
[22:00:28.332] Build status: STARTED
[22:00:28.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:19:0) after 7m11s
[22:07:39.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:19:0)
[22:07:39.481] Build status: STARTED
[22:07:39.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:20:0) after 8m33s
[22:16:12.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:20:0)
[22:16:12.654] Build status: STARTED
[22:16:12.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:21:0) after 1m19s
[22:17:31.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:21:0)
[22:17:31.692] Build status: STARTED
[22:17:31.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:22:0) after 2m48s
[22:20:19.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:22:0)
[22:20:19.767] Build status: STARTED
[22:20:19.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:23:0) after 7m17s
[22:27:36.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:23:0)
[22:27:36.895] Build status: STARTED
[22:27:36.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:24:0) after 8m31s
[22:36:07.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:24:0)
[22:36:07.900] Build status: STARTED
[22:36:07.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:25:0) after 3m36s
[22:39:44.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:25:0)
[22:39:44.113] Build status: STARTED
[22:39:44.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:26:0) after 5m5s
[22:44:49.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:26:0)
[22:44:49.287] Build status: STARTED
[22:44:49.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:27:0) after 8m14s
[22:53:03.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:27:0)
[22:53:03.379] Build status: STARTED
[22:53:03.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:28:0) after 7m35s
[23:00:38.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:28:0)
[23:00:38.419] Build status: STARTED
[23:00:38.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:29:0) after 6m22s
[23:07:00.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:29:0)
[23:07:00.713] Build status: STARTED
[23:07:00.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:30:0) after 9m1s
[23:16:01.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:30:0)
[23:16:02.019] Build status: STARTED
[23:16:02.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:31:0) after 7m8s
[23:23:10.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:31:0)
[23:23:10.124] Build status: STARTED
[23:23:10.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:32:0) after 3m24s
[23:26:34.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:32:0)
[23:26:34.210] Build status: STARTED
[23:26:34.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:33:0) after 1m0s
[23:27:34.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:33:0)
[23:27:34.348] Build status: STARTED
[23:27:34.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:34:0) after 5m5s
[23:32:39.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:34:0)
[23:32:39.553] Build status: STARTED
[23:32:39.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:35:0) after 2m29s
[23:35:08.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:35:0)
[23:35:08.647] Build status: STARTED
[23:35:08.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:36:0) after 6m57s
[23:42:05.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:36:0)
[23:42:05.804] Build status: STARTED
[23:42:05.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:37:0) after 2m10s
[23:44:15.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:37:0)
[23:44:15.992] Build status: STARTED
[23:44:15.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8839796815623913152:38:0) after 8m5s
[23:45:02.135] Received PubSub notification, asking Buildbucket for the build status
[23:45:02.169] Build:
{
"id": "8674366752270525121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32021,
"createdBy": "project:chromium",
"createTime": "2026-08-04T20:43:59.479411256Z",
"startTime": "2026-08-04T20:44:10.592700862Z",
"endTime": "2026-08-04T23:45:00.261549850Z",
"updateTime": "2026-08-04T23:45:00.261549850Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "739bc8e98d0fb0b2ac2b9d5ebbefbc89eae63786",
"ref": "refs/heads/main"
}
}
}
[23:45:02.169] Invocation finished in 3h1m5.272338629s with status FAILED