[07:03:26.358] New invocation is queued and will start shortly
[07:03:27.454] Starting the invocation (attempt 1)
[07:03:27.480] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2670eca38b9a54460cdf389c9cf5c87086a468ce"
[07:03:27.480] Popped gitiles commit info from properties and tags
[07:03:27.480] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:03:27.480] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:03:27.480] Buildbucket request:
{
"requestId": "8851897834123425440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2670eca38b9a54460cdf389c9cf5c87086a468ce",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851897834123425440"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:03:28.169] Scheduled build:
{
"id": "8686467772202796641",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31597,
"createdBy": "project:chromium",
"createTime": "2026-03-24T07:03:27.567637004Z",
"updateTime": "2026-03-24T07:03:27.567637004Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2670eca38b9a54460cdf389c9cf5c87086a468ce",
"ref": "refs/heads/main"
}
}
}
[07:03:28.169] Task URL: https://cr-buildbucket.appspot.com/build/8686467772202796641
[07:03:28.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:2:0) after 1m10s
[07:03:28.986] Received PubSub notification, asking Buildbucket for the build status
[07:03:29.131] Build status: SCHEDULED
[07:03:32.440] Received PubSub notification, asking Buildbucket for the build status
[07:03:32.453] Build status: STARTED
[07:04:38.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:2:0)
[07:04:38.206] Build status: STARTED
[07:04:38.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:5:0) after 6m30s
[07:11:08.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:5:0)
[07:11:08.272] Build status: STARTED
[07:11:08.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:6:0) after 8m9s
[07:19:17.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:6:0)
[07:19:17.475] Build status: STARTED
[07:19:17.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:7:0) after 9m28s
[07:28:45.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:7:0)
[07:28:45.552] Build status: STARTED
[07:28:45.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:8:0) after 6m13s
[07:34:58.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:8:0)
[07:34:58.643] Build status: STARTED
[07:34:58.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:9:0) after 8m25s
[07:43:23.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:9:0)
[07:43:23.690] Build status: STARTED
[07:43:23.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:10:0) after 6m30s
[07:49:53.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:10:0)
[07:49:53.728] Build status: STARTED
[07:49:53.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:11:0) after 2m26s
[07:52:19.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:11:0)
[07:52:19.824] Build status: STARTED
[07:52:19.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:12:0) after 9m22s
[08:01:42.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:12:0)
[08:01:42.700] Build status: STARTED
[08:01:42.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:13:0) after 3m33s
[08:05:15.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:13:0)
[08:05:15.866] Build status: STARTED
[08:05:15.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:14:0) after 9m25s
[08:14:40.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:14:0)
[08:14:40.935] Build status: STARTED
[08:14:40.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:15:0) after 7m7s
[08:21:47.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:15:0)
[08:21:47.979] Build status: STARTED
[08:21:47.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:16:0) after 7m57s
[08:29:45.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:16:0)
[08:29:45.098] Build status: STARTED
[08:29:45.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:17:0) after 8m46s
[08:38:31.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:17:0)
[08:38:31.119] Build status: STARTED
[08:38:31.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:18:0) after 1m49s
[08:40:20.136] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:18:0)
[08:40:20.160] Build status: STARTED
[08:40:20.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:19:0) after 8m7s
[08:48:27.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:19:0)
[08:48:27.195] Build status: STARTED
[08:48:27.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:20:0) after 5m49s
[08:54:16.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:20:0)
[08:54:16.181] Build status: STARTED
[08:54:16.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:21:0) after 8m23s
[09:02:39.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:21:0)
[09:02:39.223] Build status: STARTED
[09:02:39.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:22:0) after 5m1s
[09:07:40.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:22:0)
[09:07:40.274] Build status: STARTED
[09:07:40.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:23:0) after 7m30s
[09:15:10.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:23:0)
[09:15:10.351] Build status: STARTED
[09:15:10.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:24:0) after 9m59s
[09:25:09.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:24:0)
[09:25:09.468] Build status: STARTED
[09:25:09.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:25:0) after 4m33s
[09:29:42.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:25:0)
[09:29:42.504] Build status: STARTED
[09:29:42.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:26:0) after 1m35s
[09:31:17.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:26:0)
[09:31:17.622] Build status: STARTED
[09:31:17.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:27:0) after 5m33s
[09:36:50.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:27:0)
[09:36:50.666] Build status: STARTED
[09:36:50.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:28:0) after 6m36s
[09:43:26.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:28:0)
[09:43:26.788] Build status: STARTED
[09:43:26.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:29:0) after 9m53s
[09:53:19.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:29:0)
[09:53:19.933] Build status: STARTED
[09:53:19.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:30:0) after 4m38s
[09:57:57.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:30:0)
[09:57:57.981] Build status: STARTED
[09:57:57.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:31:0) after 7m58s
[10:05:56.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:31:0)
[10:05:56.049] Build status: STARTED
[10:05:56.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:32:0) after 4m23s
[10:10:19.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:32:0)
[10:10:19.075] Build status: STARTED
[10:10:19.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:33:0) after 6m15s
[10:16:34.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:33:0)
[10:16:34.124] Build status: STARTED
[10:16:34.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:34:0) after 1m33s
[10:18:07.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:34:0)
[10:18:07.176] Build status: STARTED
[10:18:07.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:35:0) after 8m24s
[10:26:31.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:35:0)
[10:26:31.211] Build status: STARTED
[10:26:31.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8851897834123425440:36:0) after 4m44s
[10:30:20.626] Received PubSub notification, asking Buildbucket for the build status
[10:30:20.647] Build:
{
"id": "8686467772202796641",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31597,
"createdBy": "project:chromium",
"createTime": "2026-03-24T07:03:27.567637004Z",
"startTime": "2026-03-24T07:03:32.063618548Z",
"endTime": "2026-03-24T10:30:17.960733649Z",
"updateTime": "2026-03-24T10:30:17.960733649Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2670eca38b9a54460cdf389c9cf5c87086a468ce",
"ref": "refs/heads/main"
}
}
}
[10:30:20.647] Invocation finished in 3h26m54.295327558s with status FAILED