[22:01:09.769] New invocation is queued and will start shortly
[22:01:10.897] Starting the invocation (attempt 1)
[22:01:10.924] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/09f8b026d6dcb65f29534e4d12cd62599ecbe6ad"
[22:01:10.924] Popped gitiles commit info from properties and tags
[22:01:10.924] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:01:10.924] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:01:10.924] Buildbucket request:
{
"requestId": "8850935384587876496",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "09f8b026d6dcb65f29534e4d12cd62599ecbe6ad",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850935384587876496"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:01:11.957] Scheduled build:
{
"id": "8685505322650117953",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31742,
"createdBy": "project:chromium",
"createTime": "2026-04-03T22:01:10.986716184Z",
"updateTime": "2026-04-03T22:01:10.986716184Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "09f8b026d6dcb65f29534e4d12cd62599ecbe6ad",
"ref": "refs/heads/main"
}
}
}
[22:01:11.957] Task URL: https://cr-buildbucket.appspot.com/build/8685505322650117953
[22:01:11.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:2:0) after 7m52s
[22:01:12.826] Received PubSub notification, asking Buildbucket for the build status
[22:01:12.845] Build status: SCHEDULED
[22:02:00.574] Received PubSub notification, asking Buildbucket for the build status
[22:02:00.717] Build status: STARTED
[22:09:04.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:2:0)
[22:09:04.059] Build status: STARTED
[22:09:04.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:5:0) after 4m16s
[22:13:20.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:5:0)
[22:13:20.153] Build status: STARTED
[22:13:20.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:6:0) after 1m7s
[22:14:27.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:6:0)
[22:14:27.236] Build status: STARTED
[22:14:27.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:7:0) after 3m12s
[22:17:39.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:7:0)
[22:17:39.335] Build status: STARTED
[22:17:39.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:8:0) after 2m59s
[22:20:38.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:8:0)
[22:20:38.404] Build status: STARTED
[22:20:38.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:9:0) after 2m31s
[22:23:09.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:9:0)
[22:23:09.532] Build status: STARTED
[22:23:09.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:10:0) after 6m42s
[22:29:51.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:10:0)
[22:29:51.664] Build status: STARTED
[22:29:51.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:11:0) after 8m8s
[22:37:59.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:11:0)
[22:37:59.746] Build status: STARTED
[22:37:59.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:12:0) after 4m12s
[22:42:11.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:12:0)
[22:42:11.744] Build status: STARTED
[22:42:11.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:13:0) after 8m32s
[22:50:43.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:13:0)
[22:50:43.841] Build status: STARTED
[22:50:43.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:14:0) after 2m35s
[22:53:18.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:14:0)
[22:53:18.921] Build status: STARTED
[22:53:18.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:15:0) after 5m21s
[22:58:39.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:15:0)
[22:58:40.094] Build status: STARTED
[22:58:40.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:16:0) after 6m24s
[23:05:04.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:16:0)
[23:05:04.363] Build status: STARTED
[23:05:04.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:17:0) after 6m25s
[23:11:29.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:17:0)
[23:11:29.428] Build status: STARTED
[23:11:29.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:18:0) after 8m50s
[23:20:19.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:18:0)
[23:20:19.482] Build status: STARTED
[23:20:19.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:19:0) after 4m44s
[23:25:03.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:19:0)
[23:25:03.555] Build status: STARTED
[23:25:03.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:20:0) after 3m8s
[23:28:11.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:20:0)
[23:28:11.595] Build status: STARTED
[23:28:11.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:21:0) after 9m32s
[23:37:43.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:21:0)
[23:37:43.643] Build status: STARTED
[23:37:43.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:22:0) after 8m47s
[23:46:30.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:22:0)
[23:46:30.729] Build status: STARTED
[23:46:30.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:23:0) after 8m17s
[23:54:47.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:23:0)
[23:54:47.846] Build status: STARTED
[23:54:47.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:24:0) after 3m40s
[23:58:27.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:24:0)
[23:58:27.970] Build status: STARTED
[23:58:27.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:25:0) after 4m32s
[00:02:59.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:25:0)
[00:02:59.976] Build status: STARTED
[00:02:59.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:26:0) after 7m44s
[00:10:43.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:26:0)
[00:10:44.021] Build status: STARTED
[00:10:44.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:27:0) after 4m14s
[00:14:58.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:27:0)
[00:14:58.106] Build status: STARTED
[00:14:58.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:28:0) after 1m27s
[00:16:25.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:28:0)
[00:16:25.144] Build status: STARTED
[00:16:25.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:29:0) after 7m51s
[00:24:16.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:29:0)
[00:24:16.216] Build status: STARTED
[00:24:16.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:30:0) after 6m33s
[00:30:49.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:30:0)
[00:30:49.267] Build status: STARTED
[00:30:49.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:31:0) after 2m9s
[00:32:58.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:31:0)
[00:32:58.385] Build status: STARTED
[00:32:58.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:32:0) after 8m42s
[00:41:40.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:32:0)
[00:41:40.495] Build status: STARTED
[00:41:40.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:33:0) after 3m34s
[00:45:14.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:33:0)
[00:45:14.691] Build status: STARTED
[00:45:14.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:34:0) after 2m18s
[00:47:32.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:34:0)
[00:47:32.785] Build status: STARTED
[00:47:32.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:35:0) after 1m51s
[00:49:23.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:35:0)
[00:49:23.831] Build status: STARTED
[00:49:23.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:36:0) after 5m9s
[00:54:32.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:36:0)
[00:54:32.868] Build status: STARTED
[00:54:32.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:37:0) after 1m13s
[00:55:45.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:37:0)
[00:55:45.962] Build status: STARTED
[00:55:45.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:38:0) after 2m33s
[00:58:18.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:38:0)
[00:58:18.997] Build status: STARTED
[00:58:18.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:39:0) after 3m39s
[01:01:58.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:39:0)
[01:01:58.148] Build status: STARTED
[01:01:58.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:40:0) after 1m18s
[01:03:16.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:40:0)
[01:03:16.224] Build status: STARTED
[01:03:16.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850935384587876496:41:0) after 4m0s
[01:05:53.016] Received PubSub notification, asking Buildbucket for the build status
[01:05:53.031] Build:
{
"id": "8685505322650117953",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31742,
"createdBy": "project:chromium",
"createTime": "2026-04-03T22:01:10.986716184Z",
"startTime": "2026-04-03T22:02:00.332030213Z",
"endTime": "2026-04-04T01:05:52.612355954Z",
"updateTime": "2026-04-04T01:05:52.612355954Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "09f8b026d6dcb65f29534e4d12cd62599ecbe6ad",
"ref": "refs/heads/main"
}
}
}
[01:05:53.031] Invocation finished in 3h4m43.276189735s with status FAILED