[23:00:00.693] New invocation is queued and will start shortly
[23:00:01.930] Starting the invocation (attempt 1)
[23:00:01.971] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4ca9be66845de8a7aeba76c80c38adea91e271e9"
[23:00:01.971] Popped gitiles commit info from properties and tags
[23:00:01.971] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:00:01.974] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:00:01.974] Buildbucket request:
{
"requestId": "8850569294278216144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4ca9be66845de8a7aeba76c80c38adea91e271e9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850569294278216144"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:00:02.758] Scheduled build:
{
"id": "8685139232139307377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31789,
"createdBy": "project:chromium",
"createTime": "2026-04-07T23:00:02.104448405Z",
"updateTime": "2026-04-07T23:00:02.104448405Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4ca9be66845de8a7aeba76c80c38adea91e271e9",
"ref": "refs/heads/main"
}
}
}
[23:00:02.758] Task URL: https://cr-buildbucket.appspot.com/build/8685139232139307377
[23:00:02.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:2:0) after 8m40s
[23:00:07.570] Received PubSub notification, asking Buildbucket for the build status
[23:00:07.591] Build status: SCHEDULED
[23:01:20.799] Received PubSub notification, asking Buildbucket for the build status
[23:01:20.824] Build status: STARTED
[23:08:42.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:2:0)
[23:08:42.800] Build status: STARTED
[23:08:42.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:5:0) after 3m19s
[23:12:01.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:5:0)
[23:12:02.017] Build status: STARTED
[23:12:02.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:6:0) after 6m5s
[23:18:07.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:6:0)
[23:18:07.217] Build status: STARTED
[23:18:07.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:7:0) after 8m5s
[23:26:12.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:7:0)
[23:26:12.270] Build status: STARTED
[23:26:12.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:8:0) after 7m57s
[23:34:09.431] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:8:0)
[23:34:09.456] Build status: STARTED
[23:34:09.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:9:0) after 3m44s
[23:37:53.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:9:0)
[23:37:53.560] Build status: STARTED
[23:37:53.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:10:0) after 2m30s
[23:40:23.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:10:0)
[23:40:23.603] Build status: STARTED
[23:40:23.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:11:0) after 1m35s
[23:41:58.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:11:0)
[23:41:58.751] Build status: STARTED
[23:41:58.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:12:0) after 2m55s
[23:44:53.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:12:0)
[23:44:53.863] Build status: STARTED
[23:44:53.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:13:0) after 7m23s
[23:52:16.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:13:0)
[23:52:16.959] Build status: STARTED
[23:52:16.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:14:0) after 1m34s
[23:53:50.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:14:0)
[23:53:51.023] Build status: STARTED
[23:53:51.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:15:0) after 9m17s
[00:03:08.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:15:0)
[00:03:08.048] Build status: STARTED
[00:03:08.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:16:0) after 2m48s
[00:05:56.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:16:0)
[00:05:56.137] Build status: STARTED
[00:05:56.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:17:0) after 5m30s
[00:11:26.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:17:0)
[00:11:26.226] Build status: STARTED
[00:11:26.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:18:0) after 6m6s
[00:17:32.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:18:0)
[00:17:32.376] Build status: STARTED
[00:17:32.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:19:0) after 9m42s
[00:27:14.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:19:0)
[00:27:14.727] Build status: STARTED
[00:27:14.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:20:0) after 7m2s
[00:34:16.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:20:0)
[00:34:16.726] Build status: STARTED
[00:34:16.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:21:0) after 3m12s
[00:37:28.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:21:0)
[00:37:29.006] Build status: STARTED
[00:37:29.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:22:0) after 9m0s
[00:46:29.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:22:0)
[00:46:29.052] Build status: STARTED
[00:46:29.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:23:0) after 5m2s
[00:51:31.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:23:0)
[00:51:31.184] Build status: STARTED
[00:51:31.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:24:0) after 2m21s
[00:53:52.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:24:0)
[00:53:52.346] Build status: STARTED
[00:53:52.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:25:0) after 1m18s
[00:55:10.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:25:0)
[00:55:10.389] Build status: STARTED
[00:55:10.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:26:0) after 5m5s
[01:00:15.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:26:0)
[01:00:15.547] Build status: STARTED
[01:00:15.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:27:0) after 1m45s
[01:02:00.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:27:0)
[01:02:00.557] Build status: STARTED
[01:02:00.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:28:0) after 3m52s
[01:05:52.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:28:0)
[01:05:52.691] Build status: STARTED
[01:05:52.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:29:0) after 8m44s
[01:14:36.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:29:0)
[01:14:36.750] Build status: STARTED
[01:14:36.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:30:0) after 5m16s
[01:19:52.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:30:0)
[01:19:52.897] Build status: STARTED
[01:19:52.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:31:0) after 5m35s
[01:25:28.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:31:0)
[01:25:28.078] Build status: STARTED
[01:25:28.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:32:0) after 8m35s
[01:34:03.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:32:0)
[01:34:03.216] Build status: STARTED
[01:34:03.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:33:0) after 8m16s
[01:42:19.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:33:0)
[01:42:19.334] Build status: STARTED
[01:42:19.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:34:0) after 2m22s
[01:44:41.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:34:0)
[01:44:41.464] Build status: STARTED
[01:44:41.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:35:0) after 2m14s
[01:46:55.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:35:0)
[01:46:55.536] Build status: STARTED
[01:46:55.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:36:0) after 2m36s
[01:49:31.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:36:0)
[01:49:31.647] Build status: STARTED
[01:49:31.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:37:0) after 9m5s
[01:58:36.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:37:0)
[01:58:37.008] Build status: STARTED
[01:58:37.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:38:0) after 9m16s
[02:07:53.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:38:0)
[02:07:53.058] Build status: STARTED
[02:07:53.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:39:0) after 9m15s
[02:17:08.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:39:0)
[02:17:08.132] Build status: STARTED
[02:17:08.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:40:0) after 3m5s
[02:20:13.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:40:0)
[02:20:13.334] Build status: STARTED
[02:20:13.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:41:0) after 5m16s
[02:25:29.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:41:0)
[02:25:29.366] Build status: STARTED
[02:25:29.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:42:0) after 4m25s
[02:29:54.491] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:42:0)
[02:29:54.510] Build status: STARTED
[02:29:54.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8850569294278216144:43:0) after 2m49s
[02:31:51.103] Received PubSub notification, asking Buildbucket for the build status
[02:31:51.122] Build:
{
"id": "8685139232139307377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 31789,
"createdBy": "project:chromium",
"createTime": "2026-04-07T23:00:02.104448405Z",
"startTime": "2026-04-07T23:01:09.443072702Z",
"endTime": "2026-04-08T02:31:46.652080082Z",
"updateTime": "2026-04-08T02:31:46.652080082Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4ca9be66845de8a7aeba76c80c38adea91e271e9",
"ref": "refs/heads/main"
}
}
}
[02:31:51.122] Invocation finished in 3h31m50.441248037s with status FAILED