[02:03:42.348] New invocation is queued and will start shortly
[02:03:43.709] Starting the invocation (attempt 1)
[02:03:43.741] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e0ba16a3274186d904a3336c3a78da24458b293d"
[02:03:43.741] Popped gitiles commit info from properties and tags
[02:03:43.741] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:03:43.741] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:03:43.741] Buildbucket request:
{
"requestId": "8837964758898891632",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e0ba16a3274186d904a3336c3a78da24458b293d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8837964758898891632"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:03:44.377] Scheduled build:
{
"id": "8672534696708239889",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 35188,
"createdBy": "project:chromium",
"createTime": "2026-08-25T02:03:43.815351399Z",
"updateTime": "2026-08-25T02:03:43.815351399Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e0ba16a3274186d904a3336c3a78da24458b293d",
"ref": "refs/heads/main"
}
}
}
[02:03:44.377] Task URL: https://cr-buildbucket.appspot.com/build/8672534696708239889
[02:03:44.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:2:0) after 2m43s
[02:03:45.424] Received PubSub notification, asking Buildbucket for the build status
[02:03:45.445] Build status: SCHEDULED
[02:05:47.500] Received PubSub notification, asking Buildbucket for the build status
[02:05:47.537] Build status: STARTED
[02:06:27.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:2:0)
[02:06:27.419] Build status: STARTED
[02:06:27.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:5:0) after 9m46s
[02:16:13.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:5:0)
[02:16:13.539] Build status: STARTED
[02:16:13.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:6:0) after 6m5s
[02:22:18.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:6:0)
[02:22:18.603] Build status: STARTED
[02:22:18.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:7:0) after 4m59s
[02:27:17.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:7:0)
[02:27:17.669] Build status: STARTED
[02:27:17.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:8:0) after 7m47s
[02:35:04.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:8:0)
[02:35:04.715] Build status: STARTED
[02:35:04.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:9:0) after 2m58s
[02:38:02.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:9:0)
[02:38:02.756] Build status: STARTED
[02:38:02.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:10:0) after 1m47s
[02:39:49.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:10:0)
[02:39:49.797] Build status: STARTED
[02:39:49.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:11:0) after 8m43s
[02:48:32.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:11:0)
[02:48:32.890] Build status: STARTED
[02:48:32.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:12:0) after 3m0s
[02:51:32.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:12:0)
[02:51:32.894] Build status: STARTED
[02:51:32.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:13:0) after 1m6s
[02:52:39.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:13:0)
[02:52:39.116] Build status: STARTED
[02:52:39.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:14:0) after 1m31s
[02:54:10.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:14:0)
[02:54:10.182] Build status: STARTED
[02:54:10.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:15:0) after 8m28s
[03:02:38.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:15:0)
[03:02:38.219] Build status: STARTED
[03:02:38.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:16:0) after 4m41s
[03:07:19.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:16:0)
[03:07:19.312] Build status: STARTED
[03:07:19.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:17:0) after 2m5s
[03:09:24.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:17:0)
[03:09:24.394] Build status: STARTED
[03:09:24.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:18:0) after 9m18s
[03:18:42.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:18:0)
[03:18:42.444] Build status: STARTED
[03:18:42.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:19:0) after 2m14s
[03:20:56.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:19:0)
[03:20:56.518] Build status: STARTED
[03:20:56.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:20:0) after 9m45s
[03:30:41.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:20:0)
[03:30:41.532] Build status: STARTED
[03:30:41.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:21:0) after 6m33s
[03:37:14.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:21:0)
[03:37:14.676] Build status: STARTED
[03:37:14.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:22:0) after 6m52s
[03:44:06.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:22:0)
[03:44:06.746] Build status: STARTED
[03:44:06.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:23:0) after 3m43s
[03:47:49.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:23:0)
[03:47:49.774] Build status: STARTED
[03:47:49.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:24:0) after 5m25s
[03:53:14.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:24:0)
[03:53:14.822] Build status: STARTED
[03:53:14.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:25:0) after 5m50s
[03:59:04.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:25:0)
[03:59:04.860] Build status: STARTED
[03:59:04.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:26:0) after 5m52s
[04:04:56.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:26:0)
[04:04:56.954] Build status: STARTED
[04:04:56.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:27:0) after 4m7s
[04:09:03.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:27:0)
[04:09:03.992] Build status: STARTED
[04:09:03.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:28:0) after 4m56s
[04:14:00.036] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:28:0)
[04:14:00.053] Build status: STARTED
[04:14:00.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:29:0) after 5m35s
[04:19:35.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:29:0)
[04:19:35.146] Build status: STARTED
[04:19:35.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:30:0) after 3m59s
[04:23:34.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:30:0)
[04:23:34.181] Build status: STARTED
[04:23:34.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:31:0) after 7m28s
[04:31:02.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:31:0)
[04:31:02.283] Build status: STARTED
[04:31:02.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:32:0) after 9m45s
[04:40:47.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:32:0)
[04:40:47.333] Build status: STARTED
[04:40:47.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:33:0) after 7m25s
[04:48:12.367] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:33:0)
[04:48:12.387] Build status: STARTED
[04:48:12.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:34:0) after 5m0s
[04:53:12.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:34:0)
[04:53:12.434] Build status: STARTED
[04:53:12.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:35:0) after 8m48s
[05:02:00.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:35:0)
[05:02:00.538] Build status: STARTED
[05:02:00.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:36:0) after 4m45s
[05:06:45.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:36:0)
[05:06:45.591] Build status: STARTED
[05:06:45.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:37:0) after 4m34s
[05:11:19.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:37:0)
[05:11:19.633] Build status: STARTED
[05:11:19.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:38:0) after 8m49s
[05:20:08.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:38:0)
[05:20:08.780] Build status: STARTED
[05:20:08.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8837964758898891632:39:0) after 6m24s
[05:20:56.177] Received PubSub notification, asking Buildbucket for the build status
[05:20:56.197] Build:
{
"id": "8672534696708239889",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 35188,
"createdBy": "project:chromium",
"createTime": "2026-08-25T02:03:43.815351399Z",
"startTime": "2026-08-25T02:05:47.038363477Z",
"endTime": "2026-08-25T05:20:55.904825660Z",
"updateTime": "2026-08-25T05:20:55.904825660Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e0ba16a3274186d904a3336c3a78da24458b293d",
"ref": "refs/heads/main"
}
}
}
[05:20:56.197] Invocation finished in 3h17m13.854789694s with status FAILED