[20:14:40.154] New invocation is queued and will start shortly
[20:14:41.339] Starting the invocation (attempt 1)
[20:14:41.368] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/21ad118ab0e6d3dae678c31d311ded54733b9222"
[20:14:41.369] Popped gitiles commit info from properties and tags
[20:14:41.369] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:14:41.369] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:14:41.369] Buildbucket request:
{
"requestId": "8867249538532976080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "21ad118ab0e6d3dae678c31d311ded54733b9222",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867249538532976080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:14:41.832] Scheduled build:
{
"id": "8701819476538705569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 28799,
"createdBy": "project:chromium",
"createTime": "2025-10-05T20:14:41.429668720Z",
"updateTime": "2025-10-05T20:14:41.429668720Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "21ad118ab0e6d3dae678c31d311ded54733b9222",
"ref": "refs/heads/main"
}
},
"canary": true
}
[20:14:41.832] Task URL: https://cr-buildbucket.appspot.com/build/8701819476538705569
[20:14:41.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:2:0) after 1m45s
[20:14:42.810] Received PubSub notification, asking Buildbucket for the build status
[20:14:42.831] Build status: SCHEDULED
[20:15:44.434] Received PubSub notification, asking Buildbucket for the build status
[20:15:44.450] Build status: STARTED
[20:16:26.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:2:0)
[20:16:26.883] Build status: STARTED
[20:16:26.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:5:0) after 7m19s
[20:23:45.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:5:0)
[20:23:45.950] Build status: STARTED
[20:23:45.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:6:0) after 8m39s
[20:32:24.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:6:0)
[20:32:24.980] Build status: STARTED
[20:32:24.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:7:0) after 3m40s
[20:36:05.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:7:0)
[20:36:05.279] Build status: STARTED
[20:36:05.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:8:0) after 3m17s
[20:39:22.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:8:0)
[20:39:22.308] Build status: STARTED
[20:39:22.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:9:0) after 1m22s
[20:40:44.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:9:0)
[20:40:44.447] Build status: STARTED
[20:40:44.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:10:0) after 2m42s
[20:43:26.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:10:0)
[20:43:26.576] Build status: STARTED
[20:43:26.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:11:0) after 9m11s
[20:52:37.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:11:0)
[20:52:37.645] Build status: STARTED
[20:52:37.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:12:0) after 1m26s
[20:54:03.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:12:0)
[20:54:03.677] Build status: STARTED
[20:54:03.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:13:0) after 9m51s
[21:03:54.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:13:0)
[21:03:54.735] Build status: STARTED
[21:03:54.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:14:0) after 4m19s
[21:08:13.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:14:0)
[21:08:13.803] Build status: STARTED
[21:08:13.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:15:0) after 4m24s
[21:12:37.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:15:0)
[21:12:37.838] Build status: STARTED
[21:12:37.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:16:0) after 7m30s
[21:20:07.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:16:0)
[21:20:07.928] Build status: STARTED
[21:20:07.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:17:0) after 9m39s
[21:29:46.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:17:0)
[21:29:46.966] Build status: STARTED
[21:29:46.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:18:0) after 2m33s
[21:32:20.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:18:0)
[21:32:20.022] Build status: STARTED
[21:32:20.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:19:0) after 6m5s
[21:38:25.001] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:19:0)
[21:38:25.022] Build status: STARTED
[21:38:25.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:20:0) after 4m28s
[21:42:53.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:20:0)
[21:42:53.250] Build status: STARTED
[21:42:53.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:21:0) after 6m28s
[21:49:21.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:21:0)
[21:49:21.338] Build status: STARTED
[21:49:21.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:22:0) after 2m21s
[21:51:42.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:22:0)
[21:51:42.369] Build status: STARTED
[21:51:42.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:23:0) after 2m25s
[21:54:07.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:23:0)
[21:54:07.433] Build status: STARTED
[21:54:07.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:24:0) after 5m14s
[21:59:21.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:24:0)
[21:59:21.565] Build status: STARTED
[21:59:21.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:25:0) after 1m28s
[22:00:49.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:25:0)
[22:00:49.851] Build status: STARTED
[22:00:49.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:26:0) after 2m41s
[22:03:31.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:26:0)
[22:03:31.047] Build status: STARTED
[22:03:31.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:27:0) after 6m59s
[22:10:30.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:27:0)
[22:10:30.079] Build status: STARTED
[22:10:30.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:28:0) after 2m29s
[22:12:59.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:28:0)
[22:12:59.266] Build status: STARTED
[22:12:59.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:29:0) after 3m42s
[22:16:41.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:29:0)
[22:16:41.708] Build status: STARTED
[22:16:41.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:30:0) after 2m6s
[22:18:47.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:30:0)
[22:18:47.778] Build status: STARTED
[22:18:47.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:31:0) after 4m53s
[22:23:40.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:31:0)
[22:23:40.920] Build status: STARTED
[22:23:40.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:32:0) after 6m57s
[22:30:38.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:32:0)
[22:30:38.061] Build status: STARTED
[22:30:38.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:33:0) after 8m49s
[22:39:27.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:33:0)
[22:39:27.340] Build status: STARTED
[22:39:27.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:34:0) after 9m34s
[22:49:01.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:34:0)
[22:49:01.438] Build status: STARTED
[22:49:01.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:35:0) after 5m8s
[22:54:09.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:35:0)
[22:54:09.674] Build status: STARTED
[22:54:09.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:36:0) after 3m32s
[22:57:41.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:36:0)
[22:57:41.710] Build status: STARTED
[22:57:41.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:37:0) after 4m34s
[23:02:15.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:37:0)
[23:02:15.825] Build status: STARTED
[23:02:15.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:38:0) after 6m49s
[23:09:04.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:38:0)
[23:09:04.992] Build status: STARTED
[23:09:04.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:39:0) after 8m54s
[23:17:59.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:39:0)
[23:17:59.119] Build status: STARTED
[23:17:59.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:40:0) after 8m23s
[23:26:22.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:40:0)
[23:26:22.157] Build status: STARTED
[23:26:22.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:41:0) after 5m8s
[23:31:30.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:41:0)
[23:31:30.339] Build status: STARTED
[23:31:30.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:42:0) after 1m5s
[23:32:35.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:42:0)
[23:32:35.444] Build status: STARTED
[23:32:35.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:43:0) after 3m47s
[23:36:22.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:43:0)
[23:36:22.592] Build status: STARTED
[23:36:22.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:44:0) after 4m4s
[23:40:26.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:44:0)
[23:40:26.674] Build status: STARTED
[23:40:26.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:45:0) after 4m15s
[23:44:41.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:45:0)
[23:44:41.704] Build status: STARTED
[23:44:41.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:46:0) after 5m57s
[23:50:38.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:46:0)
[23:50:38.805] Build status: STARTED
[23:50:38.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:47:0) after 7m31s
[23:58:09.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:47:0)
[23:58:09.837] Build status: STARTED
[23:58:09.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:48:0) after 7m4s
[00:05:14.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:48:0)
[00:05:14.200] Build status: STARTED
[00:05:14.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:49:0) after 5m19s
[00:10:33.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:49:0)
[00:10:33.359] Build status: STARTED
[00:10:33.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:50:0) after 9m11s
[00:19:44.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:50:0)
[00:19:44.365] Build status: STARTED
[00:19:44.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:51:0) after 1m19s
[00:21:03.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:51:0)
[00:21:03.391] Build status: STARTED
[00:21:03.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:52:0) after 9m41s
[00:30:44.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:52:0)
[00:30:44.450] Build status: STARTED
[00:30:44.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:53:0) after 4m52s
[00:35:36.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:53:0)
[00:35:36.609] Build status: STARTED
[00:35:36.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:54:0) after 4m8s
[00:39:44.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:54:0)
[00:39:44.648] Build status: STARTED
[00:39:44.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:55:0) after 4m23s
[00:44:08.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:55:0)
[00:44:08.091] Build status: STARTED
[00:44:08.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:56:0) after 7m28s
[00:51:36.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:56:0)
[00:51:36.387] Build status: STARTED
[00:51:36.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:57:0) after 6m6s
[00:57:42.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:57:0)
[00:57:42.456] Build status: STARTED
[00:57:42.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:58:0) after 4m9s
[01:01:51.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:58:0)
[01:01:51.490] Build status: STARTED
[01:01:51.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:59:0) after 8m16s
[01:10:07.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:59:0)
[01:10:07.595] Build status: STARTED
[01:10:07.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:60:0) after 4m19s
[01:14:26.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:60:0)
[01:14:26.646] Build status: STARTED
[01:14:26.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:61:0) after 5m19s
[01:19:45.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:61:0)
[01:19:46.115] Build status: STARTED
[01:19:46.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:62:0) after 9m3s
[01:28:49.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:62:0)
[01:28:49.145] Build status: STARTED
[01:28:49.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:63:0) after 3m33s
[01:32:22.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:63:0)
[01:32:22.203] Build status: STARTED
[01:32:22.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:64:0) after 6m27s
[01:38:49.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:64:0)
[01:38:49.236] Build status: STARTED
[01:38:49.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:65:0) after 3m54s
[01:42:43.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:65:0)
[01:42:43.377] Build status: STARTED
[01:42:43.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:66:0) after 1m34s
[01:44:17.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:66:0)
[01:44:17.422] Build status: STARTED
[01:44:17.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:67:0) after 8m39s
[01:52:56.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:67:0)
[01:52:56.609] Build status: STARTED
[01:52:56.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:68:0) after 7m33s
[02:00:29.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:68:0)
[02:00:29.652] Build status: STARTED
[02:00:29.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:69:0) after 4m12s
[02:04:41.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:69:0)
[02:04:41.654] Build status: STARTED
[02:04:41.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:70:0) after 6m48s
[02:11:29.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:70:0)
[02:11:29.689] Build status: STARTED
[02:11:29.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:71:0) after 4m15s
[02:15:44.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:71:0)
[02:15:44.726] Build status: STARTED
[02:15:44.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:72:0) after 2m13s
[02:17:58.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:72:0)
[02:17:58.094] Build status: STARTED
[02:17:58.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:73:0) after 7m11s
[02:25:09.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:73:0)
[02:25:09.221] Build status: STARTED
[02:25:09.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:74:0) after 3m26s
[02:28:35.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:74:0)
[02:28:35.368] Build status: STARTED
[02:28:35.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:75:0) after 2m33s
[02:31:08.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:75:0)
[02:31:08.421] Build status: STARTED
[02:31:08.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:76:0) after 1m53s
[02:33:01.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:76:0)
[02:33:01.663] Build status: STARTED
[02:33:01.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:77:0) after 3m54s
[02:36:55.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:77:0)
[02:36:55.927] Build status: STARTED
[02:36:55.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:78:0) after 9m40s
[02:46:35.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:78:0)
[02:46:35.972] Build status: STARTED
[02:46:35.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:79:0) after 8m19s
[02:54:54.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:79:0)
[02:54:55.004] Build status: STARTED
[02:54:55.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:80:0) after 9m52s
[03:04:47.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:80:0)
[03:04:47.319] Build status: STARTED
[03:04:47.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:81:0) after 2m54s
[03:07:41.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:81:0)
[03:07:41.856] Build status: STARTED
[03:07:41.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:82:0) after 9m54s
[03:17:36.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:82:0)
[03:17:36.105] Build status: STARTED
[03:17:36.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:83:0) after 1m30s
[03:19:06.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:83:0)
[03:19:06.138] Build status: STARTED
[03:19:06.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:84:0) after 5m35s
[03:24:41.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:84:0)
[03:24:41.164] Build status: STARTED
[03:24:41.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8867249538532976080:85:0) after 5m18s
[03:26:46.867] Received PubSub notification, asking Buildbucket for the build status
[03:26:47.057] Build:
{
"id": "8701819476538705569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 28799,
"createdBy": "project:chromium",
"createTime": "2025-10-05T20:14:41.429668720Z",
"startTime": "2025-10-05T20:15:43.906240656Z",
"endTime": "2025-10-06T03:26:46.432262313Z",
"updateTime": "2025-10-06T03:26:46.432262313Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "21ad118ab0e6d3dae678c31d311ded54733b9222",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:26:47.057] Invocation finished in 7h12m6.914010119s with status FAILED