[01:14:33.808] New invocation is queued and will start shortly
[01:14:34.934] Starting the invocation (attempt 1)
[01:14:34.976] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/525c2ec42e6288dc4720f1aa72512eabaa827308"
[01:14:34.976] Popped gitiles commit info from properties and tags
[01:14:34.976] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:14:34.976] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:14:34.976] Buildbucket request:
{
"requestId": "8872757085772214800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "525c2ec42e6288dc4720f1aa72512eabaa827308",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8872757085772214800"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:14:35.486] Scheduled build:
{
"id": "8707327023805247457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27956,
"createdBy": "project:chromium",
"createTime": "2025-08-06T01:14:35.054044292Z",
"updateTime": "2025-08-06T01:14:35.054044292Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "525c2ec42e6288dc4720f1aa72512eabaa827308",
"ref": "refs/heads/main"
}
}
}
[01:14:35.486] Task URL: https://cr-buildbucket.appspot.com/build/8707327023805247457
[01:14:35.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:2:0) after 1m25s
[01:14:36.483] Received PubSub notification, asking Buildbucket for the build status
[01:14:36.539] Build status: SCHEDULED
[01:15:45.948] Received PubSub notification, asking Buildbucket for the build status
[01:15:45.981] Build status: STARTED
[01:16:00.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:2:0)
[01:16:00.618] Build status: STARTED
[01:16:00.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:5:0) after 2m28s
[01:18:28.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:5:0)
[01:18:28.669] Build status: STARTED
[01:18:28.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:6:0) after 3m34s
[01:22:02.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:6:0)
[01:22:02.834] Build status: STARTED
[01:22:02.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:7:0) after 2m23s
[01:24:25.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:7:0)
[01:24:25.973] Build status: STARTED
[01:24:25.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:8:0) after 7m54s
[01:32:20.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:8:0)
[01:32:20.167] Build status: STARTED
[01:32:20.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:9:0) after 7m38s
[01:39:58.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:9:0)
[01:39:58.216] Build status: STARTED
[01:39:58.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:10:0) after 5m53s
[01:45:51.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:10:0)
[01:45:51.319] Build status: STARTED
[01:45:51.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:11:0) after 1m53s
[01:47:44.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:11:0)
[01:47:44.401] Build status: STARTED
[01:47:44.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:12:0) after 7m6s
[01:54:50.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:12:0)
[01:54:50.461] Build status: STARTED
[01:54:50.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:13:0) after 1m28s
[01:56:18.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:13:0)
[01:56:18.502] Build status: STARTED
[01:56:18.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:14:0) after 1m57s
[01:58:15.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:14:0)
[01:58:15.582] Build status: STARTED
[01:58:15.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:15:0) after 6m16s
[02:04:31.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:15:0)
[02:04:31.815] Build status: STARTED
[02:04:31.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:16:0) after 1m8s
[02:05:39.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:16:0)
[02:05:39.905] Build status: STARTED
[02:05:39.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:17:0) after 7m26s
[02:13:05.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:17:0)
[02:13:06.000] Build status: STARTED
[02:13:06.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:18:0) after 7m15s
[02:20:21.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:18:0)
[02:20:21.091] Build status: STARTED
[02:20:21.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:19:0) after 7m12s
[02:27:33.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:19:0)
[02:27:33.193] Build status: STARTED
[02:27:33.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:20:0) after 6m45s
[02:34:18.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:20:0)
[02:34:18.256] Build status: STARTED
[02:34:18.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:21:0) after 7m0s
[02:41:18.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:21:0)
[02:41:18.411] Build status: STARTED
[02:41:18.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:22:0) after 4m46s
[02:46:04.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:22:0)
[02:46:04.476] Build status: STARTED
[02:46:04.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:23:0) after 5m23s
[02:51:27.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:23:0)
[02:51:27.500] Build status: STARTED
[02:51:27.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:24:0) after 9m57s
[03:01:24.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:24:0)
[03:01:24.553] Build status: STARTED
[03:01:24.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:25:0) after 7m26s
[03:08:50.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:25:0)
[03:08:50.619] Build status: STARTED
[03:08:50.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:26:0) after 1m41s
[03:10:31.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:26:0)
[03:10:31.675] Build status: STARTED
[03:10:31.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:27:0) after 2m0s
[03:12:31.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:27:0)
[03:12:31.752] Build status: STARTED
[03:12:31.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:28:0) after 2m32s
[03:15:03.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:28:0)
[03:15:03.906] Build status: STARTED
[03:15:03.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:29:0) after 8m12s
[03:23:15.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:29:0)
[03:23:15.950] Build status: STARTED
[03:23:15.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:30:0) after 8m48s
[03:32:03.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:30:0)
[03:32:04.031] Build status: STARTED
[03:32:04.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:31:0) after 8m9s
[03:40:13.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:31:0)
[03:40:13.433] Build status: STARTED
[03:40:13.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:32:0) after 7m12s
[03:47:26.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:32:0)
[03:47:26.037] Build status: STARTED
[03:47:26.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:33:0) after 3m38s
[03:51:04.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:33:0)
[03:51:04.635] Build status: STARTED
[03:51:04.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:34:0) after 1m48s
[03:52:53.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:34:0)
[03:52:53.731] Build status: STARTED
[03:52:53.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:35:0) after 1m23s
[03:54:16.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:35:0)
[03:54:16.986] Build status: STARTED
[03:54:16.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:36:0) after 2m41s
[03:56:58.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:36:0)
[03:56:58.254] Build status: STARTED
[03:56:58.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:37:0) after 6m1s
[04:02:59.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:37:0)
[04:02:59.392] Build status: STARTED
[04:02:59.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:38:0) after 5m32s
[04:08:31.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:38:0)
[04:08:31.655] Build status: STARTED
[04:08:31.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:39:0) after 6m52s
[04:15:23.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:39:0)
[04:15:23.740] Build status: STARTED
[04:15:23.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:40:0) after 9m27s
[04:24:50.982] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:40:0)
[04:24:51.011] Build status: STARTED
[04:24:51.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:41:0) after 5m1s
[04:29:52.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:41:0)
[04:29:52.168] Build status: STARTED
[04:29:52.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:42:0) after 8m20s
[04:38:12.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:42:0)
[04:38:12.219] Build status: STARTED
[04:38:12.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:43:0) after 6m53s
[04:45:05.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:43:0)
[04:45:05.272] Build status: STARTED
[04:45:05.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:44:0) after 1m55s
[04:47:00.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:44:0)
[04:47:00.490] Build status: STARTED
[04:47:00.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:45:0) after 2m15s
[04:49:15.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:45:0)
[04:49:15.817] Build status: STARTED
[04:49:15.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:46:0) after 1m5s
[04:50:21.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:46:0)
[04:50:21.114] Build status: STARTED
[04:50:21.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:47:0) after 1m9s
[04:51:30.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:47:0)
[04:51:30.492] Build status: STARTED
[04:51:30.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:48:0) after 4m19s
[04:55:50.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:48:0)
[04:55:50.256] Build status: STARTED
[04:55:50.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:49:0) after 3m29s
[04:59:19.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:49:0)
[04:59:19.359] Build status: STARTED
[04:59:19.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:50:0) after 9m36s
[05:08:55.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:50:0)
[05:08:55.466] Build status: STARTED
[05:08:55.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:51:0) after 5m30s
[05:14:25.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:51:0)
[05:14:25.572] Build status: STARTED
[05:14:25.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:52:0) after 7m59s
[05:22:24.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:52:0)
[05:22:24.651] Build status: STARTED
[05:22:24.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:53:0) after 5m54s
[05:28:18.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:53:0)
[05:28:18.798] Build status: STARTED
[05:28:18.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:54:0) after 9m23s
[05:37:41.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:54:0)
[05:37:41.945] Build status: STARTED
[05:37:41.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:55:0) after 8m45s
[05:46:26.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:55:0)
[05:46:26.984] Build status: STARTED
[05:46:26.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:56:0) after 6m31s
[05:52:58.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:56:0)
[05:52:58.052] Build status: STARTED
[05:52:58.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:57:0) after 5m3s
[05:58:01.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:57:0)
[05:58:01.098] Build status: STARTED
[05:58:01.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:58:0) after 1m37s
[05:59:38.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:58:0)
[05:59:38.119] Build status: STARTED
[05:59:38.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:59:0) after 6m52s
[06:06:30.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:59:0)
[06:06:30.231] Build status: STARTED
[06:06:30.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:60:0) after 2m45s
[06:09:15.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:60:0)
[06:09:15.243] Build status: STARTED
[06:09:15.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:61:0) after 2m5s
[06:11:20.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:61:0)
[06:11:20.380] Build status: STARTED
[06:11:20.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:62:0) after 1m17s
[06:12:37.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:62:0)
[06:12:37.527] Build status: STARTED
[06:12:37.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:63:0) after 4m54s
[06:17:31.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:63:0)
[06:17:31.623] Build status: STARTED
[06:17:31.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:64:0) after 6m7s
[06:23:38.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:64:0)
[06:23:38.914] Build status: STARTED
[06:23:38.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:65:0) after 9m23s
[06:33:01.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:65:0)
[06:33:01.963] Build status: STARTED
[06:33:01.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:66:0) after 2m48s
[06:35:50.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:66:0)
[06:35:50.191] Build status: STARTED
[06:35:50.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:67:0) after 6m24s
[06:42:14.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:67:0)
[06:42:14.294] Build status: STARTED
[06:42:14.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:68:0) after 2m47s
[06:45:01.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:68:0)
[06:45:01.341] Build status: STARTED
[06:45:01.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:69:0) after 2m49s
[06:47:50.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:69:0)
[06:47:50.434] Build status: STARTED
[06:47:50.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:70:0) after 9m57s
[06:57:47.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:70:0)
[06:57:47.545] Build status: STARTED
[06:57:47.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:71:0) after 7m11s
[07:04:58.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:71:0)
[07:04:58.674] Build status: STARTED
[07:04:58.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:72:0) after 9m56s
[07:14:54.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:72:0)
[07:14:54.772] Build status: STARTED
[07:14:54.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:73:0) after 2m32s
[07:17:26.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:73:0)
[07:17:26.844] Build status: STARTED
[07:17:26.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:74:0) after 2m13s
[07:19:39.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:74:0)
[07:19:39.909] Build status: STARTED
[07:19:39.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:75:0) after 4m51s
[07:24:30.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:75:0)
[07:24:30.970] Build status: STARTED
[07:24:30.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:76:0) after 5m8s
[07:29:39.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:76:0)
[07:29:39.028] Build status: STARTED
[07:29:39.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:77:0) after 6m15s
[07:35:54.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:77:0)
[07:35:54.071] Build status: STARTED
[07:35:54.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:78:0) after 6m8s
[07:42:02.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:78:0)
[07:42:02.160] Build status: STARTED
[07:42:02.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:79:0) after 4m59s
[07:47:01.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:79:0)
[07:47:01.235] Build status: STARTED
[07:47:01.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:80:0) after 1m40s
[07:48:41.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:80:0)
[07:48:41.289] Build status: STARTED
[07:48:41.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:81:0) after 2m28s
[07:51:09.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:81:0)
[07:51:09.370] Build status: STARTED
[07:51:09.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:82:0) after 8m30s
[07:59:39.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:82:0)
[07:59:39.413] Build status: STARTED
[07:59:39.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:83:0) after 7m34s
[08:07:13.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:83:0)
[08:07:13.528] Build status: STARTED
[08:07:13.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:84:0) after 1m24s
[08:08:37.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:84:0)
[08:08:37.729] Build status: STARTED
[08:08:37.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:85:0) after 9m49s
[08:18:26.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:85:0)
[08:18:26.773] Build status: STARTED
[08:18:26.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:86:0) after 1m56s
[08:20:22.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:86:0)
[08:20:22.873] Build status: STARTED
[08:20:22.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:87:0) after 2m52s
[08:23:14.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:87:0)
[08:23:14.980] Build status: STARTED
[08:23:14.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:88:0) after 3m19s
[08:26:34.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:88:0)
[08:26:34.061] Build status: STARTED
[08:26:34.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:89:0) after 4m33s
[08:31:07.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:89:0)
[08:31:07.165] Build status: STARTED
[08:31:07.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:90:0) after 6m29s
[08:37:36.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:90:0)
[08:37:36.212] Build status: STARTED
[08:37:36.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:91:0) after 1m29s
[08:39:05.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:91:0)
[08:39:05.493] Build status: STARTED
[08:39:05.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:92:0) after 9m48s
[08:48:53.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:92:0)
[08:48:53.547] Build status: STARTED
[08:48:53.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:93:0) after 5m52s
[08:54:45.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:93:0)
[08:54:45.630] Build status: STARTED
[08:54:45.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:94:0) after 5m33s
[09:00:18.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:94:0)
[09:00:18.733] Build status: STARTED
[09:00:18.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:95:0) after 4m36s
[09:04:54.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:95:0)
[09:04:54.829] Build status: STARTED
[09:04:54.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:96:0) after 8m32s
[09:13:26.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:96:0)
[09:13:26.898] Build status: STARTED
[09:13:26.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:97:0) after 5m17s
[09:18:43.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:97:0)
[09:18:44.010] Build status: STARTED
[09:18:44.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:98:0) after 6m59s
[09:25:43.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:98:0)
[09:25:43.117] Build status: STARTED
[09:25:43.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:99:0) after 7m22s
[09:33:05.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:99:0)
[09:33:05.384] Build status: STARTED
[09:33:05.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:100:0) after 3m48s
[09:36:53.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:100:0)
[09:36:53.426] Build status: STARTED
[09:36:53.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:101:0) after 6m59s
[09:43:52.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:101:0)
[09:43:52.821] Build status: STARTED
[09:43:52.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:102:0) after 5m35s
[09:49:28.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:102:0)
[09:49:28.360] Build status: STARTED
[09:49:28.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:103:0) after 1m34s
[09:51:02.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:103:0)
[09:51:02.642] Build status: STARTED
[09:51:02.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:104:0) after 2m28s
[09:53:30.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:104:0)
[09:53:30.722] Build status: STARTED
[09:53:30.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:105:0) after 5m17s
[09:58:47.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:105:0)
[09:58:47.786] Build status: STARTED
[09:58:47.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:106:0) after 6m37s
[10:05:24.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:106:0)
[10:05:24.986] Build status: STARTED
[10:05:24.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:107:0) after 8m7s
[10:13:32.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:107:0)
[10:13:32.073] Build status: STARTED
[10:13:32.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872757085772214800:108:0) after 7m51s
[10:16:49.475] Received PubSub notification, asking Buildbucket for the build status
[10:16:49.564] Build:
{
"id": "8707327023805247457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27956,
"createdBy": "project:chromium",
"createTime": "2025-08-06T01:14:35.054044292Z",
"startTime": "2025-08-06T01:15:45.761743429Z",
"endTime": "2025-08-06T10:16:48.730769369Z",
"updateTime": "2025-08-06T10:16:48.730769369Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "525c2ec42e6288dc4720f1aa72512eabaa827308",
"ref": "refs/heads/main"
}
}
}
[10:16:49.564] Invocation finished in 9h2m15.769253213s with status FAILED