[03:35:58.960] New invocation is queued and will start shortly
[03:36:00.083] Starting the invocation (attempt 1)
[03:36:00.134] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/38a61fba3c8fbda2948a6d6725b4c59b3643b310"
[03:36:00.134] Popped gitiles commit info from properties and tags
[03:36:00.134] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:36:00.134] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:36:00.134] Buildbucket request:
{
"requestId": "8875466097436978448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38a61fba3c8fbda2948a6d6725b4c59b3643b310",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875466097436978448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:36:00.867] Scheduled build:
{
"id": "8710036035440712017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27788,
"createdBy": "project:chromium",
"createTime": "2025-07-07T03:36:00.235844500Z",
"updateTime": "2025-07-07T03:36:00.235844500Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38a61fba3c8fbda2948a6d6725b4c59b3643b310",
"ref": "refs/heads/main"
}
}
}
[03:36:00.867] Task URL: https://cr-buildbucket.appspot.com/build/8710036035440712017
[03:36:00.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:2:0) after 9m16s
[03:36:02.181] Received PubSub notification, asking Buildbucket for the build status
[03:36:02.203] Build status: SCHEDULED
[03:37:12.930] Received PubSub notification, asking Buildbucket for the build status
[03:37:12.954] Build status: STARTED
[03:45:16.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:2:0)
[03:45:17.135] Build status: STARTED
[03:45:17.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:5:0) after 5m48s
[03:51:05.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:5:0)
[03:51:05.234] Build status: STARTED
[03:51:05.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:6:0) after 4m20s
[03:55:25.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:6:0)
[03:55:25.324] Build status: STARTED
[03:55:25.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:7:0) after 1m22s
[03:56:47.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:7:0)
[03:56:47.666] Build status: STARTED
[03:56:47.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:8:0) after 6m16s
[04:03:03.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:8:0)
[04:03:03.723] Build status: STARTED
[04:03:03.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:9:0) after 1m53s
[04:04:56.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:9:0)
[04:04:56.888] Build status: STARTED
[04:04:56.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:10:0) after 7m40s
[04:12:36.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:10:0)
[04:12:37.001] Build status: STARTED
[04:12:37.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:11:0) after 7m29s
[04:20:06.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:11:0)
[04:20:06.179] Build status: STARTED
[04:20:06.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:12:0) after 4m10s
[04:24:16.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:12:0)
[04:24:16.331] Build status: STARTED
[04:24:16.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:13:0) after 6m36s
[04:30:52.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:13:0)
[04:30:52.612] Build status: STARTED
[04:30:52.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:14:0) after 6m36s
[04:37:28.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:14:0)
[04:37:28.743] Build status: STARTED
[04:37:28.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:15:0) after 5m28s
[04:42:56.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:15:0)
[04:42:56.856] Build status: STARTED
[04:42:56.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:16:0) after 2m50s
[04:45:47.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:16:0)
[04:45:47.090] Build status: STARTED
[04:45:47.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:17:0) after 6m6s
[04:51:53.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:17:0)
[04:51:53.140] Build status: STARTED
[04:51:53.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:18:0) after 6m4s
[04:57:57.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:18:0)
[04:57:57.177] Build status: STARTED
[04:57:57.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:19:0) after 4m52s
[05:02:49.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:19:0)
[05:02:49.265] Build status: STARTED
[05:02:49.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:20:0) after 5m37s
[05:08:26.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:20:0)
[05:08:26.354] Build status: STARTED
[05:08:26.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:21:0) after 4m9s
[05:12:35.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:21:0)
[05:12:35.414] Build status: STARTED
[05:12:35.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:22:0) after 7m15s
[05:19:50.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:22:0)
[05:19:50.463] Build status: STARTED
[05:19:50.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:23:0) after 8m28s
[05:28:18.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:23:0)
[05:28:18.799] Build status: STARTED
[05:28:18.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:24:0) after 9m4s
[05:37:22.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:24:0)
[05:37:22.872] Build status: STARTED
[05:37:22.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:25:0) after 7m52s
[05:45:14.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:25:0)
[05:45:14.886] Build status: STARTED
[05:45:14.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:26:0) after 6m58s
[05:52:12.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:26:0)
[05:52:13.005] Build status: STARTED
[05:52:13.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:27:0) after 2m41s
[05:54:54.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:27:0)
[05:54:54.040] Build status: STARTED
[05:54:54.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:28:0) after 6m31s
[06:01:25.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:28:0)
[06:01:25.280] Build status: STARTED
[06:01:25.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:29:0) after 3m21s
[06:04:46.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:29:0)
[06:04:46.329] Build status: STARTED
[06:04:46.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:30:0) after 8m47s
[06:13:33.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:30:0)
[06:13:33.434] Build status: STARTED
[06:13:33.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:31:0) after 2m22s
[06:15:55.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:31:0)
[06:15:55.654] Build status: STARTED
[06:15:55.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:32:0) after 3m38s
[06:19:34.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:32:0)
[06:19:34.153] Build status: STARTED
[06:19:34.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:33:0) after 6m22s
[06:25:56.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:33:0)
[06:25:56.360] Build status: STARTED
[06:25:56.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:34:0) after 8m2s
[06:33:58.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:34:0)
[06:33:58.615] Build status: STARTED
[06:33:58.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:35:0) after 3m59s
[06:37:57.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:35:0)
[06:37:57.768] Build status: STARTED
[06:37:57.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:36:0) after 7m58s
[06:45:55.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:36:0)
[06:45:55.818] Build status: STARTED
[06:45:55.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:37:0) after 1m53s
[06:47:48.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:37:0)
[06:47:48.900] Build status: STARTED
[06:47:48.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:38:0) after 6m36s
[06:54:25.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:38:0)
[06:54:25.352] Build status: STARTED
[06:54:25.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:39:0) after 3m5s
[06:57:30.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:39:0)
[06:57:30.393] Build status: STARTED
[06:57:30.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:40:0) after 8m47s
[07:06:17.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:40:0)
[07:06:17.564] Build status: STARTED
[07:06:17.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:41:0) after 8m2s
[07:14:19.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:41:0)
[07:14:19.673] Build status: STARTED
[07:14:19.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:42:0) after 6m19s
[07:20:39.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:42:0)
[07:20:39.443] Build status: STARTED
[07:20:39.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:43:0) after 9m16s
[07:29:55.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:43:0)
[07:29:55.562] Build status: STARTED
[07:29:55.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:44:0) after 6m30s
[07:36:25.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:44:0)
[07:36:25.606] Build status: STARTED
[07:36:25.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:45:0) after 3m6s
[07:39:31.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:45:0)
[07:39:31.737] Build status: STARTED
[07:39:31.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:46:0) after 2m38s
[07:42:09.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:46:0)
[07:42:09.815] Build status: STARTED
[07:42:09.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:47:0) after 4m14s
[07:46:23.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:47:0)
[07:46:23.914] Build status: STARTED
[07:46:23.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:48:0) after 1m23s
[07:47:46.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:48:0)
[07:47:47.031] Build status: STARTED
[07:47:47.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:49:0) after 4m42s
[07:52:29.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:49:0)
[07:52:29.558] Build status: STARTED
[07:52:29.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:50:0) after 3m10s
[07:55:39.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:50:0)
[07:55:39.614] Build status: STARTED
[07:55:39.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:51:0) after 2m6s
[07:57:45.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:51:0)
[07:57:45.774] Build status: STARTED
[07:57:45.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:52:0) after 4m52s
[08:02:37.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:52:0)
[08:02:37.935] Build status: STARTED
[08:02:37.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:53:0) after 7m34s
[08:10:11.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:53:0)
[08:10:12.032] Build status: STARTED
[08:10:12.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:54:0) after 6m8s
[08:16:20.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:54:0)
[08:16:20.133] Build status: STARTED
[08:16:20.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:55:0) after 1m55s
[08:18:15.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:55:0)
[08:18:15.685] Build status: STARTED
[08:18:15.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:56:0) after 4m21s
[08:22:36.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:56:0)
[08:22:36.905] Build status: STARTED
[08:22:36.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:57:0) after 6m6s
[08:28:43.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:57:0)
[08:28:43.108] Build status: STARTED
[08:28:43.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:58:0) after 4m34s
[08:33:17.300] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:58:0)
[08:33:17.317] Build status: STARTED
[08:33:17.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:59:0) after 6m13s
[08:39:30.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:59:0)
[08:39:30.692] Build status: STARTED
[08:39:30.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:60:0) after 6m6s
[08:45:36.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:60:0)
[08:45:36.741] Build status: STARTED
[08:45:36.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:61:0) after 7m50s
[08:53:26.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:61:0)
[08:53:26.856] Build status: STARTED
[08:53:26.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:62:0) after 4m46s
[08:58:12.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:62:0)
[08:58:12.945] Build status: STARTED
[08:58:12.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:63:0) after 1m51s
[09:00:03.963] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:63:0)
[09:00:04.020] Build status: STARTED
[09:00:04.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:64:0) after 9m0s
[09:09:04.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:64:0)
[09:09:04.309] Build status: STARTED
[09:09:04.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:65:0) after 3m0s
[09:12:04.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:65:0)
[09:12:04.353] Build status: STARTED
[09:12:04.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:66:0) after 4m25s
[09:16:29.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:66:0)
[09:16:29.892] Build status: STARTED
[09:16:29.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:67:0) after 2m8s
[09:18:37.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:67:0)
[09:18:37.958] Build status: STARTED
[09:18:37.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:68:0) after 6m13s
[09:24:50.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:68:0)
[09:24:50.997] Build status: STARTED
[09:24:50.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:69:0) after 6m1s
[09:30:52.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:69:0)
[09:30:52.265] Build status: STARTED
[09:30:52.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:70:0) after 3m8s
[09:34:00.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:70:0)
[09:34:00.312] Build status: STARTED
[09:34:00.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:71:0) after 8m58s
[09:42:58.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:71:0)
[09:42:58.384] Build status: STARTED
[09:42:58.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:72:0) after 1m10s
[09:44:08.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:72:0)
[09:44:08.483] Build status: STARTED
[09:44:08.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:73:0) after 8m11s
[09:52:19.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:73:0)
[09:52:19.557] Build status: STARTED
[09:52:19.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:74:0) after 4m22s
[09:56:41.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:74:0)
[09:56:41.605] Build status: STARTED
[09:56:41.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:75:0) after 2m55s
[09:59:36.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:75:0)
[09:59:36.648] Build status: STARTED
[09:59:36.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:76:0) after 1m5s
[10:00:41.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:76:0)
[10:00:41.697] Build status: STARTED
[10:00:41.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:77:0) after 2m53s
[10:03:34.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:77:0)
[10:03:34.731] Build status: STARTED
[10:03:34.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:78:0) after 8m58s
[10:12:32.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:78:0)
[10:12:32.872] Build status: STARTED
[10:12:32.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:79:0) after 9m24s
[10:21:56.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:79:0)
[10:21:56.908] Build status: STARTED
[10:21:56.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:80:0) after 8m9s
[10:30:05.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:80:0)
[10:30:06.041] Build status: STARTED
[10:30:06.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:81:0) after 3m50s
[10:33:56.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:81:0)
[10:33:56.099] Build status: STARTED
[10:33:56.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:82:0) after 3m0s
[10:36:56.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:82:0)
[10:36:56.149] Build status: STARTED
[10:36:56.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:83:0) after 7m5s
[10:44:01.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:83:0)
[10:44:01.194] Build status: STARTED
[10:44:01.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:84:0) after 2m9s
[10:46:10.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:84:0)
[10:46:10.325] Build status: STARTED
[10:46:10.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:85:0) after 3m40s
[10:49:50.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:85:0)
[10:49:50.393] Build status: STARTED
[10:49:50.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:86:0) after 7m52s
[10:57:42.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:86:0)
[10:57:42.451] Build status: STARTED
[10:57:42.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:87:0) after 2m7s
[10:59:49.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:87:0)
[10:59:49.529] Build status: STARTED
[10:59:49.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:88:0) after 3m7s
[11:02:56.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:88:0)
[11:02:56.572] Build status: STARTED
[11:02:56.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:89:0) after 9m35s
[11:12:31.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:89:0)
[11:12:31.831] Build status: STARTED
[11:12:31.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:90:0) after 5m21s
[11:17:52.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:90:0)
[11:17:52.877] Build status: STARTED
[11:17:52.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:91:0) after 9m21s
[11:27:14.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:91:0)
[11:27:14.225] Build status: STARTED
[11:27:14.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:92:0) after 8m4s
[11:35:18.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:92:0)
[11:35:18.276] Build status: STARTED
[11:35:18.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:93:0) after 2m25s
[11:37:43.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:93:0)
[11:37:43.336] Build status: STARTED
[11:37:43.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:94:0) after 8m59s
[11:46:42.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:94:0)
[11:46:42.387] Build status: STARTED
[11:46:42.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:95:0) after 5m23s
[11:52:05.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:95:0)
[11:52:05.671] Build status: STARTED
[11:52:05.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:96:0) after 4m57s
[11:57:02.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:96:0)
[11:57:02.715] Build status: STARTED
[11:57:02.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:97:0) after 8m43s
[12:05:45.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:97:0)
[12:05:45.756] Build status: STARTED
[12:05:45.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:98:0) after 3m20s
[12:09:05.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:98:0)
[12:09:05.819] Build status: STARTED
[12:09:05.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:99:0) after 7m47s
[12:16:52.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:99:0)
[12:16:52.988] Build status: STARTED
[12:16:52.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:100:0) after 5m52s
[12:22:45.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:100:0)
[12:22:45.044] Build status: STARTED
[12:22:45.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875466097436978448:101:0) after 8m28s
[12:28:32.109] Received PubSub notification, asking Buildbucket for the build status
[12:28:32.146] Build:
{
"id": "8710036035440712017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27788,
"createdBy": "project:chromium",
"createTime": "2025-07-07T03:36:00.235844500Z",
"startTime": "2025-07-07T03:37:12.643293869Z",
"endTime": "2025-07-07T12:28:31.842120116Z",
"updateTime": "2025-07-07T12:28:31.842120116Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38a61fba3c8fbda2948a6d6725b4c59b3643b310",
"ref": "refs/heads/main"
}
}
}
[12:28:32.146] Invocation finished in 8h52m33.198272761s with status FAILED