[23:05:43.637] New invocation is queued and will start shortly
[23:05:44.756] Starting the invocation (attempt 1)
[23:05:44.787] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c33e5dac4a5ab734a017d07f6e06ddd39519a896"
[23:05:44.787] Popped gitiles commit info from properties and tags
[23:05:44.787] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:05:44.787] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:05:44.787] Buildbucket request:
{
"requestId": "8874395936832129872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c33e5dac4a5ab734a017d07f6e06ddd39519a896",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874395936832129872"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:05:45.410] Scheduled build:
{
"id": "8708965874905321377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27829,
"createdBy": "project:chromium",
"createTime": "2025-07-18T23:05:44.852156662Z",
"updateTime": "2025-07-18T23:05:44.852156662Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c33e5dac4a5ab734a017d07f6e06ddd39519a896",
"ref": "refs/heads/main"
}
}
}
[23:05:45.410] Task URL: https://cr-buildbucket.appspot.com/build/8708965874905321377
[23:05:45.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:2:0) after 7m53s
[23:05:46.487] Received PubSub notification, asking Buildbucket for the build status
[23:05:46.521] Build status: SCHEDULED
[23:07:04.441] Received PubSub notification, asking Buildbucket for the build status
[23:07:04.461] Build status: STARTED
[23:13:38.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:2:0)
[23:13:38.525] Build status: STARTED
[23:13:38.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:5:0) after 6m28s
[23:20:06.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:5:0)
[23:20:06.585] Build status: STARTED
[23:20:06.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:6:0) after 8m6s
[23:28:12.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:6:0)
[23:28:12.627] Build status: STARTED
[23:28:12.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:7:0) after 7m29s
[23:35:41.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:7:0)
[23:35:41.798] Build status: STARTED
[23:35:41.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:8:0) after 3m3s
[23:38:44.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:8:0)
[23:38:44.914] Build status: STARTED
[23:38:44.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:9:0) after 1m4s
[23:39:48.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:9:0)
[23:39:48.997] Build status: STARTED
[23:39:48.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:10:0) after 6m19s
[23:46:08.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:10:0)
[23:46:08.039] Build status: STARTED
[23:46:08.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:11:0) after 5m24s
[23:51:32.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:11:0)
[23:51:32.098] Build status: STARTED
[23:51:32.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:12:0) after 2m45s
[23:54:17.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:12:0)
[23:54:17.121] Build status: STARTED
[23:54:17.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:13:0) after 6m16s
[00:00:33.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:13:0)
[00:00:33.177] Build status: STARTED
[00:00:33.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:14:0) after 4m27s
[00:05:00.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:14:0)
[00:05:00.240] Build status: STARTED
[00:05:00.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:15:0) after 5m2s
[00:10:02.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:15:0)
[00:10:02.297] Build status: STARTED
[00:10:02.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:16:0) after 5m14s
[00:15:16.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:16:0)
[00:15:16.356] Build status: STARTED
[00:15:16.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:17:0) after 9m14s
[00:24:30.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:17:0)
[00:24:30.417] Build status: STARTED
[00:24:30.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:18:0) after 7m4s
[00:31:34.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:18:0)
[00:31:34.662] Build status: STARTED
[00:31:34.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:19:0) after 2m55s
[00:34:29.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:19:0)
[00:34:29.731] Build status: STARTED
[00:34:29.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:20:0) after 4m14s
[00:38:43.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:20:0)
[00:38:43.807] Build status: STARTED
[00:38:43.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:21:0) after 2m52s
[00:41:35.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:21:0)
[00:41:35.863] Build status: STARTED
[00:41:35.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:22:0) after 6m21s
[00:47:56.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:22:0)
[00:47:57.000] Build status: STARTED
[00:47:57.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:23:0) after 3m20s
[00:51:17.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:23:0)
[00:51:17.110] Build status: STARTED
[00:51:17.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:24:0) after 1m25s
[00:52:42.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:24:0)
[00:52:42.187] Build status: STARTED
[00:52:42.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:25:0) after 1m48s
[00:54:30.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:25:0)
[00:54:30.231] Build status: STARTED
[00:54:30.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:26:0) after 3m22s
[00:57:52.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:26:0)
[00:57:52.405] Build status: STARTED
[00:57:52.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:27:0) after 6m59s
[01:04:51.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:27:0)
[01:04:51.450] Build status: STARTED
[01:04:51.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:28:0) after 8m55s
[01:13:46.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:28:0)
[01:13:46.629] Build status: STARTED
[01:13:46.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:29:0) after 6m26s
[01:20:12.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:29:0)
[01:20:12.897] Build status: STARTED
[01:20:12.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:30:0) after 7m50s
[01:28:02.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:30:0)
[01:28:02.915] Build status: STARTED
[01:28:02.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:31:0) after 1m42s
[01:29:44.948] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:31:0)
[01:29:45.024] Build status: STARTED
[01:29:45.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:32:0) after 1m2s
[01:30:47.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:32:0)
[01:30:47.074] Build status: STARTED
[01:30:47.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:33:0) after 5m43s
[01:36:30.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:33:0)
[01:36:30.243] Build status: STARTED
[01:36:30.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:34:0) after 9m40s
[01:46:10.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:34:0)
[01:46:10.369] Build status: STARTED
[01:46:10.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:35:0) after 9m2s
[01:55:12.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:35:0)
[01:55:12.603] Build status: STARTED
[01:55:12.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:36:0) after 3m18s
[01:58:30.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:36:0)
[01:58:30.733] Build status: STARTED
[01:58:30.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:37:0) after 2m5s
[02:00:35.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:37:0)
[02:00:35.878] Build status: STARTED
[02:00:35.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:38:0) after 4m42s
[02:05:18.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:38:0)
[02:05:18.345] Build status: STARTED
[02:05:18.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:39:0) after 2m25s
[02:07:43.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:39:0)
[02:07:43.499] Build status: STARTED
[02:07:43.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:40:0) after 6m13s
[02:13:56.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:40:0)
[02:13:56.553] Build status: STARTED
[02:13:56.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:41:0) after 7m34s
[02:21:30.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:41:0)
[02:21:30.662] Build status: STARTED
[02:21:30.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:42:0) after 4m33s
[02:26:04.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:42:0)
[02:26:04.057] Build status: STARTED
[02:26:04.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:43:0) after 5m42s
[02:31:46.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:43:0)
[02:31:46.273] Build status: STARTED
[02:31:46.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:44:0) after 8m50s
[02:40:36.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:44:0)
[02:40:36.355] Build status: STARTED
[02:40:36.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:45:0) after 8m39s
[02:49:15.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:45:0)
[02:49:15.455] Build status: STARTED
[02:49:15.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:46:0) after 8m39s
[02:57:54.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:46:0)
[02:57:54.530] Build status: STARTED
[02:57:54.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:47:0) after 5m28s
[03:03:22.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:47:0)
[03:03:22.656] Build status: STARTED
[03:03:22.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:48:0) after 3m16s
[03:06:38.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:48:0)
[03:06:38.995] Build status: STARTED
[03:06:38.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:49:0) after 8m40s
[03:15:19.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:49:0)
[03:15:19.485] Build status: STARTED
[03:15:19.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:50:0) after 1m9s
[03:16:28.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:50:0)
[03:16:28.873] Build status: STARTED
[03:16:28.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:51:0) after 3m52s
[03:20:20.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:51:0)
[03:20:20.931] Build status: STARTED
[03:20:20.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:52:0) after 8m16s
[03:28:37.046] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:52:0)
[03:28:37.118] Build status: STARTED
[03:28:37.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:53:0) after 4m21s
[03:32:58.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:53:0)
[03:32:58.130] Build status: STARTED
[03:32:58.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:54:0) after 1m42s
[03:34:40.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:54:0)
[03:34:40.214] Build status: STARTED
[03:34:40.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:55:0) after 4m2s
[03:38:42.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:55:0)
[03:38:42.271] Build status: STARTED
[03:38:42.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:56:0) after 1m40s
[03:40:22.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:56:0)
[03:40:22.316] Build status: STARTED
[03:40:22.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:57:0) after 4m53s
[03:45:15.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:57:0)
[03:45:15.476] Build status: STARTED
[03:45:15.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:58:0) after 9m19s
[03:54:34.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:58:0)
[03:54:34.692] Build status: STARTED
[03:54:34.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:59:0) after 7m44s
[04:02:19.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:59:0)
[04:02:19.296] Build status: STARTED
[04:02:19.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:60:0) after 6m10s
[04:08:29.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:60:0)
[04:08:29.459] Build status: STARTED
[04:08:29.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:61:0) after 1m23s
[04:09:52.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:61:0)
[04:09:52.678] Build status: STARTED
[04:09:52.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:62:0) after 4m33s
[04:14:25.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:62:0)
[04:14:25.749] Build status: STARTED
[04:14:25.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:63:0) after 6m9s
[04:20:34.887] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:63:0)
[04:20:34.936] Build status: STARTED
[04:20:34.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:64:0) after 1m13s
[04:21:48.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:64:0)
[04:21:48.402] Build status: STARTED
[04:21:48.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:65:0) after 2m11s
[04:23:59.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:65:0)
[04:23:59.574] Build status: STARTED
[04:23:59.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:66:0) after 1m58s
[04:25:57.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:66:0)
[04:25:57.694] Build status: STARTED
[04:25:57.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:67:0) after 2m38s
[04:28:35.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:67:0)
[04:28:35.833] Build status: STARTED
[04:28:35.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:68:0) after 3m0s
[04:31:35.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:68:0)
[04:31:35.876] Build status: STARTED
[04:31:35.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:69:0) after 8m5s
[04:39:41.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:69:0)
[04:39:41.024] Build status: STARTED
[04:39:41.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:70:0) after 7m44s
[04:47:25.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:70:0)
[04:47:25.497] Build status: STARTED
[04:47:25.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:71:0) after 5m35s
[04:53:00.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:71:0)
[04:53:00.842] Build status: STARTED
[04:53:00.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:72:0) after 2m33s
[04:55:33.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:72:0)
[04:55:33.976] Build status: STARTED
[04:55:33.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:73:0) after 1m34s
[04:57:08.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:73:0)
[04:57:08.354] Build status: STARTED
[04:57:08.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:74:0) after 6m20s
[05:03:28.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:74:0)
[05:03:28.552] Build status: STARTED
[05:03:28.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:75:0) after 5m36s
[05:09:04.618] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:75:0)
[05:09:04.688] Build status: STARTED
[05:09:04.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:76:0) after 7m49s
[05:16:53.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:76:0)
[05:16:53.747] Build status: STARTED
[05:16:53.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:77:0) after 6m20s
[05:23:13.897] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:77:0)
[05:23:13.924] Build status: STARTED
[05:23:13.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:78:0) after 3m27s
[05:26:41.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:78:0)
[05:26:41.098] Build status: STARTED
[05:26:41.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:79:0) after 5m40s
[05:32:21.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:79:0)
[05:32:21.198] Build status: STARTED
[05:32:21.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:80:0) after 4m41s
[05:37:02.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:80:0)
[05:37:02.366] Build status: STARTED
[05:37:02.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:81:0) after 9m10s
[05:46:12.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:81:0)
[05:46:12.485] Build status: STARTED
[05:46:12.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:82:0) after 3m11s
[05:49:23.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:82:0)
[05:49:23.718] Build status: STARTED
[05:49:23.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:83:0) after 5m16s
[05:54:39.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:83:0)
[05:54:39.928] Build status: STARTED
[05:54:39.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:84:0) after 2m45s
[05:57:25.001] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:84:0)
[05:57:25.023] Build status: STARTED
[05:57:25.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:85:0) after 6m49s
[06:04:14.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:85:0)
[06:04:15.013] Build status: STARTED
[06:04:15.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:86:0) after 6m37s
[06:10:52.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:86:0)
[06:10:52.064] Build status: STARTED
[06:10:52.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:87:0) after 1m53s
[06:12:45.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:87:0)
[06:12:45.837] Build status: STARTED
[06:12:45.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:88:0) after 4m40s
[06:17:25.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:88:0)
[06:17:25.905] Build status: STARTED
[06:17:25.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:89:0) after 8m34s
[06:26:00.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:89:0)
[06:26:00.069] Build status: STARTED
[06:26:00.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:90:0) after 8m3s
[06:34:03.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:90:0)
[06:34:03.270] Build status: STARTED
[06:34:03.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:91:0) after 5m56s
[06:39:59.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:91:0)
[06:39:59.384] Build status: STARTED
[06:39:59.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:92:0) after 7m49s
[06:47:48.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:92:0)
[06:47:48.494] Build status: STARTED
[06:47:48.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:93:0) after 9m54s
[06:57:42.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:93:0)
[06:57:42.547] Build status: STARTED
[06:57:42.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:94:0) after 9m13s
[07:06:55.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:94:0)
[07:06:55.734] Build status: STARTED
[07:06:55.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:95:0) after 6m24s
[07:13:19.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:95:0)
[07:13:19.820] Build status: STARTED
[07:13:19.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:96:0) after 8m11s
[07:21:30.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:96:0)
[07:21:30.841] Build status: STARTED
[07:21:30.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:97:0) after 3m6s
[07:24:37.268] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:97:0)
[07:24:37.295] Build status: STARTED
[07:24:37.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:98:0) after 3m29s
[07:28:06.374] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:98:0)
[07:28:06.390] Build status: STARTED
[07:28:06.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:99:0) after 1m17s
[07:29:23.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:99:0)
[07:29:23.564] Build status: STARTED
[07:29:23.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:100:0) after 5m44s
[07:35:07.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:100:0)
[07:35:07.646] Build status: STARTED
[07:35:07.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:101:0) after 7m47s
[07:42:54.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:101:0)
[07:42:54.722] Build status: STARTED
[07:42:54.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:102:0) after 2m50s
[07:45:44.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:102:0)
[07:45:44.777] Build status: STARTED
[07:45:44.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:103:0) after 4m28s
[07:50:12.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:103:0)
[07:50:13.077] Build status: STARTED
[07:50:13.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:104:0) after 3m5s
[07:53:18.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:104:0)
[07:53:18.140] Build status: STARTED
[07:53:18.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874395936832129872:105:0) after 7m48s
[07:58:05.302] Received PubSub notification, asking Buildbucket for the build status
[07:58:05.318] Build:
{
"id": "8708965874905321377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27829,
"createdBy": "project:chromium",
"createTime": "2025-07-18T23:05:44.852156662Z",
"startTime": "2025-07-18T23:07:04.222245126Z",
"endTime": "2025-07-19T07:58:04.900304999Z",
"updateTime": "2025-07-19T07:58:04.900304999Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c33e5dac4a5ab734a017d07f6e06ddd39519a896",
"ref": "refs/heads/main"
}
}
}
[07:58:05.318] Invocation finished in 8h52m21.68718371s with status FAILED