[10:03:24.588] New invocation is queued and will start shortly
[10:03:25.641] Starting the invocation (attempt 1)
[10:03:25.671] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/38fd66d8d2d081434bb5b40f7964cb9c94d9caad"
[10:03:25.671] Popped gitiles commit info from properties and tags
[10:03:25.671] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:03:25.671] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:03:25.671] Buildbucket request:
{
"requestId": "8869371725881795968",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38fd66d8d2d081434bb5b40f7964cb9c94d9caad",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8869371725881795968"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:03:26.248] Scheduled build:
{
"id": "8703941663997410289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 28614,
"createdBy": "project:chromium",
"createTime": "2025-09-12T10:03:25.755917189Z",
"updateTime": "2025-09-12T10:03:25.755917189Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38fd66d8d2d081434bb5b40f7964cb9c94d9caad",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:03:26.248] Task URL: https://cr-buildbucket.appspot.com/build/8703941663997410289
[10:03:26.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:2:0) after 8m46s
[10:03:27.185] Received PubSub notification, asking Buildbucket for the build status
[10:03:27.200] Build status: SCHEDULED
[10:04:31.729] Received PubSub notification, asking Buildbucket for the build status
[10:04:31.752] Build status: STARTED
[10:12:12.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:2:0)
[10:12:12.486] Build status: STARTED
[10:12:12.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:5:0) after 1m47s
[10:14:00.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:5:0)
[10:14:00.144] Build status: STARTED
[10:14:00.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:6:0) after 7m42s
[10:21:42.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:6:0)
[10:21:42.466] Build status: STARTED
[10:21:42.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:7:0) after 7m13s
[10:28:55.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:7:0)
[10:28:55.727] Build status: STARTED
[10:28:55.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:8:0) after 5m12s
[10:34:08.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:8:0)
[10:34:08.149] Build status: STARTED
[10:34:08.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:9:0) after 7m59s
[10:42:07.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:9:0)
[10:42:07.308] Build status: STARTED
[10:42:07.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:10:0) after 2m12s
[10:44:19.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:10:0)
[10:44:19.623] Build status: STARTED
[10:44:19.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:11:0) after 2m49s
[10:47:08.702] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:11:0)
[10:47:08.729] Build status: STARTED
[10:47:08.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:12:0) after 4m1s
[10:51:09.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:12:0)
[10:51:09.770] Build status: STARTED
[10:51:09.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:13:0) after 8m33s
[10:59:43.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:13:0)
[10:59:43.079] Build status: STARTED
[10:59:43.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:14:0) after 1m28s
[11:01:11.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:14:0)
[11:01:11.125] Build status: STARTED
[11:01:11.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:15:0) after 6m19s
[11:07:30.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:15:0)
[11:07:30.482] Build status: STARTED
[11:07:30.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:16:0) after 8m22s
[11:15:52.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:16:0)
[11:15:52.699] Build status: STARTED
[11:15:52.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:17:0) after 3m33s
[11:19:25.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:17:0)
[11:19:25.817] Build status: STARTED
[11:19:25.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:18:0) after 3m57s
[11:23:22.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:18:0)
[11:23:23.001] Build status: STARTED
[11:23:23.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:19:0) after 2m36s
[11:25:59.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:19:0)
[11:25:59.245] Build status: STARTED
[11:25:59.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:20:0) after 2m15s
[11:28:14.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:20:0)
[11:28:14.443] Build status: STARTED
[11:28:14.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:21:0) after 8m13s
[11:36:27.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:21:0)
[11:36:27.831] Build status: STARTED
[11:36:27.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:22:0) after 4m50s
[11:41:17.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:22:0)
[11:41:17.973] Build status: STARTED
[11:41:17.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:23:0) after 4m58s
[11:46:16.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:23:0)
[11:46:16.408] Build status: STARTED
[11:46:16.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:24:0) after 9m17s
[11:55:33.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:24:0)
[11:55:33.445] Build status: STARTED
[11:55:33.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:25:0) after 1m12s
[11:56:45.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:25:0)
[11:56:45.553] Build status: STARTED
[11:56:45.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:26:0) after 2m24s
[11:59:09.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:26:0)
[11:59:09.590] Build status: STARTED
[11:59:09.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:27:0) after 4m58s
[12:04:07.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:27:0)
[12:04:07.632] Build status: STARTED
[12:04:07.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:28:0) after 8m21s
[12:12:28.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:28:0)
[12:12:28.701] Build status: STARTED
[12:12:28.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:29:0) after 9m21s
[12:21:49.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:29:0)
[12:21:49.897] Build status: STARTED
[12:21:49.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:30:0) after 7m32s
[12:29:22.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:30:0)
[12:29:22.055] Build status: STARTED
[12:29:22.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:31:0) after 2m58s
[12:32:20.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:31:0)
[12:32:20.289] Build status: STARTED
[12:32:20.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:32:0) after 4m3s
[12:36:23.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:32:0)
[12:36:23.553] Build status: STARTED
[12:36:23.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:33:0) after 5m9s
[12:41:32.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:33:0)
[12:41:32.888] Build status: STARTED
[12:41:32.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:34:0) after 7m56s
[12:49:29.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:34:0)
[12:49:29.290] Build status: STARTED
[12:49:29.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:35:0) after 1m43s
[12:51:12.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:35:0)
[12:51:12.400] Build status: STARTED
[12:51:12.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:36:0) after 5m4s
[12:56:16.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:36:0)
[12:56:16.479] Build status: STARTED
[12:56:16.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:37:0) after 1m23s
[12:57:39.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:37:0)
[12:57:39.591] Build status: STARTED
[12:57:39.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:38:0) after 2m0s
[12:59:40.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:38:0)
[12:59:40.357] Build status: STARTED
[12:59:40.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:39:0) after 8m1s
[13:07:41.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:39:0)
[13:07:41.489] Build status: STARTED
[13:07:41.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:40:0) after 1m16s
[13:08:58.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:40:0)
[13:08:58.148] Build status: STARTED
[13:08:58.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:41:0) after 7m58s
[13:16:56.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:41:0)
[13:16:56.211] Build status: STARTED
[13:16:56.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:42:0) after 4m16s
[13:21:12.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:42:0)
[13:21:12.376] Build status: STARTED
[13:21:12.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:43:0) after 2m34s
[13:23:46.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:43:0)
[13:23:46.487] Build status: STARTED
[13:23:46.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:44:0) after 3m16s
[13:27:02.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:44:0)
[13:27:02.517] Build status: STARTED
[13:27:02.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:45:0) after 4m19s
[13:31:21.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:45:0)
[13:31:21.639] Build status: STARTED
[13:31:21.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:46:0) after 7m57s
[13:39:18.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:46:0)
[13:39:18.727] Build status: STARTED
[13:39:18.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:47:0) after 8m13s
[13:47:31.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:47:0)
[13:47:31.767] Build status: STARTED
[13:47:31.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:48:0) after 2m56s
[13:50:27.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:48:0)
[13:50:27.863] Build status: STARTED
[13:50:27.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:49:0) after 8m51s
[13:59:18.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:49:0)
[13:59:18.961] Build status: STARTED
[13:59:18.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:50:0) after 5m28s
[14:04:46.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:50:0)
[14:04:47.016] Build status: STARTED
[14:04:47.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:51:0) after 4m16s
[14:09:03.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:51:0)
[14:09:03.140] Build status: STARTED
[14:09:03.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:52:0) after 9m13s
[14:18:16.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:52:0)
[14:18:16.209] Build status: STARTED
[14:18:16.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:53:0) after 2m13s
[14:20:29.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:53:0)
[14:20:29.297] Build status: STARTED
[14:20:29.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:54:0) after 2m32s
[14:23:01.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:54:0)
[14:23:02.940] Build status: STARTED
[14:23:02.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:55:0) after 3m38s
[14:26:40.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:55:0)
[14:26:41.002] Build status: STARTED
[14:26:41.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:56:0) after 3m34s
[14:30:15.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:56:0)
[14:30:15.048] Build status: STARTED
[14:30:15.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:57:0) after 4m54s
[14:35:09.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:57:0)
[14:35:09.112] Build status: STARTED
[14:35:09.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:58:0) after 2m51s
[14:38:00.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:58:0)
[14:38:00.166] Build status: STARTED
[14:38:00.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:59:0) after 1m54s
[14:39:54.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:59:0)
[14:39:54.210] Build status: STARTED
[14:39:54.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:60:0) after 7m43s
[14:47:37.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:60:0)
[14:47:37.247] Build status: STARTED
[14:47:37.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:61:0) after 2m18s
[14:49:55.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:61:0)
[14:49:55.296] Build status: STARTED
[14:49:55.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:62:0) after 9m27s
[14:59:22.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:62:0)
[14:59:22.462] Build status: STARTED
[14:59:22.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:63:0) after 9m55s
[15:09:17.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:63:0)
[15:09:17.477] Build status: STARTED
[15:09:17.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:64:0) after 5m0s
[15:14:17.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:64:0)
[15:14:17.491] Build status: STARTED
[15:14:17.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:65:0) after 4m54s
[15:19:11.601] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:65:0)
[15:19:11.617] Build status: STARTED
[15:19:11.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:66:0) after 4m33s
[15:23:44.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:66:0)
[15:23:44.693] Build status: STARTED
[15:23:44.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:67:0) after 6m15s
[15:29:59.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:67:0)
[15:29:59.753] Build status: STARTED
[15:29:59.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:68:0) after 4m44s
[15:34:43.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:68:0)
[15:34:43.849] Build status: STARTED
[15:34:43.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:69:0) after 3m31s
[15:38:14.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:69:0)
[15:38:14.938] Build status: STARTED
[15:38:14.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:70:0) after 5m19s
[15:43:34.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:70:0)
[15:43:34.074] Build status: STARTED
[15:43:34.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:71:0) after 6m57s
[15:50:31.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:71:0)
[15:50:31.109] Build status: STARTED
[15:50:31.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:72:0) after 3m37s
[15:54:08.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:72:0)
[15:54:08.184] Build status: STARTED
[15:54:08.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:73:0) after 2m48s
[15:56:56.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:73:0)
[15:56:56.219] Build status: STARTED
[15:56:56.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:74:0) after 4m0s
[16:00:56.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:74:0)
[16:00:56.394] Build status: STARTED
[16:00:56.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:75:0) after 8m49s
[16:09:45.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:75:0)
[16:09:45.529] Build status: STARTED
[16:09:45.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:76:0) after 5m8s
[16:14:53.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:76:0)
[16:14:53.626] Build status: STARTED
[16:14:53.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:77:0) after 8m2s
[16:22:55.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:77:0)
[16:22:55.686] Build status: STARTED
[16:22:55.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:78:0) after 4m4s
[16:26:59.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:78:0)
[16:26:59.720] Build status: STARTED
[16:26:59.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:79:0) after 1m26s
[16:28:25.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:79:0)
[16:28:25.758] Build status: STARTED
[16:28:25.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:80:0) after 1m58s
[16:30:23.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:80:0)
[16:30:23.804] Build status: STARTED
[16:30:23.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:81:0) after 5m50s
[16:36:13.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:81:0)
[16:36:13.847] Build status: STARTED
[16:36:13.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:82:0) after 7m48s
[16:44:01.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:82:0)
[16:44:01.923] Build status: STARTED
[16:44:01.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:83:0) after 7m29s
[16:51:30.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:83:0)
[16:51:30.956] Build status: STARTED
[16:51:30.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:84:0) after 4m21s
[16:55:51.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:84:0)
[16:55:52.003] Build status: STARTED
[16:55:52.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:85:0) after 3m29s
[16:59:21.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:85:0)
[16:59:21.110] Build status: STARTED
[16:59:21.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:86:0) after 6m21s
[17:05:42.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:86:0)
[17:05:42.162] Build status: STARTED
[17:05:42.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:87:0) after 4m31s
[17:10:13.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:87:0)
[17:10:13.194] Build status: STARTED
[17:10:13.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:88:0) after 5m58s
[17:16:11.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:88:0)
[17:16:11.353] Build status: STARTED
[17:16:11.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:89:0) after 9m14s
[17:25:25.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:89:0)
[17:25:25.408] Build status: STARTED
[17:25:25.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:90:0) after 5m7s
[17:30:32.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:90:0)
[17:30:32.488] Build status: STARTED
[17:30:32.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:91:0) after 6m10s
[17:36:42.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:91:0)
[17:36:42.610] Build status: STARTED
[17:36:42.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:92:0) after 8m25s
[17:45:07.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:92:0)
[17:45:10.278] Build status: STARTED
[17:45:10.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:93:0) after 4m3s
[17:49:13.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:93:0)
[17:49:13.333] Build status: STARTED
[17:49:13.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:94:0) after 9m54s
[17:59:07.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:94:0)
[17:59:07.374] Build status: STARTED
[17:59:07.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:95:0) after 5m36s
[18:04:43.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:95:0)
[18:04:43.433] Build status: STARTED
[18:04:43.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:96:0) after 4m3s
[18:08:46.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:96:0)
[18:08:46.469] Build status: STARTED
[18:08:46.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:97:0) after 2m15s
[18:11:01.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:97:0)
[18:11:01.572] Build status: STARTED
[18:11:01.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:98:0) after 4m14s
[18:15:15.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:98:0)
[18:15:15.619] Build status: STARTED
[18:15:15.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:99:0) after 3m15s
[18:18:30.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:99:0)
[18:18:30.669] Build status: STARTED
[18:18:30.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8869371725881795968:100:0) after 7m15s
[18:18:49.919] Received PubSub notification, asking Buildbucket for the build status
[18:18:49.937] Build:
{
"id": "8703941663997410289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 28614,
"createdBy": "project:chromium",
"createTime": "2025-09-12T10:03:25.755917189Z",
"startTime": "2025-09-12T10:04:31.532009968Z",
"endTime": "2025-09-12T18:18:48.979080878Z",
"updateTime": "2025-09-12T18:18:48.979080878Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38fd66d8d2d081434bb5b40f7964cb9c94d9caad",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:18:49.937] Invocation finished in 8h15m25.363131926s with status FAILED