[06:56:37.245] New invocation is queued and will start shortly
[06:56:38.793] Starting the invocation (attempt 1)
[06:56:38.825] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3f332053860ab9280591773d8dc5027459fe2dc2"
[06:56:38.825] Popped gitiles commit info from properties and tags
[06:56:38.825] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:56:38.825] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:56:38.825] Buildbucket request:
{
"requestId": "8872826162356185648",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f332053860ab9280591773d8dc5027459fe2dc2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8872826162356185648"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:56:39.386] Scheduled build:
{
"id": "8707396099944665121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27954,
"createdBy": "project:chromium",
"createTime": "2025-08-05T06:56:38.914475675Z",
"updateTime": "2025-08-05T06:56:38.914475675Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f332053860ab9280591773d8dc5027459fe2dc2",
"ref": "refs/heads/main"
}
}
}
[06:56:39.386] Task URL: https://cr-buildbucket.appspot.com/build/8707396099944665121
[06:56:39.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:2:0) after 1m19s
[06:56:40.428] Received PubSub notification, asking Buildbucket for the build status
[06:56:40.450] Build status: SCHEDULED
[06:56:44.008] Received PubSub notification, asking Buildbucket for the build status
[06:56:44.036] Build status: STARTED
[06:57:58.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:2:0)
[06:57:58.464] Build status: STARTED
[06:57:58.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:5:0) after 1m1s
[06:58:59.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:5:0)
[06:58:59.522] Build status: STARTED
[06:58:59.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:6:0) after 4m41s
[07:03:40.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:6:0)
[07:03:40.635] Build status: STARTED
[07:03:40.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:7:0) after 4m18s
[07:07:58.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:7:0)
[07:07:58.670] Build status: STARTED
[07:07:58.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:8:0) after 6m54s
[07:14:53.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:8:0)
[07:14:53.079] Build status: STARTED
[07:14:53.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:9:0) after 8m53s
[07:23:46.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:9:0)
[07:23:46.163] Build status: STARTED
[07:23:46.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:10:0) after 6m27s
[07:30:13.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:10:0)
[07:30:13.262] Build status: STARTED
[07:30:13.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:11:0) after 3m19s
[07:33:32.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:11:0)
[07:33:32.327] Build status: STARTED
[07:33:32.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:12:0) after 5m47s
[07:39:19.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:12:0)
[07:39:19.385] Build status: STARTED
[07:39:19.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:13:0) after 4m18s
[07:43:37.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:13:0)
[07:43:37.577] Build status: STARTED
[07:43:37.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:14:0) after 8m18s
[07:51:55.601] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:14:0)
[07:51:55.616] Build status: STARTED
[07:51:55.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:15:0) after 6m51s
[07:58:46.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:15:0)
[07:58:46.747] Build status: STARTED
[07:58:46.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:16:0) after 2m58s
[08:01:44.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:16:0)
[08:01:44.816] Build status: STARTED
[08:01:44.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:17:0) after 8m8s
[08:09:52.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:17:0)
[08:09:52.862] Build status: STARTED
[08:09:52.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:18:0) after 4m13s
[08:14:05.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:18:0)
[08:14:05.967] Build status: STARTED
[08:14:05.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:19:0) after 8m13s
[08:22:19.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:19:0)
[08:22:19.421] Build status: STARTED
[08:22:19.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:20:0) after 9m38s
[08:31:57.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:20:0)
[08:31:57.544] Build status: STARTED
[08:31:57.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:21:0) after 8m25s
[08:40:22.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:21:0)
[08:40:22.802] Build status: STARTED
[08:40:22.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:22:0) after 5m30s
[08:45:52.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:22:0)
[08:45:53.026] Build status: STARTED
[08:45:53.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:23:0) after 1m48s
[08:47:41.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:23:0)
[08:47:41.146] Build status: STARTED
[08:47:41.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:24:0) after 7m6s
[08:54:47.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:24:0)
[08:54:47.202] Build status: STARTED
[08:54:47.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:25:0) after 3m4s
[08:57:51.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:25:0)
[08:57:51.297] Build status: STARTED
[08:57:51.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:26:0) after 4m19s
[09:02:10.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:26:0)
[09:02:10.505] Build status: STARTED
[09:02:10.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:27:0) after 8m50s
[09:11:00.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:27:0)
[09:11:00.623] Build status: STARTED
[09:11:00.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:28:0) after 4m14s
[09:15:14.706] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:28:0)
[09:15:14.766] Build status: STARTED
[09:15:14.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:29:0) after 1m6s
[09:16:20.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:29:0)
[09:16:20.814] Build status: STARTED
[09:16:20.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:30:0) after 9m37s
[09:25:57.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:30:0)
[09:25:57.880] Build status: STARTED
[09:25:57.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:31:0) after 1m26s
[09:27:23.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:31:0)
[09:27:23.920] Build status: STARTED
[09:27:23.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:32:0) after 3m59s
[09:31:23.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:32:0)
[09:31:23.325] Build status: STARTED
[09:31:23.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:33:0) after 1m27s
[09:32:50.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:33:0)
[09:32:50.377] Build status: STARTED
[09:32:50.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:34:0) after 1m56s
[09:34:46.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:34:0)
[09:34:46.555] Build status: STARTED
[09:34:46.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:35:0) after 2m14s
[09:37:00.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:35:0)
[09:37:00.920] Build status: STARTED
[09:37:00.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:36:0) after 4m40s
[09:41:41.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:36:0)
[09:41:41.420] Build status: STARTED
[09:41:41.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:37:0) after 8m32s
[09:50:13.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:37:0)
[09:50:13.559] Build status: STARTED
[09:50:13.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:38:0) after 8m54s
[09:59:07.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:38:0)
[09:59:07.725] Build status: STARTED
[09:59:07.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:39:0) after 4m36s
[10:03:43.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:39:0)
[10:03:43.900] Build status: STARTED
[10:03:43.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:40:0) after 9m40s
[10:13:23.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:40:0)
[10:13:24.032] Build status: STARTED
[10:13:24.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:41:0) after 2m52s
[10:16:16.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:41:0)
[10:16:16.232] Build status: STARTED
[10:16:16.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:42:0) after 1m52s
[10:18:08.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:42:0)
[10:18:08.335] Build status: STARTED
[10:18:08.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:43:0) after 8m31s
[10:26:39.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:43:0)
[10:26:39.573] Build status: STARTED
[10:26:39.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:44:0) after 2m17s
[10:28:57.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:44:0)
[10:28:57.617] Build status: STARTED
[10:28:57.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:45:0) after 6m39s
[10:35:36.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:45:0)
[10:35:36.822] Build status: STARTED
[10:35:36.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:46:0) after 6m52s
[10:42:28.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:46:0)
[10:42:28.931] Build status: STARTED
[10:42:28.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:47:0) after 8m24s
[10:50:53.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:47:0)
[10:50:53.077] Build status: STARTED
[10:50:53.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:48:0) after 8m46s
[10:59:39.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:48:0)
[10:59:39.192] Build status: STARTED
[10:59:39.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:49:0) after 5m2s
[11:04:41.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:49:0)
[11:04:41.423] Build status: STARTED
[11:04:41.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:50:0) after 6m17s
[11:10:58.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:50:0)
[11:10:58.579] Build status: STARTED
[11:10:58.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:51:0) after 6m47s
[11:17:45.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:51:0)
[11:17:45.607] Build status: STARTED
[11:17:45.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:52:0) after 3m36s
[11:21:21.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:52:0)
[11:21:21.655] Build status: STARTED
[11:21:21.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:53:0) after 8m11s
[11:29:32.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:53:0)
[11:29:32.721] Build status: STARTED
[11:29:32.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:54:0) after 6m47s
[11:36:19.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:54:0)
[11:36:19.793] Build status: STARTED
[11:36:19.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:55:0) after 4m10s
[11:40:29.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:55:0)
[11:40:29.898] Build status: STARTED
[11:40:29.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:56:0) after 7m8s
[11:47:37.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:56:0)
[11:47:37.951] Build status: STARTED
[11:47:37.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:57:0) after 9m27s
[11:57:04.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:57:0)
[11:57:05.021] Build status: STARTED
[11:57:05.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:58:0) after 8m1s
[12:05:06.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:58:0)
[12:05:06.117] Build status: STARTED
[12:05:06.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:59:0) after 5m41s
[12:10:47.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:59:0)
[12:10:47.260] Build status: STARTED
[12:10:47.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:60:0) after 4m43s
[12:15:30.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:60:0)
[12:15:30.312] Build status: STARTED
[12:15:30.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:61:0) after 9m53s
[12:25:23.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:61:0)
[12:25:23.481] Build status: STARTED
[12:25:23.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:62:0) after 2m31s
[12:27:54.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:62:0)
[12:27:54.611] Build status: STARTED
[12:27:54.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:63:0) after 9m3s
[12:36:57.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:63:0)
[12:36:57.720] Build status: STARTED
[12:36:57.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:64:0) after 5m41s
[12:42:38.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:64:0)
[12:42:38.769] Build status: STARTED
[12:42:38.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:65:0) after 8m34s
[12:51:12.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:65:0)
[12:51:12.894] Build status: STARTED
[12:51:12.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:66:0) after 2m13s
[12:53:25.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:66:0)
[12:53:25.921] Build status: STARTED
[12:53:25.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:67:0) after 2m7s
[12:55:32.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:67:0)
[12:55:32.971] Build status: STARTED
[12:55:32.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:68:0) after 6m38s
[13:02:11.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:68:0)
[13:02:11.027] Build status: STARTED
[13:02:11.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:69:0) after 1m53s
[13:04:04.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:69:0)
[13:04:04.187] Build status: STARTED
[13:04:04.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:70:0) after 8m52s
[13:12:56.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:70:0)
[13:12:56.276] Build status: STARTED
[13:12:56.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:71:0) after 5m56s
[13:18:52.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:71:0)
[13:18:52.413] Build status: STARTED
[13:18:52.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:72:0) after 5m34s
[13:24:26.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:72:0)
[13:24:26.513] Build status: STARTED
[13:24:26.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:73:0) after 2m45s
[13:27:11.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:73:0)
[13:27:11.563] Build status: STARTED
[13:27:11.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:74:0) after 1m39s
[13:28:50.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:74:0)
[13:28:50.617] Build status: STARTED
[13:28:50.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:75:0) after 5m33s
[13:34:23.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:75:0)
[13:34:23.642] Build status: STARTED
[13:34:23.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:76:0) after 9m2s
[13:43:26.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:76:0)
[13:43:26.065] Build status: STARTED
[13:43:26.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:77:0) after 3m37s
[13:47:03.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:77:0)
[13:47:03.637] Build status: STARTED
[13:47:03.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:78:0) after 6m24s
[13:53:27.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:78:0)
[13:53:27.706] Build status: STARTED
[13:53:27.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:79:0) after 9m20s
[14:02:47.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:79:0)
[14:02:47.794] Build status: STARTED
[14:02:47.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:80:0) after 7m42s
[14:10:29.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:80:0)
[14:10:29.939] Build status: STARTED
[14:10:29.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:81:0) after 4m47s
[14:15:17.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:81:0)
[14:15:17.119] Build status: STARTED
[14:15:17.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:82:0) after 5m43s
[14:21:00.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:82:0)
[14:21:00.314] Build status: STARTED
[14:21:00.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:83:0) after 2m47s
[14:23:47.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:83:0)
[14:23:47.517] Build status: STARTED
[14:23:47.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:84:0) after 9m17s
[14:33:04.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:84:0)
[14:33:04.623] Build status: STARTED
[14:33:04.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:85:0) after 4m57s
[14:38:01.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:85:0)
[14:38:01.673] Build status: STARTED
[14:38:01.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:86:0) after 5m23s
[14:43:24.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:86:0)
[14:43:24.795] Build status: STARTED
[14:43:24.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:87:0) after 5m14s
[14:48:38.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:87:0)
[14:48:38.883] Build status: STARTED
[14:48:38.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:88:0) after 2m13s
[14:50:51.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:88:0)
[14:50:51.977] Build status: STARTED
[14:50:51.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:89:0) after 6m34s
[14:57:26.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:89:0)
[14:57:26.070] Build status: STARTED
[14:57:26.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:90:0) after 8m56s
[15:06:22.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:90:0)
[15:06:22.122] Build status: STARTED
[15:06:22.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:91:0) after 9m21s
[15:15:43.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:91:0)
[15:15:43.412] Build status: STARTED
[15:15:43.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:92:0) after 9m44s
[15:25:27.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:92:0)
[15:25:27.546] Build status: STARTED
[15:25:27.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:93:0) after 1m13s
[15:26:40.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:93:0)
[15:26:40.558] Build status: STARTED
[15:26:40.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:94:0) after 8m19s
[15:34:59.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:94:0)
[15:34:59.612] Build status: STARTED
[15:34:59.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:95:0) after 9m3s
[15:44:02.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:95:0)
[15:44:02.742] Build status: STARTED
[15:44:02.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:96:0) after 6m39s
[15:50:41.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:96:0)
[15:50:41.796] Build status: STARTED
[15:50:41.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:97:0) after 6m13s
[15:56:54.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:97:0)
[15:56:54.881] Build status: STARTED
[15:56:54.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:98:0) after 4m31s
[16:01:25.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:98:0)
[16:01:25.999] Build status: STARTED
[16:01:25.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:99:0) after 6m35s
[16:08:01.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:99:0)
[16:08:01.055] Build status: STARTED
[16:08:01.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:100:0) after 4m15s
[16:12:16.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:100:0)
[16:12:16.075] Build status: STARTED
[16:12:16.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:101:0) after 4m45s
[16:17:01.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:101:0)
[16:17:01.253] Build status: STARTED
[16:17:01.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8872826162356185648:102:0) after 1m42s
[16:17:10.519] Received PubSub notification, asking Buildbucket for the build status
[16:17:10.543] Build:
{
"id": "8707396099944665121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27954,
"createdBy": "project:chromium",
"createTime": "2025-08-05T06:56:38.914475675Z",
"startTime": "2025-08-05T06:56:43.812327287Z",
"endTime": "2025-08-05T16:17:09.236278145Z",
"updateTime": "2025-08-05T16:17:09.236278145Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f332053860ab9280591773d8dc5027459fe2dc2",
"ref": "refs/heads/main"
}
}
}
[16:17:10.543] Invocation finished in 9h20m33.312649733s with status FAILED