[17:00:21.674] New invocation is queued and will start shortly
[17:00:22.889] Starting the invocation (attempt 1)
[17:00:22.922] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3a63ddd36cd52d426ae6b1a21d0ae941e9ef0e24"
[17:00:22.922] Popped gitiles commit info from properties and tags
[17:00:22.922] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:00:22.922] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:00:22.922] Buildbucket request:
{
"requestId": "8873694147951564032",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3a63ddd36cd52d426ae6b1a21d0ae941e9ef0e24",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8873694147951564032"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:00:23.519] Scheduled build:
{
"id": "8708264085921369105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27850,
"createdBy": "project:chromium",
"createTime": "2025-07-26T17:00:22.981975339Z",
"updateTime": "2025-07-26T17:00:22.981975339Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3a63ddd36cd52d426ae6b1a21d0ae941e9ef0e24",
"ref": "refs/heads/main"
}
}
}
[17:00:23.519] Task URL: https://cr-buildbucket.appspot.com/build/8708264085921369105
[17:00:23.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:2:0) after 9m47s
[17:00:24.475] Received PubSub notification, asking Buildbucket for the build status
[17:00:24.497] Build status: SCHEDULED
[17:06:49.236] Received PubSub notification, asking Buildbucket for the build status
[17:06:49.254] Build status: STARTED
[17:10:10.735] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:2:0)
[17:10:10.796] Build status: STARTED
[17:10:10.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:5:0) after 9m7s
[17:19:17.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:5:0)
[17:19:17.864] Build status: STARTED
[17:19:17.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:6:0) after 4m29s
[17:23:47.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:6:0)
[17:23:47.395] Build status: STARTED
[17:23:47.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:7:0) after 1m55s
[17:25:42.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:7:0)
[17:25:42.444] Build status: STARTED
[17:25:42.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:8:0) after 8m51s
[17:34:33.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:8:0)
[17:34:33.656] Build status: STARTED
[17:34:33.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:9:0) after 3m41s
[17:38:14.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:9:0)
[17:38:14.712] Build status: STARTED
[17:38:14.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:10:0) after 9m3s
[17:47:17.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:10:0)
[17:47:17.811] Build status: STARTED
[17:47:17.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:11:0) after 5m26s
[17:52:43.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:11:0)
[17:52:43.883] Build status: STARTED
[17:52:43.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:12:0) after 9m11s
[18:01:54.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:12:0)
[18:01:55.008] Build status: STARTED
[18:01:55.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:13:0) after 3m33s
[18:05:27.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:13:0)
[18:05:28.016] Build status: STARTED
[18:05:28.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:14:0) after 1m2s
[18:06:30.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:14:0)
[18:06:30.266] Build status: STARTED
[18:06:30.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:15:0) after 1m23s
[18:07:53.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:15:0)
[18:07:53.341] Build status: STARTED
[18:07:53.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:16:0) after 5m6s
[18:12:59.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:16:0)
[18:12:59.440] Build status: STARTED
[18:12:59.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:17:0) after 6m16s
[18:19:15.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:17:0)
[18:19:15.685] Build status: STARTED
[18:19:15.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:18:0) after 9m33s
[18:28:48.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:18:0)
[18:28:48.817] Build status: STARTED
[18:28:48.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:19:0) after 7m34s
[18:36:22.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:19:0)
[18:36:22.879] Build status: STARTED
[18:36:22.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:20:0) after 1m12s
[18:37:34.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:20:0)
[18:37:35.025] Build status: STARTED
[18:37:35.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:21:0) after 3m2s
[18:40:37.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:21:0)
[18:40:37.063] Build status: STARTED
[18:40:37.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:22:0) after 3m26s
[18:44:03.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:22:0)
[18:44:03.109] Build status: STARTED
[18:44:03.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:23:0) after 4m15s
[18:48:18.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:23:0)
[18:48:18.201] Build status: STARTED
[18:48:18.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:24:0) after 4m22s
[18:52:40.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:24:0)
[18:52:40.486] Build status: STARTED
[18:52:40.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:25:0) after 6m0s
[18:58:40.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:25:0)
[18:58:40.568] Build status: STARTED
[18:58:40.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:26:0) after 4m27s
[19:03:07.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:26:0)
[19:03:07.610] Build status: STARTED
[19:03:07.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:27:0) after 9m42s
[19:12:49.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:27:0)
[19:12:49.717] Build status: STARTED
[19:12:49.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:28:0) after 6m0s
[19:18:49.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:28:0)
[19:18:49.763] Build status: STARTED
[19:18:49.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:29:0) after 1m30s
[19:20:19.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:29:0)
[19:20:19.824] Build status: STARTED
[19:20:19.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:30:0) after 2m41s
[19:23:00.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:30:0)
[19:23:00.926] Build status: STARTED
[19:23:00.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:31:0) after 4m24s
[19:27:24.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:31:0)
[19:27:24.961] Build status: STARTED
[19:27:24.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:32:0) after 3m19s
[19:30:43.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:32:0)
[19:30:44.001] Build status: STARTED
[19:30:44.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:33:0) after 5m9s
[19:35:53.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:33:0)
[19:35:53.342] Build status: STARTED
[19:35:53.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:34:0) after 1m20s
[19:37:13.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:34:0)
[19:37:13.375] Build status: STARTED
[19:37:13.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:35:0) after 5m11s
[19:42:24.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:35:0)
[19:42:24.438] Build status: STARTED
[19:42:24.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:36:0) after 1m35s
[19:43:59.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:36:0)
[19:43:59.842] Build status: STARTED
[19:43:59.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:37:0) after 6m38s
[19:50:37.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:37:0)
[19:50:37.893] Build status: STARTED
[19:50:37.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:38:0) after 5m15s
[19:55:53.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:38:0)
[19:55:53.310] Build status: STARTED
[19:55:53.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:39:0) after 1m9s
[19:57:02.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:39:0)
[19:57:02.376] Build status: STARTED
[19:57:02.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:40:0) after 3m15s
[20:00:17.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:40:0)
[20:00:17.525] Build status: STARTED
[20:00:17.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:41:0) after 2m57s
[20:03:14.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:41:0)
[20:03:14.567] Build status: STARTED
[20:03:14.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:42:0) after 3m27s
[20:06:41.566] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:42:0)
[20:06:41.608] Build status: STARTED
[20:06:41.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:43:0) after 6m6s
[20:12:47.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:43:0)
[20:12:47.751] Build status: STARTED
[20:12:47.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:44:0) after 6m49s
[20:19:36.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:44:0)
[20:19:36.802] Build status: STARTED
[20:19:36.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:45:0) after 7m25s
[20:27:01.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:45:0)
[20:27:01.860] Build status: STARTED
[20:27:01.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:46:0) after 3m3s
[20:30:05.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:46:0)
[20:30:05.129] Build status: STARTED
[20:30:05.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:47:0) after 5m23s
[20:35:28.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:47:0)
[20:35:28.319] Build status: STARTED
[20:35:28.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:48:0) after 7m40s
[20:43:08.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:48:0)
[20:43:08.360] Build status: STARTED
[20:43:08.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:49:0) after 4m9s
[20:47:17.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:49:0)
[20:47:17.468] Build status: STARTED
[20:47:17.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:50:0) after 6m34s
[20:53:51.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:50:0)
[20:53:51.536] Build status: STARTED
[20:53:51.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:51:0) after 7m59s
[21:01:50.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:51:0)
[21:01:50.677] Build status: STARTED
[21:01:50.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:52:0) after 6m42s
[21:08:32.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:52:0)
[21:08:32.713] Build status: STARTED
[21:08:32.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:53:0) after 3m7s
[21:11:39.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:53:0)
[21:11:39.774] Build status: STARTED
[21:11:39.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:54:0) after 1m42s
[21:13:21.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:54:0)
[21:13:21.951] Build status: STARTED
[21:13:21.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:55:0) after 8m55s
[21:22:16.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:55:0)
[21:22:16.994] Build status: STARTED
[21:22:16.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:56:0) after 8m2s
[21:30:19.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:56:0)
[21:30:19.046] Build status: STARTED
[21:30:19.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:57:0) after 1m6s
[21:31:25.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:57:0)
[21:31:25.352] Build status: STARTED
[21:31:25.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:58:0) after 7m2s
[21:38:27.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:58:0)
[21:38:27.473] Build status: STARTED
[21:38:27.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:59:0) after 1m31s
[21:39:58.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:59:0)
[21:39:58.586] Build status: STARTED
[21:39:58.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:60:0) after 6m23s
[21:46:21.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:60:0)
[21:46:21.627] Build status: STARTED
[21:46:21.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:61:0) after 2m24s
[21:48:45.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:61:0)
[21:48:45.663] Build status: STARTED
[21:48:45.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:62:0) after 2m32s
[21:51:17.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:62:0)
[21:51:17.711] Build status: STARTED
[21:51:17.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:63:0) after 1m26s
[21:52:43.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:63:0)
[21:52:43.818] Build status: STARTED
[21:52:43.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:64:0) after 2m43s
[21:55:26.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:64:0)
[21:55:26.868] Build status: STARTED
[21:55:26.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:65:0) after 2m19s
[21:57:45.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:65:0)
[21:57:45.914] Build status: STARTED
[21:57:45.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:66:0) after 5m7s
[22:02:52.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:66:0)
[22:02:52.937] Build status: STARTED
[22:02:52.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:67:0) after 5m7s
[22:07:59.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:67:0)
[22:07:59.981] Build status: STARTED
[22:07:59.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:68:0) after 8m9s
[22:16:08.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:68:0)
[22:16:09.026] Build status: STARTED
[22:16:09.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:69:0) after 5m28s
[22:21:37.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:69:0)
[22:21:37.065] Build status: STARTED
[22:21:37.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:70:0) after 2m50s
[22:24:27.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:70:0)
[22:24:27.226] Build status: STARTED
[22:24:27.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:71:0) after 5m16s
[22:29:43.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:71:0)
[22:29:43.276] Build status: STARTED
[22:29:43.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:72:0) after 6m20s
[22:36:03.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:72:0)
[22:36:03.326] Build status: STARTED
[22:36:03.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:73:0) after 6m27s
[22:42:30.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:73:0)
[22:42:30.372] Build status: STARTED
[22:42:30.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:74:0) after 2m46s
[22:45:16.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:74:0)
[22:45:16.512] Build status: STARTED
[22:45:16.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:75:0) after 9m51s
[22:55:07.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:75:0)
[22:55:07.584] Build status: STARTED
[22:55:07.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:76:0) after 3m26s
[22:58:33.616] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:76:0)
[22:58:33.657] Build status: STARTED
[22:58:33.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:77:0) after 7m33s
[23:06:06.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:77:0)
[23:06:06.805] Build status: STARTED
[23:06:06.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:78:0) after 1m2s
[23:07:08.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:78:0)
[23:07:08.849] Build status: STARTED
[23:07:08.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:79:0) after 7m15s
[23:14:23.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:79:0)
[23:14:23.887] Build status: STARTED
[23:14:23.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:80:0) after 6m1s
[23:20:24.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:80:0)
[23:20:24.948] Build status: STARTED
[23:20:24.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:81:0) after 2m15s
[23:22:40.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:81:0)
[23:22:40.074] Build status: STARTED
[23:22:40.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:82:0) after 3m44s
[23:26:24.230] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:82:0)
[23:26:24.246] Build status: STARTED
[23:26:24.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:83:0) after 9m36s
[23:36:00.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:83:0)
[23:36:00.387] Build status: STARTED
[23:36:00.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:84:0) after 3m4s
[23:39:04.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:84:0)
[23:39:04.488] Build status: STARTED
[23:39:04.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:85:0) after 1m46s
[23:40:50.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:85:0)
[23:40:50.630] Build status: STARTED
[23:40:50.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:86:0) after 6m34s
[23:47:24.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:86:0)
[23:47:24.800] Build status: STARTED
[23:47:24.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:87:0) after 2m58s
[23:50:22.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:87:0)
[23:50:22.870] Build status: STARTED
[23:50:22.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:88:0) after 9m17s
[23:59:39.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:88:0)
[23:59:39.913] Build status: STARTED
[23:59:39.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:89:0) after 8m20s
[00:07:59.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:89:0)
[00:07:59.996] Build status: STARTED
[00:07:59.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:90:0) after 2m28s
[00:10:28.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:90:0)
[00:10:28.108] Build status: STARTED
[00:10:28.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:91:0) after 8m13s
[00:18:41.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:91:0)
[00:18:41.509] Build status: STARTED
[00:18:41.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:92:0) after 7m47s
[00:26:28.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:92:0)
[00:26:28.618] Build status: STARTED
[00:26:28.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:93:0) after 7m30s
[00:33:58.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:93:0)
[00:33:58.780] Build status: STARTED
[00:33:58.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:94:0) after 4m57s
[00:38:55.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:94:0)
[00:38:55.991] Build status: STARTED
[00:38:55.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:95:0) after 9m20s
[00:48:16.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:95:0)
[00:48:16.215] Build status: STARTED
[00:48:16.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:96:0) after 2m38s
[00:50:54.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:96:0)
[00:50:54.320] Build status: STARTED
[00:50:54.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:97:0) after 6m37s
[00:57:31.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:97:0)
[00:57:31.468] Build status: STARTED
[00:57:31.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:98:0) after 8m47s
[01:06:18.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:98:0)
[01:06:18.518] Build status: STARTED
[01:06:18.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:99:0) after 8m19s
[01:14:37.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:99:0)
[01:14:37.780] Build status: STARTED
[01:14:37.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:100:0) after 4m37s
[01:19:14.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:100:0)
[01:19:14.878] Build status: STARTED
[01:19:14.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:101:0) after 7m56s
[01:27:10.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:101:0)
[01:27:11.067] Build status: STARTED
[01:27:11.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:102:0) after 1m23s
[01:28:34.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:102:0)
[01:28:34.304] Build status: STARTED
[01:28:34.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:103:0) after 9m49s
[01:38:23.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:103:0)
[01:38:23.803] Build status: STARTED
[01:38:23.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:104:0) after 3m15s
[01:41:38.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:104:0)
[01:41:38.838] Build status: STARTED
[01:41:38.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:105:0) after 1m25s
[01:43:03.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:105:0)
[01:43:03.949] Build status: STARTED
[01:43:03.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:106:0) after 9m54s
[01:52:57.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:106:0)
[01:52:58.024] Build status: STARTED
[01:52:58.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:107:0) after 6m59s
[01:59:57.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:107:0)
[01:59:57.071] Build status: STARTED
[01:59:57.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:108:0) after 7m28s
[02:07:25.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:108:0)
[02:07:25.383] Build status: STARTED
[02:07:25.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:109:0) after 3m29s
[02:10:54.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:109:0)
[02:10:54.520] Build status: STARTED
[02:10:54.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:110:0) after 6m23s
[02:17:17.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:110:0)
[02:17:17.587] Build status: STARTED
[02:17:17.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8873694147951564032:111:0) after 8m10s
[02:23:05.598] Received PubSub notification, asking Buildbucket for the build status
[02:23:05.631] Build:
{
"id": "8708264085921369105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27850,
"createdBy": "project:chromium",
"createTime": "2025-07-26T17:00:22.981975339Z",
"startTime": "2025-07-26T17:06:49.011475012Z",
"endTime": "2025-07-27T02:23:04.546210260Z",
"updateTime": "2025-07-27T02:23:04.546210260Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3a63ddd36cd52d426ae6b1a21d0ae941e9ef0e24",
"ref": "refs/heads/main"
}
}
}
[02:23:05.631] Invocation finished in 9h22m43.969174804s with status FAILED