[12:28:35.237] New invocation is queued and will start shortly
[12:28:36.786] Starting the invocation (attempt 1)
[12:28:36.819] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ae31613bb00689e17bf34313760e0596e989211a"
[12:28:36.819] Popped gitiles commit info from properties and tags
[12:28:36.819] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:28:36.820] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:28:36.820] Buildbucket request:
{
"requestId": "8875432588849924192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae31613bb00689e17bf34313760e0596e989211a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875432588849924192"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:28:37.392] Scheduled build:
{
"id": "8710002526466933201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27789,
"createdBy": "project:chromium",
"createTime": "2025-07-07T12:28:36.882192010Z",
"updateTime": "2025-07-07T12:28:36.882192010Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae31613bb00689e17bf34313760e0596e989211a",
"ref": "refs/heads/main"
}
}
}
[12:28:37.392] Task URL: https://cr-buildbucket.appspot.com/build/8710002526466933201
[12:28:37.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:2:0) after 6m6s
[12:28:38.166] Received PubSub notification, asking Buildbucket for the build status
[12:28:38.199] Build status: SCHEDULED
[12:29:38.896] Received PubSub notification, asking Buildbucket for the build status
[12:29:38.924] Build status: STARTED
[12:34:43.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:2:0)
[12:34:43.534] Build status: STARTED
[12:34:43.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:5:0) after 9m21s
[12:44:04.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:5:0)
[12:44:04.590] Build status: STARTED
[12:44:04.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:6:0) after 9m13s
[12:53:17.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:6:0)
[12:53:17.692] Build status: STARTED
[12:53:17.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:7:0) after 2m9s
[12:55:26.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:7:0)
[12:55:26.748] Build status: STARTED
[12:55:26.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:8:0) after 3m0s
[12:58:26.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:8:0)
[12:58:26.798] Build status: STARTED
[12:58:26.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:9:0) after 8m24s
[13:06:50.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:9:0)
[13:06:50.831] Build status: STARTED
[13:06:50.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:10:0) after 7m44s
[13:14:34.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:10:0)
[13:14:34.903] Build status: STARTED
[13:14:34.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:11:0) after 1m57s
[13:16:32.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:11:0)
[13:16:32.052] Build status: STARTED
[13:16:32.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:12:0) after 7m14s
[13:23:46.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:12:0)
[13:23:46.100] Build status: STARTED
[13:23:46.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:13:0) after 9m51s
[13:33:37.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:13:0)
[13:33:37.251] Build status: STARTED
[13:33:37.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:14:0) after 8m51s
[13:42:28.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:14:0)
[13:42:28.347] Build status: STARTED
[13:42:28.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:15:0) after 7m20s
[13:49:48.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:15:0)
[13:49:48.388] Build status: STARTED
[13:49:48.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:16:0) after 3m49s
[13:53:37.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:16:0)
[13:53:37.518] Build status: STARTED
[13:53:37.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:17:0) after 8m8s
[14:01:45.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:17:0)
[14:01:45.554] Build status: STARTED
[14:01:45.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:18:0) after 7m37s
[14:09:22.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:18:0)
[14:09:22.598] Build status: STARTED
[14:09:22.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:19:0) after 7m46s
[14:17:08.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:19:0)
[14:17:08.659] Build status: STARTED
[14:17:08.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:20:0) after 8m29s
[14:25:37.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:20:0)
[14:25:37.787] Build status: STARTED
[14:25:37.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:21:0) after 8m43s
[14:34:20.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:21:0)
[14:34:20.858] Build status: STARTED
[14:34:20.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:22:0) after 8m51s
[14:43:11.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:22:0)
[14:43:11.948] Build status: STARTED
[14:43:11.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:23:0) after 7m20s
[14:50:31.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:23:0)
[14:50:31.997] Build status: STARTED
[14:50:31.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:24:0) after 5m16s
[14:55:48.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:24:0)
[14:55:48.098] Build status: STARTED
[14:55:48.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:25:0) after 6m32s
[15:02:20.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:25:0)
[15:02:20.399] Build status: STARTED
[15:02:20.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:26:0) after 1m10s
[15:03:30.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:26:0)
[15:03:30.552] Build status: STARTED
[15:03:30.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:27:0) after 8m5s
[15:11:35.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:27:0)
[15:11:35.602] Build status: STARTED
[15:11:35.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:28:0) after 3m17s
[15:14:52.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:28:0)
[15:14:52.673] Build status: STARTED
[15:14:52.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:29:0) after 1m0s
[15:15:52.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:29:0)
[15:15:52.777] Build status: STARTED
[15:15:52.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:30:0) after 4m34s
[15:20:26.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:30:0)
[15:20:26.946] Build status: STARTED
[15:20:26.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:31:0) after 2m17s
[15:22:43.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:31:0)
[15:22:43.973] Build status: STARTED
[15:22:43.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:32:0) after 6m56s
[15:29:40.046] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:32:0)
[15:29:40.073] Build status: STARTED
[15:29:40.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:33:0) after 9m5s
[15:38:45.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:33:0)
[15:38:45.125] Build status: STARTED
[15:38:45.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:34:0) after 5m7s
[15:43:52.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:34:0)
[15:43:52.192] Build status: STARTED
[15:43:52.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:35:0) after 4m36s
[15:48:28.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:35:0)
[15:48:28.224] Build status: STARTED
[15:48:28.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:36:0) after 1m56s
[15:50:24.222] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:36:0)
[15:50:24.241] Build status: STARTED
[15:50:24.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:37:0) after 1m16s
[15:51:40.270] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:37:0)
[15:51:40.288] Build status: STARTED
[15:51:40.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:38:0) after 3m50s
[15:55:30.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:38:0)
[15:55:30.363] Build status: STARTED
[15:55:30.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:39:0) after 8m18s
[16:03:48.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:39:0)
[16:03:48.425] Build status: STARTED
[16:03:48.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:40:0) after 6m35s
[16:10:23.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:40:0)
[16:10:23.439] Build status: STARTED
[16:10:23.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:41:0) after 6m22s
[16:16:45.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:41:0)
[16:16:45.517] Build status: STARTED
[16:16:45.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:42:0) after 7m29s
[16:24:14.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:42:0)
[16:24:14.586] Build status: STARTED
[16:24:14.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:43:0) after 7m12s
[16:31:26.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:43:0)
[16:31:26.753] Build status: STARTED
[16:31:26.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:44:0) after 6m44s
[16:38:10.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:44:0)
[16:38:10.838] Build status: STARTED
[16:38:10.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:45:0) after 4m27s
[16:42:37.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:45:0)
[16:42:37.929] Build status: STARTED
[16:42:37.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:46:0) after 9m43s
[16:52:20.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:46:0)
[16:52:21.016] Build status: STARTED
[16:52:21.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:47:0) after 5m56s
[16:58:16.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:47:0)
[16:58:17.017] Build status: STARTED
[16:58:17.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:48:0) after 8m32s
[17:06:49.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:48:0)
[17:06:49.107] Build status: STARTED
[17:06:49.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:49:0) after 3m21s
[17:10:10.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:49:0)
[17:10:10.344] Build status: STARTED
[17:10:10.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:50:0) after 5m29s
[17:15:39.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:50:0)
[17:15:39.474] Build status: STARTED
[17:15:39.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:51:0) after 6m0s
[17:21:39.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:51:0)
[17:21:39.644] Build status: STARTED
[17:21:39.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:52:0) after 4m14s
[17:25:53.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:52:0)
[17:25:53.703] Build status: STARTED
[17:25:53.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:53:0) after 3m16s
[17:29:09.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:53:0)
[17:29:09.724] Build status: STARTED
[17:29:09.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:54:0) after 3m17s
[17:32:26.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:54:0)
[17:32:26.723] Build status: STARTED
[17:32:26.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:55:0) after 3m29s
[17:35:55.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:55:0)
[17:35:55.784] Build status: STARTED
[17:35:55.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:56:0) after 5m17s
[17:41:12.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:56:0)
[17:41:12.836] Build status: STARTED
[17:41:12.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:57:0) after 1m15s
[17:42:27.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:57:0)
[17:42:27.899] Build status: STARTED
[17:42:27.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:58:0) after 9m57s
[17:52:24.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:58:0)
[17:52:24.973] Build status: STARTED
[17:52:24.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:59:0) after 4m35s
[17:56:59.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:59:0)
[17:57:00.015] Build status: STARTED
[17:57:00.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:60:0) after 9m45s
[18:06:45.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:60:0)
[18:06:45.093] Build status: STARTED
[18:06:45.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:61:0) after 7m36s
[18:14:21.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:61:0)
[18:14:21.136] Build status: STARTED
[18:14:21.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:62:0) after 9m36s
[18:23:57.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:62:0)
[18:23:57.194] Build status: STARTED
[18:23:57.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:63:0) after 3m24s
[18:27:21.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:63:0)
[18:27:21.252] Build status: STARTED
[18:27:21.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:64:0) after 9m31s
[18:36:52.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:64:0)
[18:36:52.475] Build status: STARTED
[18:36:52.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:65:0) after 5m4s
[18:41:56.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:65:0)
[18:41:56.616] Build status: STARTED
[18:41:56.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:66:0) after 8m14s
[18:50:10.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:66:0)
[18:50:10.765] Build status: STARTED
[18:50:10.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:67:0) after 1m21s
[18:51:31.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:67:0)
[18:51:31.809] Build status: STARTED
[18:51:31.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:68:0) after 7m7s
[18:58:38.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:68:0)
[18:58:38.855] Build status: STARTED
[18:58:38.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:69:0) after 2m35s
[19:01:13.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:69:0)
[19:01:14.013] Build status: STARTED
[19:01:14.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:70:0) after 1m54s
[19:03:08.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:70:0)
[19:03:08.050] Build status: STARTED
[19:03:08.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:71:0) after 3m10s
[19:06:18.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:71:0)
[19:06:18.157] Build status: STARTED
[19:06:18.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:72:0) after 5m55s
[19:12:13.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:72:0)
[19:12:13.199] Build status: STARTED
[19:12:13.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:73:0) after 8m36s
[19:20:49.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:73:0)
[19:20:49.276] Build status: STARTED
[19:20:49.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:74:0) after 8m31s
[19:29:20.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:74:0)
[19:29:20.327] Build status: STARTED
[19:29:20.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:75:0) after 3m16s
[19:32:36.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:75:0)
[19:32:36.396] Build status: STARTED
[19:32:36.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:76:0) after 6m12s
[19:38:48.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:76:0)
[19:38:48.482] Build status: STARTED
[19:38:48.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:77:0) after 1m1s
[19:39:49.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:77:0)
[19:39:49.528] Build status: STARTED
[19:39:49.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:78:0) after 7m11s
[19:47:00.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:78:0)
[19:47:00.625] Build status: STARTED
[19:47:00.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:79:0) after 3m43s
[19:50:43.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:79:0)
[19:50:43.663] Build status: STARTED
[19:50:43.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:80:0) after 8m33s
[19:59:16.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:80:0)
[19:59:16.851] Build status: STARTED
[19:59:16.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:81:0) after 3m24s
[20:02:40.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:81:0)
[20:02:40.955] Build status: STARTED
[20:02:40.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:82:0) after 5m36s
[20:08:16.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:82:0)
[20:08:17.007] Build status: STARTED
[20:08:17.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:83:0) after 8m36s
[20:16:53.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:83:0)
[20:16:53.080] Build status: STARTED
[20:16:53.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:84:0) after 8m43s
[20:25:36.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:84:0)
[20:25:36.134] Build status: STARTED
[20:25:36.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:85:0) after 5m18s
[20:30:54.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:85:0)
[20:30:54.212] Build status: STARTED
[20:30:54.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:86:0) after 2m17s
[20:33:11.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:86:0)
[20:33:11.259] Build status: STARTED
[20:33:11.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:87:0) after 7m4s
[20:40:15.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:87:0)
[20:40:15.306] Build status: STARTED
[20:40:15.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:88:0) after 4m5s
[20:44:20.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:88:0)
[20:44:20.407] Build status: STARTED
[20:44:20.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:89:0) after 9m51s
[20:54:11.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:89:0)
[20:54:11.524] Build status: STARTED
[20:54:11.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:90:0) after 3m35s
[20:57:46.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:90:0)
[20:57:46.581] Build status: STARTED
[20:57:46.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:91:0) after 3m35s
[21:01:21.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:91:0)
[21:01:21.746] Build status: STARTED
[21:01:21.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:92:0) after 6m6s
[21:07:27.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:92:0)
[21:07:27.776] Build status: STARTED
[21:07:27.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:93:0) after 7m1s
[21:14:28.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:93:0)
[21:14:28.773] Build status: STARTED
[21:14:28.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:94:0) after 2m1s
[21:16:29.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:94:0)
[21:16:30.149] Build status: STARTED
[21:16:30.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:95:0) after 1m15s
[21:17:45.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:95:0)
[21:17:45.245] Build status: STARTED
[21:17:45.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8875432588849924192:96:0) after 9m56s
[21:22:38.265] Received PubSub notification, asking Buildbucket for the build status
[21:22:38.283] Build:
{
"id": "8710002526466933201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27789,
"createdBy": "project:chromium",
"createTime": "2025-07-07T12:28:36.882192010Z",
"startTime": "2025-07-07T12:29:37.796926903Z",
"endTime": "2025-07-07T21:22:37.935921997Z",
"updateTime": "2025-07-07T21:22:37.935921997Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae31613bb00689e17bf34313760e0596e989211a",
"ref": "refs/heads/main"
}
}
}
[21:22:38.283] Invocation finished in 8h54m3.057480981s with status FAILED