[16:13:53.573] New invocation is queued and will start shortly
[16:13:54.687] Starting the invocation (attempt 1)
[16:13:54.721] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/801662b5466d86af6d765047aaae413187747a29"
[16:13:54.721] Popped gitiles commit info from properties and tags
[16:13:54.721] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:13:54.721] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:13:54.722] Buildbucket request:
{
"requestId": "8874874832049391040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "801662b5466d86af6d765047aaae413187747a29",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874874832049391040"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:13:55.667] Scheduled build:
{
"id": "8709444770117949041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27809,
"createdBy": "project:chromium",
"createTime": "2025-07-13T16:13:54.787266883Z",
"updateTime": "2025-07-13T16:13:54.787266883Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "801662b5466d86af6d765047aaae413187747a29",
"ref": "refs/heads/main"
}
}
}
[16:13:55.667] Task URL: https://cr-buildbucket.appspot.com/build/8709444770117949041
[16:13:55.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:2:0) after 3m34s
[16:13:56.557] Received PubSub notification, asking Buildbucket for the build status
[16:13:56.583] Build status: SCHEDULED
[16:15:01.814] Received PubSub notification, asking Buildbucket for the build status
[16:15:01.850] Build status: STARTED
[16:17:29.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:2:0)
[16:17:29.682] Build status: STARTED
[16:17:29.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:5:0) after 4m17s
[16:21:46.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:5:0)
[16:21:47.097] Build status: STARTED
[16:21:47.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:6:0) after 6m48s
[16:28:35.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:6:0)
[16:28:35.146] Build status: STARTED
[16:28:35.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:7:0) after 3m17s
[16:31:52.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:7:0)
[16:31:52.494] Build status: STARTED
[16:31:52.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:8:0) after 1m29s
[16:33:21.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:8:0)
[16:33:21.573] Build status: STARTED
[16:33:21.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:9:0) after 3m46s
[16:37:07.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:9:0)
[16:37:07.630] Build status: STARTED
[16:37:07.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:10:0) after 9m12s
[16:46:19.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:10:0)
[16:46:19.697] Build status: STARTED
[16:46:19.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:11:0) after 9m13s
[16:55:32.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:11:0)
[16:55:32.891] Build status: STARTED
[16:55:32.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:12:0) after 4m50s
[17:00:22.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:12:0)
[17:00:23.184] Build status: STARTED
[17:00:23.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:13:0) after 6m7s
[17:06:30.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:13:0)
[17:06:30.423] Build status: STARTED
[17:06:30.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:14:0) after 7m53s
[17:14:23.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:14:0)
[17:14:23.837] Build status: STARTED
[17:14:23.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:15:0) after 5m30s
[17:19:54.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:15:0)
[17:19:54.150] Build status: STARTED
[17:19:54.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:16:0) after 3m29s
[17:23:23.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:16:0)
[17:23:23.720] Build status: STARTED
[17:23:23.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:17:0) after 1m42s
[17:25:06.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:17:0)
[17:25:06.161] Build status: STARTED
[17:25:06.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:18:0) after 6m39s
[17:31:45.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:18:0)
[17:31:45.207] Build status: STARTED
[17:31:45.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:19:0) after 5m11s
[17:36:56.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:19:0)
[17:36:56.263] Build status: STARTED
[17:36:56.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:20:0) after 2m1s
[17:38:57.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:20:0)
[17:38:57.313] Build status: STARTED
[17:38:57.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:21:0) after 9m9s
[17:48:06.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:21:0)
[17:48:06.353] Build status: STARTED
[17:48:06.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:22:0) after 3m57s
[17:52:03.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:22:0)
[17:52:03.470] Build status: STARTED
[17:52:03.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:23:0) after 7m45s
[17:59:48.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:23:0)
[17:59:48.498] Build status: STARTED
[17:59:48.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:24:0) after 5m17s
[18:05:05.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:24:0)
[18:05:05.725] Build status: STARTED
[18:05:05.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:25:0) after 8m21s
[18:13:27.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:25:0)
[18:13:27.258] Build status: STARTED
[18:13:27.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:26:0) after 6m15s
[18:19:42.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:26:0)
[18:19:42.315] Build status: STARTED
[18:19:42.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:27:0) after 3m35s
[18:23:17.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:27:0)
[18:23:17.532] Build status: STARTED
[18:23:17.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:28:0) after 3m34s
[18:26:51.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:28:0)
[18:26:51.584] Build status: STARTED
[18:26:51.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:29:0) after 5m41s
[18:32:32.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:29:0)
[18:32:32.615] Build status: STARTED
[18:32:32.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:30:0) after 4m46s
[18:37:18.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:30:0)
[18:37:18.684] Build status: STARTED
[18:37:18.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:31:0) after 5m9s
[18:42:27.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:31:0)
[18:42:27.741] Build status: STARTED
[18:42:27.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:32:0) after 4m20s
[18:46:47.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:32:0)
[18:46:47.859] Build status: STARTED
[18:46:47.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:33:0) after 3m35s
[18:50:23.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:33:0)
[18:50:23.102] Build status: STARTED
[18:50:23.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:34:0) after 8m51s
[18:59:14.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:34:0)
[18:59:14.333] Build status: STARTED
[18:59:14.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:35:0) after 1m28s
[19:00:42.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:35:0)
[19:00:42.377] Build status: STARTED
[19:00:42.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:36:0) after 8m45s
[19:09:27.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:36:0)
[19:09:27.659] Build status: STARTED
[19:09:27.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:37:0) after 7m50s
[19:17:17.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:37:0)
[19:17:17.869] Build status: STARTED
[19:17:17.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:38:0) after 2m23s
[19:19:40.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:38:0)
[19:19:40.923] Build status: STARTED
[19:19:40.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:39:0) after 4m19s
[19:23:59.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:39:0)
[19:23:59.973] Build status: STARTED
[19:23:59.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:40:0) after 9m19s
[19:33:18.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:40:0)
[19:33:18.983] Build status: STARTED
[19:33:18.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:41:0) after 8m33s
[19:41:52.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:41:0)
[19:41:52.049] Build status: STARTED
[19:41:52.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:42:0) after 2m26s
[19:44:18.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:42:0)
[19:44:18.242] Build status: STARTED
[19:44:18.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:43:0) after 8m25s
[19:52:43.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:43:0)
[19:52:43.587] Build status: STARTED
[19:52:43.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:44:0) after 5m2s
[19:57:45.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:44:0)
[19:57:45.788] Build status: STARTED
[19:57:45.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:45:0) after 4m1s
[20:01:46.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:45:0)
[20:01:46.937] Build status: STARTED
[20:01:46.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:46:0) after 3m41s
[20:05:28.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:46:0)
[20:05:28.154] Build status: STARTED
[20:05:28.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:47:0) after 5m29s
[20:10:57.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:47:0)
[20:10:57.368] Build status: STARTED
[20:10:57.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:48:0) after 8m30s
[20:19:27.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:48:0)
[20:19:27.496] Build status: STARTED
[20:19:27.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:49:0) after 5m52s
[20:25:19.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:49:0)
[20:25:19.536] Build status: STARTED
[20:25:19.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:50:0) after 3m11s
[20:28:30.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:50:0)
[20:28:30.787] Build status: STARTED
[20:28:30.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:51:0) after 4m58s
[20:33:28.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:51:0)
[20:33:28.859] Build status: STARTED
[20:33:28.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:52:0) after 4m52s
[20:38:21.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:52:0)
[20:38:21.212] Build status: STARTED
[20:38:21.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:53:0) after 1m43s
[20:40:04.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:53:0)
[20:40:04.334] Build status: STARTED
[20:40:04.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:54:0) after 1m24s
[20:41:28.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:54:0)
[20:41:28.595] Build status: STARTED
[20:41:28.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:55:0) after 6m55s
[20:48:23.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:55:0)
[20:48:23.624] Build status: STARTED
[20:48:23.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:56:0) after 1m13s
[20:49:36.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:56:0)
[20:49:36.677] Build status: STARTED
[20:49:36.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:57:0) after 9m46s
[20:59:22.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:57:0)
[20:59:22.758] Build status: STARTED
[20:59:22.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:58:0) after 8m50s
[21:08:12.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:58:0)
[21:08:12.832] Build status: STARTED
[21:08:12.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:59:0) after 6m21s
[21:14:33.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:59:0)
[21:14:33.984] Build status: STARTED
[21:14:33.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:60:0) after 5m57s
[21:20:31.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:60:0)
[21:20:31.087] Build status: STARTED
[21:20:31.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:61:0) after 4m27s
[21:24:58.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:61:0)
[21:24:58.135] Build status: STARTED
[21:24:58.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:62:0) after 3m31s
[21:28:29.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:62:0)
[21:28:29.337] Build status: STARTED
[21:28:29.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:63:0) after 1m25s
[21:29:54.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:63:0)
[21:29:54.464] Build status: STARTED
[21:29:54.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:64:0) after 8m45s
[21:38:39.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:64:0)
[21:38:39.838] Build status: STARTED
[21:38:39.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:65:0) after 8m5s
[21:46:44.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:65:0)
[21:46:44.892] Build status: STARTED
[21:46:44.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:66:0) after 4m53s
[21:51:38.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:66:0)
[21:51:38.241] Build status: STARTED
[21:51:38.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:67:0) after 1m22s
[21:53:00.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:67:0)
[21:53:00.280] Build status: STARTED
[21:53:00.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:68:0) after 4m59s
[21:57:59.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:68:0)
[21:57:59.373] Build status: STARTED
[21:57:59.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:69:0) after 5m26s
[22:03:25.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:69:0)
[22:03:25.502] Build status: STARTED
[22:03:25.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:70:0) after 2m26s
[22:05:51.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:70:0)
[22:05:51.613] Build status: STARTED
[22:05:51.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:71:0) after 3m54s
[22:09:45.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:71:0)
[22:09:45.697] Build status: STARTED
[22:09:45.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:72:0) after 8m29s
[22:18:14.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:72:0)
[22:18:14.739] Build status: STARTED
[22:18:14.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:73:0) after 6m41s
[22:24:55.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:73:0)
[22:24:55.936] Build status: STARTED
[22:24:55.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:74:0) after 8m7s
[22:33:02.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:74:0)
[22:33:03.005] Build status: STARTED
[22:33:03.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:75:0) after 2m51s
[22:35:54.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:75:0)
[22:35:54.086] Build status: STARTED
[22:35:54.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:76:0) after 7m36s
[22:43:30.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:76:0)
[22:43:30.244] Build status: STARTED
[22:43:30.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:77:0) after 7m39s
[22:51:09.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:77:0)
[22:51:09.501] Build status: STARTED
[22:51:09.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:78:0) after 4m35s
[22:55:44.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:78:0)
[22:55:44.695] Build status: STARTED
[22:55:44.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:79:0) after 1m9s
[22:56:53.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:79:0)
[22:56:53.728] Build status: STARTED
[22:56:53.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:80:0) after 7m43s
[23:04:36.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:80:0)
[23:04:36.811] Build status: STARTED
[23:04:36.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:81:0) after 3m20s
[23:07:56.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:81:0)
[23:07:56.873] Build status: STARTED
[23:07:56.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:82:0) after 2m26s
[23:10:23.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:82:0)
[23:10:23.043] Build status: STARTED
[23:10:23.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:83:0) after 2m14s
[23:12:37.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:83:0)
[23:12:37.337] Build status: STARTED
[23:12:37.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:84:0) after 1m5s
[23:13:42.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:84:0)
[23:13:42.406] Build status: STARTED
[23:13:42.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:85:0) after 7m12s
[23:20:54.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:85:0)
[23:20:54.479] Build status: STARTED
[23:20:54.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:86:0) after 4m43s
[23:25:37.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:86:0)
[23:25:37.525] Build status: STARTED
[23:25:37.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:87:0) after 4m41s
[23:30:18.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:87:0)
[23:30:18.561] Build status: STARTED
[23:30:18.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:88:0) after 4m54s
[23:35:12.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:88:0)
[23:35:12.599] Build status: STARTED
[23:35:12.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:89:0) after 2m36s
[23:37:48.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:89:0)
[23:37:48.702] Build status: STARTED
[23:37:48.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:90:0) after 2m17s
[23:40:05.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:90:0)
[23:40:05.812] Build status: STARTED
[23:40:05.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:91:0) after 2m3s
[23:42:08.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:91:0)
[23:42:08.859] Build status: STARTED
[23:42:08.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:92:0) after 7m31s
[23:49:39.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:92:0)
[23:49:39.926] Build status: STARTED
[23:49:39.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:93:0) after 9m13s
[23:58:52.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:93:0)
[23:58:52.988] Build status: STARTED
[23:58:52.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:94:0) after 2m44s
[00:01:37.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:94:0)
[00:01:37.107] Build status: STARTED
[00:01:37.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:95:0) after 1m6s
[00:02:43.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:95:0)
[00:02:43.204] Build status: STARTED
[00:02:43.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:96:0) after 9m10s
[00:11:53.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:96:0)
[00:11:53.242] Build status: STARTED
[00:11:53.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:97:0) after 5m14s
[00:17:07.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:97:0)
[00:17:07.293] Build status: STARTED
[00:17:07.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:98:0) after 9m31s
[00:26:38.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:98:0)
[00:26:38.433] Build status: STARTED
[00:26:38.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:99:0) after 7m29s
[00:34:07.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:99:0)
[00:34:07.478] Build status: STARTED
[00:34:07.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:100:0) after 8m8s
[00:42:15.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:100:0)
[00:42:15.568] Build status: STARTED
[00:42:15.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:101:0) after 7m59s
[00:50:14.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:101:0)
[00:50:14.801] Build status: STARTED
[00:50:14.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:102:0) after 1m40s
[00:51:55.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:102:0)
[00:51:55.148] Build status: STARTED
[00:51:55.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:103:0) after 8m7s
[01:00:02.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:103:0)
[01:00:02.481] Build status: STARTED
[01:00:02.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:104:0) after 5m45s
[01:05:47.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:104:0)
[01:05:47.526] Build status: STARTED
[01:05:47.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:105:0) after 9m48s
[01:15:35.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:105:0)
[01:15:35.600] Build status: STARTED
[01:15:35.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874874832049391040:106:0) after 9m0s
[01:19:30.751] Received PubSub notification, asking Buildbucket for the build status
[01:19:30.771] Build:
{
"id": "8709444770117949041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27809,
"createdBy": "project:chromium",
"createTime": "2025-07-13T16:13:54.787266883Z",
"startTime": "2025-07-13T16:15:01.601794407Z",
"endTime": "2025-07-14T01:19:30.464328159Z",
"updateTime": "2025-07-14T01:19:30.464328159Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "801662b5466d86af6d765047aaae413187747a29",
"ref": "refs/heads/main"
}
}
}
[01:19:30.771] Invocation finished in 9h5m37.209586862s with status FAILED