[19:16:50.383] New invocation is queued and will start shortly
[19:16:51.451] Starting the invocation (attempt 1)
[19:16:51.479] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/23f4d1b552a7c5af2bcdd29ef6db32108cb991c9"
[19:16:51.479] Popped gitiles commit info from properties and tags
[19:16:51.479] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:16:51.479] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:16:51.479] Buildbucket request:
{
"requestId": "8902495396778225504",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "23f4d1b552a7c5af2bcdd29ef6db32108cb991c9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8902495396778225504"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:16:52.211] Scheduled build:
{
"id": "8737065334881120577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 24394,
"createdBy": "project:chromium",
"createTime": "2024-09-11T19:16:51.568956896Z",
"updateTime": "2024-09-11T19:16:51.568956896Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "23f4d1b552a7c5af2bcdd29ef6db32108cb991c9",
"ref": "refs/heads/main"
}
}
}
[19:16:52.211] Task URL: https://cr-buildbucket.appspot.com/build/8737065334881120577
[19:16:52.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:2:0) after 2m0s
[19:16:53.132] Received PubSub notification, asking Buildbucket for the build status
[19:16:53.162] Build status: SCHEDULED
[19:18:28.427] Received PubSub notification, asking Buildbucket for the build status
[19:18:28.453] Build status: STARTED
[19:18:52.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:2:0)
[19:18:52.324] Build status: STARTED
[19:18:52.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:5:0) after 1m19s
[19:20:11.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:5:0)
[19:20:11.556] Build status: STARTED
[19:20:11.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:6:0) after 4m2s
[19:24:13.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:6:0)
[19:24:13.638] Build status: STARTED
[19:24:13.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:7:0) after 9m45s
[19:33:58.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:7:0)
[19:33:58.775] Build status: STARTED
[19:33:58.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:8:0) after 3m26s
[19:37:24.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:8:0)
[19:37:24.817] Build status: STARTED
[19:37:24.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:9:0) after 4m36s
[19:42:00.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:9:0)
[19:42:00.903] Build status: STARTED
[19:42:00.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:10:0) after 7m13s
[19:49:13.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:10:0)
[19:49:13.954] Build status: STARTED
[19:49:13.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:11:0) after 5m0s
[19:54:13.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:11:0)
[19:54:14.039] Build status: STARTED
[19:54:14.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:12:0) after 3m49s
[19:58:03.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:12:0)
[19:58:03.142] Build status: STARTED
[19:58:03.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:13:0) after 2m3s
[20:00:06.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:13:0)
[20:00:06.210] Build status: STARTED
[20:00:06.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:14:0) after 4m4s
[20:04:10.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:14:0)
[20:04:10.289] Build status: STARTED
[20:04:10.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:15:0) after 7m32s
[20:11:42.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:15:0)
[20:11:42.370] Build status: STARTED
[20:11:42.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:16:0) after 6m25s
[20:18:07.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:16:0)
[20:18:07.537] Build status: STARTED
[20:18:07.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:17:0) after 3m53s
[20:22:00.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:17:0)
[20:22:00.686] Build status: STARTED
[20:22:00.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:18:0) after 3m28s
[20:25:28.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:18:0)
[20:25:28.800] Build status: STARTED
[20:25:28.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:19:0) after 2m57s
[20:28:25.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:19:0)
[20:28:25.892] Build status: STARTED
[20:28:25.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:20:0) after 1m59s
[20:30:24.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:20:0)
[20:30:25.107] Build status: STARTED
[20:30:25.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:21:0) after 3m16s
[20:33:41.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:21:0)
[20:33:41.178] Build status: STARTED
[20:33:41.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:22:0) after 1m20s
[20:35:01.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:22:0)
[20:35:01.355] Build status: STARTED
[20:35:01.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:23:0) after 1m53s
[20:36:54.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:23:0)
[20:36:54.422] Build status: STARTED
[20:36:54.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:24:0) after 9m10s
[20:46:04.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:24:0)
[20:46:04.538] Build status: STARTED
[20:46:04.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:25:0) after 5m15s
[20:51:19.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:25:0)
[20:51:19.627] Build status: STARTED
[20:51:19.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:26:0) after 1m31s
[20:52:50.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:26:0)
[20:52:50.743] Build status: STARTED
[20:52:50.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:27:0) after 8m31s
[21:01:21.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:27:0)
[21:01:21.799] Build status: STARTED
[21:01:21.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:28:0) after 7m57s
[21:09:18.814] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:28:0)
[21:09:18.832] Build status: STARTED
[21:09:18.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:29:0) after 8m50s
[21:18:08.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:29:0)
[21:18:09.025] Build status: STARTED
[21:18:09.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:30:0) after 1m1s
[21:19:10.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:30:0)
[21:19:10.097] Build status: STARTED
[21:19:10.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:31:0) after 5m56s
[21:25:06.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:31:0)
[21:25:06.165] Build status: STARTED
[21:25:06.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:32:0) after 5m9s
[21:30:15.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:32:0)
[21:30:15.290] Build status: STARTED
[21:30:15.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:33:0) after 9m58s
[21:40:13.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:33:0)
[21:40:13.406] Build status: STARTED
[21:40:13.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:34:0) after 9m3s
[21:49:16.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:34:0)
[21:49:16.517] Build status: STARTED
[21:49:16.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:35:0) after 1m35s
[21:50:51.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:35:0)
[21:50:51.575] Build status: STARTED
[21:50:51.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:36:0) after 3m28s
[21:54:19.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:36:0)
[21:54:19.631] Build status: STARTED
[21:54:19.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:37:0) after 1m51s
[21:56:10.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:37:0)
[21:56:10.774] Build status: STARTED
[21:56:10.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:38:0) after 5m16s
[22:01:26.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:38:0)
[22:01:26.845] Build status: STARTED
[22:01:26.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:39:0) after 1m50s
[22:03:16.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:39:0)
[22:03:16.976] Build status: STARTED
[22:03:16.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:40:0) after 3m20s
[22:06:37.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:40:0)
[22:06:37.093] Build status: STARTED
[22:06:37.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:41:0) after 1m35s
[22:08:12.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:41:0)
[22:08:12.169] Build status: STARTED
[22:08:12.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:42:0) after 4m27s
[22:12:39.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:42:0)
[22:12:39.297] Build status: STARTED
[22:12:39.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:43:0) after 2m42s
[22:15:21.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:43:0)
[22:15:21.387] Build status: STARTED
[22:15:21.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:44:0) after 1m56s
[22:17:17.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:44:0)
[22:17:17.467] Build status: STARTED
[22:17:17.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:45:0) after 7m34s
[22:24:51.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:45:0)
[22:24:51.530] Build status: STARTED
[22:24:51.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:46:0) after 9m19s
[22:34:10.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:46:0)
[22:34:10.570] Build status: STARTED
[22:34:10.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:47:0) after 8m55s
[22:43:05.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:47:0)
[22:43:05.613] Build status: STARTED
[22:43:05.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:48:0) after 1m12s
[22:44:17.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:48:0)
[22:44:17.700] Build status: STARTED
[22:44:17.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:49:0) after 7m3s
[22:51:20.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:49:0)
[22:51:20.785] Build status: STARTED
[22:51:20.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:50:0) after 5m30s
[22:56:50.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:50:0)
[22:56:50.838] Build status: STARTED
[22:56:50.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:51:0) after 9m19s
[23:06:09.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:51:0)
[23:06:09.930] Build status: STARTED
[23:06:09.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:52:0) after 7m26s
[23:13:36.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:52:0)
[23:13:36.037] Build status: STARTED
[23:13:36.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:53:0) after 6m45s
[23:20:21.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:53:0)
[23:20:21.146] Build status: STARTED
[23:20:21.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:54:0) after 2m50s
[23:23:11.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:54:0)
[23:23:11.257] Build status: STARTED
[23:23:11.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:55:0) after 4m37s
[23:27:48.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:55:0)
[23:27:48.322] Build status: STARTED
[23:27:48.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902495396778225504:56:0) after 1m36s
[23:27:54.649] Received PubSub notification, asking Buildbucket for the build status
[23:27:54.667] Build:
{
"id": "8737065334881120577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 24394,
"createdBy": "project:chromium",
"createTime": "2024-09-11T19:16:51.568956896Z",
"startTime": "2024-09-11T19:18:28.235753071Z",
"endTime": "2024-09-11T23:27:54.270492155Z",
"updateTime": "2024-09-11T23:27:54.270492155Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "23f4d1b552a7c5af2bcdd29ef6db32108cb991c9",
"ref": "refs/heads/main"
}
}
}
[23:27:54.667] Invocation finished in 4h11m4.292485738s with status FAILED