[15:23:54.632] New invocation is queued and will start shortly
[15:23:55.959] Starting the invocation (attempt 1)
[15:23:55.986] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6f1180e87d14504122e8a7a51fbe5f4436e1388f"
[15:23:55.986] Popped gitiles commit info from properties and tags
[15:23:55.986] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:23:55.987] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:23:55.987] Buildbucket request:
{
"requestId": "8910301390529774000",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6f1180e87d14504122e8a7a51fbe5f4436e1388f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8910301390529774000"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:23:56.700] Scheduled build:
{
"id": "8744871328384465297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 23568,
"createdBy": "project:chromium",
"createTime": "2024-06-17T15:23:56.050822724Z",
"updateTime": "2024-06-17T15:23:56.050822724Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6f1180e87d14504122e8a7a51fbe5f4436e1388f",
"ref": "refs/heads/main"
}
}
}
[15:23:56.700] Task URL: https://cr-buildbucket.appspot.com/build/8744871328384465297
[15:23:56.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:2:0) after 1m49s
[15:23:57.578] Received PubSub notification, asking Buildbucket for the build status
[15:23:57.725] Build status: SCHEDULED
[15:25:24.384] Received PubSub notification, asking Buildbucket for the build status
[15:25:24.401] Build status: STARTED
[15:25:45.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:2:0)
[15:25:45.731] Build status: STARTED
[15:25:45.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:5:0) after 2m25s
[15:28:10.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:5:0)
[15:28:10.820] Build status: STARTED
[15:28:10.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:6:0) after 2m22s
[15:30:32.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:6:0)
[15:30:32.934] Build status: STARTED
[15:30:32.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:7:0) after 1m59s
[15:32:32.031] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:7:0)
[15:32:32.047] Build status: STARTED
[15:32:32.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:8:0) after 2m41s
[15:35:13.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:8:0)
[15:35:13.054] Build status: STARTED
[15:35:13.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:9:0) after 2m41s
[15:37:54.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:9:0)
[15:37:54.091] Build status: STARTED
[15:37:54.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:10:0) after 5m22s
[15:43:16.171] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:10:0)
[15:43:16.197] Build status: STARTED
[15:43:16.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:11:0) after 6m45s
[15:50:01.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:11:0)
[15:50:01.260] Build status: STARTED
[15:50:01.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:12:0) after 8m47s
[15:58:48.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:12:0)
[15:58:48.349] Build status: STARTED
[15:58:48.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:13:0) after 9m48s
[16:08:36.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:13:0)
[16:08:36.483] Build status: STARTED
[16:08:36.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:14:0) after 2m4s
[16:10:40.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:14:0)
[16:10:40.610] Build status: STARTED
[16:10:40.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:15:0) after 2m30s
[16:13:10.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:15:0)
[16:13:10.642] Build status: STARTED
[16:13:10.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:16:0) after 6m43s
[16:19:53.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:16:0)
[16:19:53.652] Build status: STARTED
[16:19:53.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:17:0) after 5m54s
[16:25:47.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:17:0)
[16:25:47.700] Build status: STARTED
[16:25:47.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:18:0) after 2m43s
[16:28:30.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:18:0)
[16:28:30.834] Build status: STARTED
[16:28:30.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:19:0) after 1m45s
[16:30:15.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:19:0)
[16:30:15.928] Build status: STARTED
[16:30:15.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:20:0) after 8m38s
[16:38:54.036] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:20:0)
[16:38:54.051] Build status: STARTED
[16:38:54.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:21:0) after 6m45s
[16:45:39.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:21:0)
[16:45:39.173] Build status: STARTED
[16:45:39.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:22:0) after 3m34s
[16:49:13.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:22:0)
[16:49:13.272] Build status: STARTED
[16:49:13.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:23:0) after 1m17s
[16:50:30.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:23:0)
[16:50:30.411] Build status: STARTED
[16:50:30.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:24:0) after 9m43s
[17:00:13.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:24:0)
[17:00:13.463] Build status: STARTED
[17:00:13.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:25:0) after 6m55s
[17:07:08.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:25:0)
[17:07:08.657] Build status: STARTED
[17:07:08.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:26:0) after 7m40s
[17:14:48.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:26:0)
[17:14:48.846] Build status: STARTED
[17:14:48.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:27:0) after 2m49s
[17:17:37.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:27:0)
[17:17:37.901] Build status: STARTED
[17:17:37.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:28:0) after 6m35s
[17:24:13.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:28:0)
[17:24:13.068] Build status: STARTED
[17:24:13.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:29:0) after 4m25s
[17:28:38.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:29:0)
[17:28:38.109] Build status: STARTED
[17:28:38.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:30:0) after 7m15s
[17:35:53.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:30:0)
[17:35:53.210] Build status: STARTED
[17:35:53.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:31:0) after 1m17s
[17:37:10.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:31:0)
[17:37:10.230] Build status: STARTED
[17:37:10.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:32:0) after 1m41s
[17:38:51.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:32:0)
[17:38:51.289] Build status: STARTED
[17:38:51.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:33:0) after 2m3s
[17:40:54.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:33:0)
[17:40:54.355] Build status: STARTED
[17:40:54.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:34:0) after 8m42s
[17:49:36.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:34:0)
[17:49:36.381] Build status: STARTED
[17:49:36.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:35:0) after 4m31s
[17:54:07.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:35:0)
[17:54:07.456] Build status: STARTED
[17:54:07.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:36:0) after 6m51s
[18:00:58.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:36:0)
[18:00:58.508] Build status: STARTED
[18:00:58.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:37:0) after 5m39s
[18:06:37.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:37:0)
[18:06:37.712] Build status: STARTED
[18:06:37.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:38:0) after 1m48s
[18:08:25.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:38:0)
[18:08:25.768] Build status: STARTED
[18:08:25.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:39:0) after 9m16s
[18:17:41.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:39:0)
[18:17:41.817] Build status: STARTED
[18:17:41.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:40:0) after 4m25s
[18:22:06.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:40:0)
[18:22:06.938] Build status: STARTED
[18:22:06.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:41:0) after 3m23s
[18:25:29.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:41:0)
[18:25:29.983] Build status: STARTED
[18:25:29.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:42:0) after 1m45s
[18:27:15.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:42:0)
[18:27:15.040] Build status: STARTED
[18:27:15.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:43:0) after 5m6s
[18:32:21.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:43:0)
[18:32:21.628] Build status: STARTED
[18:32:21.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:44:0) after 9m5s
[18:41:26.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:44:0)
[18:41:26.682] Build status: STARTED
[18:41:26.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:45:0) after 6m3s
[18:47:29.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:45:0)
[18:47:29.857] Build status: STARTED
[18:47:29.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:46:0) after 5m34s
[18:53:04.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:46:0)
[18:53:04.379] Build status: STARTED
[18:53:04.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:47:0) after 3m27s
[18:56:31.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:47:0)
[18:56:31.521] Build status: STARTED
[18:56:31.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:48:0) after 8m39s
[19:05:10.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:48:0)
[19:05:10.628] Build status: STARTED
[19:05:10.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:49:0) after 9m14s
[19:14:24.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:49:0)
[19:14:24.724] Build status: STARTED
[19:14:24.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:50:0) after 4m46s
[19:19:10.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:50:0)
[19:19:10.800] Build status: STARTED
[19:19:10.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:51:0) after 3m46s
[19:22:56.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:51:0)
[19:22:56.843] Build status: STARTED
[19:22:56.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:52:0) after 7m26s
[19:30:22.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:52:0)
[19:30:22.884] Build status: STARTED
[19:30:22.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:53:0) after 1m50s
[19:32:12.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:53:0)
[19:32:12.929] Build status: STARTED
[19:32:12.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:54:0) after 9m45s
[19:41:57.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:54:0)
[19:41:57.995] Build status: STARTED
[19:41:57.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:55:0) after 4m0s
[19:45:58.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:55:0)
[19:45:58.049] Build status: STARTED
[19:45:58.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:56:0) after 4m48s
[19:50:46.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:56:0)
[19:50:46.201] Build status: STARTED
[19:50:46.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:57:0) after 1m35s
[19:52:21.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:57:0)
[19:52:21.270] Build status: STARTED
[19:52:21.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:58:0) after 7m35s
[19:59:56.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:58:0)
[19:59:56.364] Build status: STARTED
[19:59:56.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:59:0) after 2m59s
[20:02:55.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:59:0)
[20:02:55.422] Build status: STARTED
[20:02:55.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:60:0) after 8m7s
[20:11:02.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:60:0)
[20:11:02.519] Build status: STARTED
[20:11:02.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:61:0) after 5m2s
[20:16:04.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:61:0)
[20:16:04.608] Build status: STARTED
[20:16:04.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:62:0) after 5m15s
[20:21:19.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:62:0)
[20:21:19.698] Build status: STARTED
[20:21:19.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:63:0) after 7m45s
[20:29:04.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:63:0)
[20:29:04.806] Build status: STARTED
[20:29:04.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:64:0) after 8m35s
[20:37:39.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:64:0)
[20:37:39.867] Build status: STARTED
[20:37:39.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:65:0) after 1m28s
[20:39:07.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:65:0)
[20:39:07.933] Build status: STARTED
[20:39:07.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:66:0) after 1m48s
[20:40:56.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:66:0)
[20:40:56.018] Build status: STARTED
[20:40:56.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:67:0) after 9m24s
[20:50:20.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:67:0)
[20:50:20.128] Build status: STARTED
[20:50:20.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:68:0) after 6m42s
[20:57:02.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:68:0)
[20:57:02.192] Build status: STARTED
[20:57:02.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:69:0) after 9m0s
[21:06:02.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:69:0)
[21:06:02.351] Build status: STARTED
[21:06:02.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:70:0) after 9m37s
[21:15:39.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:70:0)
[21:15:39.405] Build status: STARTED
[21:15:39.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:71:0) after 7m50s
[21:23:29.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:71:0)
[21:23:29.567] Build status: STARTED
[21:23:29.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:72:0) after 1m53s
[21:25:22.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:72:0)
[21:25:22.645] Build status: STARTED
[21:25:22.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:73:0) after 7m44s
[21:33:06.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:73:0)
[21:33:06.688] Build status: STARTED
[21:33:06.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:74:0) after 3m27s
[21:36:33.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:74:0)
[21:36:33.748] Build status: STARTED
[21:36:33.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:75:0) after 7m1s
[21:43:34.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:75:0)
[21:43:34.779] Build status: STARTED
[21:43:34.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:76:0) after 7m34s
[21:51:08.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:76:0)
[21:51:08.816] Build status: STARTED
[21:51:08.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:77:0) after 4m12s
[21:55:20.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:77:0)
[21:55:20.903] Build status: STARTED
[21:55:20.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:78:0) after 3m45s
[21:59:05.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:78:0)
[21:59:05.988] Build status: STARTED
[21:59:05.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:79:0) after 2m32s
[22:01:38.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:79:0)
[22:01:38.051] Build status: STARTED
[22:01:38.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:80:0) after 1m42s
[22:03:20.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:80:0)
[22:03:20.119] Build status: STARTED
[22:03:20.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:81:0) after 6m47s
[22:10:07.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:81:0)
[22:10:07.215] Build status: STARTED
[22:10:07.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:82:0) after 2m19s
[22:12:26.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:82:0)
[22:12:26.268] Build status: STARTED
[22:12:26.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:83:0) after 9m3s
[22:21:29.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:83:0)
[22:21:29.397] Build status: STARTED
[22:21:29.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:84:0) after 8m40s
[22:30:09.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:84:0)
[22:30:09.465] Build status: STARTED
[22:30:09.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:85:0) after 9m15s
[22:39:24.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:85:0)
[22:39:24.578] Build status: STARTED
[22:39:24.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:86:0) after 3m27s
[22:42:51.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:86:0)
[22:42:51.623] Build status: STARTED
[22:42:51.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:87:0) after 5m36s
[22:48:27.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:87:0)
[22:48:27.724] Build status: STARTED
[22:48:27.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:88:0) after 7m57s
[22:56:24.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:88:0)
[22:56:24.783] Build status: STARTED
[22:56:24.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:89:0) after 5m10s
[23:01:34.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:89:0)
[23:01:34.909] Build status: STARTED
[23:01:34.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:90:0) after 6m8s
[23:07:42.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:90:0)
[23:07:43.000] Build status: STARTED
[23:07:43.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:91:0) after 9m17s
[23:17:00.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:91:0)
[23:17:00.085] Build status: STARTED
[23:17:00.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:92:0) after 4m31s
[23:21:31.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:92:0)
[23:21:31.179] Build status: STARTED
[23:21:31.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:93:0) after 6m36s
[23:28:07.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:93:0)
[23:28:07.215] Build status: STARTED
[23:28:07.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:94:0) after 8m39s
[23:36:46.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:94:0)
[23:36:46.252] Build status: STARTED
[23:36:46.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:95:0) after 5m21s
[23:42:07.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:95:0)
[23:42:07.339] Build status: STARTED
[23:42:07.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:96:0) after 9m32s
[23:51:39.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:96:0)
[23:51:39.455] Build status: STARTED
[23:51:39.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:97:0) after 9m26s
[00:01:05.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:97:0)
[00:01:05.519] Build status: STARTED
[00:01:05.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:98:0) after 3m15s
[00:04:20.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:98:0)
[00:04:20.584] Build status: STARTED
[00:04:20.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:99:0) after 4m33s
[00:08:53.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:99:0)
[00:08:53.838] Build status: STARTED
[00:08:53.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:100:0) after 1m24s
[00:10:17.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:100:0)
[00:10:17.961] Build status: STARTED
[00:10:17.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:101:0) after 9m44s
[00:20:01.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:101:0)
[00:20:02.010] Build status: STARTED
[00:20:02.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:102:0) after 6m13s
[00:26:15.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:102:0)
[00:26:15.119] Build status: STARTED
[00:26:15.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:103:0) after 4m36s
[00:30:51.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:103:0)
[00:30:51.161] Build status: STARTED
[00:30:51.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:104:0) after 9m5s
[00:39:56.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:104:0)
[00:39:56.275] Build status: STARTED
[00:39:56.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:105:0) after 1m42s
[00:41:38.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:105:0)
[00:41:38.640] Build status: STARTED
[00:41:38.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:106:0) after 1m22s
[00:43:00.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:106:0)
[00:43:00.770] Build status: STARTED
[00:43:00.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:107:0) after 4m37s
[00:47:38.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:107:0)
[00:47:38.059] Build status: STARTED
[00:47:38.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:108:0) after 2m1s
[00:49:39.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:108:0)
[00:49:39.190] Build status: STARTED
[00:49:39.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:109:0) after 3m30s
[00:53:09.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:109:0)
[00:53:09.216] Build status: STARTED
[00:53:09.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:110:0) after 2m34s
[00:55:43.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:110:0)
[00:55:43.781] Build status: STARTED
[00:55:43.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910301390529774000:111:0) after 6m46s
[01:01:47.520] Received PubSub notification, asking Buildbucket for the build status
[01:01:47.539] Build:
{
"id": "8744871328384465297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 23568,
"createdBy": "project:chromium",
"createTime": "2024-06-17T15:23:56.050822724Z",
"startTime": "2024-06-17T15:25:24.195977977Z",
"endTime": "2024-06-18T01:01:46.715228734Z",
"updateTime": "2024-06-18T01:01:46.715228734Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6f1180e87d14504122e8a7a51fbe5f4436e1388f",
"ref": "refs/heads/main"
}
}
}
[01:01:47.539] Invocation finished in 9h37m52.918953681s with status FAILED