[13:15:02.839] New invocation is queued and will start shortly
[13:15:04.085] Starting the invocation (attempt 1)
[13:15:04.120] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/694fb257ee5507e88d1c254d13fafaafd555dc35"
[13:15:04.120] Popped gitiles commit info from properties and tags
[13:15:04.120] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:15:04.120] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:15:04.120] Buildbucket request:
{
"requestId": "8950987535816454048",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "694fb257ee5507e88d1c254d13fafaafd555dc35",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950987535816454048"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:15:04.728] Scheduled build:
{
"id": "8785557473558675169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18622,
"createdBy": "project:chromium",
"createTime": "2023-03-26T13:15:04.364987419Z",
"updateTime": "2023-03-26T13:15:04.364987419Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "694fb257ee5507e88d1c254d13fafaafd555dc35",
"ref": "refs/heads/main"
}
}
}
[13:15:04.728] Task URL: https://cr-buildbucket.appspot.com/build/8785557473558675169
[13:15:04.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:2:0) after 4m25s
[13:19:29.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:2:0)
[13:19:29.868] Build status: SCHEDULED
[13:19:29.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:3:0) after 1m46s
[13:20:42.250] Received PubSub notification, asking Buildbucket for the build status
[13:20:42.276] Build status: STARTED
[13:21:15.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:3:0)
[13:21:16.039] Build status: STARTED
[13:21:16.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:5:0) after 7m2s
[13:28:18.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:5:0)
[13:28:18.345] Build status: STARTED
[13:28:18.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:6:0) after 4m38s
[13:32:56.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:6:0)
[13:32:56.392] Build status: STARTED
[13:32:56.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:7:0) after 4m58s
[13:37:54.425] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:7:0)
[13:37:54.444] Build status: STARTED
[13:37:54.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:8:0) after 5m40s
[13:43:34.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:8:0)
[13:43:34.469] Build status: STARTED
[13:43:34.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:9:0) after 4m30s
[13:48:04.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:9:0)
[13:48:04.703] Build status: STARTED
[13:48:04.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:10:0) after 5m27s
[13:53:32.035] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:10:0)
[13:53:32.060] Build status: STARTED
[13:53:32.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:11:0) after 7m13s
[14:00:45.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:11:0)
[14:00:45.151] Build status: STARTED
[14:00:45.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:12:0) after 8m14s
[14:08:59.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:12:0)
[14:08:59.234] Build status: STARTED
[14:08:59.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:13:0) after 1m30s
[14:10:29.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:13:0)
[14:10:29.302] Build status: STARTED
[14:10:29.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:14:0) after 7m21s
[14:17:50.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:14:0)
[14:17:50.335] Build status: STARTED
[14:17:50.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:15:0) after 1m18s
[14:19:08.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:15:0)
[14:19:08.470] Build status: STARTED
[14:19:08.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:16:0) after 6m21s
[14:25:29.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:16:0)
[14:25:29.571] Build status: STARTED
[14:25:29.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:17:0) after 6m13s
[14:31:42.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:17:0)
[14:31:42.614] Build status: STARTED
[14:31:42.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:18:0) after 2m10s
[14:33:52.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:18:0)
[14:33:52.659] Build status: STARTED
[14:33:52.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:19:0) after 3m54s
[14:37:46.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:19:0)
[14:37:46.692] Build status: STARTED
[14:37:46.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:20:0) after 6m56s
[14:44:42.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:20:0)
[14:44:42.783] Build status: STARTED
[14:44:42.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:21:0) after 8m11s
[14:52:53.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:21:0)
[14:52:53.842] Build status: STARTED
[14:52:53.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:22:0) after 6m30s
[14:59:23.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:22:0)
[14:59:23.870] Build status: STARTED
[14:59:23.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:23:0) after 7m56s
[15:07:19.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:23:0)
[15:07:20.019] Build status: STARTED
[15:07:20.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:24:0) after 6m33s
[15:13:53.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:24:0)
[15:13:53.179] Build status: STARTED
[15:13:53.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:25:0) after 9m4s
[15:22:57.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:25:0)
[15:22:57.216] Build status: STARTED
[15:22:57.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:26:0) after 7m42s
[15:30:39.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:26:0)
[15:30:39.255] Build status: STARTED
[15:30:39.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:27:0) after 1m54s
[15:32:33.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:27:0)
[15:32:33.301] Build status: STARTED
[15:32:33.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:28:0) after 6m32s
[15:39:05.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:28:0)
[15:39:05.487] Build status: STARTED
[15:39:05.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:29:0) after 1m48s
[15:40:53.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:29:0)
[15:40:53.680] Build status: STARTED
[15:40:53.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:30:0) after 7m9s
[15:48:02.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:30:0)
[15:48:02.727] Build status: STARTED
[15:48:02.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:31:0) after 5m19s
[15:53:21.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:31:0)
[15:53:21.771] Build status: STARTED
[15:53:21.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:32:0) after 1m20s
[15:54:41.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:32:0)
[15:54:41.816] Build status: STARTED
[15:54:41.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:33:0) after 2m34s
[15:57:15.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:33:0)
[15:57:15.966] Build status: STARTED
[15:57:15.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:34:0) after 5m13s
[16:02:29.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:34:0)
[16:02:29.403] Build status: STARTED
[16:02:29.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:35:0) after 2m49s
[16:05:18.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:35:0)
[16:05:18.496] Build status: STARTED
[16:05:18.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:36:0) after 9m14s
[16:14:32.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:36:0)
[16:14:32.777] Build status: STARTED
[16:14:32.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:37:0) after 4m52s
[16:19:24.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:37:0)
[16:19:25.027] Build status: STARTED
[16:19:25.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:38:0) after 8m2s
[16:27:27.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:38:0)
[16:27:27.107] Build status: STARTED
[16:27:27.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:39:0) after 7m21s
[16:34:48.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:39:0)
[16:34:48.147] Build status: STARTED
[16:34:48.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:40:0) after 5m0s
[16:39:49.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:40:0)
[16:39:49.042] Build status: STARTED
[16:39:49.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:41:0) after 9m20s
[16:49:09.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:41:0)
[16:49:09.205] Build status: STARTED
[16:49:09.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:42:0) after 7m33s
[16:56:42.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:42:0)
[16:56:42.261] Build status: STARTED
[16:56:42.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:43:0) after 4m35s
[17:01:17.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:43:0)
[17:01:17.380] Build status: STARTED
[17:01:17.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:44:0) after 9m56s
[17:11:13.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:44:0)
[17:11:13.505] Build status: STARTED
[17:11:13.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:45:0) after 8m9s
[17:19:22.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:45:0)
[17:19:22.518] Build status: STARTED
[17:19:22.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:46:0) after 3m9s
[17:22:31.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:46:0)
[17:22:31.562] Build status: STARTED
[17:22:31.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:47:0) after 9m30s
[17:32:01.589] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:47:0)
[17:32:01.627] Build status: STARTED
[17:32:01.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:48:0) after 9m49s
[17:41:50.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:48:0)
[17:41:50.826] Build status: STARTED
[17:41:50.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:49:0) after 1m37s
[17:43:27.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:49:0)
[17:43:27.976] Build status: STARTED
[17:43:27.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:50:0) after 9m3s
[17:52:31.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:50:0)
[17:52:31.034] Build status: STARTED
[17:52:31.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:51:0) after 6m21s
[17:58:52.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:51:0)
[17:58:52.170] Build status: STARTED
[17:58:52.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:52:0) after 9m55s
[18:08:47.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:52:0)
[18:08:47.216] Build status: STARTED
[18:08:47.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:53:0) after 7m3s
[18:15:50.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:53:0)
[18:15:50.289] Build status: STARTED
[18:15:50.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:54:0) after 4m3s
[18:19:53.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:54:0)
[18:19:53.338] Build status: STARTED
[18:19:53.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:55:0) after 4m26s
[18:24:19.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:55:0)
[18:24:19.410] Build status: STARTED
[18:24:19.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:56:0) after 8m36s
[18:32:55.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:56:0)
[18:32:55.498] Build status: STARTED
[18:32:55.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:57:0) after 4m1s
[18:36:56.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:57:0)
[18:36:56.544] Build status: STARTED
[18:36:56.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:58:0) after 2m9s
[18:39:05.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:58:0)
[18:39:05.624] Build status: STARTED
[18:39:05.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:59:0) after 3m25s
[18:42:30.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:59:0)
[18:42:30.671] Build status: STARTED
[18:42:30.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:60:0) after 8m27s
[18:50:57.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:60:0)
[18:50:57.710] Build status: STARTED
[18:50:57.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:61:0) after 7m33s
[18:58:30.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:61:0)
[18:58:30.885] Build status: STARTED
[18:58:30.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:62:0) after 3m41s
[19:02:11.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:62:0)
[19:02:11.931] Build status: STARTED
[19:02:11.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:63:0) after 1m9s
[19:03:20.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:63:0)
[19:03:20.969] Build status: STARTED
[19:03:20.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:64:0) after 3m16s
[19:06:36.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:64:0)
[19:06:37.016] Build status: STARTED
[19:06:37.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:65:0) after 8m41s
[19:15:18.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:65:0)
[19:15:18.121] Build status: STARTED
[19:15:18.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:66:0) after 8m4s
[19:23:22.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:66:0)
[19:23:22.243] Build status: STARTED
[19:23:22.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:67:0) after 7m1s
[19:30:23.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:67:0)
[19:30:23.343] Build status: STARTED
[19:30:23.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:68:0) after 1m18s
[19:31:41.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:68:0)
[19:31:41.352] Build status: STARTED
[19:31:41.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:69:0) after 4m53s
[19:36:34.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:69:0)
[19:36:34.613] Build status: STARTED
[19:36:34.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:70:0) after 9m32s
[19:46:06.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:70:0)
[19:46:06.794] Build status: STARTED
[19:46:06.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:71:0) after 8m46s
[19:54:52.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:71:0)
[19:54:52.937] Build status: STARTED
[19:54:52.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:72:0) after 3m27s
[19:58:20.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:72:0)
[19:58:20.124] Build status: STARTED
[19:58:20.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:73:0) after 3m32s
[20:01:52.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:73:0)
[20:01:52.266] Build status: STARTED
[20:01:52.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:74:0) after 9m44s
[20:11:36.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:74:0)
[20:11:36.308] Build status: STARTED
[20:11:36.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:75:0) after 5m59s
[20:17:35.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:75:0)
[20:17:35.371] Build status: STARTED
[20:17:35.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:76:0) after 3m37s
[20:21:12.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:76:0)
[20:21:12.423] Build status: STARTED
[20:21:12.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:77:0) after 2m5s
[20:23:17.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:77:0)
[20:23:17.464] Build status: STARTED
[20:23:17.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:78:0) after 1m57s
[20:25:14.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:78:0)
[20:25:14.635] Build status: STARTED
[20:25:14.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:79:0) after 9m46s
[20:35:00.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:79:0)
[20:35:00.672] Build status: STARTED
[20:35:00.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:80:0) after 9m27s
[20:44:27.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:80:0)
[20:44:27.712] Build status: STARTED
[20:44:27.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:81:0) after 3m9s
[20:47:36.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:81:0)
[20:47:36.769] Build status: STARTED
[20:47:36.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:82:0) after 2m30s
[20:50:06.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:82:0)
[20:50:06.808] Build status: STARTED
[20:50:06.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:83:0) after 4m42s
[20:54:48.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:83:0)
[20:54:48.860] Build status: STARTED
[20:54:48.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:84:0) after 8m19s
[21:03:07.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:84:0)
[21:03:08.098] Build status: STARTED
[21:03:08.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:85:0) after 4m3s
[21:07:11.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:85:0)
[21:07:11.149] Build status: STARTED
[21:07:11.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:86:0) after 9m5s
[21:16:16.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:86:0)
[21:16:16.195] Build status: STARTED
[21:16:16.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:87:0) after 3m54s
[21:20:10.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:87:0)
[21:20:10.283] Build status: STARTED
[21:20:10.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:88:0) after 7m15s
[21:27:25.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:88:0)
[21:27:25.323] Build status: STARTED
[21:27:25.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:89:0) after 2m4s
[21:29:29.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:89:0)
[21:29:29.368] Build status: STARTED
[21:29:29.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:90:0) after 1m58s
[21:31:27.372] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:90:0)
[21:31:27.403] Build status: STARTED
[21:31:27.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:91:0) after 4m56s
[21:36:23.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:91:0)
[21:36:23.517] Build status: STARTED
[21:36:23.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:92:0) after 8m48s
[21:45:11.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:92:0)
[21:45:11.671] Build status: STARTED
[21:45:11.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:93:0) after 5m57s
[21:51:08.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:93:0)
[21:51:08.737] Build status: STARTED
[21:51:08.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:94:0) after 8m45s
[21:59:53.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:94:0)
[21:59:53.773] Build status: STARTED
[21:59:53.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:95:0) after 5m47s
[22:05:40.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:95:0)
[22:05:40.992] Build status: STARTED
[22:05:40.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:96:0) after 3m1s
[22:08:42.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:96:0)
[22:08:42.176] Build status: STARTED
[22:08:42.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:97:0) after 6m38s
[22:15:20.367] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:97:0)
[22:15:20.387] Build status: STARTED
[22:15:20.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:98:0) after 7m51s
[22:23:11.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:98:0)
[22:23:11.531] Build status: STARTED
[22:23:11.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:99:0) after 6m16s
[22:29:27.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:99:0)
[22:29:27.728] Build status: STARTED
[22:29:27.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:100:0) after 1m39s
[22:31:06.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:100:0)
[22:31:06.887] Build status: STARTED
[22:31:06.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:101:0) after 7m38s
[22:38:44.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:101:0)
[22:38:44.930] Build status: STARTED
[22:38:44.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:102:0) after 6m16s
[22:45:00.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:102:0)
[22:45:00.992] Build status: STARTED
[22:45:00.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:103:0) after 4m12s
[22:49:13.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:103:0)
[22:49:13.115] Build status: STARTED
[22:49:13.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:104:0) after 1m7s
[22:50:20.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:104:0)
[22:50:20.184] Build status: STARTED
[22:50:20.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:105:0) after 6m47s
[22:57:07.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:105:0)
[22:57:07.331] Build status: STARTED
[22:57:07.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:106:0) after 3m28s
[23:00:35.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:106:0)
[23:00:35.439] Build status: STARTED
[23:00:35.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:107:0) after 5m42s
[23:06:17.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:107:0)
[23:06:17.576] Build status: STARTED
[23:06:17.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950987535816454048:108:0) after 8m45s
[23:06:41.364] Received PubSub notification, asking Buildbucket for the build status
[23:06:41.386] Build:
{
"id": "8785557473558675169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18622,
"createdBy": "project:chromium",
"createTime": "2023-03-26T13:15:04.364987419Z",
"startTime": "2023-03-26T13:20:41.619385Z",
"endTime": "2023-03-26T23:06:40.953875501Z",
"updateTime": "2023-03-26T23:06:40.953875501Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "694fb257ee5507e88d1c254d13fafaafd555dc35",
"ref": "refs/heads/main"
}
}
}
[23:06:41.386] Invocation finished in 9h51m38.559071166s with status FAILED