[15:31:58.792] New invocation is queued and will start shortly
[15:32:00.151] Starting the invocation (attempt 1)
[15:32:00.181] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9fa9d12d34d53f11fece86bb668b1bf86d4ac9fd"
[15:32:00.182] Popped gitiles commit info from properties and tags
[15:32:00.182] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:32:00.182] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:32:00.182] Buildbucket request:
{
"requestId": "8945905490641037616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9fa9d12d34d53f11fece86bb668b1bf86d4ac9fd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945905490641037616"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:32:00.612] Scheduled build:
{
"id": "8780475428460573201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19004,
"createdBy": "project:chromium",
"createTime": "2023-05-21T15:32:00.248124286Z",
"updateTime": "2023-05-21T15:32:00.248124286Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9fa9d12d34d53f11fece86bb668b1bf86d4ac9fd",
"ref": "refs/heads/main"
}
}
}
[15:32:00.612] Task URL: https://cr-buildbucket.appspot.com/build/8780475428460573201
[15:32:00.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:2:0) after 9m48s
[15:34:07.694] Received PubSub notification, asking Buildbucket for the build status
[15:34:07.709] Build status: STARTED
[15:41:48.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:2:0)
[15:41:48.659] Build status: STARTED
[15:41:48.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:4:0) after 3m7s
[15:44:55.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:4:0)
[15:44:56.031] Build status: STARTED
[15:44:56.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:5:0) after 4m40s
[15:49:36.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:5:0)
[15:49:36.272] Build status: STARTED
[15:49:36.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:6:0) after 9m37s
[15:59:13.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:6:0)
[15:59:13.311] Build status: STARTED
[15:59:13.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:7:0) after 1m54s
[16:01:07.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:7:0)
[16:01:07.366] Build status: STARTED
[16:01:07.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:8:0) after 3m22s
[16:04:29.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:8:0)
[16:04:29.627] Build status: STARTED
[16:04:29.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:9:0) after 2m42s
[16:07:11.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:9:0)
[16:07:11.696] Build status: STARTED
[16:07:11.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:10:0) after 2m52s
[16:10:03.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:10:0)
[16:10:03.745] Build status: STARTED
[16:10:03.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:11:0) after 3m10s
[16:13:13.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:11:0)
[16:13:13.880] Build status: STARTED
[16:13:13.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:12:0) after 6m17s
[16:19:30.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:12:0)
[16:19:30.918] Build status: STARTED
[16:19:30.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:13:0) after 3m46s
[16:23:16.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:13:0)
[16:23:16.948] Build status: STARTED
[16:23:16.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:14:0) after 6m47s
[16:30:03.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:14:0)
[16:30:04.020] Build status: STARTED
[16:30:04.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:15:0) after 4m3s
[16:34:07.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:15:0)
[16:34:07.069] Build status: STARTED
[16:34:07.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:16:0) after 8m20s
[16:42:27.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:16:0)
[16:42:27.112] Build status: STARTED
[16:42:27.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:17:0) after 5m59s
[16:48:26.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:17:0)
[16:48:26.152] Build status: STARTED
[16:48:26.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:18:0) after 2m22s
[16:50:48.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:18:0)
[16:50:48.205] Build status: STARTED
[16:50:48.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:19:0) after 8m8s
[16:58:56.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:19:0)
[16:58:56.279] Build status: STARTED
[16:58:56.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:20:0) after 3m53s
[17:02:49.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:20:0)
[17:02:49.313] Build status: STARTED
[17:02:49.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:21:0) after 5m33s
[17:08:22.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:21:0)
[17:08:22.353] Build status: STARTED
[17:08:22.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:22:0) after 7m21s
[17:15:43.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:22:0)
[17:15:43.419] Build status: STARTED
[17:15:43.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:23:0) after 5m37s
[17:21:20.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:23:0)
[17:21:20.456] Build status: STARTED
[17:21:20.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:24:0) after 1m53s
[17:23:13.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:24:0)
[17:23:13.496] Build status: STARTED
[17:23:13.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:25:0) after 6m52s
[17:30:05.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:25:0)
[17:30:05.658] Build status: STARTED
[17:30:05.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:26:0) after 1m55s
[17:32:01.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:26:0)
[17:32:01.151] Build status: STARTED
[17:32:01.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:27:0) after 6m56s
[17:38:57.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:27:0)
[17:38:57.272] Build status: STARTED
[17:38:57.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:28:0) after 8m42s
[17:47:39.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:28:0)
[17:47:39.309] Build status: STARTED
[17:47:39.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:29:0) after 5m4s
[17:52:43.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:29:0)
[17:52:43.353] Build status: STARTED
[17:52:43.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:30:0) after 6m19s
[17:59:02.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:30:0)
[17:59:02.503] Build status: STARTED
[17:59:02.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:31:0) after 2m0s
[18:01:02.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:31:0)
[18:01:02.638] Build status: STARTED
[18:01:02.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:32:0) after 6m55s
[18:07:57.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:32:0)
[18:07:57.683] Build status: STARTED
[18:07:57.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:33:0) after 1m13s
[18:09:10.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:33:0)
[18:09:10.722] Build status: STARTED
[18:09:10.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:34:0) after 4m13s
[18:13:23.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:34:0)
[18:13:23.715] Build status: STARTED
[18:13:23.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:35:0) after 9m40s
[18:23:03.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:35:0)
[18:23:03.757] Build status: STARTED
[18:23:03.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:36:0) after 1m16s
[18:24:19.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:36:0)
[18:24:19.788] Build status: STARTED
[18:24:19.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:37:0) after 5m55s
[18:30:15.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:37:0)
[18:30:15.192] Build status: STARTED
[18:30:15.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:38:0) after 7m13s
[18:37:28.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:38:0)
[18:37:28.231] Build status: STARTED
[18:37:28.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:39:0) after 1m54s
[18:39:22.566] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:39:0)
[18:39:22.645] Build status: STARTED
[18:39:22.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:40:0) after 6m56s
[18:46:19.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:40:0)
[18:46:19.361] Build status: STARTED
[18:46:19.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:41:0) after 4m37s
[18:50:56.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:41:0)
[18:50:56.886] Build status: STARTED
[18:50:56.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:42:0) after 8m32s
[18:59:29.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:42:0)
[18:59:29.225] Build status: STARTED
[18:59:29.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:43:0) after 3m20s
[19:02:49.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:43:0)
[19:02:49.407] Build status: STARTED
[19:02:49.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:44:0) after 4m48s
[19:07:37.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:44:0)
[19:07:37.729] Build status: STARTED
[19:07:37.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:45:0) after 7m13s
[19:14:51.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:45:0)
[19:14:51.327] Build status: STARTED
[19:14:51.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:46:0) after 7m23s
[19:22:14.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:46:0)
[19:22:14.424] Build status: STARTED
[19:22:14.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:47:0) after 5m35s
[19:27:49.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:47:0)
[19:27:49.479] Build status: STARTED
[19:27:49.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:48:0) after 5m52s
[19:33:41.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:48:0)
[19:33:41.718] Build status: STARTED
[19:33:41.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:49:0) after 4m36s
[19:38:18.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:49:0)
[19:38:18.056] Build status: STARTED
[19:38:18.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:50:0) after 4m9s
[19:42:27.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:50:0)
[19:42:27.711] Build status: STARTED
[19:42:27.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:51:0) after 5m43s
[19:48:10.823] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:51:0)
[19:48:10.843] Build status: STARTED
[19:48:10.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:52:0) after 1m31s
[19:49:41.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:52:0)
[19:49:41.878] Build status: STARTED
[19:49:41.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:53:0) after 9m18s
[19:59:00.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:53:0)
[19:59:00.080] Build status: STARTED
[19:59:00.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:54:0) after 9m48s
[20:08:48.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:54:0)
[20:08:48.167] Build status: STARTED
[20:08:48.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:55:0) after 7m26s
[20:16:14.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:55:0)
[20:16:14.587] Build status: STARTED
[20:16:14.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:56:0) after 8m17s
[20:24:31.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:56:0)
[20:24:31.653] Build status: STARTED
[20:24:31.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:57:0) after 6m58s
[20:31:29.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:57:0)
[20:31:29.914] Build status: STARTED
[20:31:29.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:58:0) after 4m21s
[20:35:51.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:58:0)
[20:35:51.238] Build status: STARTED
[20:35:51.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:59:0) after 5m6s
[20:40:57.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:59:0)
[20:40:57.844] Build status: STARTED
[20:40:57.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:60:0) after 6m39s
[20:47:37.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:60:0)
[20:47:37.424] Build status: STARTED
[20:47:37.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:61:0) after 5m56s
[20:53:33.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:61:0)
[20:53:33.865] Build status: STARTED
[20:53:33.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:62:0) after 7m55s
[21:01:29.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:62:0)
[21:01:29.211] Build status: STARTED
[21:01:29.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:63:0) after 6m31s
[21:08:00.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:63:0)
[21:08:00.294] Build status: STARTED
[21:08:00.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:64:0) after 5m12s
[21:13:12.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:64:0)
[21:13:12.338] Build status: STARTED
[21:13:12.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:65:0) after 2m32s
[21:15:44.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:65:0)
[21:15:44.521] Build status: STARTED
[21:15:44.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:66:0) after 4m7s
[21:19:51.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:66:0)
[21:19:51.641] Build status: STARTED
[21:19:51.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:67:0) after 7m26s
[21:27:17.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:67:0)
[21:27:17.724] Build status: STARTED
[21:27:17.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:68:0) after 9m18s
[21:36:35.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:68:0)
[21:36:35.767] Build status: STARTED
[21:36:35.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:69:0) after 8m3s
[21:44:38.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:69:0)
[21:44:38.902] Build status: STARTED
[21:44:38.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:70:0) after 5m52s
[21:50:31.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:70:0)
[21:50:31.114] Build status: STARTED
[21:50:31.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:71:0) after 6m39s
[21:57:10.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:71:0)
[21:57:10.182] Build status: STARTED
[21:57:10.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:72:0) after 4m15s
[22:01:25.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:72:0)
[22:01:25.472] Build status: STARTED
[22:01:25.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:73:0) after 6m51s
[22:08:16.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:73:0)
[22:08:16.593] Build status: STARTED
[22:08:16.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:74:0) after 9m23s
[22:17:39.897] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:74:0)
[22:17:39.915] Build status: STARTED
[22:17:39.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:75:0) after 6m44s
[22:24:23.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:75:0)
[22:24:23.954] Build status: STARTED
[22:24:23.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:76:0) after 9m39s
[22:34:02.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:76:0)
[22:34:02.951] Build status: STARTED
[22:34:02.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:77:0) after 9m1s
[22:43:03.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:77:0)
[22:43:03.943] Build status: STARTED
[22:43:03.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:78:0) after 8m21s
[22:51:25.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:78:0)
[22:51:25.284] Build status: STARTED
[22:51:25.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:79:0) after 7m35s
[22:59:00.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:79:0)
[22:59:00.321] Build status: STARTED
[22:59:00.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:80:0) after 5m0s
[23:04:00.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:80:0)
[23:04:00.421] Build status: STARTED
[23:04:00.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:81:0) after 8m8s
[23:12:08.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:81:0)
[23:12:08.881] Build status: STARTED
[23:12:08.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:82:0) after 9m12s
[23:21:21.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:82:0)
[23:21:21.297] Build status: STARTED
[23:21:21.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:83:0) after 3m14s
[23:24:35.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:83:0)
[23:24:35.367] Build status: STARTED
[23:24:35.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:84:0) after 7m57s
[23:32:32.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:84:0)
[23:32:32.416] Build status: STARTED
[23:32:32.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:85:0) after 7m38s
[23:40:10.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:85:0)
[23:40:10.706] Build status: STARTED
[23:40:10.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:86:0) after 9m47s
[23:49:57.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:86:0)
[23:49:57.995] Build status: STARTED
[23:49:57.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:87:0) after 4m2s
[23:54:00.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:87:0)
[23:54:00.283] Build status: STARTED
[23:54:00.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:88:0) after 5m49s
[23:59:49.735] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:88:0)
[23:59:49.753] Build status: STARTED
[23:59:49.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:89:0) after 6m25s
[00:06:15.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:89:0)
[00:06:15.456] Build status: STARTED
[00:06:15.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:90:0) after 7m20s
[00:13:35.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:90:0)
[00:13:35.509] Build status: STARTED
[00:13:35.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:91:0) after 3m13s
[00:16:48.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:91:0)
[00:16:48.571] Build status: STARTED
[00:16:48.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:92:0) after 2m25s
[00:19:13.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:92:0)
[00:19:13.692] Build status: STARTED
[00:19:13.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:93:0) after 1m13s
[00:20:26.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:93:0)
[00:20:26.963] Build status: STARTED
[00:20:26.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:94:0) after 1m36s
[00:22:02.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:94:0)
[00:22:02.984] Build status: STARTED
[00:22:02.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:95:0) after 5m18s
[00:27:21.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:95:0)
[00:27:21.101] Build status: STARTED
[00:27:21.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:96:0) after 7m24s
[00:34:45.222] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:96:0)
[00:34:45.245] Build status: STARTED
[00:34:45.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:97:0) after 2m29s
[00:37:14.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:97:0)
[00:37:14.324] Build status: STARTED
[00:37:14.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:98:0) after 3m46s
[00:41:00.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:98:0)
[00:41:00.562] Build status: STARTED
[00:41:00.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:99:0) after 9m26s
[00:50:26.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:99:0)
[00:50:26.632] Build status: STARTED
[00:50:26.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:100:0) after 4m52s
[00:55:18.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:100:0)
[00:55:18.700] Build status: STARTED
[00:55:18.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:101:0) after 7m28s
[01:02:46.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:101:0)
[01:02:46.715] Build status: STARTED
[01:02:46.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:102:0) after 4m46s
[01:07:33.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:102:0)
[01:07:33.301] Build status: STARTED
[01:07:33.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:103:0) after 9m22s
[01:16:55.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:103:0)
[01:16:55.375] Build status: STARTED
[01:16:55.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:104:0) after 7m18s
[01:24:13.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:104:0)
[01:24:13.526] Build status: STARTED
[01:24:13.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:105:0) after 9m6s
[01:33:19.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:105:0)
[01:33:19.564] Build status: STARTED
[01:33:19.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:106:0) after 1m37s
[01:34:56.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:106:0)
[01:34:56.668] Build status: STARTED
[01:34:56.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:107:0) after 6m8s
[01:41:04.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:107:0)
[01:41:04.720] Build status: STARTED
[01:41:04.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:108:0) after 2m11s
[01:43:15.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:108:0)
[01:43:15.860] Build status: STARTED
[01:43:15.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:109:0) after 9m30s
[01:52:46.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:109:0)
[01:52:46.200] Build status: STARTED
[01:52:46.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:110:0) after 4m2s
[01:56:48.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:110:0)
[01:56:48.222] Build status: STARTED
[01:56:48.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:111:0) after 7m12s
[02:04:00.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:111:0)
[02:04:00.368] Build status: STARTED
[02:04:00.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:112:0) after 8m26s
[02:12:26.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:112:0)
[02:12:26.402] Build status: STARTED
[02:12:26.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:113:0) after 4m49s
[02:17:15.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:113:0)
[02:17:15.443] Build status: STARTED
[02:17:15.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945905490641037616:114:0) after 9m38s
[02:24:55.912] Received PubSub notification, asking Buildbucket for the build status
[02:24:55.932] Build:
{
"id": "8780475428460573201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19004,
"createdBy": "project:chromium",
"createTime": "2023-05-21T15:32:00.248124286Z",
"startTime": "2023-05-21T15:34:06.893107Z",
"endTime": "2023-05-22T02:24:55.575751273Z",
"updateTime": "2023-05-22T02:24:55.575751273Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9fa9d12d34d53f11fece86bb668b1bf86d4ac9fd",
"ref": "refs/heads/main"
}
}
}
[02:24:55.933] Invocation finished in 10h52m57.147964461s with status FAILED