[18:51:13.293] New invocation is queued and will start shortly
[18:51:14.392] Starting the invocation (attempt 1)
[18:51:14.421] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3ac7d8e0a0ba830bdf05f7313029da6f4e937685"
[18:51:14.421] Popped gitiles commit info from properties and tags
[18:51:14.421] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:51:14.421] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:51:14.421] Buildbucket request:
{
"requestId": "8953593697584880336",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ac7d8e0a0ba830bdf05f7313029da6f4e937685",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953593697584880336"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:51:14.915] Scheduled build:
{
"id": "8788163635598123809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18538,
"createdBy": "project:chromium",
"createTime": "2023-02-25T18:51:14.562993165Z",
"updateTime": "2023-02-25T18:51:14.562993165Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ac7d8e0a0ba830bdf05f7313029da6f4e937685",
"ref": "refs/heads/main"
}
}
}
[18:51:14.915] Task URL: https://cr-buildbucket.appspot.com/build/8788163635598123809
[18:51:14.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:2:0) after 6m8s
[18:54:22.524] Received PubSub notification, asking Buildbucket for the build status
[18:54:22.594] Build status: STARTED
[18:57:23.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:2:0)
[18:57:23.201] Build status: STARTED
[18:57:23.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:4:0) after 5m52s
[19:03:15.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:4:0)
[19:03:15.385] Build status: STARTED
[19:03:15.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:5:0) after 4m4s
[19:07:19.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:5:0)
[19:07:19.402] Build status: STARTED
[19:07:19.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:6:0) after 4m13s
[19:11:32.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:6:0)
[19:11:32.449] Build status: STARTED
[19:11:32.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:7:0) after 7m46s
[19:19:18.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:7:0)
[19:19:18.571] Build status: STARTED
[19:19:18.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:8:0) after 4m12s
[19:23:30.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:8:0)
[19:23:30.860] Build status: STARTED
[19:23:30.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:9:0) after 2m10s
[19:25:40.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:9:0)
[19:25:40.969] Build status: STARTED
[19:25:40.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:10:0) after 1m31s
[19:27:11.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:10:0)
[19:27:12.021] Build status: STARTED
[19:27:12.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:11:0) after 2m35s
[19:29:47.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:11:0)
[19:29:47.160] Build status: STARTED
[19:29:47.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:12:0) after 8m53s
[19:38:40.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:12:0)
[19:38:40.197] Build status: STARTED
[19:38:40.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:13:0) after 2m28s
[19:41:08.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:13:0)
[19:41:08.249] Build status: STARTED
[19:41:08.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:14:0) after 7m50s
[19:48:58.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:14:0)
[19:48:58.353] Build status: STARTED
[19:48:58.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:15:0) after 1m58s
[19:50:56.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:15:0)
[19:50:56.468] Build status: STARTED
[19:50:56.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:16:0) after 1m41s
[19:52:37.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:16:0)
[19:52:37.506] Build status: STARTED
[19:52:37.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:17:0) after 3m23s
[19:56:00.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:17:0)
[19:56:00.731] Build status: STARTED
[19:56:00.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:18:0) after 7m1s
[20:03:01.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:18:0)
[20:03:01.864] Build status: STARTED
[20:03:01.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:19:0) after 6m32s
[20:09:33.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:19:0)
[20:09:33.972] Build status: STARTED
[20:09:33.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:20:0) after 8m41s
[20:18:15.036] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:20:0)
[20:18:15.063] Build status: STARTED
[20:18:15.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:21:0) after 1m0s
[20:19:15.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:21:0)
[20:19:15.213] Build status: STARTED
[20:19:15.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:22:0) after 1m22s
[20:20:37.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:22:0)
[20:20:37.506] Build status: STARTED
[20:20:37.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:23:0) after 8m23s
[20:29:00.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:23:0)
[20:29:00.761] Build status: STARTED
[20:29:00.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:24:0) after 6m27s
[20:35:27.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:24:0)
[20:35:27.819] Build status: STARTED
[20:35:27.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:25:0) after 4m56s
[20:40:23.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:25:0)
[20:40:23.899] Build status: STARTED
[20:40:23.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:26:0) after 5m57s
[20:46:21.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:26:0)
[20:46:21.043] Build status: STARTED
[20:46:21.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:27:0) after 1m13s
[20:47:34.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:27:0)
[20:47:34.095] Build status: STARTED
[20:47:34.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:28:0) after 6m14s
[20:53:48.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:28:0)
[20:53:48.140] Build status: STARTED
[20:53:48.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:29:0) after 9m9s
[21:02:57.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:29:0)
[21:02:57.273] Build status: STARTED
[21:02:57.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:30:0) after 9m1s
[21:11:58.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:30:0)
[21:11:58.438] Build status: STARTED
[21:11:58.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:31:0) after 3m20s
[21:15:18.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:31:0)
[21:15:18.481] Build status: STARTED
[21:15:18.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:32:0) after 5m32s
[21:20:50.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:32:0)
[21:20:50.549] Build status: STARTED
[21:20:50.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:33:0) after 4m13s
[21:25:03.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:33:0)
[21:25:03.906] Build status: STARTED
[21:25:03.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:34:0) after 8m27s
[21:33:30.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:34:0)
[21:33:30.948] Build status: STARTED
[21:33:30.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:35:0) after 1m54s
[21:35:24.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:35:0)
[21:35:25.015] Build status: STARTED
[21:35:25.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:36:0) after 7m14s
[21:42:39.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:36:0)
[21:42:39.084] Build status: STARTED
[21:42:39.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:37:0) after 2m44s
[21:45:23.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:37:0)
[21:45:23.160] Build status: STARTED
[21:45:23.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:38:0) after 4m51s
[21:50:14.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:38:0)
[21:50:14.209] Build status: STARTED
[21:50:14.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:39:0) after 1m33s
[21:51:47.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:39:0)
[21:51:47.302] Build status: STARTED
[21:51:47.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:40:0) after 9m57s
[22:01:44.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:40:0)
[22:01:44.488] Build status: STARTED
[22:01:44.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:41:0) after 4m3s
[22:05:47.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:41:0)
[22:05:47.545] Build status: STARTED
[22:05:47.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:42:0) after 9m5s
[22:14:52.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:42:0)
[22:14:52.766] Build status: STARTED
[22:14:52.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:43:0) after 9m24s
[22:24:17.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:43:0)
[22:24:17.195] Build status: STARTED
[22:24:17.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:44:0) after 5m44s
[22:30:01.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:44:0)
[22:30:01.235] Build status: STARTED
[22:30:01.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:45:0) after 8m59s
[22:39:00.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:45:0)
[22:39:00.379] Build status: STARTED
[22:39:00.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:46:0) after 4m6s
[22:43:06.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:46:0)
[22:43:06.460] Build status: STARTED
[22:43:06.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:47:0) after 3m14s
[22:46:20.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:47:0)
[22:46:20.508] Build status: STARTED
[22:46:20.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:48:0) after 5m45s
[22:52:05.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:48:0)
[22:52:05.960] Build status: STARTED
[22:52:05.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:49:0) after 5m52s
[22:57:57.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:49:0)
[22:57:58.004] Build status: STARTED
[22:57:58.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:50:0) after 9m10s
[23:07:08.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:50:0)
[23:07:08.212] Build status: STARTED
[23:07:08.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:51:0) after 7m11s
[23:14:19.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:51:0)
[23:14:19.985] Build status: STARTED
[23:14:19.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:52:0) after 2m17s
[23:16:37.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:52:0)
[23:16:37.129] Build status: STARTED
[23:16:37.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:53:0) after 5m26s
[23:22:03.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:53:0)
[23:22:03.380] Build status: STARTED
[23:22:03.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:54:0) after 7m11s
[23:29:14.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:54:0)
[23:29:14.546] Build status: STARTED
[23:29:14.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:55:0) after 6m37s
[23:35:51.566] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:55:0)
[23:35:51.587] Build status: STARTED
[23:35:51.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:56:0) after 3m4s
[23:38:55.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:56:0)
[23:38:55.660] Build status: STARTED
[23:38:55.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:57:0) after 4m14s
[23:43:09.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:57:0)
[23:43:09.936] Build status: STARTED
[23:43:09.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:58:0) after 3m51s
[23:47:01.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:58:0)
[23:47:01.025] Build status: STARTED
[23:47:01.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:59:0) after 8m41s
[23:55:42.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:59:0)
[23:55:42.762] Build status: STARTED
[23:55:42.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:60:0) after 2m14s
[23:57:57.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:60:0)
[23:57:57.770] Build status: STARTED
[23:57:57.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:61:0) after 6m11s
[00:04:08.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:61:0)
[00:04:08.978] Build status: STARTED
[00:04:08.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:62:0) after 1m47s
[00:05:56.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:62:0)
[00:05:56.032] Build status: STARTED
[00:05:56.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:63:0) after 2m48s
[00:08:44.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:63:0)
[00:08:44.073] Build status: STARTED
[00:08:44.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:64:0) after 7m4s
[00:15:48.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:64:0)
[00:15:48.117] Build status: STARTED
[00:15:48.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:65:0) after 2m38s
[00:18:26.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:65:0)
[00:18:26.295] Build status: STARTED
[00:18:26.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:66:0) after 1m5s
[00:19:31.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:66:0)
[00:19:31.526] Build status: STARTED
[00:19:31.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:67:0) after 1m47s
[00:21:18.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:67:0)
[00:21:18.683] Build status: STARTED
[00:21:18.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:68:0) after 5m5s
[00:26:23.702] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:68:0)
[00:26:23.726] Build status: STARTED
[00:26:23.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:69:0) after 8m38s
[00:35:01.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:69:0)
[00:35:01.777] Build status: STARTED
[00:35:01.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:70:0) after 7m59s
[00:43:01.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:70:0)
[00:43:01.851] Build status: STARTED
[00:43:01.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:71:0) after 4m32s
[00:47:33.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:71:0)
[00:47:33.902] Build status: STARTED
[00:47:33.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:72:0) after 7m55s
[00:55:28.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:72:0)
[00:55:28.928] Build status: STARTED
[00:55:28.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:73:0) after 5m10s
[01:00:39.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:73:0)
[01:00:39.417] Build status: STARTED
[01:00:39.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:74:0) after 1m15s
[01:01:55.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:74:0)
[01:01:55.034] Build status: STARTED
[01:01:55.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:75:0) after 7m19s
[01:09:14.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:75:0)
[01:09:14.082] Build status: STARTED
[01:09:14.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:76:0) after 5m5s
[01:14:19.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:76:0)
[01:14:19.648] Build status: STARTED
[01:14:19.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:77:0) after 3m43s
[01:18:02.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:77:0)
[01:18:02.705] Build status: STARTED
[01:18:02.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:78:0) after 6m42s
[01:24:45.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:78:0)
[01:24:45.222] Build status: STARTED
[01:24:45.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:79:0) after 7m32s
[01:32:17.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:79:0)
[01:32:17.933] Build status: STARTED
[01:32:17.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:80:0) after 9m4s
[01:41:21.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:80:0)
[01:41:21.979] Build status: STARTED
[01:41:21.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:81:0) after 7m24s
[01:48:45.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:81:0)
[01:48:46.078] Build status: STARTED
[01:48:46.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:82:0) after 2m26s
[01:51:12.372] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:82:0)
[01:51:12.397] Build status: STARTED
[01:51:12.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:83:0) after 4m18s
[01:55:30.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:83:0)
[01:55:30.507] Build status: STARTED
[01:55:30.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:84:0) after 1m27s
[01:56:57.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:84:0)
[01:56:57.687] Build status: STARTED
[01:56:57.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:85:0) after 3m35s
[02:00:32.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:85:0)
[02:00:32.930] Build status: STARTED
[02:00:32.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:86:0) after 8m0s
[02:08:32.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:86:0)
[02:08:32.973] Build status: STARTED
[02:08:32.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:87:0) after 9m30s
[02:18:03.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:87:0)
[02:18:03.047] Build status: STARTED
[02:18:03.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:88:0) after 2m3s
[02:20:06.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:88:0)
[02:20:06.233] Build status: STARTED
[02:20:06.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:89:0) after 7m18s
[02:27:24.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:89:0)
[02:27:24.277] Build status: STARTED
[02:27:24.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:90:0) after 1m39s
[02:29:03.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:90:0)
[02:29:03.529] Build status: STARTED
[02:29:03.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:91:0) after 7m45s
[02:36:48.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:91:0)
[02:36:48.617] Build status: STARTED
[02:36:48.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:92:0) after 4m47s
[02:41:35.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:92:0)
[02:41:35.698] Build status: STARTED
[02:41:35.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:93:0) after 2m59s
[02:44:34.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:93:0)
[02:44:34.778] Build status: STARTED
[02:44:34.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:94:0) after 3m9s
[02:47:43.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:94:0)
[02:47:43.877] Build status: STARTED
[02:47:43.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:95:0) after 6m52s
[02:54:35.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:95:0)
[02:54:35.930] Build status: STARTED
[02:54:35.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:96:0) after 4m20s
[02:58:55.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:96:0)
[02:58:56.038] Build status: STARTED
[02:58:56.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:97:0) after 4m20s
[03:03:16.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:97:0)
[03:03:16.089] Build status: STARTED
[03:03:16.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:98:0) after 6m50s
[03:10:06.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:98:0)
[03:10:06.145] Build status: STARTED
[03:10:06.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:99:0) after 1m18s
[03:11:24.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:99:0)
[03:11:24.213] Build status: STARTED
[03:11:24.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:100:0) after 9m9s
[03:20:33.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:100:0)
[03:20:33.582] Build status: STARTED
[03:20:33.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:101:0) after 4m37s
[03:25:10.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:101:0)
[03:25:10.676] Build status: STARTED
[03:25:10.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:102:0) after 1m37s
[03:26:47.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:102:0)
[03:26:47.757] Build status: STARTED
[03:26:47.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:103:0) after 2m58s
[03:29:45.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:103:0)
[03:29:45.803] Build status: STARTED
[03:29:45.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:104:0) after 7m6s
[03:36:51.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:104:0)
[03:36:51.919] Build status: STARTED
[03:36:51.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:105:0) after 2m35s
[03:39:27.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:105:0)
[03:39:27.084] Build status: STARTED
[03:39:27.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:106:0) after 9m1s
[03:48:28.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:106:0)
[03:48:28.146] Build status: STARTED
[03:48:28.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:107:0) after 1m9s
[03:49:37.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:107:0)
[03:49:37.187] Build status: STARTED
[03:49:37.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:108:0) after 7m9s
[03:56:46.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:108:0)
[03:56:46.296] Build status: STARTED
[03:56:46.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:109:0) after 3m8s
[03:59:54.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:109:0)
[03:59:54.323] Build status: STARTED
[03:59:54.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:110:0) after 1m1s
[04:00:55.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:110:0)
[04:00:55.738] Build status: STARTED
[04:00:55.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:111:0) after 6m44s
[04:07:39.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:111:0)
[04:07:39.782] Build status: STARTED
[04:07:39.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:112:0) after 3m42s
[04:11:21.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:112:0)
[04:11:21.864] Build status: STARTED
[04:11:21.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:113:0) after 9m26s
[04:20:47.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:113:0)
[04:20:47.943] Build status: STARTED
[04:20:47.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:114:0) after 2m33s
[04:23:20.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:114:0)
[04:23:21.006] Build status: STARTED
[04:23:21.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:115:0) after 6m57s
[04:30:18.035] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:115:0)
[04:30:18.059] Build status: STARTED
[04:30:18.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:116:0) after 3m0s
[04:33:18.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:116:0)
[04:33:18.105] Build status: STARTED
[04:33:18.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:117:0) after 5m25s
[04:38:43.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:117:0)
[04:38:43.152] Build status: STARTED
[04:38:43.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953593697584880336:118:0) after 8m26s
[04:41:15.069] Received PubSub notification, asking Buildbucket for the build status
[04:41:15.093] Build:
{
"id": "8788163635598123809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18538,
"createdBy": "project:chromium",
"createTime": "2023-02-25T18:51:14.562993165Z",
"startTime": "2023-02-25T18:54:21.863405Z",
"endTime": "2023-02-26T04:41:14.719863254Z",
"updateTime": "2023-02-26T04:41:14.719863254Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ac7d8e0a0ba830bdf05f7313029da6f4e937685",
"ref": "refs/heads/main"
}
}
}
[04:41:15.093] Invocation finished in 9h50m1.808781368s with status FAILED