[06:32:04.687] New invocation is queued and will start shortly
[06:32:05.769] Starting the invocation (attempt 1)
[06:32:05.803] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a229230b31888eab02543ee548bd9bd68b5b24b2"
[06:32:05.803] Popped gitiles commit info from properties and tags
[06:32:05.803] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:32:05.805] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:32:05.805] Buildbucket request:
{
"requestId": "8950197515743608256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a229230b31888eab02543ee548bd9bd68b5b24b2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950197515743608256"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:32:06.285] Scheduled build:
{
"id": "8784767453801519121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18665,
"createdBy": "project:chromium",
"createTime": "2023-04-04T06:32:05.915601134Z",
"updateTime": "2023-04-04T06:32:05.915601134Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a229230b31888eab02543ee548bd9bd68b5b24b2",
"ref": "refs/heads/main"
}
}
}
[06:32:06.285] Task URL: https://cr-buildbucket.appspot.com/build/8784767453801519121
[06:32:06.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:2:0) after 9m13s
[06:36:34.818] Received PubSub notification, asking Buildbucket for the build status
[06:36:34.847] Build status: STARTED
[06:41:19.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:2:0)
[06:41:19.342] Build status: STARTED
[06:41:19.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:4:0) after 9m45s
[06:51:04.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:4:0)
[06:51:04.396] Build status: STARTED
[06:51:04.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:5:0) after 2m0s
[06:53:04.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:5:0)
[06:53:04.555] Build status: STARTED
[06:53:04.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:6:0) after 4m54s
[06:57:59.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:6:0)
[06:57:59.575] Build status: STARTED
[06:57:59.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:7:0) after 8m45s
[07:06:45.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:7:0)
[07:06:45.101] Build status: STARTED
[07:06:45.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:8:0) after 7m22s
[07:14:07.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:8:0)
[07:14:07.334] Build status: STARTED
[07:14:07.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:9:0) after 1m56s
[07:16:03.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:9:0)
[07:16:03.397] Build status: STARTED
[07:16:03.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:10:0) after 1m1s
[07:17:04.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:10:0)
[07:17:04.451] Build status: STARTED
[07:17:04.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:11:0) after 6m15s
[07:23:19.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:11:0)
[07:23:19.737] Build status: STARTED
[07:23:19.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:12:0) after 2m40s
[07:26:00.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:12:0)
[07:26:00.078] Build status: STARTED
[07:26:00.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:13:0) after 9m26s
[07:35:26.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:13:0)
[07:35:26.164] Build status: STARTED
[07:35:26.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:14:0) after 4m59s
[07:40:25.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:14:0)
[07:40:25.471] Build status: STARTED
[07:40:25.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:15:0) after 4m22s
[07:44:47.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:15:0)
[07:44:47.665] Build status: STARTED
[07:44:47.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:16:0) after 5m25s
[07:50:13.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:16:0)
[07:50:13.235] Build status: STARTED
[07:50:13.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:17:0) after 6m4s
[07:56:18.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:17:0)
[07:56:18.119] Build status: STARTED
[07:56:18.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:18:0) after 8m15s
[08:04:33.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:18:0)
[08:04:33.171] Build status: STARTED
[08:04:33.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:19:0) after 4m40s
[08:09:13.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:19:0)
[08:09:13.250] Build status: STARTED
[08:09:13.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:20:0) after 8m1s
[08:17:14.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:20:0)
[08:17:14.740] Build status: STARTED
[08:17:14.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:21:0) after 1m40s
[08:18:54.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:21:0)
[08:18:54.864] Build status: STARTED
[08:18:54.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:22:0) after 5m4s
[08:23:59.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:22:0)
[08:23:59.116] Build status: STARTED
[08:23:59.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:23:0) after 9m6s
[08:33:05.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:23:0)
[08:33:05.269] Build status: STARTED
[08:33:05.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:24:0) after 1m22s
[08:34:27.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:24:0)
[08:34:27.370] Build status: STARTED
[08:34:27.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:25:0) after 4m38s
[08:39:05.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:25:0)
[08:39:05.562] Build status: STARTED
[08:39:05.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:26:0) after 7m3s
[08:46:08.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:26:0)
[08:46:08.745] Build status: STARTED
[08:46:08.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:27:0) after 7m13s
[08:53:21.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:27:0)
[08:53:21.953] Build status: STARTED
[08:53:21.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:28:0) after 3m27s
[08:56:49.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:28:0)
[08:56:49.154] Build status: STARTED
[08:56:49.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:29:0) after 8m46s
[09:05:35.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:29:0)
[09:05:35.393] Build status: STARTED
[09:05:35.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:30:0) after 4m16s
[09:09:51.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:30:0)
[09:09:51.553] Build status: STARTED
[09:09:51.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:31:0) after 9m14s
[09:19:05.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:31:0)
[09:19:05.627] Build status: STARTED
[09:19:05.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:32:0) after 7m4s
[09:26:09.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:32:0)
[09:26:09.691] Build status: STARTED
[09:26:09.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:33:0) after 5m42s
[09:31:51.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:33:0)
[09:31:51.754] Build status: STARTED
[09:31:51.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:34:0) after 6m37s
[09:38:29.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:34:0)
[09:38:29.548] Build status: STARTED
[09:38:29.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:35:0) after 1m8s
[09:39:37.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:35:0)
[09:39:37.965] Build status: STARTED
[09:39:37.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:36:0) after 9m11s
[09:48:49.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:36:0)
[09:48:49.148] Build status: STARTED
[09:48:49.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:37:0) after 1m12s
[09:50:01.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:37:0)
[09:50:01.362] Build status: STARTED
[09:50:01.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:38:0) after 9m37s
[09:59:38.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:38:0)
[09:59:38.768] Build status: STARTED
[09:59:38.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:39:0) after 2m54s
[10:02:32.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:39:0)
[10:02:33.001] Build status: STARTED
[10:02:33.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:40:0) after 8m0s
[10:10:33.182] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:40:0)
[10:10:33.205] Build status: STARTED
[10:10:33.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:41:0) after 9m29s
[10:20:03.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:41:0)
[10:20:03.201] Build status: STARTED
[10:20:03.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:42:0) after 3m47s
[10:23:50.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:42:0)
[10:23:50.269] Build status: STARTED
[10:23:50.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:43:0) after 2m18s
[10:26:08.412] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:43:0)
[10:26:08.462] Build status: STARTED
[10:26:08.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:44:0) after 3m23s
[10:29:31.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:44:0)
[10:29:31.855] Build status: STARTED
[10:29:31.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:45:0) after 4m49s
[10:34:20.887] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:45:0)
[10:34:20.908] Build status: STARTED
[10:34:20.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:46:0) after 1m57s
[10:36:17.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:46:0)
[10:36:18.058] Build status: STARTED
[10:36:18.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:47:0) after 1m41s
[10:37:59.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:47:0)
[10:37:59.195] Build status: STARTED
[10:37:59.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:48:0) after 4m17s
[10:42:16.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:48:0)
[10:42:16.311] Build status: STARTED
[10:42:16.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:49:0) after 8m22s
[10:50:38.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:49:0)
[10:50:38.405] Build status: STARTED
[10:50:38.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:50:0) after 2m14s
[10:52:52.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:50:0)
[10:52:52.460] Build status: STARTED
[10:52:52.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:51:0) after 4m51s
[10:57:43.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:51:0)
[10:57:43.516] Build status: STARTED
[10:57:43.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:52:0) after 8m16s
[11:06:00.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:52:0)
[11:06:00.800] Build status: STARTED
[11:06:00.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:53:0) after 1m23s
[11:07:24.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:53:0)
[11:07:24.272] Build status: STARTED
[11:07:24.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:54:0) after 2m39s
[11:10:03.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:54:0)
[11:10:03.983] Build status: STARTED
[11:10:03.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:55:0) after 4m15s
[11:14:18.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:55:0)
[11:14:19.014] Build status: STARTED
[11:14:19.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:56:0) after 9m8s
[11:23:27.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:56:0)
[11:23:27.068] Build status: STARTED
[11:23:27.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:57:0) after 7m55s
[11:31:22.270] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:57:0)
[11:31:22.292] Build status: STARTED
[11:31:22.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:58:0) after 4m24s
[11:35:47.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:58:0)
[11:35:47.165] Build status: STARTED
[11:35:47.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:59:0) after 2m18s
[11:38:05.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:59:0)
[11:38:05.289] Build status: STARTED
[11:38:05.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:60:0) after 7m52s
[11:45:57.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:60:0)
[11:45:57.343] Build status: STARTED
[11:45:57.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:61:0) after 1m6s
[11:47:03.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:61:0)
[11:47:03.411] Build status: STARTED
[11:47:03.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:62:0) after 2m39s
[11:49:42.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:62:0)
[11:49:42.637] Build status: STARTED
[11:49:42.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:63:0) after 7m34s
[11:57:16.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:63:0)
[11:57:16.717] Build status: STARTED
[11:57:16.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:64:0) after 6m18s
[12:03:34.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:64:0)
[12:03:34.856] Build status: STARTED
[12:03:34.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:65:0) after 2m47s
[12:06:21.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:65:0)
[12:06:21.920] Build status: STARTED
[12:06:21.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:66:0) after 8m31s
[12:14:52.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:66:0)
[12:14:53.037] Build status: STARTED
[12:14:53.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:67:0) after 5m24s
[12:20:17.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:67:0)
[12:20:17.408] Build status: STARTED
[12:20:17.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:68:0) after 5m42s
[12:25:59.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:68:0)
[12:25:59.463] Build status: STARTED
[12:25:59.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:69:0) after 9m32s
[12:35:31.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:69:0)
[12:35:31.520] Build status: STARTED
[12:35:31.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:70:0) after 5m26s
[12:40:57.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:70:0)
[12:40:57.675] Build status: STARTED
[12:40:57.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:71:0) after 1m42s
[12:42:39.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:71:0)
[12:42:39.777] Build status: STARTED
[12:42:39.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:72:0) after 8m41s
[12:51:20.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:72:0)
[12:51:20.876] Build status: STARTED
[12:51:20.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:73:0) after 1m19s
[12:52:39.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:73:0)
[12:52:40.011] Build status: STARTED
[12:52:40.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:74:0) after 3m2s
[12:55:42.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:74:0)
[12:55:42.108] Build status: STARTED
[12:55:42.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:75:0) after 2m53s
[12:58:35.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:75:0)
[12:58:35.158] Build status: STARTED
[12:58:35.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:76:0) after 2m20s
[13:00:55.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:76:0)
[13:00:55.579] Build status: STARTED
[13:00:55.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:77:0) after 2m21s
[13:03:17.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:77:0)
[13:03:17.353] Build status: STARTED
[13:03:17.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:78:0) after 7m29s
[13:10:46.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:78:0)
[13:10:46.497] Build status: STARTED
[13:10:46.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:79:0) after 9m9s
[13:19:55.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:79:0)
[13:19:55.628] Build status: STARTED
[13:19:55.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:80:0) after 4m46s
[13:24:41.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:80:0)
[13:24:41.823] Build status: STARTED
[13:24:41.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:81:0) after 2m16s
[13:26:58.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:81:0)
[13:26:58.069] Build status: STARTED
[13:26:58.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:82:0) after 4m36s
[13:31:34.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:82:0)
[13:31:34.367] Build status: STARTED
[13:31:34.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:83:0) after 7m55s
[13:39:29.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:83:0)
[13:39:29.525] Build status: STARTED
[13:39:29.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:84:0) after 2m44s
[13:42:14.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:84:0)
[13:42:14.045] Build status: STARTED
[13:42:14.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:85:0) after 1m6s
[13:43:20.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:85:0)
[13:43:20.131] Build status: STARTED
[13:43:20.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:86:0) after 5m40s
[13:49:00.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:86:0)
[13:49:00.199] Build status: STARTED
[13:49:00.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:87:0) after 4m45s
[13:53:45.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:87:0)
[13:53:45.284] Build status: STARTED
[13:53:45.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:88:0) after 5m3s
[13:58:48.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:88:0)
[13:58:48.442] Build status: STARTED
[13:58:48.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:89:0) after 7m53s
[14:06:41.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:89:0)
[14:06:41.572] Build status: STARTED
[14:06:41.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:90:0) after 2m4s
[14:08:45.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:90:0)
[14:08:45.647] Build status: STARTED
[14:08:45.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:91:0) after 6m38s
[14:15:23.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:91:0)
[14:15:23.727] Build status: STARTED
[14:15:23.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:92:0) after 1m11s
[14:16:34.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:92:0)
[14:16:34.902] Build status: STARTED
[14:16:34.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:93:0) after 8m51s
[14:25:25.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:93:0)
[14:25:25.956] Build status: STARTED
[14:25:25.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:94:0) after 9m43s
[14:35:09.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:94:0)
[14:35:09.267] Build status: STARTED
[14:35:09.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:95:0) after 6m46s
[14:41:55.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:95:0)
[14:41:55.322] Build status: STARTED
[14:41:55.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:96:0) after 4m37s
[14:46:32.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:96:0)
[14:46:32.399] Build status: STARTED
[14:46:32.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:97:0) after 1m16s
[14:47:48.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:97:0)
[14:47:48.775] Build status: STARTED
[14:47:48.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:98:0) after 7m25s
[14:55:14.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:98:0)
[14:55:14.111] Build status: STARTED
[14:55:14.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:99:0) after 8m58s
[15:04:12.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:99:0)
[15:04:12.316] Build status: STARTED
[15:04:12.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:100:0) after 3m16s
[15:07:28.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:100:0)
[15:07:28.804] Build status: STARTED
[15:07:28.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:101:0) after 4m12s
[15:11:40.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:101:0)
[15:11:40.942] Build status: STARTED
[15:11:40.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:102:0) after 2m49s
[15:14:30.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:102:0)
[15:14:30.337] Build status: STARTED
[15:14:30.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:103:0) after 9m19s
[15:23:49.408] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:103:0)
[15:23:49.432] Build status: STARTED
[15:23:49.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:104:0) after 2m26s
[15:26:15.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:104:0)
[15:26:15.472] Build status: STARTED
[15:26:15.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:105:0) after 8m41s
[15:34:56.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:105:0)
[15:34:56.962] Build status: STARTED
[15:34:56.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:106:0) after 8m43s
[15:43:41.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:106:0)
[15:43:41.181] Build status: STARTED
[15:43:41.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:107:0) after 7m29s
[15:51:10.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:107:0)
[15:51:10.250] Build status: STARTED
[15:51:10.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:108:0) after 2m21s
[15:53:31.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:108:0)
[15:53:31.313] Build status: STARTED
[15:53:31.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:109:0) after 9m39s
[16:03:10.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:109:0)
[16:03:10.422] Build status: STARTED
[16:03:10.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:110:0) after 9m52s
[16:13:02.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:110:0)
[16:13:02.492] Build status: STARTED
[16:13:02.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:111:0) after 9m54s
[16:22:56.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:111:0)
[16:22:56.551] Build status: STARTED
[16:22:56.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:112:0) after 1m59s
[16:24:55.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:112:0)
[16:24:55.626] Build status: STARTED
[16:24:55.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:113:0) after 9m29s
[16:34:24.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:113:0)
[16:34:24.671] Build status: STARTED
[16:34:24.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:114:0) after 7m16s
[16:41:40.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:114:0)
[16:41:40.981] Build status: STARTED
[16:41:40.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:115:0) after 3m6s
[16:44:47.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:115:0)
[16:44:47.104] Build status: STARTED
[16:44:47.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:116:0) after 4m55s
[16:49:42.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:116:0)
[16:49:42.304] Build status: STARTED
[16:49:42.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:117:0) after 4m40s
[16:54:22.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:117:0)
[16:54:22.368] Build status: STARTED
[16:54:22.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:118:0) after 2m3s
[16:56:25.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:118:0)
[16:56:25.568] Build status: STARTED
[16:56:25.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:119:0) after 5m8s
[17:01:33.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:119:0)
[17:01:33.731] Build status: STARTED
[17:01:33.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:120:0) after 3m37s
[17:05:10.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:120:0)
[17:05:10.814] Build status: STARTED
[17:05:10.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:121:0) after 4m36s
[17:09:46.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:121:0)
[17:09:46.997] Build status: STARTED
[17:09:46.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:122:0) after 7m25s
[17:17:12.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:122:0)
[17:17:12.100] Build status: STARTED
[17:17:12.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:123:0) after 1m47s
[17:18:59.371] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:123:0)
[17:18:59.415] Build status: STARTED
[17:18:59.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:124:0) after 4m29s
[17:23:28.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:124:0)
[17:23:28.467] Build status: STARTED
[17:23:28.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:125:0) after 4m2s
[17:27:30.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:125:0)
[17:27:30.838] Build status: STARTED
[17:27:30.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:126:0) after 3m22s
[17:30:53.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:126:0)
[17:30:53.060] Build status: STARTED
[17:30:53.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950197515743608256:127:0) after 7m45s
[17:35:17.512] Received PubSub notification, asking Buildbucket for the build status
[17:35:17.546] Build:
{
"id": "8784767453801519121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18665,
"createdBy": "project:chromium",
"createTime": "2023-04-04T06:32:05.915601134Z",
"startTime": "2023-04-04T06:36:34.289423Z",
"endTime": "2023-04-04T17:35:17.198945798Z",
"updateTime": "2023-04-04T17:35:17.198945798Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a229230b31888eab02543ee548bd9bd68b5b24b2",
"ref": "refs/heads/main"
}
}
}
[17:35:17.546] Invocation finished in 11h3m12.866598986s with status FAILED