[11:51:08.429] New invocation is queued and will start shortly
[11:51:09.553] Starting the invocation (attempt 1)
[11:51:09.583] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/27dba4649e9dd14d2a12c9e24a602161720cbc45"
[11:51:09.583] Popped gitiles commit info from properties and tags
[11:51:09.583] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:51:09.583] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:51:09.583] Buildbucket request:
{
"requestId": "8950721023874761536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "27dba4649e9dd14d2a12c9e24a602161720cbc45",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950721023874761536"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:51:10.108] Scheduled build:
{
"id": "8785290961880388881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18629,
"createdBy": "project:chromium",
"createTime": "2023-03-29T11:51:09.706570328Z",
"updateTime": "2023-03-29T11:51:09.706570328Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "27dba4649e9dd14d2a12c9e24a602161720cbc45",
"ref": "refs/heads/main"
}
}
}
[11:51:10.108] Task URL: https://cr-buildbucket.appspot.com/build/8785290961880388881
[11:51:10.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:2:0) after 8m59s
[11:53:07.502] Received PubSub notification, asking Buildbucket for the build status
[11:53:07.533] Build status: STARTED
[12:00:09.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:2:0)
[12:00:09.331] Build status: STARTED
[12:00:09.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:4:0) after 8m36s
[12:08:45.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:4:0)
[12:08:45.434] Build status: STARTED
[12:08:45.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:5:0) after 7m55s
[12:16:40.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:5:0)
[12:16:40.796] Build status: STARTED
[12:16:40.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:6:0) after 2m56s
[12:19:36.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:6:0)
[12:19:36.903] Build status: STARTED
[12:19:36.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:7:0) after 7m40s
[12:27:17.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:7:0)
[12:27:17.200] Build status: STARTED
[12:27:17.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:8:0) after 2m9s
[12:29:26.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:8:0)
[12:29:26.296] Build status: STARTED
[12:29:26.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:9:0) after 4m20s
[12:33:46.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:9:0)
[12:33:46.340] Build status: STARTED
[12:33:46.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:10:0) after 2m52s
[12:36:38.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:10:0)
[12:36:38.484] Build status: STARTED
[12:36:38.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:11:0) after 4m37s
[12:41:15.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:11:0)
[12:41:15.770] Build status: STARTED
[12:41:15.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:12:0) after 1m3s
[12:42:18.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:12:0)
[12:42:19.005] Build status: STARTED
[12:42:19.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:13:0) after 5m6s
[12:47:25.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:13:0)
[12:47:25.290] Build status: STARTED
[12:47:25.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:14:0) after 2m30s
[12:49:55.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:14:0)
[12:49:55.472] Build status: STARTED
[12:49:55.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:15:0) after 3m51s
[12:53:46.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:15:0)
[12:53:46.803] Build status: STARTED
[12:53:46.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:16:0) after 2m25s
[12:56:11.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:16:0)
[12:56:11.961] Build status: STARTED
[12:56:11.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:17:0) after 3m3s
[12:59:15.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:17:0)
[12:59:15.193] Build status: STARTED
[12:59:15.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:18:0) after 1m38s
[13:00:53.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:18:0)
[13:00:53.320] Build status: STARTED
[13:00:53.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:19:0) after 2m45s
[13:03:38.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:19:0)
[13:03:38.375] Build status: STARTED
[13:03:38.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:20:0) after 9m48s
[13:13:26.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:20:0)
[13:13:26.437] Build status: STARTED
[13:13:26.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:21:0) after 2m38s
[13:16:04.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:21:0)
[13:16:04.634] Build status: STARTED
[13:16:04.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:22:0) after 9m44s
[13:25:48.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:22:0)
[13:25:48.799] Build status: STARTED
[13:25:48.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:23:0) after 9m38s
[13:35:26.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:23:0)
[13:35:26.850] Build status: STARTED
[13:35:26.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:24:0) after 7m14s
[13:42:40.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:24:0)
[13:42:40.901] Build status: STARTED
[13:42:40.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:25:0) after 2m31s
[13:45:11.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:25:0)
[13:45:11.992] Build status: STARTED
[13:45:11.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:26:0) after 6m19s
[13:51:31.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:26:0)
[13:51:31.104] Build status: STARTED
[13:51:31.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:27:0) after 9m19s
[14:00:50.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:27:0)
[14:00:50.192] Build status: STARTED
[14:00:50.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:28:0) after 1m52s
[14:02:42.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:28:0)
[14:02:42.414] Build status: STARTED
[14:02:42.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:29:0) after 6m26s
[14:09:08.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:29:0)
[14:09:08.752] Build status: STARTED
[14:09:08.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:30:0) after 2m23s
[14:11:32.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:30:0)
[14:11:32.144] Build status: STARTED
[14:11:32.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:31:0) after 5m15s
[14:16:47.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:31:0)
[14:16:47.344] Build status: STARTED
[14:16:47.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:32:0) after 2m4s
[14:18:51.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:32:0)
[14:18:51.463] Build status: STARTED
[14:18:51.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:33:0) after 4m17s
[14:23:08.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:33:0)
[14:23:08.800] Build status: STARTED
[14:23:08.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:34:0) after 3m54s
[14:27:02.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:34:0)
[14:27:02.830] Build status: STARTED
[14:27:02.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:35:0) after 9m46s
[14:36:49.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:35:0)
[14:36:49.113] Build status: STARTED
[14:36:49.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:36:0) after 1m58s
[14:38:47.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:36:0)
[14:38:47.250] Build status: STARTED
[14:38:47.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:37:0) after 7m49s
[14:46:36.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:37:0)
[14:46:36.318] Build status: STARTED
[14:46:36.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:38:0) after 9m29s
[14:56:05.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:38:0)
[14:56:05.389] Build status: STARTED
[14:56:05.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:39:0) after 2m49s
[14:58:54.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:39:0)
[14:58:54.491] Build status: STARTED
[14:58:54.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:40:0) after 8m41s
[15:07:35.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:40:0)
[15:07:35.628] Build status: STARTED
[15:07:35.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:41:0) after 5m40s
[15:13:15.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:41:0)
[15:13:15.812] Build status: STARTED
[15:13:15.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:42:0) after 5m21s
[15:18:37.027] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:42:0)
[15:18:37.054] Build status: STARTED
[15:18:37.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:43:0) after 7m28s
[15:26:05.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:43:0)
[15:26:05.512] Build status: STARTED
[15:26:05.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:44:0) after 8m21s
[15:34:26.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:44:0)
[15:34:26.568] Build status: STARTED
[15:34:26.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:45:0) after 4m58s
[15:39:24.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:45:0)
[15:39:24.787] Build status: STARTED
[15:39:24.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:46:0) after 4m7s
[15:43:31.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:46:0)
[15:43:31.859] Build status: STARTED
[15:43:31.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:47:0) after 3m47s
[15:47:18.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:47:0)
[15:47:18.956] Build status: STARTED
[15:47:18.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:48:0) after 1m3s
[15:48:21.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:48:0)
[15:48:21.997] Build status: STARTED
[15:48:21.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:49:0) after 3m55s
[15:52:17.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:49:0)
[15:52:17.061] Build status: STARTED
[15:52:17.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:50:0) after 4m4s
[15:56:21.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:50:0)
[15:56:21.178] Build status: STARTED
[15:56:21.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:51:0) after 8m3s
[16:04:24.268] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:51:0)
[16:04:24.302] Build status: STARTED
[16:04:24.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:52:0) after 1m42s
[16:06:06.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:52:0)
[16:06:06.346] Build status: STARTED
[16:06:06.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:53:0) after 2m48s
[16:08:54.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:53:0)
[16:08:54.405] Build status: STARTED
[16:08:54.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:54:0) after 1m9s
[16:10:03.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:54:0)
[16:10:03.456] Build status: STARTED
[16:10:03.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:55:0) after 5m48s
[16:15:51.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:55:0)
[16:15:51.483] Build status: STARTED
[16:15:51.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:56:0) after 9m58s
[16:25:49.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:56:0)
[16:25:49.618] Build status: STARTED
[16:25:49.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:57:0) after 6m24s
[16:32:13.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:57:0)
[16:32:13.668] Build status: STARTED
[16:32:13.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:58:0) after 5m11s
[16:37:24.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:58:0)
[16:37:24.733] Build status: STARTED
[16:37:24.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:59:0) after 3m36s
[16:41:00.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:59:0)
[16:41:00.782] Build status: STARTED
[16:41:00.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:60:0) after 8m52s
[16:49:52.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:60:0)
[16:49:52.829] Build status: STARTED
[16:49:52.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:61:0) after 4m53s
[16:54:45.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:61:0)
[16:54:45.883] Build status: STARTED
[16:54:45.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:62:0) after 2m51s
[16:57:36.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:62:0)
[16:57:36.924] Build status: STARTED
[16:57:36.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:63:0) after 9m10s
[17:06:46.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:63:0)
[17:06:46.986] Build status: STARTED
[17:06:46.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:64:0) after 9m39s
[17:16:26.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:64:0)
[17:16:26.082] Build status: STARTED
[17:16:26.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:65:0) after 8m47s
[17:25:13.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:65:0)
[17:25:13.215] Build status: STARTED
[17:25:13.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:66:0) after 4m34s
[17:29:47.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:66:0)
[17:29:47.286] Build status: STARTED
[17:29:47.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:67:0) after 3m0s
[17:32:47.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:67:0)
[17:32:47.338] Build status: STARTED
[17:32:47.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:68:0) after 5m3s
[17:37:50.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:68:0)
[17:37:50.432] Build status: STARTED
[17:37:50.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:69:0) after 6m27s
[17:44:17.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:69:0)
[17:44:17.689] Build status: STARTED
[17:44:17.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:70:0) after 5m33s
[17:49:50.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:70:0)
[17:49:50.697] Build status: STARTED
[17:49:50.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:71:0) after 4m49s
[17:54:39.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:71:0)
[17:54:39.869] Build status: STARTED
[17:54:39.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:72:0) after 2m33s
[17:57:12.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:72:0)
[17:57:13.000] Build status: STARTED
[17:57:13.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:73:0) after 2m55s
[18:00:08.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:73:0)
[18:00:08.371] Build status: STARTED
[18:00:08.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:74:0) after 7m40s
[18:07:48.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:74:0)
[18:07:48.514] Build status: STARTED
[18:07:48.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:75:0) after 6m30s
[18:14:18.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:75:0)
[18:14:18.624] Build status: STARTED
[18:14:18.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:76:0) after 9m57s
[18:24:15.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:76:0)
[18:24:15.686] Build status: STARTED
[18:24:15.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:77:0) after 1m43s
[18:25:58.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:77:0)
[18:25:58.839] Build status: STARTED
[18:25:58.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:78:0) after 9m18s
[18:35:16.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:78:0)
[18:35:16.853] Build status: STARTED
[18:35:16.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:79:0) after 2m36s
[18:37:53.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:79:0)
[18:37:53.052] Build status: STARTED
[18:37:53.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:80:0) after 8m30s
[18:46:23.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:80:0)
[18:46:23.208] Build status: STARTED
[18:46:23.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:81:0) after 7m35s
[18:53:58.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:81:0)
[18:53:58.403] Build status: STARTED
[18:53:58.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:82:0) after 7m55s
[19:01:53.766] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:82:0)
[19:01:53.790] Build status: STARTED
[19:01:53.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:83:0) after 2m45s
[19:04:39.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:83:0)
[19:04:39.388] Build status: STARTED
[19:04:39.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:84:0) after 2m56s
[19:07:35.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:84:0)
[19:07:35.441] Build status: STARTED
[19:07:35.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:85:0) after 9m24s
[19:16:59.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:85:0)
[19:16:59.491] Build status: STARTED
[19:16:59.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:86:0) after 5m32s
[19:22:31.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:86:0)
[19:22:31.540] Build status: STARTED
[19:22:31.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:87:0) after 5m27s
[19:27:58.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:87:0)
[19:27:58.670] Build status: STARTED
[19:27:58.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:88:0) after 1m11s
[19:29:10.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:88:0)
[19:29:10.042] Build status: STARTED
[19:29:10.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:89:0) after 7m50s
[19:37:00.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:89:0)
[19:37:00.123] Build status: STARTED
[19:37:00.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:90:0) after 2m17s
[19:39:17.566] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:90:0)
[19:39:17.590] Build status: STARTED
[19:39:17.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:91:0) after 2m39s
[19:41:56.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:91:0)
[19:41:56.650] Build status: STARTED
[19:41:56.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:92:0) after 4m46s
[19:46:42.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:92:0)
[19:46:42.938] Build status: STARTED
[19:46:42.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:93:0) after 1m26s
[19:48:09.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:93:0)
[19:48:09.083] Build status: STARTED
[19:48:09.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:94:0) after 7m50s
[19:55:59.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:94:0)
[19:55:59.101] Build status: STARTED
[19:55:59.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:95:0) after 5m11s
[20:01:10.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:95:0)
[20:01:10.166] Build status: STARTED
[20:01:10.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:96:0) after 7m53s
[20:09:03.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:96:0)
[20:09:03.213] Build status: STARTED
[20:09:03.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:97:0) after 2m52s
[20:11:55.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:97:0)
[20:11:55.299] Build status: STARTED
[20:11:55.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:98:0) after 9m58s
[20:21:53.404] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:98:0)
[20:21:53.475] Build status: STARTED
[20:21:53.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:99:0) after 5m53s
[20:27:46.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:99:0)
[20:27:46.582] Build status: STARTED
[20:27:46.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:100:0) after 9m17s
[20:37:03.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:100:0)
[20:37:03.754] Build status: STARTED
[20:37:03.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:101:0) after 2m21s
[20:39:24.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:101:0)
[20:39:24.824] Build status: STARTED
[20:39:24.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:102:0) after 5m49s
[20:45:13.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:102:0)
[20:45:13.875] Build status: STARTED
[20:45:13.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:103:0) after 3m42s
[20:48:55.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:103:0)
[20:48:55.964] Build status: STARTED
[20:48:55.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:104:0) after 8m45s
[20:57:40.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:104:0)
[20:57:41.008] Build status: STARTED
[20:57:41.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:105:0) after 2m17s
[20:59:58.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:105:0)
[20:59:58.063] Build status: STARTED
[20:59:58.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:106:0) after 5m46s
[21:05:44.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:106:0)
[21:05:44.234] Build status: STARTED
[21:05:44.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:107:0) after 8m44s
[21:14:28.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:107:0)
[21:14:28.430] Build status: STARTED
[21:14:28.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:108:0) after 9m25s
[21:23:53.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:108:0)
[21:23:53.960] Build status: STARTED
[21:23:53.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:109:0) after 1m57s
[21:25:51.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:109:0)
[21:25:51.434] Build status: STARTED
[21:25:51.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:110:0) after 6m1s
[21:31:52.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:110:0)
[21:31:52.483] Build status: STARTED
[21:31:52.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:111:0) after 7m46s
[21:39:38.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:111:0)
[21:39:38.781] Build status: STARTED
[21:39:38.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:112:0) after 2m29s
[21:42:07.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:112:0)
[21:42:07.832] Build status: STARTED
[21:42:07.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:113:0) after 6m12s
[21:48:20.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:113:0)
[21:48:20.178] Build status: STARTED
[21:48:20.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:114:0) after 8m28s
[21:56:48.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:114:0)
[21:56:48.388] Build status: STARTED
[21:56:48.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:115:0) after 8m22s
[22:05:10.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:115:0)
[22:05:10.513] Build status: STARTED
[22:05:10.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:116:0) after 8m29s
[22:13:39.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:116:0)
[22:13:39.682] Build status: STARTED
[22:13:39.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:117:0) after 5m0s
[22:18:40.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:117:0)
[22:18:40.424] Build status: STARTED
[22:18:40.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:118:0) after 5m36s
[22:24:16.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:118:0)
[22:24:16.685] Build status: STARTED
[22:24:16.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:119:0) after 2m12s
[22:26:28.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:119:0)
[22:26:28.754] Build status: STARTED
[22:26:28.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950721023874761536:120:0) after 6m17s
[22:26:59.703] Received PubSub notification, asking Buildbucket for the build status
[22:26:59.732] Build:
{
"id": "8785290961880388881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18629,
"createdBy": "project:chromium",
"createTime": "2023-03-29T11:51:09.706570328Z",
"startTime": "2023-03-29T11:53:06.615996Z",
"endTime": "2023-03-29T22:26:59.282174772Z",
"updateTime": "2023-03-29T22:26:59.282174772Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "27dba4649e9dd14d2a12c9e24a602161720cbc45",
"ref": "refs/heads/main"
}
}
}
[22:26:59.732] Invocation finished in 10h35m51.310296669s with status FAILED