[12:43:22.851] New invocation is queued and will start shortly
[12:43:23.934] Starting the invocation (attempt 1)
[12:43:23.964] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/694fb257ee5507e88d1c254d13fafaafd555dc35"
[12:43:23.964] Popped gitiles commit info from properties and tags
[12:43:23.964] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:43:23.964] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:43:23.964] Buildbucket request:
{
"requestId": "8950989528096721056",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "694fb257ee5507e88d1c254d13fafaafd555dc35",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950989528096721056"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:43:24.429] Scheduled build:
{
"id": "8785559466154733537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 19248,
"createdBy": "project:chromium",
"createTime": "2023-03-26T12:43:24.076800301Z",
"updateTime": "2023-03-26T12:43:24.076800301Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "694fb257ee5507e88d1c254d13fafaafd555dc35",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:43:24.429] Task URL: https://cr-buildbucket.appspot.com/build/8785559466154733537
[12:43:24.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:2:0) after 2m44s
[12:46:08.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:2:0)
[12:46:08.590] Build status: SCHEDULED
[12:46:08.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:3:0) after 9m36s
[12:54:34.272] Received PubSub notification, asking Buildbucket for the build status
[12:54:34.289] Build status: STARTED
[12:55:44.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:3:0)
[12:55:44.692] Build status: STARTED
[12:55:44.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:5:0) after 4m31s
[13:00:15.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:5:0)
[13:00:15.789] Build status: STARTED
[13:00:15.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:6:0) after 6m2s
[13:06:17.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:6:0)
[13:06:17.879] Build status: STARTED
[13:06:17.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:7:0) after 4m29s
[13:10:46.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:7:0)
[13:10:46.896] Build status: STARTED
[13:10:46.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:8:0) after 9m35s
[13:20:22.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:8:0)
[13:20:22.100] Build status: STARTED
[13:20:22.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:9:0) after 2m54s
[13:23:16.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:9:0)
[13:23:16.417] Build status: STARTED
[13:23:16.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:10:0) after 1m5s
[13:24:21.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:10:0)
[13:24:21.677] Build status: STARTED
[13:24:21.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:11:0) after 6m19s
[13:30:40.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:11:0)
[13:30:40.733] Build status: STARTED
[13:30:40.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:12:0) after 2m52s
[13:33:32.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:12:0)
[13:33:32.883] Build status: STARTED
[13:33:32.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:13:0) after 2m40s
[13:36:12.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:13:0)
[13:36:12.970] Build status: STARTED
[13:36:12.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:14:0) after 7m12s
[13:43:25.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:14:0)
[13:43:25.173] Build status: STARTED
[13:43:25.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:15:0) after 3m49s
[13:47:14.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:15:0)
[13:47:14.783] Build status: STARTED
[13:47:14.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:16:0) after 3m12s
[13:50:26.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:16:0)
[13:50:26.823] Build status: STARTED
[13:50:26.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:17:0) after 5m34s
[13:56:00.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:17:0)
[13:56:00.898] Build status: STARTED
[13:56:00.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:18:0) after 2m4s
[13:58:04.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:18:0)
[13:58:04.948] Build status: STARTED
[13:58:04.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:19:0) after 9m13s
[14:07:19.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:19:0)
[14:07:19.175] Build status: STARTED
[14:07:19.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:20:0) after 5m6s
[14:12:25.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:20:0)
[14:12:25.240] Build status: STARTED
[14:12:25.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:21:0) after 3m17s
[14:15:42.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:21:0)
[14:15:42.366] Build status: STARTED
[14:15:42.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:22:0) after 5m5s
[14:20:47.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:22:0)
[14:20:47.435] Build status: STARTED
[14:20:47.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:23:0) after 1m57s
[14:22:44.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:23:0)
[14:22:44.470] Build status: STARTED
[14:22:44.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:24:0) after 4m51s
[14:27:35.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:24:0)
[14:27:35.825] Build status: STARTED
[14:27:35.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:25:0) after 5m59s
[14:33:34.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:25:0)
[14:33:34.865] Build status: STARTED
[14:33:34.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:26:0) after 1m6s
[14:34:40.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:26:0)
[14:34:40.908] Build status: STARTED
[14:34:40.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:27:0) after 1m14s
[14:35:55.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:27:0)
[14:35:55.037] Build status: STARTED
[14:35:55.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:28:0) after 6m15s
[14:42:10.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:28:0)
[14:42:10.100] Build status: STARTED
[14:42:10.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:29:0) after 1m49s
[14:43:59.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:29:0)
[14:43:59.124] Build status: STARTED
[14:43:59.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:30:0) after 8m59s
[14:52:58.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:30:0)
[14:52:58.211] Build status: STARTED
[14:52:58.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:31:0) after 6m34s
[14:59:32.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:31:0)
[14:59:32.287] Build status: STARTED
[14:59:32.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:32:0) after 2m26s
[15:01:58.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:32:0)
[15:01:58.357] Build status: STARTED
[15:01:58.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:33:0) after 8m13s
[15:10:11.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:33:0)
[15:10:11.490] Build status: STARTED
[15:10:11.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:34:0) after 5m9s
[15:15:20.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:34:0)
[15:15:20.573] Build status: STARTED
[15:15:20.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:35:0) after 1m47s
[15:17:07.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:35:0)
[15:17:07.585] Build status: STARTED
[15:17:07.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:36:0) after 4m13s
[15:21:20.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:36:0)
[15:21:20.632] Build status: STARTED
[15:21:20.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:37:0) after 2m27s
[15:23:47.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:37:0)
[15:23:47.685] Build status: STARTED
[15:23:47.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:38:0) after 7m50s
[15:31:37.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:38:0)
[15:31:37.770] Build status: STARTED
[15:31:37.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:39:0) after 1m40s
[15:33:17.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:39:0)
[15:33:18.010] Build status: STARTED
[15:33:18.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:40:0) after 8m59s
[15:42:17.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:40:0)
[15:42:17.072] Build status: STARTED
[15:42:17.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:41:0) after 2m43s
[15:45:00.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:41:0)
[15:45:00.219] Build status: STARTED
[15:45:00.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:42:0) after 3m37s
[15:48:37.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:42:0)
[15:48:37.362] Build status: STARTED
[15:48:37.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:43:0) after 6m16s
[15:54:53.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:43:0)
[15:54:53.491] Build status: STARTED
[15:54:53.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:44:0) after 5m7s
[16:00:00.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:44:0)
[16:00:00.595] Build status: STARTED
[16:00:00.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:45:0) after 6m41s
[16:06:41.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:45:0)
[16:06:41.645] Build status: STARTED
[16:06:41.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:46:0) after 2m31s
[16:09:12.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:46:0)
[16:09:12.887] Build status: STARTED
[16:09:12.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:47:0) after 4m28s
[16:13:41.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:47:0)
[16:13:41.086] Build status: STARTED
[16:13:41.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:48:0) after 8m52s
[16:22:33.111] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:48:0)
[16:22:33.128] Build status: STARTED
[16:22:33.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:49:0) after 7m29s
[16:30:02.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:49:0)
[16:30:02.410] Build status: STARTED
[16:30:02.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:50:0) after 7m49s
[16:37:51.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:50:0)
[16:37:51.572] Build status: STARTED
[16:37:51.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:51:0) after 9m27s
[16:47:18.589] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:51:0)
[16:47:18.612] Build status: STARTED
[16:47:18.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:52:0) after 7m45s
[16:55:03.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:52:0)
[16:55:03.636] Build status: STARTED
[16:55:03.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:53:0) after 8m48s
[17:03:51.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:53:0)
[17:03:51.776] Build status: STARTED
[17:03:51.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:54:0) after 3m21s
[17:07:12.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:54:0)
[17:07:12.958] Build status: STARTED
[17:07:12.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:55:0) after 4m44s
[17:11:57.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:55:0)
[17:11:57.163] Build status: STARTED
[17:11:57.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:56:0) after 2m17s
[17:14:14.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:56:0)
[17:14:14.223] Build status: STARTED
[17:14:14.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:57:0) after 2m33s
[17:16:47.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:57:0)
[17:16:47.307] Build status: STARTED
[17:16:47.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:58:0) after 9m20s
[17:26:07.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:58:0)
[17:26:07.450] Build status: STARTED
[17:26:07.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:59:0) after 5m37s
[17:31:44.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:59:0)
[17:31:44.505] Build status: STARTED
[17:31:44.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:60:0) after 1m5s
[17:32:49.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:60:0)
[17:32:49.581] Build status: STARTED
[17:32:49.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:61:0) after 6m5s
[17:38:54.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:61:0)
[17:38:54.632] Build status: STARTED
[17:38:54.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:62:0) after 5m42s
[17:44:36.897] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:62:0)
[17:44:36.936] Build status: STARTED
[17:44:36.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:63:0) after 8m54s
[17:53:31.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:63:0)
[17:53:31.077] Build status: STARTED
[17:53:31.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:64:0) after 7m36s
[18:01:07.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:64:0)
[18:01:07.135] Build status: STARTED
[18:01:07.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:65:0) after 6m41s
[18:07:48.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:65:0)
[18:07:48.219] Build status: STARTED
[18:07:48.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:66:0) after 2m47s
[18:10:35.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:66:0)
[18:10:35.311] Build status: STARTED
[18:10:35.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:67:0) after 6m24s
[18:16:59.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:67:0)
[18:16:59.419] Build status: STARTED
[18:16:59.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:68:0) after 7m15s
[18:24:14.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:68:0)
[18:24:14.459] Build status: STARTED
[18:24:14.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:69:0) after 8m1s
[18:32:15.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:69:0)
[18:32:15.510] Build status: STARTED
[18:32:15.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:70:0) after 3m1s
[18:35:16.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:70:0)
[18:35:16.572] Build status: STARTED
[18:35:16.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:71:0) after 2m35s
[18:37:51.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:71:0)
[18:37:51.687] Build status: STARTED
[18:37:51.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:72:0) after 1m59s
[18:39:50.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:72:0)
[18:39:50.708] Build status: STARTED
[18:39:50.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:73:0) after 8m6s
[18:47:56.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:73:0)
[18:47:56.931] Build status: STARTED
[18:47:56.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:74:0) after 8m21s
[18:56:17.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:74:0)
[18:56:17.985] Build status: STARTED
[18:56:17.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:75:0) after 7m58s
[19:04:16.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:75:0)
[19:04:16.035] Build status: STARTED
[19:04:16.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:76:0) after 1m16s
[19:05:32.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:76:0)
[19:05:32.183] Build status: STARTED
[19:05:32.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:77:0) after 5m54s
[19:11:26.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:77:0)
[19:11:26.308] Build status: STARTED
[19:11:26.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:78:0) after 1m19s
[19:12:45.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:78:0)
[19:12:45.390] Build status: STARTED
[19:12:45.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:79:0) after 4m42s
[19:17:27.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:79:0)
[19:17:27.649] Build status: STARTED
[19:17:27.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:80:0) after 4m36s
[19:22:03.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:80:0)
[19:22:03.940] Build status: STARTED
[19:22:03.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:81:0) after 2m3s
[19:24:06.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:81:0)
[19:24:06.958] Build status: STARTED
[19:24:06.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:82:0) after 6m47s
[19:30:54.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:82:0)
[19:30:54.127] Build status: STARTED
[19:30:54.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:83:0) after 8m35s
[19:39:29.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:83:0)
[19:39:29.347] Build status: STARTED
[19:39:29.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:84:0) after 2m42s
[19:42:11.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:84:0)
[19:42:11.393] Build status: STARTED
[19:42:11.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:85:0) after 5m44s
[19:47:55.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:85:0)
[19:47:55.461] Build status: STARTED
[19:47:55.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:86:0) after 8m9s
[19:56:04.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:86:0)
[19:56:04.501] Build status: STARTED
[19:56:04.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:87:0) after 8m36s
[20:04:40.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:87:0)
[20:04:40.556] Build status: STARTED
[20:04:40.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:88:0) after 7m40s
[20:12:20.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:88:0)
[20:12:20.600] Build status: STARTED
[20:12:20.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:89:0) after 5m36s
[20:17:56.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:89:0)
[20:17:56.659] Build status: STARTED
[20:17:56.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:90:0) after 6m21s
[20:24:17.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:90:0)
[20:24:17.732] Build status: STARTED
[20:24:17.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:91:0) after 6m2s
[20:30:19.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:91:0)
[20:30:19.853] Build status: STARTED
[20:30:19.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:92:0) after 9m52s
[20:40:12.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:92:0)
[20:40:12.164] Build status: STARTED
[20:40:12.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:93:0) after 6m6s
[20:46:18.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:93:0)
[20:46:18.226] Build status: STARTED
[20:46:18.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:94:0) after 7m45s
[20:54:03.260] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:94:0)
[20:54:03.362] Build status: STARTED
[20:54:03.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:95:0) after 9m26s
[21:03:29.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:95:0)
[21:03:29.407] Build status: STARTED
[21:03:29.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:96:0) after 7m9s
[21:10:38.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:96:0)
[21:10:38.631] Build status: STARTED
[21:10:38.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:97:0) after 5m58s
[21:16:36.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:97:0)
[21:16:36.694] Build status: STARTED
[21:16:36.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:98:0) after 8m18s
[21:24:54.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:98:0)
[21:24:54.795] Build status: STARTED
[21:24:54.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:99:0) after 7m2s
[21:31:56.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:99:0)
[21:31:56.843] Build status: STARTED
[21:31:56.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:100:0) after 2m8s
[21:34:04.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:100:0)
[21:34:05.003] Build status: STARTED
[21:34:05.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:101:0) after 8m55s
[21:43:00.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:101:0)
[21:43:00.168] Build status: STARTED
[21:43:00.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:102:0) after 7m9s
[21:50:09.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:102:0)
[21:50:09.216] Build status: STARTED
[21:50:09.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:103:0) after 5m28s
[21:55:37.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:103:0)
[21:55:37.281] Build status: STARTED
[21:55:37.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:104:0) after 2m32s
[21:58:09.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:104:0)
[21:58:09.424] Build status: STARTED
[21:58:09.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:105:0) after 6m12s
[22:04:21.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:105:0)
[22:04:21.545] Build status: STARTED
[22:04:21.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:106:0) after 9m16s
[22:13:37.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:106:0)
[22:13:37.602] Build status: STARTED
[22:13:37.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:107:0) after 6m6s
[22:19:43.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:107:0)
[22:19:43.667] Build status: STARTED
[22:19:43.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:108:0) after 1m39s
[22:21:22.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:108:0)
[22:21:22.741] Build status: STARTED
[22:21:22.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:109:0) after 8m55s
[22:30:17.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:109:0)
[22:30:17.794] Build status: STARTED
[22:30:17.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:110:0) after 9m30s
[22:39:47.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:110:0)
[22:39:47.900] Build status: STARTED
[22:39:47.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8950989528096721056:111:0) after 6m39s
[22:44:53.720] Received PubSub notification, asking Buildbucket for the build status
[22:44:53.819] Build:
{
"id": "8785559466154733537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 19248,
"createdBy": "project:chromium",
"createTime": "2023-03-26T12:43:24.076800301Z",
"startTime": "2023-03-26T12:54:33.794813Z",
"endTime": "2023-03-26T22:44:52.673533523Z",
"updateTime": "2023-03-26T22:44:52.673533523Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "694fb257ee5507e88d1c254d13fafaafd555dc35",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:44:53.820] Invocation finished in 10h1m30.979514216s with status FAILED