[21:12:20.052] New invocation is queued and will start shortly
[21:12:21.255] Starting the invocation (attempt 1)
[21:12:21.282] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e73d644b880dc7ebb73fbe91ec38a61d5da2eac5"
[21:12:21.283] Popped gitiles commit info from properties and tags
[21:12:21.283] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:12:21.283] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:12:21.283] Buildbucket request:
{
"requestId": "8935737217159560080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e73d644b880dc7ebb73fbe91ec38a61d5da2eac5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8935737217159560080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:12:21.850] Scheduled build:
{
"id": "8770307155146517825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 20448,
"createdBy": "project:chromium",
"createTime": "2023-09-10T21:12:21.350877618Z",
"updateTime": "2023-09-10T21:12:21.350877618Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e73d644b880dc7ebb73fbe91ec38a61d5da2eac5",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:12:21.850] Task URL: https://cr-buildbucket.appspot.com/build/8770307155146517825
[21:12:21.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:2:0) after 6m13s
[21:12:22.036] Received PubSub notification, asking Buildbucket for the build status
[21:12:22.068] Build status: SCHEDULED
[21:12:27.267] Received PubSub notification, asking Buildbucket for the build status
[21:12:27.300] Build status: STARTED
[21:18:34.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:2:0)
[21:18:34.901] Build status: STARTED
[21:18:34.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:5:0) after 8m14s
[21:26:49.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:5:0)
[21:26:49.244] Build status: STARTED
[21:26:49.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:6:0) after 5m59s
[21:32:48.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:6:0)
[21:32:48.366] Build status: STARTED
[21:32:48.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:7:0) after 8m50s
[21:41:38.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:7:0)
[21:41:38.419] Build status: STARTED
[21:41:38.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:8:0) after 4m16s
[21:45:54.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:8:0)
[21:45:54.428] Build status: STARTED
[21:45:54.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:9:0) after 7m44s
[21:53:38.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:9:0)
[21:53:38.464] Build status: STARTED
[21:53:38.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:10:0) after 7m8s
[22:00:46.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:10:0)
[22:00:46.755] Build status: STARTED
[22:00:46.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:11:0) after 4m52s
[22:05:38.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:11:0)
[22:05:38.799] Build status: STARTED
[22:05:38.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:12:0) after 9m56s
[22:15:34.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:12:0)
[22:15:34.953] Build status: STARTED
[22:15:34.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:13:0) after 6m52s
[22:22:27.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:13:0)
[22:22:27.132] Build status: STARTED
[22:22:27.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:14:0) after 9m5s
[22:31:32.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:14:0)
[22:31:32.261] Build status: STARTED
[22:31:32.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:15:0) after 5m56s
[22:37:28.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:15:0)
[22:37:28.541] Build status: STARTED
[22:37:28.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:16:0) after 8m22s
[22:45:50.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:16:0)
[22:45:50.689] Build status: STARTED
[22:45:50.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:17:0) after 9m34s
[22:55:24.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:17:0)
[22:55:24.980] Build status: STARTED
[22:55:24.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:18:0) after 7m58s
[23:03:23.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:18:0)
[23:03:23.116] Build status: STARTED
[23:03:23.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:19:0) after 6m42s
[23:10:05.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:19:0)
[23:10:05.361] Build status: STARTED
[23:10:05.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:20:0) after 8m50s
[23:18:55.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:20:0)
[23:18:55.663] Build status: STARTED
[23:18:55.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:21:0) after 8m11s
[23:27:06.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:21:0)
[23:27:06.700] Build status: STARTED
[23:27:06.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:22:0) after 1m21s
[23:28:27.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:22:0)
[23:28:27.738] Build status: STARTED
[23:28:27.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:23:0) after 3m51s
[23:32:18.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:23:0)
[23:32:18.800] Build status: STARTED
[23:32:18.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:24:0) after 2m11s
[23:34:29.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:24:0)
[23:34:29.867] Build status: STARTED
[23:34:29.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:25:0) after 5m44s
[23:40:13.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:25:0)
[23:40:13.907] Build status: STARTED
[23:40:13.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:26:0) after 1m49s
[23:42:02.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:26:0)
[23:42:02.956] Build status: STARTED
[23:42:02.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:27:0) after 9m31s
[23:51:34.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:27:0)
[23:51:34.052] Build status: STARTED
[23:51:34.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:28:0) after 5m37s
[23:57:11.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:28:0)
[23:57:11.194] Build status: STARTED
[23:57:11.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:29:0) after 2m40s
[23:59:51.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:29:0)
[23:59:51.232] Build status: STARTED
[23:59:51.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:30:0) after 2m9s
[00:02:00.362] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:30:0)
[00:02:00.383] Build status: STARTED
[00:02:00.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:31:0) after 9m27s
[00:11:27.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:31:0)
[00:11:27.584] Build status: STARTED
[00:11:27.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:32:0) after 2m47s
[00:14:15.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:32:0)
[00:14:15.122] Build status: STARTED
[00:14:15.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:33:0) after 9m25s
[00:23:40.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:33:0)
[00:23:40.198] Build status: STARTED
[00:23:40.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:34:0) after 1m24s
[00:25:04.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:34:0)
[00:25:04.598] Build status: STARTED
[00:25:04.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:35:0) after 6m17s
[00:31:21.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:35:0)
[00:31:21.928] Build status: STARTED
[00:31:21.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:36:0) after 5m20s
[00:36:41.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:36:0)
[00:36:41.969] Build status: STARTED
[00:36:41.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:37:0) after 4m30s
[00:41:12.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:37:0)
[00:41:12.124] Build status: STARTED
[00:41:12.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:38:0) after 4m10s
[00:45:22.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:38:0)
[00:45:22.212] Build status: STARTED
[00:45:22.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:39:0) after 2m34s
[00:47:56.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:39:0)
[00:47:56.243] Build status: STARTED
[00:47:56.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:40:0) after 3m10s
[00:51:06.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:40:0)
[00:51:06.571] Build status: STARTED
[00:51:06.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:41:0) after 7m11s
[00:58:17.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:41:0)
[00:58:17.760] Build status: STARTED
[00:58:17.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:42:0) after 9m53s
[01:08:11.027] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:42:0)
[01:08:11.048] Build status: STARTED
[01:08:11.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:43:0) after 5m11s
[01:13:22.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:43:0)
[01:13:22.199] Build status: STARTED
[01:13:22.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:44:0) after 8m33s
[01:21:55.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:44:0)
[01:21:55.298] Build status: STARTED
[01:21:55.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:45:0) after 4m17s
[01:26:12.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:45:0)
[01:26:12.601] Build status: STARTED
[01:26:12.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:46:0) after 5m25s
[01:31:37.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:46:0)
[01:31:37.788] Build status: STARTED
[01:31:37.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:47:0) after 5m15s
[01:36:52.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:47:0)
[01:36:52.873] Build status: STARTED
[01:36:52.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:48:0) after 5m39s
[01:42:31.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:48:0)
[01:42:31.954] Build status: STARTED
[01:42:31.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:49:0) after 6m54s
[01:49:25.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:49:0)
[01:49:26.008] Build status: STARTED
[01:49:26.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:50:0) after 1m28s
[01:50:54.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:50:0)
[01:50:54.046] Build status: STARTED
[01:50:54.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:51:0) after 7m32s
[01:58:26.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:51:0)
[01:58:26.240] Build status: STARTED
[01:58:26.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:52:0) after 9m9s
[02:07:35.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:52:0)
[02:07:35.415] Build status: STARTED
[02:07:35.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:53:0) after 9m7s
[02:16:42.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:53:0)
[02:16:42.791] Build status: STARTED
[02:16:42.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:54:0) after 7m6s
[02:23:48.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:54:0)
[02:23:48.922] Build status: STARTED
[02:23:48.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:55:0) after 8m6s
[02:31:55.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:55:0)
[02:31:55.044] Build status: STARTED
[02:31:55.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:56:0) after 8m12s
[02:40:07.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:56:0)
[02:40:07.108] Build status: STARTED
[02:40:07.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:57:0) after 3m42s
[02:43:49.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:57:0)
[02:43:49.283] Build status: STARTED
[02:43:49.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:58:0) after 2m59s
[02:46:48.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:58:0)
[02:46:48.324] Build status: STARTED
[02:46:48.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:59:0) after 2m29s
[02:49:17.408] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:59:0)
[02:49:17.444] Build status: STARTED
[02:49:17.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:60:0) after 9m1s
[02:58:18.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:60:0)
[02:58:18.518] Build status: STARTED
[02:58:18.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:61:0) after 4m34s
[03:02:52.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:61:0)
[03:02:52.573] Build status: STARTED
[03:02:52.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:62:0) after 9m31s
[03:12:23.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:62:0)
[03:12:23.622] Build status: STARTED
[03:12:23.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:63:0) after 2m26s
[03:14:49.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:63:0)
[03:14:49.827] Build status: STARTED
[03:14:49.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:64:0) after 8m58s
[03:23:47.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:64:0)
[03:23:47.887] Build status: STARTED
[03:23:47.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:65:0) after 4m50s
[03:28:37.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:65:0)
[03:28:38.009] Build status: STARTED
[03:28:38.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:66:0) after 1m33s
[03:30:11.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:66:0)
[03:30:11.057] Build status: STARTED
[03:30:11.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:67:0) after 6m35s
[03:36:46.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:67:0)
[03:36:46.191] Build status: STARTED
[03:36:46.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:68:0) after 7m50s
[03:44:36.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:68:0)
[03:44:36.234] Build status: STARTED
[03:44:36.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:69:0) after 6m4s
[03:50:40.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:69:0)
[03:50:40.279] Build status: STARTED
[03:50:40.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:70:0) after 4m48s
[03:55:28.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:70:0)
[03:55:28.465] Build status: STARTED
[03:55:28.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:71:0) after 7m16s
[04:02:44.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:71:0)
[04:02:44.600] Build status: STARTED
[04:02:44.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:72:0) after 7m25s
[04:10:09.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:72:0)
[04:10:09.638] Build status: STARTED
[04:10:09.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:73:0) after 2m42s
[04:12:51.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:73:0)
[04:12:51.676] Build status: STARTED
[04:12:51.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:74:0) after 8m28s
[04:21:19.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:74:0)
[04:21:19.864] Build status: STARTED
[04:21:19.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:75:0) after 4m45s
[04:26:04.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:75:0)
[04:26:04.959] Build status: STARTED
[04:26:04.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:76:0) after 3m12s
[04:29:16.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:76:0)
[04:29:16.992] Build status: STARTED
[04:29:16.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:77:0) after 7m6s
[04:36:22.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:77:0)
[04:36:22.995] Build status: STARTED
[04:36:22.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:78:0) after 2m48s
[04:39:11.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:78:0)
[04:39:11.132] Build status: STARTED
[04:39:11.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:79:0) after 4m9s
[04:43:20.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:79:0)
[04:43:20.225] Build status: STARTED
[04:43:20.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:80:0) after 7m46s
[04:51:06.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:80:0)
[04:51:06.400] Build status: STARTED
[04:51:06.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:81:0) after 4m42s
[04:55:48.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:81:0)
[04:55:48.407] Build status: STARTED
[04:55:48.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:82:0) after 2m46s
[04:58:34.431] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:82:0)
[04:58:34.516] Build status: STARTED
[04:58:34.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:83:0) after 2m31s
[05:01:05.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:83:0)
[05:01:05.664] Build status: STARTED
[05:01:05.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:84:0) after 8m24s
[05:09:29.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:84:0)
[05:09:29.717] Build status: STARTED
[05:09:29.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:85:0) after 5m49s
[05:15:18.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:85:0)
[05:15:18.859] Build status: STARTED
[05:15:18.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:86:0) after 1m1s
[05:16:19.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:86:0)
[05:16:19.930] Build status: STARTED
[05:16:19.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:87:0) after 9m45s
[05:26:04.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:87:0)
[05:26:04.978] Build status: STARTED
[05:26:04.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:88:0) after 2m13s
[05:28:17.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:88:0)
[05:28:18.013] Build status: STARTED
[05:28:18.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:89:0) after 1m37s
[05:29:55.031] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:89:0)
[05:29:55.049] Build status: STARTED
[05:29:55.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:90:0) after 4m24s
[05:34:19.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:90:0)
[05:34:19.091] Build status: STARTED
[05:34:19.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:91:0) after 1m49s
[05:36:08.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:91:0)
[05:36:08.397] Build status: STARTED
[05:36:08.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:92:0) after 8m41s
[05:44:49.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:92:0)
[05:44:49.480] Build status: STARTED
[05:44:49.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:93:0) after 2m39s
[05:47:28.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:93:0)
[05:47:28.517] Build status: STARTED
[05:47:28.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:94:0) after 1m30s
[05:48:58.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:94:0)
[05:48:58.632] Build status: STARTED
[05:48:58.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:95:0) after 9m1s
[05:57:59.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:95:0)
[05:57:59.926] Build status: STARTED
[05:57:59.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:96:0) after 5m1s
[06:03:00.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:96:0)
[06:03:00.971] Build status: STARTED
[06:03:00.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:97:0) after 5m34s
[06:08:34.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:97:0)
[06:08:35.010] Build status: STARTED
[06:08:35.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:98:0) after 6m14s
[06:14:49.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:98:0)
[06:14:49.156] Build status: STARTED
[06:14:49.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:99:0) after 8m55s
[06:23:44.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:99:0)
[06:23:44.202] Build status: STARTED
[06:23:44.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:100:0) after 7m30s
[06:31:14.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:100:0)
[06:31:14.347] Build status: STARTED
[06:31:14.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:101:0) after 5m3s
[06:36:17.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:101:0)
[06:36:17.428] Build status: STARTED
[06:36:17.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:102:0) after 8m51s
[06:45:08.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:102:0)
[06:45:08.531] Build status: STARTED
[06:45:08.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:103:0) after 7m37s
[06:52:45.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:103:0)
[06:52:45.662] Build status: STARTED
[06:52:45.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:104:0) after 6m35s
[06:59:20.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:104:0)
[06:59:20.699] Build status: STARTED
[06:59:20.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:105:0) after 1m27s
[07:00:47.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:105:0)
[07:00:47.768] Build status: STARTED
[07:00:47.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:106:0) after 8m34s
[07:09:21.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:106:0)
[07:09:21.798] Build status: STARTED
[07:09:21.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:107:0) after 8m19s
[07:17:40.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:107:0)
[07:17:40.832] Build status: STARTED
[07:17:40.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:108:0) after 4m34s
[07:22:15.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:108:0)
[07:22:15.210] Build status: STARTED
[07:22:15.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8935737217159560080:109:0) after 2m46s
[07:23:13.982] Received PubSub notification, asking Buildbucket for the build status
[07:23:14.008] Build:
{
"id": "8770307155146517825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 20448,
"createdBy": "project:chromium",
"createTime": "2023-09-10T21:12:21.350877618Z",
"startTime": "2023-09-10T21:12:26.519158Z",
"endTime": "2023-09-11T07:23:13.169111801Z",
"updateTime": "2023-09-11T07:23:13.169111801Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e73d644b880dc7ebb73fbe91ec38a61d5da2eac5",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:23:14.008] Invocation finished in 10h10m53.960742549s with status FAILED