[13:15:13.538] New invocation is queued and will start shortly
[13:15:15.231] Starting the invocation (attempt 1)
[13:15:15.278] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f74c37faaa3a9fe8da92ea3a9ad77943e0c5265d"
[13:15:15.278] Popped gitiles commit info from properties and tags
[13:15:15.278] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:15:15.278] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:15:15.279] Buildbucket request:
{
"requestId": "8967113784618766144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f74c37faaa3a9fe8da92ea3a9ad77943e0c5265d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8967113784618766144"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:15:15.778] Scheduled build:
{
"id": "8801683722025669601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28204,
"createdBy": "project:chromium",
"createTime": "2022-09-29T13:15:15.381348672Z",
"updateTime": "2022-09-29T13:15:15.381348672Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f74c37faaa3a9fe8da92ea3a9ad77943e0c5265d",
"ref": "refs/heads/main"
}
}
}
[13:15:15.778] Task URL: https://cr-buildbucket.appspot.com/build/8801683722025669601
[13:15:15.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:2:0) after 3m11s
[13:18:26.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:2:0)
[13:18:26.908] Build status: SCHEDULED
[13:18:26.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:3:0) after 1m4s
[13:19:30.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:3:0)
[13:19:30.976] Build status: SCHEDULED
[13:19:30.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:4:0) after 2m26s
[13:21:38.113] Received PubSub notification, asking Buildbucket for the build status
[13:21:38.138] Build status: STARTED
[13:21:57.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:4:0)
[13:21:57.511] Build status: STARTED
[13:21:57.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:6:0) after 7m46s
[13:29:44.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:6:0)
[13:29:44.095] Build status: STARTED
[13:29:44.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:7:0) after 3m59s
[13:33:43.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:7:0)
[13:33:43.237] Build status: STARTED
[13:33:43.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:8:0) after 7m13s
[13:40:56.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:8:0)
[13:40:56.610] Build status: STARTED
[13:40:56.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:9:0) after 9m48s
[13:50:44.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:9:0)
[13:50:44.673] Build status: STARTED
[13:50:44.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:10:0) after 1m49s
[13:52:34.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:10:0)
[13:52:34.044] Build status: STARTED
[13:52:34.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:11:0) after 6m43s
[13:59:17.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:11:0)
[13:59:17.138] Build status: STARTED
[13:59:17.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:12:0) after 4m48s
[14:04:05.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:12:0)
[14:04:05.331] Build status: STARTED
[14:04:05.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:13:0) after 4m32s
[14:08:37.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:13:0)
[14:08:37.509] Build status: STARTED
[14:08:37.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:14:0) after 3m43s
[14:12:20.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:14:0)
[14:12:20.568] Build status: STARTED
[14:12:20.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:15:0) after 8m28s
[14:20:48.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:15:0)
[14:20:48.767] Build status: STARTED
[14:20:48.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:16:0) after 9m27s
[14:30:15.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:16:0)
[14:30:15.985] Build status: STARTED
[14:30:15.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:17:0) after 9m46s
[14:40:02.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:17:0)
[14:40:02.201] Build status: STARTED
[14:40:02.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:18:0) after 6m34s
[14:46:36.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:18:0)
[14:46:36.370] Build status: STARTED
[14:46:36.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:19:0) after 4m38s
[14:51:14.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:19:0)
[14:51:14.684] Build status: STARTED
[14:51:14.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:20:0) after 4m33s
[14:55:47.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:20:0)
[14:55:47.838] Build status: STARTED
[14:55:47.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:21:0) after 3m45s
[14:59:32.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:21:0)
[14:59:32.969] Build status: STARTED
[14:59:32.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:22:0) after 4m55s
[15:04:27.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:22:0)
[15:04:28.035] Build status: STARTED
[15:04:28.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:23:0) after 1m8s
[15:05:36.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:23:0)
[15:05:36.433] Build status: STARTED
[15:05:36.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:24:0) after 2m31s
[15:08:07.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:24:0)
[15:08:07.544] Build status: STARTED
[15:08:07.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:25:0) after 5m8s
[15:13:15.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:25:0)
[15:13:15.649] Build status: STARTED
[15:13:15.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:26:0) after 7m14s
[15:20:29.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:26:0)
[15:20:29.717] Build status: STARTED
[15:20:29.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:27:0) after 4m54s
[15:25:23.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:27:0)
[15:25:23.940] Build status: STARTED
[15:25:23.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:28:0) after 2m23s
[15:27:46.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:28:0)
[15:27:46.995] Build status: STARTED
[15:27:46.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:29:0) after 8m56s
[15:36:43.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:29:0)
[15:36:43.245] Build status: STARTED
[15:36:43.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:30:0) after 7m39s
[15:44:22.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:30:0)
[15:44:22.313] Build status: STARTED
[15:44:22.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:31:0) after 2m5s
[15:46:27.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:31:0)
[15:46:27.649] Build status: STARTED
[15:46:27.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:32:0) after 4m6s
[15:50:33.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:32:0)
[15:50:33.964] Build status: STARTED
[15:50:33.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:33:0) after 9m48s
[16:00:22.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:33:0)
[16:00:22.184] Build status: STARTED
[16:00:22.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:34:0) after 3m13s
[16:03:36.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:34:0)
[16:03:36.188] Build status: STARTED
[16:03:36.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:35:0) after 3m24s
[16:07:00.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:35:0)
[16:07:00.390] Build status: STARTED
[16:07:00.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:36:0) after 4m20s
[16:11:20.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:36:0)
[16:11:20.450] Build status: STARTED
[16:11:20.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:37:0) after 6m53s
[16:18:13.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:37:0)
[16:18:13.513] Build status: STARTED
[16:18:13.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:38:0) after 8m3s
[16:26:16.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:38:0)
[16:26:16.572] Build status: STARTED
[16:26:16.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:39:0) after 5m44s
[16:32:00.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:39:0)
[16:32:00.750] Build status: STARTED
[16:32:00.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:40:0) after 5m25s
[16:37:25.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:40:0)
[16:37:25.804] Build status: STARTED
[16:37:25.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:41:0) after 9m45s
[16:47:10.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:41:0)
[16:47:10.963] Build status: STARTED
[16:47:10.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:42:0) after 5m18s
[16:52:28.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:42:0)
[16:52:29.024] Build status: STARTED
[16:52:29.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:43:0) after 2m4s
[16:54:33.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:43:0)
[16:54:33.181] Build status: STARTED
[16:54:33.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:44:0) after 7m17s
[17:01:50.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:44:0)
[17:01:50.241] Build status: STARTED
[17:01:50.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:45:0) after 3m22s
[17:05:12.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:45:0)
[17:05:12.332] Build status: STARTED
[17:05:12.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:46:0) after 4m50s
[17:10:02.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:46:0)
[17:10:02.436] Build status: STARTED
[17:10:02.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:47:0) after 3m32s
[17:13:34.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:47:0)
[17:13:34.551] Build status: STARTED
[17:13:34.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:48:0) after 7m4s
[17:20:38.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:48:0)
[17:20:38.751] Build status: STARTED
[17:20:38.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:49:0) after 7m23s
[17:28:01.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:49:0)
[17:28:01.900] Build status: STARTED
[17:28:01.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:50:0) after 4m40s
[17:32:42.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:50:0)
[17:32:42.174] Build status: STARTED
[17:32:42.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:51:0) after 8m16s
[17:40:58.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:51:0)
[17:40:58.276] Build status: STARTED
[17:40:58.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:52:0) after 6m52s
[17:47:50.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:52:0)
[17:47:50.407] Build status: STARTED
[17:47:50.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:53:0) after 9m8s
[17:56:58.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:53:0)
[17:56:58.534] Build status: STARTED
[17:56:58.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:54:0) after 4m37s
[18:01:35.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:54:0)
[18:01:35.788] Build status: STARTED
[18:01:35.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:55:0) after 7m3s
[18:08:38.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:55:0)
[18:08:38.848] Build status: STARTED
[18:08:38.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:56:0) after 9m33s
[18:18:12.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:56:0)
[18:18:12.028] Build status: STARTED
[18:18:12.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:57:0) after 7m2s
[18:25:14.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:57:0)
[18:25:14.412] Build status: STARTED
[18:25:14.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:58:0) after 6m56s
[18:32:10.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:58:0)
[18:32:10.442] Build status: STARTED
[18:32:10.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:59:0) after 7m55s
[18:40:05.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:59:0)
[18:40:05.585] Build status: STARTED
[18:40:05.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:60:0) after 6m18s
[18:46:23.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:60:0)
[18:46:23.646] Build status: STARTED
[18:46:23.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:61:0) after 7m54s
[18:54:18.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:61:0)
[18:54:18.239] Build status: STARTED
[18:54:18.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:62:0) after 9m45s
[19:04:03.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:62:0)
[19:04:03.334] Build status: STARTED
[19:04:03.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:63:0) after 8m30s
[19:12:33.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:63:0)
[19:12:33.581] Build status: STARTED
[19:12:33.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:64:0) after 6m1s
[19:18:34.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:64:0)
[19:18:34.670] Build status: STARTED
[19:18:34.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:65:0) after 7m10s
[19:25:44.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:65:0)
[19:25:44.775] Build status: STARTED
[19:25:44.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:66:0) after 9m11s
[19:34:56.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:66:0)
[19:34:56.165] Build status: STARTED
[19:34:56.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:67:0) after 7m31s
[19:42:27.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:67:0)
[19:42:27.324] Build status: STARTED
[19:42:27.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:68:0) after 8m27s
[19:50:54.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:68:0)
[19:50:54.494] Build status: STARTED
[19:50:54.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:69:0) after 7m37s
[19:58:31.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:69:0)
[19:58:31.710] Build status: STARTED
[19:58:31.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:70:0) after 4m36s
[20:03:07.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:70:0)
[20:03:07.888] Build status: STARTED
[20:03:07.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:71:0) after 8m54s
[20:12:02.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:71:0)
[20:12:02.140] Build status: STARTED
[20:12:02.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:72:0) after 1m18s
[20:13:20.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:72:0)
[20:13:20.742] Build status: STARTED
[20:13:20.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:73:0) after 4m19s
[20:17:39.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:73:0)
[20:17:39.996] Build status: STARTED
[20:17:39.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:74:0) after 1m53s
[20:19:33.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:74:0)
[20:19:33.051] Build status: STARTED
[20:19:33.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:75:0) after 2m26s
[20:21:59.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:75:0)
[20:21:59.107] Build status: STARTED
[20:21:59.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:76:0) after 6m31s
[20:28:30.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:76:0)
[20:28:30.285] Build status: STARTED
[20:28:30.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:77:0) after 4m7s
[20:32:37.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:77:0)
[20:32:37.357] Build status: STARTED
[20:32:37.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:78:0) after 5m26s
[20:38:03.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:78:0)
[20:38:03.600] Build status: STARTED
[20:38:03.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:79:0) after 1m47s
[20:39:50.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:79:0)
[20:39:50.687] Build status: STARTED
[20:39:50.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:80:0) after 5m32s
[20:45:22.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:80:0)
[20:45:22.698] Build status: STARTED
[20:45:22.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:81:0) after 8m17s
[20:53:39.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:81:0)
[20:53:39.938] Build status: STARTED
[20:53:39.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:82:0) after 7m13s
[21:00:53.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:82:0)
[21:00:53.462] Build status: STARTED
[21:00:53.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:83:0) after 2m22s
[21:03:15.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:83:0)
[21:03:15.714] Build status: STARTED
[21:03:15.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:84:0) after 9m42s
[21:12:57.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:84:0)
[21:12:57.776] Build status: STARTED
[21:12:57.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:85:0) after 3m13s
[21:16:11.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:85:0)
[21:16:11.230] Build status: STARTED
[21:16:11.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:86:0) after 5m16s
[21:21:27.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:86:0)
[21:21:27.623] Build status: STARTED
[21:21:27.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:87:0) after 5m25s
[21:26:52.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:87:0)
[21:26:52.766] Build status: STARTED
[21:26:52.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:88:0) after 3m51s
[21:30:44.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:88:0)
[21:30:44.075] Build status: STARTED
[21:30:44.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:89:0) after 3m53s
[21:34:37.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:89:0)
[21:34:37.548] Build status: STARTED
[21:34:37.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:90:0) after 8m49s
[21:43:26.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:90:0)
[21:43:26.631] Build status: STARTED
[21:43:26.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:91:0) after 4m50s
[21:48:16.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:91:0)
[21:48:16.705] Build status: STARTED
[21:48:16.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:92:0) after 1m41s
[21:49:57.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:92:0)
[21:49:57.769] Build status: STARTED
[21:49:57.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:93:0) after 3m46s
[21:53:44.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:93:0)
[21:53:44.026] Build status: STARTED
[21:53:44.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:94:0) after 7m9s
[22:00:53.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:94:0)
[22:00:53.238] Build status: STARTED
[22:00:53.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:95:0) after 5m55s
[22:06:48.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:95:0)
[22:06:48.384] Build status: STARTED
[22:06:48.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:96:0) after 6m11s
[22:12:59.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:96:0)
[22:12:59.680] Build status: STARTED
[22:12:59.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:97:0) after 1m3s
[22:14:02.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:97:0)
[22:14:02.735] Build status: STARTED
[22:14:02.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:98:0) after 1m56s
[22:15:58.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:98:0)
[22:15:58.971] Build status: STARTED
[22:15:58.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:99:0) after 7m25s
[22:23:24.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:99:0)
[22:23:24.276] Build status: STARTED
[22:23:24.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:100:0) after 1m44s
[22:25:08.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:100:0)
[22:25:08.346] Build status: STARTED
[22:25:08.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:101:0) after 5m47s
[22:30:55.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:101:0)
[22:30:55.466] Build status: STARTED
[22:30:55.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:102:0) after 4m45s
[22:35:40.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:102:0)
[22:35:40.625] Build status: STARTED
[22:35:40.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:103:0) after 9m8s
[22:44:48.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:103:0)
[22:44:49.013] Build status: STARTED
[22:44:49.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:104:0) after 1m19s
[22:46:07.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:104:0)
[22:46:08.026] Build status: STARTED
[22:46:08.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:105:0) after 2m12s
[22:48:20.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:105:0)
[22:48:20.259] Build status: STARTED
[22:48:20.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:106:0) after 4m30s
[22:52:50.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:106:0)
[22:52:50.267] Build status: STARTED
[22:52:50.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:107:0) after 1m34s
[22:54:24.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:107:0)
[22:54:24.365] Build status: STARTED
[22:54:24.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:108:0) after 3m5s
[22:57:29.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:108:0)
[22:57:29.421] Build status: STARTED
[22:57:29.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:109:0) after 9m34s
[23:07:03.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:109:0)
[23:07:03.591] Build status: STARTED
[23:07:03.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:110:0) after 5m24s
[23:12:27.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:110:0)
[23:12:27.666] Build status: STARTED
[23:12:27.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:111:0) after 6m50s
[23:19:17.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:111:0)
[23:19:17.793] Build status: STARTED
[23:19:17.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:112:0) after 4m30s
[23:23:47.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:112:0)
[23:23:47.853] Build status: STARTED
[23:23:47.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:113:0) after 1m8s
[23:24:56.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:113:0)
[23:24:56.376] Build status: STARTED
[23:24:56.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:114:0) after 6m34s
[23:31:30.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:114:0)
[23:31:30.499] Build status: STARTED
[23:31:30.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:115:0) after 6m49s
[23:38:19.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:115:0)
[23:38:19.681] Build status: STARTED
[23:38:19.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:116:0) after 8m11s
[23:46:30.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:116:0)
[23:46:30.802] Build status: STARTED
[23:46:30.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:117:0) after 6m35s
[23:53:05.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:117:0)
[23:53:05.858] Build status: STARTED
[23:53:05.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:118:0) after 2m58s
[23:56:04.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:118:0)
[23:56:04.062] Build status: STARTED
[23:56:04.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:119:0) after 2m3s
[23:58:07.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:119:0)
[23:58:07.316] Build status: STARTED
[23:58:07.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:120:0) after 3m28s
[00:01:35.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:120:0)
[00:01:35.381] Build status: STARTED
[00:01:35.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:121:0) after 8m21s
[00:09:56.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:121:0)
[00:09:56.597] Build status: STARTED
[00:09:56.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:122:0) after 7m25s
[00:17:21.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:122:0)
[00:17:21.634] Build status: STARTED
[00:17:21.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:123:0) after 5m18s
[00:22:39.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:123:0)
[00:22:39.700] Build status: STARTED
[00:22:39.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:124:0) after 8m3s
[00:30:42.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:124:0)
[00:30:42.908] Build status: STARTED
[00:30:42.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:125:0) after 2m16s
[00:32:59.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:125:0)
[00:32:59.128] Build status: STARTED
[00:32:59.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:126:0) after 8m39s
[00:41:38.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:126:0)
[00:41:38.358] Build status: STARTED
[00:41:38.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:127:0) after 3m9s
[00:44:47.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:127:0)
[00:44:47.772] Build status: STARTED
[00:44:47.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:128:0) after 4m29s
[00:49:16.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:128:0)
[00:49:16.974] Build status: STARTED
[00:49:16.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:129:0) after 1m48s
[00:51:05.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:129:0)
[00:51:05.102] Build status: STARTED
[00:51:05.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:130:0) after 9m34s
[01:00:39.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:130:0)
[01:00:39.164] Build status: STARTED
[01:00:39.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:131:0) after 1m48s
[01:02:27.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:131:0)
[01:02:27.471] Build status: STARTED
[01:02:27.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:132:0) after 2m49s
[01:05:16.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:132:0)
[01:05:16.644] Build status: STARTED
[01:05:16.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:133:0) after 6m58s
[01:12:14.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:133:0)
[01:12:14.818] Build status: STARTED
[01:12:14.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:134:0) after 2m57s
[01:15:12.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:134:0)
[01:15:12.225] Build status: STARTED
[01:15:12.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:135:0) after 5m13s
[01:20:25.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:135:0)
[01:20:25.958] Build status: STARTED
[01:20:25.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:136:0) after 4m37s
[01:25:03.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:136:0)
[01:25:03.095] Build status: STARTED
[01:25:03.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:137:0) after 7m38s
[01:32:41.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:137:0)
[01:32:41.407] Build status: STARTED
[01:32:41.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:138:0) after 9m19s
[01:42:00.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:138:0)
[01:42:00.676] Build status: STARTED
[01:42:00.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:139:0) after 2m38s
[01:44:39.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:139:0)
[01:44:39.113] Build status: STARTED
[01:44:39.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:140:0) after 9m9s
[01:53:48.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:140:0)
[01:53:48.169] Build status: STARTED
[01:53:48.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:141:0) after 7m41s
[02:01:29.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:141:0)
[02:01:29.490] Build status: STARTED
[02:01:29.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:142:0) after 2m8s
[02:03:37.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:142:0)
[02:03:37.677] Build status: STARTED
[02:03:37.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:143:0) after 2m57s
[02:06:34.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:143:0)
[02:06:34.763] Build status: STARTED
[02:06:34.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:144:0) after 2m52s
[02:09:26.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:144:0)
[02:09:26.818] Build status: STARTED
[02:09:26.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:145:0) after 9m59s
[02:19:25.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:145:0)
[02:19:25.885] Build status: STARTED
[02:19:25.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:146:0) after 3m7s
[02:22:32.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:146:0)
[02:22:32.988] Build status: STARTED
[02:22:32.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967113784618766144:147:0) after 3m51s
[02:23:49.244] Received PubSub notification, asking Buildbucket for the build status
[02:23:49.271] Build:
{
"id": "8801683722025669601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28204,
"createdBy": "project:chromium",
"createTime": "2022-09-29T13:15:15.381348672Z",
"startTime": "2022-09-29T13:21:37.312966Z",
"endTime": "2022-09-30T02:23:48.715356773Z",
"updateTime": "2022-09-30T02:23:48.715356773Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f74c37faaa3a9fe8da92ea3a9ad77943e0c5265d",
"ref": "refs/heads/main"
}
}
}
[02:23:49.271] Invocation finished in 13h8m35.746490277s with status FAILED