[17:01:28.596] New invocation is queued and will start shortly
[17:01:29.788] Starting the invocation (attempt 1)
[17:01:29.824] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/98a9da578d2010134664655ae5bf2595586e7062"
[17:01:29.824] Popped gitiles commit info from properties and tags
[17:01:29.824] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:01:29.824] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:01:29.824] Buildbucket request:
{
"requestId": "8996543564219573296",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "98a9da578d2010134664655ae5bf2595586e7062",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8996543564219573296"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:01:30.532] Scheduled build:
{
"id": "8831113502178696753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26250,
"createdBy": "project:chromium",
"createTime": "2021-11-08T17:01:29.911226522Z",
"updateTime": "2021-11-08T17:01:29.911226522Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "98a9da578d2010134664655ae5bf2595586e7062",
"ref": "refs/heads/main"
}
}
}
[17:01:30.532] Task URL: https://cr-buildbucket.appspot.com/build/8831113502178696753
[17:01:30.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:2:0) after 7m17s
[17:08:47.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:2:0)
[17:08:47.827] Build status: SCHEDULED
[17:08:47.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:3:0) after 4m9s
[17:12:56.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:3:0)
[17:12:57.004] Build status: SCHEDULED
[17:12:57.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:4:0) after 9m5s
[17:19:35.194] Received PubSub notification, asking Buildbucket for the build status
[17:19:35.229] Build status: STARTED
[17:22:02.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:4:0)
[17:22:02.957] Build status: STARTED
[17:22:02.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:6:0) after 2m51s
[17:24:53.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:6:0)
[17:24:54.025] Build status: STARTED
[17:24:54.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:7:0) after 9m16s
[17:34:10.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:7:0)
[17:34:10.078] Build status: STARTED
[17:34:10.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:8:0) after 4m8s
[17:38:18.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:8:0)
[17:38:18.433] Build status: STARTED
[17:38:18.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:9:0) after 3m44s
[17:42:02.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:9:0)
[17:42:02.727] Build status: STARTED
[17:42:02.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:10:0) after 4m37s
[17:46:39.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:10:0)
[17:46:39.870] Build status: STARTED
[17:46:39.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:11:0) after 8m20s
[17:55:00.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:11:0)
[17:55:00.216] Build status: STARTED
[17:55:00.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:12:0) after 7m32s
[18:02:32.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:12:0)
[18:02:32.577] Build status: STARTED
[18:02:32.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:13:0) after 2m13s
[18:04:45.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:13:0)
[18:04:46.029] Build status: STARTED
[18:04:46.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:14:0) after 2m0s
[18:06:46.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:14:0)
[18:06:46.088] Build status: STARTED
[18:06:46.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:15:0) after 2m42s
[18:09:28.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:15:0)
[18:09:28.198] Build status: STARTED
[18:09:28.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:16:0) after 8m50s
[18:18:18.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:16:0)
[18:18:18.250] Build status: STARTED
[18:18:18.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:17:0) after 2m56s
[18:21:14.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:17:0)
[18:21:14.400] Build status: STARTED
[18:21:14.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:18:0) after 2m12s
[18:23:26.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:18:0)
[18:23:26.844] Build status: STARTED
[18:23:26.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:19:0) after 6m37s
[18:30:03.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:19:0)
[18:30:03.974] Build status: STARTED
[18:30:03.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:20:0) after 1m10s
[18:31:14.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:20:0)
[18:31:14.059] Build status: STARTED
[18:31:14.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:21:0) after 5m32s
[18:36:46.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:21:0)
[18:36:46.207] Build status: STARTED
[18:36:46.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:22:0) after 9m34s
[18:46:20.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:22:0)
[18:46:20.396] Build status: STARTED
[18:46:20.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:23:0) after 3m32s
[18:49:52.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:23:0)
[18:49:52.504] Build status: STARTED
[18:49:52.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:24:0) after 3m16s
[18:53:08.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:24:0)
[18:53:08.667] Build status: STARTED
[18:53:08.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:25:0) after 4m35s
[18:57:43.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:25:0)
[18:57:43.742] Build status: STARTED
[18:57:43.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:26:0) after 4m39s
[19:02:22.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:26:0)
[19:02:22.813] Build status: STARTED
[19:02:22.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:27:0) after 1m41s
[19:04:04.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:27:0)
[19:04:04.354] Build status: STARTED
[19:04:04.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:28:0) after 8m39s
[19:12:43.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:28:0)
[19:12:43.989] Build status: STARTED
[19:12:43.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:29:0) after 8m31s
[19:21:15.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:29:0)
[19:21:15.202] Build status: STARTED
[19:21:15.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:30:0) after 8m42s
[19:29:57.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:30:0)
[19:29:57.337] Build status: STARTED
[19:29:57.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:31:0) after 9m30s
[19:39:27.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:31:0)
[19:39:27.460] Build status: STARTED
[19:39:27.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:32:0) after 8m18s
[19:47:45.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:32:0)
[19:47:45.523] Build status: STARTED
[19:47:45.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:33:0) after 8m42s
[19:56:27.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:33:0)
[19:56:27.893] Build status: STARTED
[19:56:27.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:34:0) after 3m36s
[20:00:04.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:34:0)
[20:00:04.206] Build status: STARTED
[20:00:04.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:35:0) after 2m10s
[20:02:15.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:35:0)
[20:02:15.073] Build status: STARTED
[20:02:15.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:36:0) after 5m29s
[20:07:44.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:36:0)
[20:07:44.257] Build status: STARTED
[20:07:44.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:37:0) after 9m18s
[20:17:02.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:37:0)
[20:17:02.746] Build status: STARTED
[20:17:02.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:38:0) after 2m46s
[20:19:48.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:38:0)
[20:19:48.926] Build status: STARTED
[20:19:48.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:39:0) after 5m42s
[20:25:30.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:39:0)
[20:25:30.989] Build status: STARTED
[20:25:30.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:40:0) after 3m7s
[20:28:38.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:40:0)
[20:28:38.112] Build status: STARTED
[20:28:38.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:41:0) after 7m53s
[20:36:31.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:41:0)
[20:36:31.400] Build status: STARTED
[20:36:31.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:42:0) after 9m57s
[20:46:28.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:42:0)
[20:46:28.748] Build status: STARTED
[20:46:28.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:43:0) after 5m12s
[20:51:40.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:43:0)
[20:51:40.854] Build status: STARTED
[20:51:40.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:44:0) after 7m8s
[20:58:49.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:44:0)
[20:58:49.039] Build status: STARTED
[20:58:49.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:45:0) after 6m11s
[21:05:00.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:45:0)
[21:05:00.135] Build status: STARTED
[21:05:00.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:46:0) after 3m42s
[21:08:42.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:46:0)
[21:08:42.528] Build status: STARTED
[21:08:42.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:47:0) after 7m23s
[21:16:05.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:47:0)
[21:16:05.976] Build status: STARTED
[21:16:05.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:48:0) after 9m44s
[21:25:50.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:48:0)
[21:25:50.069] Build status: STARTED
[21:25:50.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:49:0) after 7m46s
[21:33:36.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:49:0)
[21:33:36.330] Build status: STARTED
[21:33:36.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:50:0) after 4m33s
[21:38:09.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:50:0)
[21:38:09.520] Build status: STARTED
[21:38:09.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:51:0) after 1m35s
[21:39:44.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:51:0)
[21:39:44.578] Build status: STARTED
[21:39:44.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:52:0) after 5m8s
[21:44:52.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:52:0)
[21:44:52.617] Build status: STARTED
[21:44:52.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:53:0) after 4m48s
[21:49:40.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:53:0)
[21:49:40.737] Build status: STARTED
[21:49:40.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:54:0) after 3m0s
[21:52:40.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:54:0)
[21:52:40.811] Build status: STARTED
[21:52:40.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:55:0) after 6m22s
[21:59:02.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:55:0)
[21:59:02.947] Build status: STARTED
[21:59:02.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:56:0) after 8m35s
[22:07:38.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:56:0)
[22:07:38.043] Build status: STARTED
[22:07:38.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:57:0) after 9m17s
[22:16:55.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:57:0)
[22:16:55.506] Build status: STARTED
[22:16:55.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:58:0) after 8m19s
[22:25:14.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:58:0)
[22:25:14.615] Build status: STARTED
[22:25:14.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:59:0) after 6m8s
[22:31:22.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:59:0)
[22:31:22.777] Build status: STARTED
[22:31:22.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:60:0) after 1m49s
[22:33:12.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:60:0)
[22:33:12.193] Build status: STARTED
[22:33:12.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:61:0) after 2m15s
[22:35:27.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:61:0)
[22:35:27.403] Build status: STARTED
[22:35:27.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:62:0) after 3m44s
[22:39:11.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:62:0)
[22:39:11.987] Build status: STARTED
[22:39:11.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:63:0) after 5m59s
[22:45:11.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:63:0)
[22:45:11.047] Build status: STARTED
[22:45:11.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:64:0) after 8m55s
[22:54:06.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:64:0)
[22:54:06.143] Build status: STARTED
[22:54:06.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:65:0) after 7m32s
[23:01:38.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:65:0)
[23:01:38.260] Build status: STARTED
[23:01:38.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:66:0) after 1m56s
[23:03:34.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:66:0)
[23:03:34.421] Build status: STARTED
[23:03:34.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:67:0) after 4m13s
[23:07:48.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:67:0)
[23:07:48.392] Build status: STARTED
[23:07:48.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:68:0) after 9m19s
[23:17:07.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:68:0)
[23:17:07.925] Build status: STARTED
[23:17:07.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:69:0) after 3m37s
[23:20:44.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:69:0)
[23:20:44.962] Build status: STARTED
[23:20:44.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:70:0) after 4m3s
[23:24:47.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:70:0)
[23:24:48.065] Build status: STARTED
[23:24:48.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:71:0) after 6m14s
[23:31:02.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:71:0)
[23:31:02.128] Build status: STARTED
[23:31:02.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:72:0) after 4m15s
[23:35:17.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:72:0)
[23:35:17.663] Build status: STARTED
[23:35:17.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:73:0) after 1m49s
[23:37:06.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:73:0)
[23:37:06.967] Build status: STARTED
[23:37:06.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:74:0) after 9m23s
[23:46:30.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:74:0)
[23:46:30.141] Build status: STARTED
[23:46:30.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:75:0) after 6m55s
[23:53:25.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:75:0)
[23:53:25.341] Build status: STARTED
[23:53:25.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:76:0) after 5m56s
[23:59:21.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:76:0)
[23:59:21.488] Build status: STARTED
[23:59:21.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:77:0) after 5m18s
[00:04:39.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:77:0)
[00:04:39.546] Build status: STARTED
[00:04:39.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:78:0) after 9m36s
[00:14:15.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:78:0)
[00:14:15.576] Build status: STARTED
[00:14:15.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:79:0) after 1m32s
[00:15:47.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:79:0)
[00:15:47.954] Build status: STARTED
[00:15:47.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:80:0) after 1m30s
[00:17:17.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:80:0)
[00:17:18.003] Build status: STARTED
[00:17:18.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:81:0) after 5m41s
[00:22:59.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:81:0)
[00:22:59.087] Build status: STARTED
[00:22:59.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:82:0) after 5m19s
[00:28:18.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:82:0)
[00:28:18.171] Build status: STARTED
[00:28:18.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:83:0) after 8m4s
[00:36:22.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:83:0)
[00:36:22.266] Build status: STARTED
[00:36:22.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:84:0) after 5m1s
[00:41:23.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:84:0)
[00:41:23.553] Build status: STARTED
[00:41:23.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:85:0) after 5m26s
[00:46:49.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:85:0)
[00:46:49.744] Build status: STARTED
[00:46:49.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:86:0) after 6m19s
[00:53:08.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:86:0)
[00:53:08.930] Build status: STARTED
[00:53:08.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:87:0) after 4m19s
[00:57:28.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:87:0)
[00:57:28.095] Build status: STARTED
[00:57:28.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:88:0) after 2m53s
[01:00:22.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:88:0)
[01:00:22.538] Build status: STARTED
[01:00:22.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:89:0) after 5m17s
[01:05:40.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:89:0)
[01:05:40.192] Build status: STARTED
[01:05:40.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:90:0) after 6m21s
[01:12:01.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:90:0)
[01:12:01.291] Build status: STARTED
[01:12:01.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:91:0) after 7m27s
[01:19:28.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:91:0)
[01:19:28.416] Build status: STARTED
[01:19:28.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:92:0) after 3m55s
[01:23:23.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:92:0)
[01:23:23.512] Build status: STARTED
[01:23:23.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:93:0) after 7m25s
[01:30:48.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:93:0)
[01:30:48.685] Build status: STARTED
[01:30:48.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:94:0) after 1m35s
[01:32:23.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:94:0)
[01:32:23.825] Build status: STARTED
[01:32:23.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:95:0) after 9m59s
[01:42:22.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:95:0)
[01:42:22.935] Build status: STARTED
[01:42:22.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:96:0) after 6m1s
[01:48:24.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:96:0)
[01:48:24.175] Build status: STARTED
[01:48:24.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:97:0) after 3m10s
[01:51:34.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:97:0)
[01:51:34.255] Build status: STARTED
[01:51:34.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:98:0) after 6m58s
[01:58:32.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:98:0)
[01:58:32.322] Build status: STARTED
[01:58:32.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:99:0) after 4m34s
[02:03:06.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:99:0)
[02:03:06.474] Build status: STARTED
[02:03:06.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:100:0) after 1m37s
[02:04:43.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:100:0)
[02:04:43.537] Build status: STARTED
[02:04:43.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:101:0) after 9m55s
[02:14:38.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:101:0)
[02:14:38.705] Build status: STARTED
[02:14:38.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:102:0) after 3m12s
[02:17:50.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:102:0)
[02:17:50.851] Build status: STARTED
[02:17:50.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:103:0) after 6m13s
[02:24:04.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:103:0)
[02:24:04.098] Build status: STARTED
[02:24:04.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:104:0) after 8m8s
[02:32:12.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:104:0)
[02:32:12.225] Build status: STARTED
[02:32:12.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:105:0) after 3m57s
[02:36:09.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:105:0)
[02:36:09.307] Build status: STARTED
[02:36:09.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:106:0) after 9m44s
[02:45:53.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:106:0)
[02:45:53.508] Build status: STARTED
[02:45:53.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:107:0) after 7m47s
[02:53:40.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:107:0)
[02:53:40.724] Build status: STARTED
[02:53:40.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:108:0) after 7m53s
[03:01:34.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:108:0)
[03:01:34.164] Build status: STARTED
[03:01:34.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:109:0) after 6m40s
[03:08:14.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:109:0)
[03:08:14.635] Build status: STARTED
[03:08:14.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:110:0) after 4m27s
[03:12:41.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:110:0)
[03:12:41.819] Build status: STARTED
[03:12:41.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:111:0) after 1m23s
[03:14:04.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:111:0)
[03:14:04.864] Build status: STARTED
[03:14:04.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:112:0) after 7m8s
[03:21:13.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:112:0)
[03:21:13.081] Build status: STARTED
[03:21:13.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:113:0) after 4m52s
[03:26:05.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:113:0)
[03:26:05.153] Build status: STARTED
[03:26:05.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:114:0) after 2m31s
[03:28:36.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:114:0)
[03:28:36.228] Build status: STARTED
[03:28:36.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:115:0) after 7m43s
[03:36:19.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:115:0)
[03:36:19.287] Build status: STARTED
[03:36:19.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:116:0) after 9m26s
[03:45:45.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:116:0)
[03:45:45.388] Build status: STARTED
[03:45:45.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:117:0) after 8m5s
[03:53:50.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:117:0)
[03:53:50.511] Build status: STARTED
[03:53:50.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:118:0) after 9m40s
[04:03:30.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:118:0)
[04:03:30.705] Build status: STARTED
[04:03:30.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996543564219573296:119:0) after 2m16s
[04:05:36.130] Received PubSub notification, asking Buildbucket for the build status
[04:05:36.160] Build:
{
"id": "8831113502178696753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26250,
"createdBy": "project:chromium",
"createTime": "2021-11-08T17:01:29.911226522Z",
"startTime": "2021-11-08T17:19:34.561813Z",
"endTime": "2021-11-09T04:05:35.670715569Z",
"updateTime": "2021-11-09T04:05:35.670715569Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "98a9da578d2010134664655ae5bf2595586e7062",
"ref": "refs/heads/main"
}
}
}
[04:05:36.160] Invocation finished in 11h4m7.578615217s with status FAILED