[16:13:34.465] New invocation is queued and will start shortly
[16:13:35.554] Starting the invocation (attempt 1)
[16:13:35.621] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c5f6bf8e22bb43947c7195ebd08dd1900b56fb94"
[16:13:35.621] Popped gitiles commit info from properties and tags
[16:13:35.621] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:13:35.621] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:13:35.621] Buildbucket request:
{
"requestId": "8979514348281713280",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c5f6bf8e22bb43947c7195ebd08dd1900b56fb94",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8979514348281713280"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:13:36.263] Scheduled build:
{
"id": "8814084286306068161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26920,
"createdBy": "project:chromium",
"createTime": "2022-05-15T16:13:35.717232318Z",
"updateTime": "2022-05-15T16:13:35.717232318Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c5f6bf8e22bb43947c7195ebd08dd1900b56fb94",
"ref": "refs/heads/main"
}
}
}
[16:13:36.263] Task URL: https://cr-buildbucket.appspot.com/build/8814084286306068161
[16:13:36.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:2:0) after 9m42s
[16:23:18.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:2:0)
[16:23:18.338] Build status: SCHEDULED
[16:23:18.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:3:0) after 2m32s
[16:25:33.532] Received PubSub notification, asking Buildbucket for the build status
[16:25:33.565] Build status: STARTED
[16:25:50.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:3:0)
[16:25:50.462] Build status: STARTED
[16:25:50.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:5:0) after 8m42s
[16:34:32.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:5:0)
[16:34:32.504] Build status: STARTED
[16:34:32.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:6:0) after 1m27s
[16:35:59.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:6:0)
[16:35:59.574] Build status: STARTED
[16:35:59.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:7:0) after 6m29s
[16:42:28.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:7:0)
[16:42:28.814] Build status: STARTED
[16:42:28.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:8:0) after 3m27s
[16:45:56.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:8:0)
[16:45:56.082] Build status: STARTED
[16:45:56.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:9:0) after 2m47s
[16:48:43.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:9:0)
[16:48:43.506] Build status: STARTED
[16:48:43.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:10:0) after 7m17s
[16:56:00.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:10:0)
[16:56:00.508] Build status: STARTED
[16:56:00.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:11:0) after 2m15s
[16:58:15.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:11:0)
[16:58:15.575] Build status: STARTED
[16:58:15.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:12:0) after 5m1s
[17:03:16.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:12:0)
[17:03:16.663] Build status: STARTED
[17:03:16.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:13:0) after 1m28s
[17:04:44.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:13:0)
[17:04:44.730] Build status: STARTED
[17:04:44.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:14:0) after 4m17s
[17:09:01.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:14:0)
[17:09:01.784] Build status: STARTED
[17:09:01.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:15:0) after 2m8s
[17:11:10.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:15:0)
[17:11:10.161] Build status: STARTED
[17:11:10.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:16:0) after 4m38s
[17:15:48.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:16:0)
[17:15:48.266] Build status: STARTED
[17:15:48.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:17:0) after 7m18s
[17:23:06.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:17:0)
[17:23:06.312] Build status: STARTED
[17:23:06.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:18:0) after 4m55s
[17:28:01.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:18:0)
[17:28:01.355] Build status: STARTED
[17:28:01.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:19:0) after 7m45s
[17:35:46.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:19:0)
[17:35:46.404] Build status: STARTED
[17:35:46.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:20:0) after 4m7s
[17:39:53.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:20:0)
[17:39:53.447] Build status: STARTED
[17:39:53.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:21:0) after 2m23s
[17:42:16.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:21:0)
[17:42:16.485] Build status: STARTED
[17:42:16.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:22:0) after 3m3s
[17:45:19.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:22:0)
[17:45:19.740] Build status: STARTED
[17:45:19.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:23:0) after 8m6s
[17:53:25.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:23:0)
[17:53:25.886] Build status: STARTED
[17:53:25.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:24:0) after 2m5s
[17:55:30.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:24:0)
[17:55:30.990] Build status: STARTED
[17:55:30.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:25:0) after 3m13s
[17:58:44.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:25:0)
[17:58:44.039] Build status: STARTED
[17:58:44.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:26:0) after 6m9s
[18:04:53.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:26:0)
[18:04:53.138] Build status: STARTED
[18:04:53.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:27:0) after 9m1s
[18:13:54.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:27:0)
[18:13:54.249] Build status: STARTED
[18:13:54.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:28:0) after 1m10s
[18:15:04.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:28:0)
[18:15:04.242] Build status: STARTED
[18:15:04.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:29:0) after 4m34s
[18:19:38.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:29:0)
[18:19:38.305] Build status: STARTED
[18:19:38.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:30:0) after 2m50s
[18:22:28.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:30:0)
[18:22:28.663] Build status: STARTED
[18:22:28.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:31:0) after 7m0s
[18:29:28.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:31:0)
[18:29:28.726] Build status: STARTED
[18:29:28.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:32:0) after 1m38s
[18:31:06.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:32:0)
[18:31:06.829] Build status: STARTED
[18:31:06.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:33:0) after 5m31s
[18:36:37.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:33:0)
[18:36:37.878] Build status: STARTED
[18:36:37.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:34:0) after 2m16s
[18:38:54.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:34:0)
[18:38:54.133] Build status: STARTED
[18:38:54.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:35:0) after 4m12s
[18:43:06.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:35:0)
[18:43:06.453] Build status: STARTED
[18:43:06.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:36:0) after 7m41s
[18:50:47.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:36:0)
[18:50:47.538] Build status: STARTED
[18:50:47.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:37:0) after 4m34s
[18:55:21.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:37:0)
[18:55:21.580] Build status: STARTED
[18:55:21.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:38:0) after 5m51s
[19:01:12.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:38:0)
[19:01:12.640] Build status: STARTED
[19:01:12.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:39:0) after 6m12s
[19:07:24.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:39:0)
[19:07:24.748] Build status: STARTED
[19:07:24.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:40:0) after 1m53s
[19:09:18.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:40:0)
[19:09:18.409] Build status: STARTED
[19:09:18.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:41:0) after 1m39s
[19:10:57.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:41:0)
[19:10:57.480] Build status: STARTED
[19:10:57.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:42:0) after 3m45s
[19:14:42.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:42:0)
[19:14:42.544] Build status: STARTED
[19:14:42.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:43:0) after 9m58s
[19:24:40.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:43:0)
[19:24:40.598] Build status: STARTED
[19:24:40.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:44:0) after 3m53s
[19:28:33.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:44:0)
[19:28:33.801] Build status: STARTED
[19:28:33.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:45:0) after 8m13s
[19:36:46.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:45:0)
[19:36:46.866] Build status: STARTED
[19:36:46.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:46:0) after 6m26s
[19:43:12.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:46:0)
[19:43:12.993] Build status: STARTED
[19:43:12.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:47:0) after 7m10s
[19:50:23.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:47:0)
[19:50:23.064] Build status: STARTED
[19:50:23.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:48:0) after 5m1s
[19:55:24.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:48:0)
[19:55:24.139] Build status: STARTED
[19:55:24.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:49:0) after 3m13s
[19:58:37.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:49:0)
[19:58:37.227] Build status: STARTED
[19:58:37.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:50:0) after 1m57s
[20:00:34.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:50:0)
[20:00:34.292] Build status: STARTED
[20:00:34.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:51:0) after 5m30s
[20:06:04.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:51:0)
[20:06:04.362] Build status: STARTED
[20:06:04.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:52:0) after 6m27s
[20:12:31.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:52:0)
[20:12:31.417] Build status: STARTED
[20:12:31.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:53:0) after 5m57s
[20:18:28.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:53:0)
[20:18:28.466] Build status: STARTED
[20:18:28.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:54:0) after 6m47s
[20:25:15.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:54:0)
[20:25:15.810] Build status: STARTED
[20:25:15.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:55:0) after 5m25s
[20:30:40.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:55:0)
[20:30:40.850] Build status: STARTED
[20:30:40.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:56:0) after 3m19s
[20:33:59.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:56:0)
[20:34:00.011] Build status: STARTED
[20:34:00.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:57:0) after 6m34s
[20:40:34.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:57:0)
[20:40:34.068] Build status: STARTED
[20:40:34.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:58:0) after 2m18s
[20:42:52.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:58:0)
[20:42:52.185] Build status: STARTED
[20:42:52.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:59:0) after 3m42s
[20:46:34.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:59:0)
[20:46:34.191] Build status: STARTED
[20:46:34.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:60:0) after 4m59s
[20:51:33.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:60:0)
[20:51:33.484] Build status: STARTED
[20:51:33.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:61:0) after 5m59s
[20:57:32.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:61:0)
[20:57:32.574] Build status: STARTED
[20:57:32.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:62:0) after 2m8s
[20:59:40.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:62:0)
[20:59:40.701] Build status: STARTED
[20:59:40.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:63:0) after 6m41s
[21:06:21.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:63:0)
[21:06:21.900] Build status: STARTED
[21:06:21.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:64:0) after 2m43s
[21:09:05.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:64:0)
[21:09:05.082] Build status: STARTED
[21:09:05.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:65:0) after 3m44s
[21:12:49.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:65:0)
[21:12:49.119] Build status: STARTED
[21:12:49.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:66:0) after 7m10s
[21:19:59.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:66:0)
[21:19:59.157] Build status: STARTED
[21:19:59.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:67:0) after 7m16s
[21:27:15.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:67:0)
[21:27:15.546] Build status: STARTED
[21:27:15.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:68:0) after 1m28s
[21:28:43.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:68:0)
[21:28:43.666] Build status: STARTED
[21:28:43.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:69:0) after 2m34s
[21:31:17.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:69:0)
[21:31:17.740] Build status: STARTED
[21:31:17.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:70:0) after 4m34s
[21:35:51.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:70:0)
[21:35:51.961] Build status: STARTED
[21:35:51.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:71:0) after 2m43s
[21:38:34.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:71:0)
[21:38:35.049] Build status: STARTED
[21:38:35.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:72:0) after 6m35s
[21:45:10.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:72:0)
[21:45:10.198] Build status: STARTED
[21:45:10.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:73:0) after 7m16s
[21:52:26.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:73:0)
[21:52:26.603] Build status: STARTED
[21:52:26.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:74:0) after 8m14s
[22:00:40.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:74:0)
[22:00:40.821] Build status: STARTED
[22:00:40.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:75:0) after 7m11s
[22:07:51.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:75:0)
[22:07:51.973] Build status: STARTED
[22:07:51.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:76:0) after 4m25s
[22:12:16.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:76:0)
[22:12:17.014] Build status: STARTED
[22:12:17.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:77:0) after 1m20s
[22:13:37.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:77:0)
[22:13:37.105] Build status: STARTED
[22:13:37.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:78:0) after 4m35s
[22:18:12.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:78:0)
[22:18:12.326] Build status: STARTED
[22:18:12.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:79:0) after 4m20s
[22:22:32.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:79:0)
[22:22:32.364] Build status: STARTED
[22:22:32.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:80:0) after 7m53s
[22:30:25.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:80:0)
[22:30:25.410] Build status: STARTED
[22:30:25.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:81:0) after 6m8s
[22:36:33.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:81:0)
[22:36:33.437] Build status: STARTED
[22:36:33.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:82:0) after 2m41s
[22:39:14.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:82:0)
[22:39:14.579] Build status: STARTED
[22:39:14.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:83:0) after 3m35s
[22:42:49.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:83:0)
[22:42:49.840] Build status: STARTED
[22:42:49.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:84:0) after 9m31s
[22:52:21.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:84:0)
[22:52:21.398] Build status: STARTED
[22:52:21.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:85:0) after 4m51s
[22:57:12.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:85:0)
[22:57:12.498] Build status: STARTED
[22:57:12.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:86:0) after 7m21s
[23:04:33.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:86:0)
[23:04:33.784] Build status: STARTED
[23:04:33.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:87:0) after 4m0s
[23:08:33.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:87:0)
[23:08:33.828] Build status: STARTED
[23:08:33.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:88:0) after 6m29s
[23:15:03.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:88:0)
[23:15:03.131] Build status: STARTED
[23:15:03.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:89:0) after 7m2s
[23:22:05.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:89:0)
[23:22:05.333] Build status: STARTED
[23:22:05.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:90:0) after 4m26s
[23:26:31.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:90:0)
[23:26:31.847] Build status: STARTED
[23:26:31.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:91:0) after 3m20s
[23:29:51.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:91:0)
[23:29:52.023] Build status: STARTED
[23:29:52.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:92:0) after 5m54s
[23:35:46.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:92:0)
[23:35:46.199] Build status: STARTED
[23:35:46.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:93:0) after 8m1s
[23:43:48.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:93:0)
[23:43:48.068] Build status: STARTED
[23:43:48.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:94:0) after 1m4s
[23:44:52.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:94:0)
[23:44:52.493] Build status: STARTED
[23:44:52.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:95:0) after 9m8s
[23:54:00.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:95:0)
[23:54:00.567] Build status: STARTED
[23:54:00.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:96:0) after 2m20s
[23:56:21.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:96:0)
[23:56:21.645] Build status: STARTED
[23:56:21.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:97:0) after 7m9s
[00:03:30.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:97:0)
[00:03:30.717] Build status: STARTED
[00:03:30.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:98:0) after 9m54s
[00:13:24.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:98:0)
[00:13:24.851] Build status: STARTED
[00:13:24.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:99:0) after 9m50s
[00:23:15.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:99:0)
[00:23:15.239] Build status: STARTED
[00:23:15.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:100:0) after 5m43s
[00:28:58.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:100:0)
[00:28:58.576] Build status: STARTED
[00:28:58.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:101:0) after 7m19s
[00:36:17.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:101:0)
[00:36:17.733] Build status: STARTED
[00:36:17.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:102:0) after 6m33s
[00:42:50.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:102:0)
[00:42:50.823] Build status: STARTED
[00:42:50.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:103:0) after 4m3s
[00:46:53.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:103:0)
[00:46:53.876] Build status: STARTED
[00:46:53.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:104:0) after 2m35s
[00:49:29.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:104:0)
[00:49:29.529] Build status: STARTED
[00:49:29.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:105:0) after 8m36s
[00:58:05.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:105:0)
[00:58:05.720] Build status: STARTED
[00:58:05.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:106:0) after 5m50s
[01:03:55.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:106:0)
[01:03:55.771] Build status: STARTED
[01:03:55.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:107:0) after 5m46s
[01:09:41.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:107:0)
[01:09:41.894] Build status: STARTED
[01:09:41.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:108:0) after 4m36s
[01:14:17.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:108:0)
[01:14:17.945] Build status: STARTED
[01:14:17.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:109:0) after 6m18s
[01:20:35.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:109:0)
[01:20:36.006] Build status: STARTED
[01:20:36.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:110:0) after 6m31s
[01:27:07.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:110:0)
[01:27:07.063] Build status: STARTED
[01:27:07.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:111:0) after 6m1s
[01:33:08.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:111:0)
[01:33:08.272] Build status: STARTED
[01:33:08.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:112:0) after 3m9s
[01:36:17.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:112:0)
[01:36:17.382] Build status: STARTED
[01:36:17.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:113:0) after 4m32s
[01:40:49.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:113:0)
[01:40:49.463] Build status: STARTED
[01:40:49.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:114:0) after 6m5s
[01:46:54.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:114:0)
[01:46:54.503] Build status: STARTED
[01:46:54.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:115:0) after 6m48s
[01:53:42.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:115:0)
[01:53:42.567] Build status: STARTED
[01:53:42.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:116:0) after 8m59s
[02:02:41.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:116:0)
[02:02:41.615] Build status: STARTED
[02:02:41.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:117:0) after 6m33s
[02:09:14.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:117:0)
[02:09:14.694] Build status: STARTED
[02:09:14.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:118:0) after 1m30s
[02:10:44.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:118:0)
[02:10:44.843] Build status: STARTED
[02:10:44.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:119:0) after 7m30s
[02:18:14.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:119:0)
[02:18:14.892] Build status: STARTED
[02:18:14.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:120:0) after 9m49s
[02:28:03.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:120:0)
[02:28:03.978] Build status: STARTED
[02:28:03.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:121:0) after 5m37s
[02:33:41.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:121:0)
[02:33:41.020] Build status: STARTED
[02:33:41.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:122:0) after 8m54s
[02:42:35.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:122:0)
[02:42:35.070] Build status: STARTED
[02:42:35.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:123:0) after 3m34s
[02:46:09.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:123:0)
[02:46:09.356] Build status: STARTED
[02:46:09.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:124:0) after 3m54s
[02:50:03.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:124:0)
[02:50:03.470] Build status: STARTED
[02:50:03.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:125:0) after 6m39s
[02:56:42.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:125:0)
[02:56:42.665] Build status: STARTED
[02:56:42.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:126:0) after 4m51s
[03:01:33.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:126:0)
[03:01:33.740] Build status: STARTED
[03:01:33.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:127:0) after 9m20s
[03:10:53.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:127:0)
[03:10:53.872] Build status: STARTED
[03:10:53.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:128:0) after 2m31s
[03:13:25.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:128:0)
[03:13:25.073] Build status: STARTED
[03:13:25.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:129:0) after 7m47s
[03:21:13.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:129:0)
[03:21:13.768] Build status: STARTED
[03:21:13.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:130:0) after 4m50s
[03:26:03.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:130:0)
[03:26:04.018] Build status: STARTED
[03:26:04.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:131:0) after 1m3s
[03:27:07.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:131:0)
[03:27:07.084] Build status: STARTED
[03:27:07.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:132:0) after 1m28s
[03:28:35.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:132:0)
[03:28:35.081] Build status: STARTED
[03:28:35.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8979514348281713280:133:0) after 9m10s
[03:37:42.988] Received PubSub notification, asking Buildbucket for the build status
[03:37:43.048] Build:
{
"id": "8814084286306068161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26920,
"createdBy": "project:chromium",
"createTime": "2022-05-15T16:13:35.717232318Z",
"startTime": "2022-05-15T16:25:32.534901Z",
"endTime": "2022-05-16T03:37:42.643356324Z",
"updateTime": "2022-05-16T03:37:42.643356324Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c5f6bf8e22bb43947c7195ebd08dd1900b56fb94",
"ref": "refs/heads/main"
}
}
}
[03:37:43.048] Invocation finished in 11h24m8.59860878s with status FAILED