[03:37:00.467] New invocation is queued and will start shortly
[03:37:01.813] Starting the invocation (attempt 1)
[03:37:01.857] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1036839f6e79fc53ac7a0aeaeb0fc89c1eacd814"
[03:37:01.857] Popped gitiles commit info from properties and tags
[03:37:01.857] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:37:01.857] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:37:01.857] Buildbucket request:
{
"requestId": "8983638810828346208",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1036839f6e79fc53ac7a0aeaeb0fc89c1eacd814",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8983638810828346208"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:37:02.569] Scheduled build:
{
"id": "8818208748601229281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26767,
"createdBy": "project:chromium",
"createTime": "2022-03-31T03:37:01.958151721Z",
"updateTime": "2022-03-31T03:37:01.958151721Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1036839f6e79fc53ac7a0aeaeb0fc89c1eacd814",
"ref": "refs/heads/main"
}
}
}
[03:37:02.569] Task URL: https://cr-buildbucket.appspot.com/build/8818208748601229281
[03:37:02.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:2:0) after 6m42s
[03:43:44.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:2:0)
[03:43:44.638] Build status: SCHEDULED
[03:43:44.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:3:0) after 3m52s
[03:47:37.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:3:0)
[03:47:37.266] Build status: SCHEDULED
[03:47:37.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:4:0) after 9m49s
[03:52:43.991] Received PubSub notification, asking Buildbucket for the build status
[03:52:44.013] Build status: STARTED
[03:57:26.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:4:0)
[03:57:26.309] Build status: STARTED
[03:57:26.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:6:0) after 6m51s
[04:04:17.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:6:0)
[04:04:17.366] Build status: STARTED
[04:04:17.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:7:0) after 3m23s
[04:07:40.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:7:0)
[04:07:40.440] Build status: STARTED
[04:07:40.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:8:0) after 5m19s
[04:12:59.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:8:0)
[04:12:59.519] Build status: STARTED
[04:12:59.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:9:0) after 9m56s
[04:22:55.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:9:0)
[04:22:55.879] Build status: STARTED
[04:22:55.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:10:0) after 8m49s
[04:31:45.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:10:0)
[04:31:45.023] Build status: STARTED
[04:31:45.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:11:0) after 6m15s
[04:38:00.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:11:0)
[04:38:00.073] Build status: STARTED
[04:38:00.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:12:0) after 1m10s
[04:39:10.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:12:0)
[04:39:10.228] Build status: STARTED
[04:39:10.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:13:0) after 3m44s
[04:42:54.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:13:0)
[04:42:54.670] Build status: STARTED
[04:42:54.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:14:0) after 9m52s
[04:52:46.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:14:0)
[04:52:46.966] Build status: STARTED
[04:52:46.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:15:0) after 2m0s
[04:54:47.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:15:0)
[04:54:47.116] Build status: STARTED
[04:54:47.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:16:0) after 2m27s
[04:57:14.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:16:0)
[04:57:14.483] Build status: STARTED
[04:57:14.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:17:0) after 1m4s
[04:58:18.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:17:0)
[04:58:18.905] Build status: STARTED
[04:58:18.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:18:0) after 3m39s
[05:01:58.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:18:0)
[05:01:58.380] Build status: STARTED
[05:01:58.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:19:0) after 3m55s
[05:05:53.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:19:0)
[05:05:53.632] Build status: STARTED
[05:05:53.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:20:0) after 7m55s
[05:13:48.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:20:0)
[05:13:48.720] Build status: STARTED
[05:13:48.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:21:0) after 2m2s
[05:15:50.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:21:0)
[05:15:50.958] Build status: STARTED
[05:15:50.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:22:0) after 9m35s
[05:25:26.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:22:0)
[05:25:26.172] Build status: STARTED
[05:25:26.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:23:0) after 3m17s
[05:28:43.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:23:0)
[05:28:43.507] Build status: STARTED
[05:28:43.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:24:0) after 1m12s
[05:29:55.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:24:0)
[05:29:55.518] Build status: STARTED
[05:29:55.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:25:0) after 4m38s
[05:34:33.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:25:0)
[05:34:33.792] Build status: STARTED
[05:34:33.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:26:0) after 2m11s
[05:36:44.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:26:0)
[05:36:44.819] Build status: STARTED
[05:36:44.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:27:0) after 5m51s
[05:42:35.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:27:0)
[05:42:35.881] Build status: STARTED
[05:42:35.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:28:0) after 6m23s
[05:48:59.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:28:0)
[05:48:59.228] Build status: STARTED
[05:48:59.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:29:0) after 1m23s
[05:50:22.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:29:0)
[05:50:22.293] Build status: STARTED
[05:50:22.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:30:0) after 3m16s
[05:53:38.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:30:0)
[05:53:38.449] Build status: STARTED
[05:53:38.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:31:0) after 5m12s
[05:58:50.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:31:0)
[05:58:50.508] Build status: STARTED
[05:58:50.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:32:0) after 6m20s
[06:05:10.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:32:0)
[06:05:10.706] Build status: STARTED
[06:05:10.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:33:0) after 6m41s
[06:11:51.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:33:0)
[06:11:51.821] Build status: STARTED
[06:11:51.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:34:0) after 3m42s
[06:15:33.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:34:0)
[06:15:34.031] Build status: STARTED
[06:15:34.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:35:0) after 1m4s
[06:16:38.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:35:0)
[06:16:38.125] Build status: STARTED
[06:16:38.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:36:0) after 8m7s
[06:24:45.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:36:0)
[06:24:45.183] Build status: STARTED
[06:24:45.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:37:0) after 8m37s
[06:33:22.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:37:0)
[06:33:22.334] Build status: STARTED
[06:33:22.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:38:0) after 4m52s
[06:38:14.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:38:0)
[06:38:14.426] Build status: STARTED
[06:38:14.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:39:0) after 4m54s
[06:43:08.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:39:0)
[06:43:08.631] Build status: STARTED
[06:43:08.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:40:0) after 8m34s
[06:51:42.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:40:0)
[06:51:43.005] Build status: STARTED
[06:51:43.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:41:0) after 5m37s
[06:57:20.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:41:0)
[06:57:20.122] Build status: STARTED
[06:57:20.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:42:0) after 8m46s
[07:06:06.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:42:0)
[07:06:06.271] Build status: STARTED
[07:06:06.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:43:0) after 2m47s
[07:08:53.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:43:0)
[07:08:53.413] Build status: STARTED
[07:08:53.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:44:0) after 2m27s
[07:11:20.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:44:0)
[07:11:20.459] Build status: STARTED
[07:11:20.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:45:0) after 7m52s
[07:19:12.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:45:0)
[07:19:12.518] Build status: STARTED
[07:19:12.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:46:0) after 7m31s
[07:26:43.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:46:0)
[07:26:43.719] Build status: STARTED
[07:26:43.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:47:0) after 3m10s
[07:29:53.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:47:0)
[07:29:53.840] Build status: STARTED
[07:29:53.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:48:0) after 5m54s
[07:35:47.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:48:0)
[07:35:47.971] Build status: STARTED
[07:35:47.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:49:0) after 7m28s
[07:43:16.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:49:0)
[07:43:16.057] Build status: STARTED
[07:43:16.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:50:0) after 3m11s
[07:46:27.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:50:0)
[07:46:27.162] Build status: STARTED
[07:46:27.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:51:0) after 4m28s
[07:50:55.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:51:0)
[07:50:55.367] Build status: STARTED
[07:50:55.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:52:0) after 2m57s
[07:53:52.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:52:0)
[07:53:52.423] Build status: STARTED
[07:53:52.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:53:0) after 9m12s
[08:03:04.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:53:0)
[08:03:04.611] Build status: STARTED
[08:03:04.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:54:0) after 6m40s
[08:09:44.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:54:0)
[08:09:44.887] Build status: STARTED
[08:09:44.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:55:0) after 9m54s
[08:19:38.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:55:0)
[08:19:38.940] Build status: STARTED
[08:19:38.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:56:0) after 4m20s
[08:23:58.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:56:0)
[08:23:59.040] Build status: STARTED
[08:23:59.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:57:0) after 1m9s
[08:25:08.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:57:0)
[08:25:08.181] Build status: STARTED
[08:25:08.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:58:0) after 1m0s
[08:26:08.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:58:0)
[08:26:08.372] Build status: STARTED
[08:26:08.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:59:0) after 7m14s
[08:33:22.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:59:0)
[08:33:22.589] Build status: STARTED
[08:33:22.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:60:0) after 2m7s
[08:35:29.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:60:0)
[08:35:29.664] Build status: STARTED
[08:35:29.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:61:0) after 7m16s
[08:42:45.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:61:0)
[08:42:45.774] Build status: STARTED
[08:42:45.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:62:0) after 8m15s
[08:51:00.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:62:0)
[08:51:00.979] Build status: STARTED
[08:51:00.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:63:0) after 1m31s
[08:52:32.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:63:0)
[08:52:32.067] Build status: STARTED
[08:52:32.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:64:0) after 2m7s
[08:54:39.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:64:0)
[08:54:39.311] Build status: STARTED
[08:54:39.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:65:0) after 5m55s
[09:00:34.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:65:0)
[09:00:34.484] Build status: STARTED
[09:00:34.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:66:0) after 4m30s
[09:05:04.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:66:0)
[09:05:04.498] Build status: STARTED
[09:05:04.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:67:0) after 4m0s
[09:09:04.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:67:0)
[09:09:04.639] Build status: STARTED
[09:09:04.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:68:0) after 8m32s
[09:17:36.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:68:0)
[09:17:36.949] Build status: STARTED
[09:17:36.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:69:0) after 2m44s
[09:20:20.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:69:0)
[09:20:21.022] Build status: STARTED
[09:20:21.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:70:0) after 6m53s
[09:27:14.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:70:0)
[09:27:14.072] Build status: STARTED
[09:27:14.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:71:0) after 2m13s
[09:29:27.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:71:0)
[09:29:27.167] Build status: STARTED
[09:29:27.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:72:0) after 7m37s
[09:37:04.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:72:0)
[09:37:04.342] Build status: STARTED
[09:37:04.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:73:0) after 4m32s
[09:41:36.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:73:0)
[09:41:36.390] Build status: STARTED
[09:41:36.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:74:0) after 5m58s
[09:47:34.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:74:0)
[09:47:34.516] Build status: STARTED
[09:47:34.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:75:0) after 4m59s
[09:52:33.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:75:0)
[09:52:33.838] Build status: STARTED
[09:52:33.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:76:0) after 1m41s
[09:54:14.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:76:0)
[09:54:14.929] Build status: STARTED
[09:54:14.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:77:0) after 2m54s
[09:57:08.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:77:0)
[09:57:09.010] Build status: STARTED
[09:57:09.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:78:0) after 8m0s
[10:05:09.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:78:0)
[10:05:09.090] Build status: STARTED
[10:05:09.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:79:0) after 7m38s
[10:12:47.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:79:0)
[10:12:47.385] Build status: STARTED
[10:12:47.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:80:0) after 6m10s
[10:18:57.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:80:0)
[10:18:57.392] Build status: STARTED
[10:18:57.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:81:0) after 3m17s
[10:22:15.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:81:0)
[10:22:15.150] Build status: STARTED
[10:22:15.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:82:0) after 5m51s
[10:28:06.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:82:0)
[10:28:06.408] Build status: STARTED
[10:28:06.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:83:0) after 9m45s
[10:37:51.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:83:0)
[10:37:51.464] Build status: STARTED
[10:37:51.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:84:0) after 6m6s
[10:43:57.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:84:0)
[10:43:57.567] Build status: STARTED
[10:43:57.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:85:0) after 9m44s
[10:53:41.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:85:0)
[10:53:41.715] Build status: STARTED
[10:53:41.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:86:0) after 8m56s
[11:02:38.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:86:0)
[11:02:38.024] Build status: STARTED
[11:02:38.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:87:0) after 7m20s
[11:09:58.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:87:0)
[11:09:58.111] Build status: STARTED
[11:09:58.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:88:0) after 3m17s
[11:13:15.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:88:0)
[11:13:15.470] Build status: STARTED
[11:13:15.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:89:0) after 1m52s
[11:15:07.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:89:0)
[11:15:07.519] Build status: STARTED
[11:15:07.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:90:0) after 3m14s
[11:18:21.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:90:0)
[11:18:21.571] Build status: STARTED
[11:18:21.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:91:0) after 2m21s
[11:20:42.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:91:0)
[11:20:42.705] Build status: STARTED
[11:20:42.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:92:0) after 7m44s
[11:28:26.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:92:0)
[11:28:26.758] Build status: STARTED
[11:28:26.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:93:0) after 3m48s
[11:32:14.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:93:0)
[11:32:14.808] Build status: STARTED
[11:32:14.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:94:0) after 7m40s
[11:39:54.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:94:0)
[11:39:54.863] Build status: STARTED
[11:39:54.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:95:0) after 7m28s
[11:47:22.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:95:0)
[11:47:22.957] Build status: STARTED
[11:47:22.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:96:0) after 4m40s
[11:52:03.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:96:0)
[11:52:03.164] Build status: STARTED
[11:52:03.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:97:0) after 2m20s
[11:54:23.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:97:0)
[11:54:23.376] Build status: STARTED
[11:54:23.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:98:0) after 9m46s
[12:04:09.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:98:0)
[12:04:09.433] Build status: STARTED
[12:04:09.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:99:0) after 5m47s
[12:09:56.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:99:0)
[12:09:56.627] Build status: STARTED
[12:09:56.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:100:0) after 9m54s
[12:19:50.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:100:0)
[12:19:50.869] Build status: STARTED
[12:19:50.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:101:0) after 8m33s
[12:28:23.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:101:0)
[12:28:23.988] Build status: STARTED
[12:28:23.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:102:0) after 3m2s
[12:31:26.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:102:0)
[12:31:26.060] Build status: STARTED
[12:31:26.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:103:0) after 8m20s
[12:39:46.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:103:0)
[12:39:46.499] Build status: STARTED
[12:39:46.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:104:0) after 4m3s
[12:43:49.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:104:0)
[12:43:49.557] Build status: STARTED
[12:43:49.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:105:0) after 7m51s
[12:51:40.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:105:0)
[12:51:40.613] Build status: STARTED
[12:51:40.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:106:0) after 4m28s
[12:56:08.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:106:0)
[12:56:08.678] Build status: STARTED
[12:56:08.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:107:0) after 6m38s
[13:02:46.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:107:0)
[13:02:46.754] Build status: STARTED
[13:02:46.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:108:0) after 3m25s
[13:06:11.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:108:0)
[13:06:11.993] Build status: STARTED
[13:06:11.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:109:0) after 1m12s
[13:07:24.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:109:0)
[13:07:24.088] Build status: STARTED
[13:07:24.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:110:0) after 5m8s
[13:12:32.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:110:0)
[13:12:32.248] Build status: STARTED
[13:12:32.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:111:0) after 4m21s
[13:16:53.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:111:0)
[13:16:53.316] Build status: STARTED
[13:16:53.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:112:0) after 3m59s
[13:20:52.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:112:0)
[13:20:52.399] Build status: STARTED
[13:20:52.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:113:0) after 8m3s
[13:28:55.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:113:0)
[13:28:55.528] Build status: STARTED
[13:28:55.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:114:0) after 1m34s
[13:30:29.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:114:0)
[13:30:29.592] Build status: STARTED
[13:30:29.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:115:0) after 1m25s
[13:31:54.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:115:0)
[13:31:54.692] Build status: STARTED
[13:31:54.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:116:0) after 3m24s
[13:35:18.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:116:0)
[13:35:18.750] Build status: STARTED
[13:35:18.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:117:0) after 3m51s
[13:39:09.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:117:0)
[13:39:09.817] Build status: STARTED
[13:39:09.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:118:0) after 4m41s
[13:43:51.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:118:0)
[13:43:51.445] Build status: STARTED
[13:43:51.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:119:0) after 6m35s
[13:50:26.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:119:0)
[13:50:26.626] Build status: STARTED
[13:50:26.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:120:0) after 3m20s
[13:53:46.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:120:0)
[13:53:46.682] Build status: STARTED
[13:53:46.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:121:0) after 4m9s
[13:57:55.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:121:0)
[13:57:55.744] Build status: STARTED
[13:57:55.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:122:0) after 1m36s
[13:59:31.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:122:0)
[13:59:31.853] Build status: STARTED
[13:59:31.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:123:0) after 2m38s
[14:02:09.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:123:0)
[14:02:09.930] Build status: STARTED
[14:02:09.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:124:0) after 9m23s
[14:11:32.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:124:0)
[14:11:32.957] Build status: STARTED
[14:11:32.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:125:0) after 4m0s
[14:15:33.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:125:0)
[14:15:33.028] Build status: STARTED
[14:15:33.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:126:0) after 2m42s
[14:18:15.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:126:0)
[14:18:15.161] Build status: STARTED
[14:18:15.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:127:0) after 5m48s
[14:24:03.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:127:0)
[14:24:03.280] Build status: STARTED
[14:24:03.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:128:0) after 1m45s
[14:25:48.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:128:0)
[14:25:48.567] Build status: STARTED
[14:25:48.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:129:0) after 9m14s
[14:35:02.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:129:0)
[14:35:02.956] Build status: STARTED
[14:35:02.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:130:0) after 9m28s
[14:44:31.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:130:0)
[14:44:31.104] Build status: STARTED
[14:44:31.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:131:0) after 7m3s
[14:51:34.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:131:0)
[14:51:34.256] Build status: STARTED
[14:51:34.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8983638810828346208:132:0) after 9m0s
[14:53:25.823] Received PubSub notification, asking Buildbucket for the build status
[14:53:25.853] Build:
{
"id": "8818208748601229281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26767,
"createdBy": "project:chromium",
"createTime": "2022-03-31T03:37:01.958151721Z",
"startTime": "2022-03-31T03:52:43.209798Z",
"endTime": "2022-03-31T14:53:25.047900166Z",
"updateTime": "2022-03-31T14:53:25.047900166Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1036839f6e79fc53ac7a0aeaeb0fc89c1eacd814",
"ref": "refs/heads/main"
}
}
}
[14:53:25.853] Invocation finished in 11h16m25.402715128s with status FAILED