[07:05:48.718] New invocation is queued and will start shortly
[07:05:49.840] Starting the invocation (attempt 1)
[07:05:49.893] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/401265d5586d6c58b7ccac5f4dc799ecdfbc3ed8"
[07:05:49.893] Popped gitiles commit info from properties and tags
[07:05:49.893] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:05:49.893] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:05:49.893] Buildbucket request:
{
"requestId": "8967318220057739888",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "401265d5586d6c58b7ccac5f4dc799ecdfbc3ed8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8967318220057739888"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:05:50.514] Scheduled build:
{
"id": "8801888157956881745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28200,
"createdBy": "project:chromium",
"createTime": "2022-09-27T07:05:50.084810813Z",
"updateTime": "2022-09-27T07:05:50.084810813Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "401265d5586d6c58b7ccac5f4dc799ecdfbc3ed8",
"ref": "refs/heads/main"
}
}
}
[07:05:50.514] Task URL: https://cr-buildbucket.appspot.com/build/8801888157956881745
[07:05:50.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:2:0) after 3m2s
[07:08:52.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:2:0)
[07:08:52.812] Build status: SCHEDULED
[07:08:52.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:3:0) after 6m40s
[07:11:24.250] Received PubSub notification, asking Buildbucket for the build status
[07:11:24.296] Build status: STARTED
[07:15:33.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:3:0)
[07:15:33.070] Build status: STARTED
[07:15:33.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:5:0) after 5m54s
[07:21:27.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:5:0)
[07:21:27.378] Build status: STARTED
[07:21:27.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:6:0) after 7m36s
[07:29:03.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:6:0)
[07:29:03.495] Build status: STARTED
[07:29:03.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:7:0) after 9m36s
[07:38:39.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:7:0)
[07:38:39.740] Build status: STARTED
[07:38:39.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:8:0) after 2m25s
[07:41:04.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:8:0)
[07:41:04.817] Build status: STARTED
[07:41:04.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:9:0) after 1m9s
[07:42:14.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:9:0)
[07:42:14.103] Build status: STARTED
[07:42:14.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:10:0) after 9m49s
[07:52:03.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:10:0)
[07:52:03.215] Build status: STARTED
[07:52:03.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:11:0) after 1m47s
[07:53:50.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:11:0)
[07:53:50.447] Build status: STARTED
[07:53:50.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:12:0) after 5m35s
[07:59:25.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:12:0)
[07:59:25.511] Build status: STARTED
[07:59:25.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:13:0) after 2m34s
[08:01:59.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:13:0)
[08:01:59.817] Build status: STARTED
[08:01:59.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:14:0) after 4m47s
[08:06:47.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:14:0)
[08:06:47.242] Build status: STARTED
[08:06:47.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:15:0) after 4m8s
[08:10:55.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:15:0)
[08:10:55.375] Build status: STARTED
[08:10:55.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:16:0) after 9m46s
[08:20:41.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:16:0)
[08:20:41.470] Build status: STARTED
[08:20:41.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:17:0) after 7m52s
[08:28:33.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:17:0)
[08:28:33.844] Build status: STARTED
[08:28:33.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:18:0) after 9m43s
[08:38:17.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:18:0)
[08:38:17.070] Build status: STARTED
[08:38:17.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:19:0) after 1m17s
[08:39:34.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:19:0)
[08:39:34.372] Build status: STARTED
[08:39:34.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:20:0) after 1m22s
[08:40:56.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:20:0)
[08:40:56.436] Build status: STARTED
[08:40:56.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:21:0) after 6m24s
[08:47:20.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:21:0)
[08:47:20.600] Build status: STARTED
[08:47:20.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:22:0) after 3m25s
[08:50:45.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:22:0)
[08:50:45.828] Build status: STARTED
[08:50:45.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:23:0) after 4m57s
[08:55:43.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:23:0)
[08:55:43.699] Build status: STARTED
[08:55:43.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:24:0) after 4m41s
[09:00:24.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:24:0)
[09:00:24.919] Build status: STARTED
[09:00:24.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:25:0) after 7m11s
[09:07:35.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:25:0)
[09:07:35.985] Build status: STARTED
[09:07:35.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:26:0) after 3m39s
[09:11:15.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:26:0)
[09:11:15.336] Build status: STARTED
[09:11:15.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:27:0) after 8m29s
[09:19:44.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:27:0)
[09:19:44.388] Build status: STARTED
[09:19:44.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:28:0) after 9m21s
[09:29:05.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:28:0)
[09:29:05.549] Build status: STARTED
[09:29:05.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:29:0) after 2m45s
[09:31:50.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:29:0)
[09:31:50.636] Build status: STARTED
[09:31:50.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:30:0) after 7m58s
[09:39:48.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:30:0)
[09:39:48.691] Build status: STARTED
[09:39:48.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:31:0) after 8m38s
[09:48:27.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:31:0)
[09:48:27.283] Build status: STARTED
[09:48:27.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:32:0) after 7m58s
[09:56:25.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:32:0)
[09:56:25.347] Build status: STARTED
[09:56:25.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:33:0) after 5m27s
[10:01:52.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:33:0)
[10:01:52.595] Build status: STARTED
[10:01:52.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:34:0) after 2m4s
[10:03:56.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:34:0)
[10:03:56.736] Build status: STARTED
[10:03:56.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:35:0) after 7m47s
[10:11:43.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:35:0)
[10:11:43.931] Build status: STARTED
[10:11:43.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:36:0) after 2m50s
[10:14:33.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:36:0)
[10:14:33.999] Build status: STARTED
[10:14:33.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:37:0) after 5m48s
[10:20:22.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:37:0)
[10:20:22.151] Build status: STARTED
[10:20:22.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:38:0) after 7m24s
[10:27:46.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:38:0)
[10:27:46.203] Build status: STARTED
[10:27:46.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:39:0) after 5m32s
[10:33:18.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:39:0)
[10:33:18.425] Build status: STARTED
[10:33:18.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:40:0) after 8m2s
[10:41:20.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:40:0)
[10:41:20.505] Build status: STARTED
[10:41:20.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:41:0) after 8m24s
[10:49:44.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:41:0)
[10:49:44.546] Build status: STARTED
[10:49:44.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:42:0) after 8m40s
[10:58:24.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:42:0)
[10:58:24.728] Build status: STARTED
[10:58:24.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:43:0) after 5m20s
[11:03:45.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:43:0)
[11:03:45.066] Build status: STARTED
[11:03:45.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:44:0) after 4m59s
[11:08:44.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:44:0)
[11:08:44.121] Build status: STARTED
[11:08:44.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:45:0) after 3m19s
[11:12:03.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:45:0)
[11:12:03.221] Build status: STARTED
[11:12:03.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:46:0) after 6m47s
[11:18:50.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:46:0)
[11:18:50.308] Build status: STARTED
[11:18:50.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:47:0) after 3m31s
[11:22:21.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:47:0)
[11:22:21.375] Build status: STARTED
[11:22:21.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:48:0) after 7m5s
[11:29:26.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:48:0)
[11:29:26.762] Build status: STARTED
[11:29:26.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:49:0) after 2m11s
[11:31:37.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:49:0)
[11:31:37.823] Build status: STARTED
[11:31:37.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:50:0) after 1m50s
[11:33:28.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:50:0)
[11:33:28.174] Build status: STARTED
[11:33:28.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:51:0) after 3m12s
[11:36:40.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:51:0)
[11:36:40.333] Build status: STARTED
[11:36:40.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:52:0) after 6m50s
[11:43:30.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:52:0)
[11:43:30.398] Build status: STARTED
[11:43:30.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:53:0) after 2m26s
[11:45:56.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:53:0)
[11:45:56.466] Build status: STARTED
[11:45:56.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:54:0) after 2m15s
[11:48:11.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:54:0)
[11:48:11.750] Build status: STARTED
[11:48:11.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:55:0) after 2m47s
[11:50:58.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:55:0)
[11:50:58.860] Build status: STARTED
[11:50:58.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:56:0) after 4m21s
[11:55:19.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:56:0)
[11:55:19.960] Build status: STARTED
[11:55:19.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:57:0) after 5m0s
[12:00:20.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:57:0)
[12:00:20.135] Build status: STARTED
[12:00:20.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:58:0) after 3m30s
[12:03:50.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:58:0)
[12:03:50.492] Build status: STARTED
[12:03:50.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:59:0) after 8m55s
[12:12:46.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:59:0)
[12:12:46.067] Build status: STARTED
[12:12:46.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:60:0) after 2m20s
[12:15:06.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:60:0)
[12:15:06.292] Build status: STARTED
[12:15:06.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:61:0) after 7m42s
[12:22:48.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:61:0)
[12:22:48.472] Build status: STARTED
[12:22:48.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:62:0) after 2m26s
[12:25:14.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:62:0)
[12:25:14.650] Build status: STARTED
[12:25:14.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:63:0) after 3m51s
[12:29:05.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:63:0)
[12:29:05.719] Build status: STARTED
[12:29:05.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:64:0) after 2m8s
[12:31:13.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:64:0)
[12:31:13.787] Build status: STARTED
[12:31:13.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:65:0) after 1m55s
[12:33:08.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:65:0)
[12:33:08.957] Build status: STARTED
[12:33:08.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:66:0) after 7m4s
[12:40:12.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:66:0)
[12:40:13.024] Build status: STARTED
[12:40:13.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:67:0) after 3m27s
[12:43:40.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:67:0)
[12:43:40.086] Build status: STARTED
[12:43:40.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:68:0) after 7m46s
[12:51:26.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:68:0)
[12:51:26.345] Build status: STARTED
[12:51:26.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:69:0) after 5m38s
[12:57:04.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:69:0)
[12:57:04.443] Build status: STARTED
[12:57:04.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:70:0) after 2m7s
[12:59:11.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:70:0)
[12:59:11.554] Build status: STARTED
[12:59:11.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:71:0) after 3m2s
[13:02:13.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:71:0)
[13:02:13.722] Build status: STARTED
[13:02:13.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:72:0) after 1m6s
[13:03:19.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:72:0)
[13:03:19.778] Build status: STARTED
[13:03:19.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:73:0) after 8m8s
[13:11:27.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:73:0)
[13:11:27.878] Build status: STARTED
[13:11:27.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:74:0) after 4m3s
[13:15:31.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:74:0)
[13:15:31.174] Build status: STARTED
[13:15:31.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:75:0) after 7m41s
[13:23:12.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:75:0)
[13:23:12.226] Build status: STARTED
[13:23:12.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:76:0) after 2m54s
[13:26:06.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:76:0)
[13:26:06.358] Build status: STARTED
[13:26:06.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:77:0) after 5m10s
[13:31:16.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:77:0)
[13:31:16.525] Build status: STARTED
[13:31:16.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:78:0) after 9m16s
[13:40:32.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:78:0)
[13:40:32.784] Build status: STARTED
[13:40:32.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:79:0) after 1m4s
[13:41:36.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:79:0)
[13:41:36.897] Build status: STARTED
[13:41:36.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:80:0) after 8m24s
[13:50:01.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:80:0)
[13:50:01.038] Build status: STARTED
[13:50:01.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:81:0) after 2m8s
[13:52:09.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:81:0)
[13:52:09.207] Build status: STARTED
[13:52:09.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:82:0) after 7m17s
[13:59:26.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:82:0)
[13:59:26.352] Build status: STARTED
[13:59:26.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:83:0) after 2m2s
[14:01:28.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:83:0)
[14:01:28.584] Build status: STARTED
[14:01:28.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:84:0) after 1m33s
[14:03:02.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:84:0)
[14:03:02.137] Build status: STARTED
[14:03:02.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:85:0) after 1m27s
[14:04:29.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:85:0)
[14:04:29.379] Build status: STARTED
[14:04:29.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:86:0) after 4m19s
[14:08:48.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:86:0)
[14:08:48.608] Build status: STARTED
[14:08:48.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:87:0) after 8m59s
[14:17:47.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:87:0)
[14:17:47.728] Build status: STARTED
[14:17:47.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:88:0) after 2m11s
[14:19:58.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:88:0)
[14:19:58.803] Build status: STARTED
[14:19:58.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:89:0) after 1m46s
[14:21:44.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:89:0)
[14:21:44.986] Build status: STARTED
[14:21:44.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:90:0) after 5m21s
[14:27:06.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:90:0)
[14:27:06.106] Build status: STARTED
[14:27:06.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:91:0) after 4m18s
[14:31:24.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:91:0)
[14:31:24.863] Build status: STARTED
[14:31:24.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:92:0) after 1m3s
[14:32:28.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:92:0)
[14:32:28.133] Build status: STARTED
[14:32:28.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:93:0) after 9m17s
[14:41:45.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:93:0)
[14:41:45.197] Build status: STARTED
[14:41:45.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:94:0) after 5m3s
[14:46:48.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:94:0)
[14:46:48.343] Build status: STARTED
[14:46:48.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:95:0) after 4m39s
[14:51:27.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:95:0)
[14:51:27.470] Build status: STARTED
[14:51:27.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:96:0) after 1m55s
[14:53:22.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:96:0)
[14:53:22.539] Build status: STARTED
[14:53:22.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:97:0) after 3m38s
[14:57:00.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:97:0)
[14:57:00.708] Build status: STARTED
[14:57:00.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:98:0) after 7m14s
[15:04:14.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:98:0)
[15:04:15.026] Build status: STARTED
[15:04:15.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:99:0) after 6m58s
[15:11:13.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:99:0)
[15:11:13.273] Build status: STARTED
[15:11:13.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:100:0) after 9m58s
[15:21:11.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:100:0)
[15:21:11.434] Build status: STARTED
[15:21:11.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:101:0) after 8m49s
[15:30:00.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:101:0)
[15:30:00.879] Build status: STARTED
[15:30:00.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:102:0) after 6m5s
[15:36:06.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:102:0)
[15:36:06.125] Build status: STARTED
[15:36:06.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:103:0) after 7m16s
[15:43:22.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:103:0)
[15:43:22.842] Build status: STARTED
[15:43:22.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:104:0) after 2m36s
[15:45:58.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:104:0)
[15:45:58.895] Build status: STARTED
[15:45:58.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:105:0) after 7m29s
[15:53:27.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:105:0)
[15:53:28.012] Build status: STARTED
[15:53:28.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:106:0) after 2m53s
[15:56:21.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:106:0)
[15:56:21.637] Build status: STARTED
[15:56:21.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:107:0) after 7m53s
[16:04:14.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:107:0)
[16:04:14.883] Build status: STARTED
[16:04:14.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:108:0) after 6m58s
[16:11:13.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:108:0)
[16:11:13.286] Build status: STARTED
[16:11:13.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:109:0) after 5m2s
[16:16:15.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:109:0)
[16:16:15.357] Build status: STARTED
[16:16:15.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:110:0) after 1m6s
[16:17:21.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:110:0)
[16:17:21.433] Build status: STARTED
[16:17:21.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:111:0) after 8m24s
[16:25:45.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:111:0)
[16:25:45.569] Build status: STARTED
[16:25:45.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:112:0) after 9m12s
[16:34:57.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:112:0)
[16:34:57.946] Build status: STARTED
[16:34:57.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:113:0) after 6m28s
[16:41:26.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:113:0)
[16:41:26.935] Build status: STARTED
[16:41:26.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:114:0) after 2m30s
[16:43:57.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:114:0)
[16:43:57.403] Build status: STARTED
[16:43:57.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:115:0) after 1m3s
[16:45:00.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:115:0)
[16:45:00.598] Build status: STARTED
[16:45:00.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:116:0) after 1m42s
[16:46:42.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:116:0)
[16:46:42.656] Build status: STARTED
[16:46:42.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:117:0) after 5m12s
[16:51:54.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:117:0)
[16:51:54.955] Build status: STARTED
[16:51:54.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:118:0) after 9m38s
[17:01:33.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:118:0)
[17:01:33.157] Build status: STARTED
[17:01:33.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:119:0) after 4m3s
[17:05:36.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:119:0)
[17:05:36.400] Build status: STARTED
[17:05:36.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:120:0) after 6m23s
[17:11:59.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:120:0)
[17:11:59.458] Build status: STARTED
[17:11:59.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:121:0) after 4m30s
[17:16:29.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:121:0)
[17:16:29.546] Build status: STARTED
[17:16:29.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:122:0) after 7m24s
[17:23:53.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:122:0)
[17:23:53.602] Build status: STARTED
[17:23:53.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:123:0) after 9m45s
[17:33:38.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:123:0)
[17:33:38.756] Build status: STARTED
[17:33:38.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:124:0) after 9m29s
[17:43:07.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:124:0)
[17:43:07.806] Build status: STARTED
[17:43:07.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:125:0) after 8m8s
[17:51:15.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:125:0)
[17:51:15.954] Build status: STARTED
[17:51:15.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:126:0) after 8m47s
[18:00:03.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:126:0)
[18:00:03.178] Build status: STARTED
[18:00:03.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:127:0) after 6m28s
[18:06:31.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:127:0)
[18:06:31.373] Build status: STARTED
[18:06:31.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:128:0) after 5m39s
[18:12:10.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:128:0)
[18:12:10.637] Build status: STARTED
[18:12:10.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:129:0) after 8m52s
[18:21:02.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:129:0)
[18:21:02.951] Build status: STARTED
[18:21:02.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:130:0) after 6m33s
[18:27:36.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:130:0)
[18:27:36.073] Build status: STARTED
[18:27:36.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:131:0) after 8m58s
[18:36:34.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:131:0)
[18:36:34.277] Build status: STARTED
[18:36:34.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:132:0) after 9m58s
[18:46:32.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:132:0)
[18:46:32.369] Build status: STARTED
[18:46:32.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:133:0) after 2m57s
[18:49:29.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:133:0)
[18:49:29.456] Build status: STARTED
[18:49:29.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:134:0) after 7m59s
[18:57:29.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:134:0)
[18:57:29.123] Build status: STARTED
[18:57:29.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:135:0) after 1m43s
[18:59:12.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:135:0)
[18:59:12.307] Build status: STARTED
[18:59:12.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:136:0) after 8m22s
[19:07:34.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:136:0)
[19:07:34.407] Build status: STARTED
[19:07:34.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:137:0) after 4m56s
[19:12:30.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:137:0)
[19:12:30.547] Build status: STARTED
[19:12:30.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:138:0) after 4m0s
[19:16:30.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:138:0)
[19:16:30.927] Build status: STARTED
[19:16:30.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:139:0) after 1m31s
[19:18:02.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:139:0)
[19:18:02.200] Build status: STARTED
[19:18:02.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:140:0) after 4m56s
[19:22:58.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:140:0)
[19:22:58.440] Build status: STARTED
[19:22:58.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:141:0) after 3m35s
[19:26:33.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:141:0)
[19:26:34.012] Build status: STARTED
[19:26:34.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:142:0) after 7m30s
[19:34:04.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:142:0)
[19:34:04.102] Build status: STARTED
[19:34:04.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:143:0) after 5m4s
[19:39:08.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:143:0)
[19:39:08.507] Build status: STARTED
[19:39:08.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:144:0) after 2m43s
[19:41:51.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:144:0)
[19:41:51.564] Build status: STARTED
[19:41:51.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:145:0) after 9m14s
[19:51:05.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:145:0)
[19:51:05.638] Build status: STARTED
[19:51:05.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:146:0) after 1m54s
[19:52:59.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:146:0)
[19:52:59.884] Build status: STARTED
[19:52:59.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8967318220057739888:147:0) after 9m9s
[19:54:32.798] Received PubSub notification, asking Buildbucket for the build status
[19:54:32.819] Build:
{
"id": "8801888157956881745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28200,
"createdBy": "project:chromium",
"createTime": "2022-09-27T07:05:50.084810813Z",
"startTime": "2022-09-27T07:11:22.027468Z",
"endTime": "2022-09-27T19:54:32.398122687Z",
"updateTime": "2022-09-27T19:54:32.398122687Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "401265d5586d6c58b7ccac5f4dc799ecdfbc3ed8",
"ref": "refs/heads/main"
}
}
}
[19:54:32.819] Invocation finished in 12h48m44.122509469s with status FAILED