[07:52:32.392] New invocation is queued and will start shortly
[07:52:33.466] Starting the invocation (attempt 1)
[07:52:33.503] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e8bd9641fddf5246cb63d70839096b832cedd630"
[07:52:33.503] Popped gitiles commit info from properties and tags
[07:52:33.503] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:52:33.503] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:52:33.503] Buildbucket request:
{
"requestId": "8977733931323192096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e8bd9641fddf5246cb63d70839096b832cedd630",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8977733931323192096"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:52:34.143] Scheduled build:
{
"id": "8812303869384772209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26958,
"createdBy": "project:chromium",
"createTime": "2022-06-04T07:52:33.608674195Z",
"updateTime": "2022-06-04T07:52:33.608674195Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e8bd9641fddf5246cb63d70839096b832cedd630",
"ref": "refs/heads/main"
}
}
}
[07:52:34.143] Task URL: https://cr-buildbucket.appspot.com/build/8812303869384772209
[07:52:34.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:2:0) after 8m40s
[07:53:27.887] Received PubSub notification, asking Buildbucket for the build status
[07:53:27.942] Build status: STARTED
[08:01:14.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:2:0)
[08:01:14.498] Build status: STARTED
[08:01:14.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:4:0) after 2m43s
[08:03:57.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:4:0)
[08:03:57.560] Build status: STARTED
[08:03:57.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:5:0) after 8m50s
[08:12:47.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:5:0)
[08:12:47.720] Build status: STARTED
[08:12:47.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:6:0) after 1m20s
[08:14:07.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:6:0)
[08:14:07.795] Build status: STARTED
[08:14:07.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:7:0) after 9m50s
[08:23:57.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:7:0)
[08:23:57.835] Build status: STARTED
[08:23:57.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:8:0) after 6m15s
[08:30:13.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:8:0)
[08:30:13.033] Build status: STARTED
[08:30:13.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:9:0) after 4m31s
[08:34:44.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:9:0)
[08:34:44.039] Build status: STARTED
[08:34:44.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:10:0) after 2m41s
[08:37:25.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:10:0)
[08:37:25.253] Build status: STARTED
[08:37:25.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:11:0) after 3m4s
[08:40:29.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:11:0)
[08:40:29.297] Build status: STARTED
[08:40:29.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:12:0) after 7m34s
[08:48:03.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:12:0)
[08:48:03.369] Build status: STARTED
[08:48:03.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:13:0) after 5m18s
[08:53:21.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:13:0)
[08:53:21.687] Build status: STARTED
[08:53:21.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:14:0) after 5m35s
[08:58:56.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:14:0)
[08:58:56.737] Build status: STARTED
[08:58:56.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:15:0) after 9m35s
[09:08:31.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:15:0)
[09:08:31.812] Build status: STARTED
[09:08:31.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:16:0) after 8m51s
[09:17:22.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:16:0)
[09:17:23.024] Build status: STARTED
[09:17:23.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:17:0) after 3m28s
[09:20:51.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:17:0)
[09:20:51.075] Build status: STARTED
[09:20:51.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:18:0) after 5m56s
[09:26:47.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:18:0)
[09:26:47.131] Build status: STARTED
[09:26:47.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:19:0) after 8m34s
[09:35:21.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:19:0)
[09:35:21.188] Build status: STARTED
[09:35:21.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:20:0) after 8m6s
[09:43:27.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:20:0)
[09:43:27.267] Build status: STARTED
[09:43:27.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:21:0) after 9m31s
[09:52:58.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:21:0)
[09:52:58.328] Build status: STARTED
[09:52:58.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:22:0) after 1m56s
[09:54:54.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:22:0)
[09:54:54.363] Build status: STARTED
[09:54:54.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:23:0) after 7m59s
[10:02:53.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:23:0)
[10:02:53.438] Build status: STARTED
[10:02:53.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:24:0) after 3m11s
[10:06:04.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:24:0)
[10:06:04.515] Build status: STARTED
[10:06:04.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:25:0) after 7m19s
[10:13:23.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:25:0)
[10:13:23.618] Build status: STARTED
[10:13:23.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:26:0) after 8m32s
[10:21:55.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:26:0)
[10:21:55.688] Build status: STARTED
[10:21:55.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:27:0) after 1m18s
[10:23:13.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:27:0)
[10:23:13.759] Build status: STARTED
[10:23:13.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:28:0) after 1m22s
[10:24:35.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:28:0)
[10:24:35.990] Build status: STARTED
[10:24:35.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:29:0) after 5m6s
[10:29:42.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:29:0)
[10:29:42.054] Build status: STARTED
[10:29:42.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:30:0) after 6m16s
[10:35:58.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:30:0)
[10:35:58.120] Build status: STARTED
[10:35:58.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:31:0) after 4m13s
[10:40:11.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:31:0)
[10:40:11.183] Build status: STARTED
[10:40:11.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:32:0) after 3m44s
[10:43:55.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:32:0)
[10:43:55.425] Build status: STARTED
[10:43:55.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:33:0) after 7m8s
[10:51:03.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:33:0)
[10:51:03.502] Build status: STARTED
[10:51:03.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:34:0) after 2m53s
[10:53:56.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:34:0)
[10:53:56.883] Build status: STARTED
[10:53:56.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:35:0) after 5m6s
[10:59:03.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:35:0)
[10:59:03.298] Build status: STARTED
[10:59:03.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:36:0) after 2m53s
[11:01:56.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:36:0)
[11:01:56.781] Build status: STARTED
[11:01:56.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:37:0) after 9m35s
[11:11:31.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:37:0)
[11:11:32.015] Build status: STARTED
[11:11:32.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:38:0) after 5m31s
[11:17:03.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:38:0)
[11:17:03.076] Build status: STARTED
[11:17:03.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:39:0) after 9m57s
[11:27:00.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:39:0)
[11:27:00.286] Build status: STARTED
[11:27:00.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:40:0) after 8m14s
[11:35:15.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:40:0)
[11:35:15.205] Build status: STARTED
[11:35:15.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:41:0) after 3m49s
[11:39:04.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:41:0)
[11:39:04.339] Build status: STARTED
[11:39:04.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:42:0) after 6m47s
[11:45:51.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:42:0)
[11:45:51.484] Build status: STARTED
[11:45:51.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:43:0) after 2m36s
[11:48:27.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:43:0)
[11:48:27.750] Build status: STARTED
[11:48:27.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:44:0) after 7m21s
[11:55:49.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:44:0)
[11:55:49.117] Build status: STARTED
[11:55:49.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:45:0) after 6m36s
[12:02:25.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:45:0)
[12:02:25.265] Build status: STARTED
[12:02:25.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:46:0) after 5m14s
[12:07:39.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:46:0)
[12:07:39.335] Build status: STARTED
[12:07:39.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:47:0) after 6m52s
[12:14:31.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:47:0)
[12:14:31.568] Build status: STARTED
[12:14:31.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:48:0) after 9m45s
[12:24:17.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:48:0)
[12:24:17.148] Build status: STARTED
[12:24:17.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:49:0) after 7m8s
[12:31:25.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:49:0)
[12:31:25.336] Build status: STARTED
[12:31:25.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:50:0) after 6m36s
[12:38:01.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:50:0)
[12:38:01.687] Build status: STARTED
[12:38:01.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:51:0) after 9m46s
[12:47:47.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:51:0)
[12:47:47.759] Build status: STARTED
[12:47:47.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:52:0) after 7m53s
[12:55:40.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:52:0)
[12:55:40.818] Build status: STARTED
[12:55:40.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:53:0) after 6m31s
[13:02:11.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:53:0)
[13:02:11.889] Build status: STARTED
[13:02:11.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:54:0) after 8m25s
[13:10:36.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:54:0)
[13:10:37.003] Build status: STARTED
[13:10:37.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:55:0) after 3m38s
[13:14:15.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:55:0)
[13:14:15.084] Build status: STARTED
[13:14:15.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:56:0) after 4m21s
[13:18:36.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:56:0)
[13:18:36.136] Build status: STARTED
[13:18:36.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:57:0) after 4m26s
[13:23:02.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:57:0)
[13:23:02.182] Build status: STARTED
[13:23:02.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:58:0) after 3m39s
[13:26:41.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:58:0)
[13:26:41.250] Build status: STARTED
[13:26:41.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:59:0) after 6m22s
[13:33:03.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:59:0)
[13:33:03.343] Build status: STARTED
[13:33:03.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:60:0) after 8m16s
[13:41:19.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:60:0)
[13:41:19.486] Build status: STARTED
[13:41:19.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:61:0) after 3m1s
[13:44:20.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:61:0)
[13:44:20.612] Build status: STARTED
[13:44:20.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:62:0) after 4m25s
[13:48:45.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:62:0)
[13:48:45.927] Build status: STARTED
[13:48:45.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:63:0) after 1m57s
[13:50:42.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:63:0)
[13:50:42.994] Build status: STARTED
[13:50:42.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:64:0) after 1m58s
[13:52:41.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:64:0)
[13:52:41.074] Build status: STARTED
[13:52:41.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:65:0) after 5m50s
[13:58:31.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:65:0)
[13:58:31.345] Build status: STARTED
[13:58:31.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:66:0) after 5m56s
[14:04:27.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:66:0)
[14:04:27.404] Build status: STARTED
[14:04:27.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:67:0) after 2m16s
[14:06:43.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:67:0)
[14:06:44.000] Build status: STARTED
[14:06:44.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:68:0) after 4m16s
[14:11:00.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:68:0)
[14:11:00.297] Build status: STARTED
[14:11:00.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:69:0) after 5m12s
[14:16:12.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:69:0)
[14:16:12.558] Build status: STARTED
[14:16:12.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:70:0) after 7m30s
[14:23:42.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:70:0)
[14:23:42.967] Build status: STARTED
[14:23:42.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:71:0) after 8m36s
[14:32:19.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:71:0)
[14:32:19.075] Build status: STARTED
[14:32:19.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:72:0) after 1m7s
[14:33:26.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:72:0)
[14:33:26.258] Build status: STARTED
[14:33:26.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:73:0) after 9m45s
[14:43:11.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:73:0)
[14:43:11.330] Build status: STARTED
[14:43:11.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:74:0) after 6m39s
[14:49:50.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:74:0)
[14:49:50.375] Build status: STARTED
[14:49:50.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:75:0) after 6m46s
[14:56:36.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:75:0)
[14:56:36.670] Build status: STARTED
[14:56:36.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:76:0) after 6m24s
[15:03:00.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:76:0)
[15:03:00.908] Build status: STARTED
[15:03:00.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:77:0) after 3m57s
[15:06:57.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:77:0)
[15:06:57.961] Build status: STARTED
[15:06:57.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:78:0) after 1m51s
[15:08:48.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:78:0)
[15:08:49.049] Build status: STARTED
[15:08:49.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:79:0) after 4m16s
[15:13:05.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:79:0)
[15:13:05.150] Build status: STARTED
[15:13:05.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:80:0) after 1m30s
[15:14:35.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:80:0)
[15:14:35.327] Build status: STARTED
[15:14:35.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:81:0) after 3m30s
[15:18:05.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:81:0)
[15:18:05.375] Build status: STARTED
[15:18:05.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:82:0) after 2m56s
[15:21:01.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:82:0)
[15:21:01.442] Build status: STARTED
[15:21:01.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:83:0) after 2m9s
[15:23:10.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:83:0)
[15:23:10.490] Build status: STARTED
[15:23:10.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:84:0) after 8m14s
[15:31:24.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:84:0)
[15:31:24.550] Build status: STARTED
[15:31:24.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:85:0) after 5m19s
[15:36:43.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:85:0)
[15:36:43.610] Build status: STARTED
[15:36:43.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:86:0) after 4m29s
[15:41:12.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:86:0)
[15:41:12.693] Build status: STARTED
[15:41:12.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:87:0) after 2m59s
[15:44:12.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:87:0)
[15:44:12.369] Build status: STARTED
[15:44:12.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:88:0) after 4m53s
[15:49:05.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:88:0)
[15:49:05.653] Build status: STARTED
[15:49:05.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:89:0) after 6m59s
[15:56:04.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:89:0)
[15:56:04.991] Build status: STARTED
[15:56:04.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:90:0) after 1m50s
[15:57:55.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:90:0)
[15:57:55.265] Build status: STARTED
[15:57:55.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:91:0) after 5m19s
[16:03:14.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:91:0)
[16:03:14.405] Build status: STARTED
[16:03:14.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:92:0) after 4m52s
[16:08:06.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:92:0)
[16:08:06.461] Build status: STARTED
[16:08:06.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:93:0) after 1m46s
[16:09:52.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:93:0)
[16:09:52.615] Build status: STARTED
[16:09:52.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:94:0) after 2m36s
[16:12:28.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:94:0)
[16:12:28.873] Build status: STARTED
[16:12:28.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:95:0) after 7m54s
[16:20:22.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:95:0)
[16:20:23.015] Build status: STARTED
[16:20:23.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:96:0) after 2m53s
[16:23:16.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:96:0)
[16:23:16.436] Build status: STARTED
[16:23:16.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:97:0) after 7m3s
[16:30:19.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:97:0)
[16:30:19.794] Build status: STARTED
[16:30:19.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:98:0) after 3m35s
[16:33:54.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:98:0)
[16:33:54.948] Build status: STARTED
[16:33:54.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:99:0) after 1m18s
[16:35:13.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:99:0)
[16:35:13.090] Build status: STARTED
[16:35:13.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:100:0) after 5m25s
[16:40:38.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:100:0)
[16:40:38.772] Build status: STARTED
[16:40:38.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:101:0) after 7m0s
[16:47:38.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:101:0)
[16:47:38.822] Build status: STARTED
[16:47:38.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:102:0) after 1m36s
[16:49:14.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:102:0)
[16:49:14.948] Build status: STARTED
[16:49:14.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:103:0) after 5m28s
[16:54:42.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:103:0)
[16:54:43.027] Build status: STARTED
[16:54:43.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:104:0) after 6m34s
[17:01:17.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:104:0)
[17:01:17.145] Build status: STARTED
[17:01:17.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:105:0) after 5m12s
[17:06:29.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:105:0)
[17:06:29.208] Build status: STARTED
[17:06:29.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:106:0) after 4m47s
[17:11:16.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:106:0)
[17:11:16.258] Build status: STARTED
[17:11:16.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:107:0) after 7m21s
[17:18:37.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:107:0)
[17:18:37.490] Build status: STARTED
[17:18:37.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:108:0) after 3m58s
[17:22:35.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:108:0)
[17:22:35.573] Build status: STARTED
[17:22:35.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:109:0) after 6m11s
[17:28:46.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:109:0)
[17:28:46.635] Build status: STARTED
[17:28:46.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:110:0) after 8m36s
[17:37:22.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:110:0)
[17:37:22.712] Build status: STARTED
[17:37:22.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:111:0) after 8m50s
[17:46:12.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:111:0)
[17:46:12.814] Build status: STARTED
[17:46:12.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:112:0) after 1m23s
[17:47:35.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:112:0)
[17:47:35.978] Build status: STARTED
[17:47:35.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:113:0) after 3m52s
[17:51:27.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:113:0)
[17:51:28.035] Build status: STARTED
[17:51:28.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:114:0) after 6m55s
[17:58:23.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:114:0)
[17:58:23.087] Build status: STARTED
[17:58:23.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:115:0) after 3m5s
[18:01:28.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:115:0)
[18:01:28.181] Build status: STARTED
[18:01:28.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:116:0) after 3m41s
[18:05:09.206] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:116:0)
[18:05:09.251] Build status: STARTED
[18:05:09.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:117:0) after 2m12s
[18:07:21.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:117:0)
[18:07:21.344] Build status: STARTED
[18:07:21.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:118:0) after 6m55s
[18:14:16.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:118:0)
[18:14:16.419] Build status: STARTED
[18:14:16.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:119:0) after 5m6s
[18:19:22.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:119:0)
[18:19:22.476] Build status: STARTED
[18:19:22.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:120:0) after 1m26s
[18:20:48.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:120:0)
[18:20:48.687] Build status: STARTED
[18:20:48.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:121:0) after 7m7s
[18:27:55.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:121:0)
[18:27:55.771] Build status: STARTED
[18:27:55.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:122:0) after 2m58s
[18:30:53.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:122:0)
[18:30:53.822] Build status: STARTED
[18:30:53.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:123:0) after 8m34s
[18:39:27.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:123:0)
[18:39:28.026] Build status: STARTED
[18:39:28.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:124:0) after 3m17s
[18:42:45.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:124:0)
[18:42:45.239] Build status: STARTED
[18:42:45.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:125:0) after 5m12s
[18:47:57.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:125:0)
[18:47:57.302] Build status: STARTED
[18:47:57.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977733931323192096:126:0) after 9m0s
[18:56:01.475] Received PubSub notification, asking Buildbucket for the build status
[18:56:01.539] Build:
{
"id": "8812303869384772209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26958,
"createdBy": "project:chromium",
"createTime": "2022-06-04T07:52:33.608674195Z",
"startTime": "2022-06-04T07:53:27.132945Z",
"endTime": "2022-06-04T18:56:00.943357637Z",
"updateTime": "2022-06-04T18:56:00.943357637Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e8bd9641fddf5246cb63d70839096b832cedd630",
"ref": "refs/heads/main"
}
}
}
[18:56:01.539] Invocation finished in 11h3m29.162579898s with status FAILED