[22:45:30.304] New invocation is queued and will start shortly
[22:45:31.407] Starting the invocation (attempt 1)
[22:45:31.439] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a321009e827ac3ab93ab41e762ffcf1d92a0fb69"
[22:45:31.439] Popped gitiles commit info from properties and tags
[22:45:31.439] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:45:31.440] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:45:31.441] Buildbucket request:
{
"requestId": "8992082668467952592",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a321009e827ac3ab93ab41e762ffcf1d92a0fb69",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8992082668467952592"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:45:32.174] Scheduled build:
{
"id": "8826652606471383617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26386,
"createdBy": "project:chromium",
"createTime": "2021-12-27T22:45:31.575436519Z",
"updateTime": "2021-12-27T22:45:31.575436519Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a321009e827ac3ab93ab41e762ffcf1d92a0fb69",
"ref": "refs/heads/main"
}
}
}
[22:45:32.174] Task URL: https://cr-buildbucket.appspot.com/build/8826652606471383617
[22:45:32.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:2:0) after 5m20s
[22:50:52.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:2:0)
[22:50:52.432] Build status: SCHEDULED
[22:50:52.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:3:0) after 5m29s
[22:56:21.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:3:0)
[22:56:21.484] Build status: SCHEDULED
[22:56:21.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:4:0) after 6m22s
[23:02:43.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:4:0)
[23:02:43.481] Build status: SCHEDULED
[23:02:43.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:5:0) after 5m36s
[23:08:19.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:5:0)
[23:08:19.565] Build status: SCHEDULED
[23:08:19.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:6:0) after 1m23s
[23:09:42.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:6:0)
[23:09:42.678] Build status: SCHEDULED
[23:09:42.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:7:0) after 7m57s
[23:12:15.746] Received PubSub notification, asking Buildbucket for the build status
[23:12:15.782] Build status: STARTED
[23:17:39.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:7:0)
[23:17:39.738] Build status: STARTED
[23:17:39.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:9:0) after 1m39s
[23:19:18.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:9:0)
[23:19:18.791] Build status: STARTED
[23:19:18.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:10:0) after 9m1s
[23:28:19.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:10:0)
[23:28:19.843] Build status: STARTED
[23:28:19.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:11:0) after 4m53s
[23:33:12.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:11:0)
[23:33:12.926] Build status: STARTED
[23:33:12.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:12:0) after 4m42s
[23:37:54.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:12:0)
[23:37:54.943] Build status: STARTED
[23:37:54.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:13:0) after 6m0s
[23:43:55.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:13:0)
[23:43:55.036] Build status: STARTED
[23:43:55.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:14:0) after 3m41s
[23:47:36.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:14:0)
[23:47:36.203] Build status: STARTED
[23:47:36.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:15:0) after 2m49s
[23:50:25.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:15:0)
[23:50:25.500] Build status: STARTED
[23:50:25.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:16:0) after 8m12s
[23:58:37.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:16:0)
[23:58:37.563] Build status: STARTED
[23:58:37.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:17:0) after 5m0s
[00:03:37.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:17:0)
[00:03:37.603] Build status: STARTED
[00:03:37.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:18:0) after 6m38s
[00:10:15.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:18:0)
[00:10:15.685] Build status: STARTED
[00:10:15.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:19:0) after 5m18s
[00:15:34.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:19:0)
[00:15:34.269] Build status: STARTED
[00:15:34.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:20:0) after 9m48s
[00:25:22.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:20:0)
[00:25:22.310] Build status: STARTED
[00:25:22.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:21:0) after 2m41s
[00:28:03.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:21:0)
[00:28:03.454] Build status: STARTED
[00:28:03.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:22:0) after 7m44s
[00:35:47.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:22:0)
[00:35:47.510] Build status: STARTED
[00:35:47.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:23:0) after 7m17s
[00:43:05.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:23:0)
[00:43:05.163] Build status: STARTED
[00:43:05.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:24:0) after 5m47s
[00:48:53.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:24:0)
[00:48:53.369] Build status: STARTED
[00:48:53.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:25:0) after 5m22s
[00:54:15.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:25:0)
[00:54:15.620] Build status: STARTED
[00:54:15.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:26:0) after 1m53s
[00:56:08.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:26:0)
[00:56:08.661] Build status: STARTED
[00:56:08.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:27:0) after 4m3s
[01:00:11.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:27:0)
[01:00:11.726] Build status: STARTED
[01:00:11.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:28:0) after 7m25s
[01:07:36.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:28:0)
[01:07:36.829] Build status: STARTED
[01:07:36.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:29:0) after 6m28s
[01:14:04.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:29:0)
[01:14:04.951] Build status: STARTED
[01:14:04.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:30:0) after 7m51s
[01:21:55.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:30:0)
[01:21:56.018] Build status: STARTED
[01:21:56.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:31:0) after 9m45s
[01:31:41.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:31:0)
[01:31:41.362] Build status: STARTED
[01:31:41.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:32:0) after 5m54s
[01:37:35.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:32:0)
[01:37:35.404] Build status: STARTED
[01:37:35.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:33:0) after 5m10s
[01:42:45.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:33:0)
[01:42:45.458] Build status: STARTED
[01:42:45.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:34:0) after 7m53s
[01:50:38.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:34:0)
[01:50:38.612] Build status: STARTED
[01:50:38.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:35:0) after 4m41s
[01:55:19.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:35:0)
[01:55:19.664] Build status: STARTED
[01:55:19.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:36:0) after 2m58s
[01:58:17.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:36:0)
[01:58:17.751] Build status: STARTED
[01:58:17.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:37:0) after 2m8s
[02:00:26.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:37:0)
[02:00:26.260] Build status: STARTED
[02:00:26.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:38:0) after 6m15s
[02:06:41.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:38:0)
[02:06:41.666] Build status: STARTED
[02:06:41.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:39:0) after 1m20s
[02:08:02.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:39:0)
[02:08:02.088] Build status: STARTED
[02:08:02.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:40:0) after 1m20s
[02:09:22.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:40:0)
[02:09:22.160] Build status: STARTED
[02:09:22.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:41:0) after 8m19s
[02:17:41.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:41:0)
[02:17:41.197] Build status: STARTED
[02:17:41.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:42:0) after 6m42s
[02:24:23.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:42:0)
[02:24:23.285] Build status: STARTED
[02:24:23.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:43:0) after 5m45s
[02:30:08.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:43:0)
[02:30:08.435] Build status: STARTED
[02:30:08.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:44:0) after 5m44s
[02:35:52.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:44:0)
[02:35:52.788] Build status: STARTED
[02:35:52.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:45:0) after 1m41s
[02:37:33.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:45:0)
[02:37:34.016] Build status: STARTED
[02:37:34.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:46:0) after 8m14s
[02:45:49.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:46:0)
[02:45:49.633] Build status: STARTED
[02:45:49.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:47:0) after 3m55s
[02:49:44.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:47:0)
[02:49:44.788] Build status: STARTED
[02:49:44.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:48:0) after 4m21s
[02:54:05.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:48:0)
[02:54:05.843] Build status: STARTED
[02:54:05.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:49:0) after 8m54s
[03:02:59.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:49:0)
[03:03:00.016] Build status: STARTED
[03:03:00.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:50:0) after 7m55s
[03:10:55.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:50:0)
[03:10:55.200] Build status: STARTED
[03:10:55.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:51:0) after 3m5s
[03:14:00.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:51:0)
[03:14:00.238] Build status: STARTED
[03:14:00.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:52:0) after 3m20s
[03:17:20.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:52:0)
[03:17:20.300] Build status: STARTED
[03:17:20.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:53:0) after 2m58s
[03:20:18.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:53:0)
[03:20:18.338] Build status: STARTED
[03:20:18.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:54:0) after 4m39s
[03:24:57.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:54:0)
[03:24:57.494] Build status: STARTED
[03:24:57.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:55:0) after 9m13s
[03:34:10.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:55:0)
[03:34:10.546] Build status: STARTED
[03:34:10.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:56:0) after 9m52s
[03:44:02.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:56:0)
[03:44:02.592] Build status: STARTED
[03:44:02.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:57:0) after 2m8s
[03:46:10.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:57:0)
[03:46:10.765] Build status: STARTED
[03:46:10.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:58:0) after 4m58s
[03:51:08.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:58:0)
[03:51:09.079] Build status: STARTED
[03:51:09.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:59:0) after 5m55s
[03:57:04.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:59:0)
[03:57:04.124] Build status: STARTED
[03:57:04.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:60:0) after 1m11s
[03:58:15.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:60:0)
[03:58:15.183] Build status: STARTED
[03:58:15.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:61:0) after 2m49s
[04:01:04.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:61:0)
[04:01:04.300] Build status: STARTED
[04:01:04.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:62:0) after 8m59s
[04:10:03.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:62:0)
[04:10:03.344] Build status: STARTED
[04:10:03.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:63:0) after 7m40s
[04:17:43.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:63:0)
[04:17:43.448] Build status: STARTED
[04:17:43.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:64:0) after 9m59s
[04:27:42.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:64:0)
[04:27:42.452] Build status: STARTED
[04:27:42.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:65:0) after 2m46s
[04:30:28.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:65:0)
[04:30:28.693] Build status: STARTED
[04:30:28.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:66:0) after 1m41s
[04:32:09.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:66:0)
[04:32:09.735] Build status: STARTED
[04:32:09.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:67:0) after 9m53s
[04:42:02.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:67:0)
[04:42:02.791] Build status: STARTED
[04:42:02.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:68:0) after 6m49s
[04:48:51.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:68:0)
[04:48:51.833] Build status: STARTED
[04:48:51.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:69:0) after 6m43s
[04:55:35.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:69:0)
[04:55:35.251] Build status: STARTED
[04:55:35.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:70:0) after 9m8s
[05:04:43.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:70:0)
[05:04:43.244] Build status: STARTED
[05:04:43.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:71:0) after 4m18s
[05:09:01.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:71:0)
[05:09:01.354] Build status: STARTED
[05:09:01.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:72:0) after 5m22s
[05:14:23.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:72:0)
[05:14:23.398] Build status: STARTED
[05:14:23.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:73:0) after 6m55s
[05:21:18.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:73:0)
[05:21:18.439] Build status: STARTED
[05:21:18.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:74:0) after 3m17s
[05:24:35.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:74:0)
[05:24:35.484] Build status: STARTED
[05:24:35.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:75:0) after 1m36s
[05:26:11.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:75:0)
[05:26:11.611] Build status: STARTED
[05:26:11.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:76:0) after 4m20s
[05:30:33.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:76:0)
[05:30:33.801] Build status: STARTED
[05:30:33.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:77:0) after 5m31s
[05:36:04.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:77:0)
[05:36:04.899] Build status: STARTED
[05:36:04.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:78:0) after 4m37s
[05:40:41.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:78:0)
[05:40:41.941] Build status: STARTED
[05:40:41.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:79:0) after 2m5s
[05:42:47.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:79:0)
[05:42:47.133] Build status: STARTED
[05:42:47.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:80:0) after 1m24s
[05:44:11.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:80:0)
[05:44:11.195] Build status: STARTED
[05:44:11.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:81:0) after 6m36s
[05:50:47.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:81:0)
[05:50:47.492] Build status: STARTED
[05:50:47.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:82:0) after 6m46s
[05:57:33.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:82:0)
[05:57:33.558] Build status: STARTED
[05:57:33.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:83:0) after 3m13s
[06:00:46.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:83:0)
[06:00:46.592] Build status: STARTED
[06:00:46.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:84:0) after 7m27s
[06:08:13.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:84:0)
[06:08:13.635] Build status: STARTED
[06:08:13.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:85:0) after 5m0s
[06:13:13.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:85:0)
[06:13:13.863] Build status: STARTED
[06:13:13.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:86:0) after 4m44s
[06:17:57.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:86:0)
[06:17:57.914] Build status: STARTED
[06:17:57.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:87:0) after 9m15s
[06:27:12.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:87:0)
[06:27:12.999] Build status: STARTED
[06:27:12.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:88:0) after 4m11s
[06:31:24.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:88:0)
[06:31:24.146] Build status: STARTED
[06:31:24.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:89:0) after 3m53s
[06:35:17.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:89:0)
[06:35:17.207] Build status: STARTED
[06:35:17.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:90:0) after 1m36s
[06:36:53.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:90:0)
[06:36:53.260] Build status: STARTED
[06:36:53.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:91:0) after 3m30s
[06:40:23.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:91:0)
[06:40:23.300] Build status: STARTED
[06:40:23.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:92:0) after 2m31s
[06:42:54.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:92:0)
[06:42:54.367] Build status: STARTED
[06:42:54.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:93:0) after 1m57s
[06:44:51.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:93:0)
[06:44:51.435] Build status: STARTED
[06:44:51.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:94:0) after 4m37s
[06:49:28.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:94:0)
[06:49:28.500] Build status: STARTED
[06:49:28.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:95:0) after 6m49s
[06:56:17.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:95:0)
[06:56:17.793] Build status: STARTED
[06:56:17.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:96:0) after 8m38s
[07:04:55.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:96:0)
[07:04:56.011] Build status: STARTED
[07:04:56.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:97:0) after 5m37s
[07:10:33.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:97:0)
[07:10:33.280] Build status: STARTED
[07:10:33.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:98:0) after 1m7s
[07:11:40.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:98:0)
[07:11:40.346] Build status: STARTED
[07:11:40.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:99:0) after 4m56s
[07:16:36.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:99:0)
[07:16:36.387] Build status: STARTED
[07:16:36.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:100:0) after 1m43s
[07:18:19.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:100:0)
[07:18:19.435] Build status: STARTED
[07:18:19.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:101:0) after 2m35s
[07:20:54.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:101:0)
[07:20:54.479] Build status: STARTED
[07:20:54.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:102:0) after 7m49s
[07:28:43.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:102:0)
[07:28:43.733] Build status: STARTED
[07:28:43.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:103:0) after 9m33s
[07:38:16.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:103:0)
[07:38:16.770] Build status: STARTED
[07:38:16.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:104:0) after 2m10s
[07:40:26.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:104:0)
[07:40:26.959] Build status: STARTED
[07:40:26.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:105:0) after 8m59s
[07:49:26.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:105:0)
[07:49:26.166] Build status: STARTED
[07:49:26.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:106:0) after 3m32s
[07:52:58.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:106:0)
[07:52:58.201] Build status: STARTED
[07:52:58.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:107:0) after 3m27s
[07:56:25.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:107:0)
[07:56:25.556] Build status: STARTED
[07:56:25.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:108:0) after 5m47s
[08:02:12.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:108:0)
[08:02:12.603] Build status: STARTED
[08:02:12.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:109:0) after 6m30s
[08:08:42.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:109:0)
[08:08:42.694] Build status: STARTED
[08:08:42.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:110:0) after 7m58s
[08:16:40.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:110:0)
[08:16:40.768] Build status: STARTED
[08:16:40.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:111:0) after 1m16s
[08:17:56.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:111:0)
[08:17:56.965] Build status: STARTED
[08:17:56.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:112:0) after 3m3s
[08:21:00.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:112:0)
[08:21:00.066] Build status: STARTED
[08:21:00.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:113:0) after 9m30s
[08:30:30.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:113:0)
[08:30:30.106] Build status: STARTED
[08:30:30.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:114:0) after 2m55s
[08:33:25.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:114:0)
[08:33:25.148] Build status: STARTED
[08:33:25.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:115:0) after 8m24s
[08:41:49.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:115:0)
[08:41:49.495] Build status: STARTED
[08:41:49.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:116:0) after 8m56s
[08:50:45.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:116:0)
[08:50:45.564] Build status: STARTED
[08:50:45.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:117:0) after 1m53s
[08:52:38.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:117:0)
[08:52:38.619] Build status: STARTED
[08:52:38.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:118:0) after 7m44s
[09:00:22.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:118:0)
[09:00:22.882] Build status: STARTED
[09:00:22.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:119:0) after 6m29s
[09:06:51.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:119:0)
[09:06:51.929] Build status: STARTED
[09:06:51.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:120:0) after 6m24s
[09:13:16.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:120:0)
[09:13:16.074] Build status: STARTED
[09:13:16.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:121:0) after 9m59s
[09:23:17.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:121:0)
[09:23:17.135] Build status: STARTED
[09:23:17.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:122:0) after 1m47s
[09:25:04.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:122:0)
[09:25:04.193] Build status: STARTED
[09:25:04.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:123:0) after 8m20s
[09:33:24.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:123:0)
[09:33:24.259] Build status: STARTED
[09:33:24.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:124:0) after 1m56s
[09:35:20.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:124:0)
[09:35:20.724] Build status: STARTED
[09:35:20.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:125:0) after 3m54s
[09:39:14.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:125:0)
[09:39:14.764] Build status: STARTED
[09:39:14.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:126:0) after 6m22s
[09:45:37.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:126:0)
[09:45:37.120] Build status: STARTED
[09:45:37.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:127:0) after 7m17s
[09:52:54.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:127:0)
[09:52:54.746] Build status: STARTED
[09:52:54.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992082668467952592:128:0) after 7m45s
[09:53:30.971] Received PubSub notification, asking Buildbucket for the build status
[09:53:31.023] Build:
{
"id": "8826652606471383617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26386,
"createdBy": "project:chromium",
"createTime": "2021-12-27T22:45:31.575436519Z",
"startTime": "2021-12-27T23:12:14.378941Z",
"endTime": "2021-12-28T09:53:30.525784456Z",
"updateTime": "2021-12-28T09:53:30.525784456Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a321009e827ac3ab93ab41e762ffcf1d92a0fb69",
"ref": "refs/heads/main"
}
}
}
[09:53:31.024] Invocation finished in 11h8m0.735572024s with status FAILED