[21:59:40.372] New invocation is queued and will start shortly
[21:59:41.528] Starting the invocation (attempt 1)
[21:59:41.576] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cb5bcd1d3b0c4f14c803556d624925dd9d00e0af"
[21:59:41.576] Popped gitiles commit info from properties and tags
[21:59:41.576] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:59:41.576] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:59:41.576] Buildbucket request:
{
"requestId": "8977318246458520544",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb5bcd1d3b0c4f14c803556d624925dd9d00e0af",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8977318246458520544"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:59:42.301] Scheduled build:
{
"id": "8811888184441534561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26966,
"createdBy": "project:chromium",
"createTime": "2022-06-08T21:59:41.662469321Z",
"updateTime": "2022-06-08T21:59:41.662469321Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb5bcd1d3b0c4f14c803556d624925dd9d00e0af",
"ref": "refs/heads/main"
}
}
}
[21:59:42.301] Task URL: https://cr-buildbucket.appspot.com/build/8811888184441534561
[21:59:42.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:2:0) after 2m52s
[22:02:34.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:2:0)
[22:02:34.437] Build status: SCHEDULED
[22:02:34.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:3:0) after 6m28s
[22:09:02.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:3:0)
[22:09:02.565] Build status: SCHEDULED
[22:09:02.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:4:0) after 5m9s
[22:14:11.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:4:0)
[22:14:11.848] Build status: SCHEDULED
[22:14:11.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:5:0) after 5m35s
[22:19:36.467] Received PubSub notification, asking Buildbucket for the build status
[22:19:36.491] Build status: STARTED
[22:19:46.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:5:0)
[22:19:46.922] Build status: STARTED
[22:19:46.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:7:0) after 5m53s
[22:25:40.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:7:0)
[22:25:40.136] Build status: STARTED
[22:25:40.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:8:0) after 6m59s
[22:32:39.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:8:0)
[22:32:39.659] Build status: STARTED
[22:32:39.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:9:0) after 3m45s
[22:36:24.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:9:0)
[22:36:24.891] Build status: STARTED
[22:36:24.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:10:0) after 4m3s
[22:40:27.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:10:0)
[22:40:27.969] Build status: STARTED
[22:40:27.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:11:0) after 6m23s
[22:46:51.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:11:0)
[22:46:51.138] Build status: STARTED
[22:46:51.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:12:0) after 4m48s
[22:51:39.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:12:0)
[22:51:39.313] Build status: STARTED
[22:51:39.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:13:0) after 9m56s
[23:01:35.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:13:0)
[23:01:35.695] Build status: STARTED
[23:01:35.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:14:0) after 6m3s
[23:07:38.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:14:0)
[23:07:39.022] Build status: STARTED
[23:07:39.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:15:0) after 2m23s
[23:10:02.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:15:0)
[23:10:02.650] Build status: STARTED
[23:10:02.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:16:0) after 9m18s
[23:19:20.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:16:0)
[23:19:20.711] Build status: STARTED
[23:19:20.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:17:0) after 7m30s
[23:26:50.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:17:0)
[23:26:50.795] Build status: STARTED
[23:26:50.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:18:0) after 4m59s
[23:31:49.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:18:0)
[23:31:49.901] Build status: STARTED
[23:31:49.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:19:0) after 2m33s
[23:34:22.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:19:0)
[23:34:23.032] Build status: STARTED
[23:34:23.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:20:0) after 9m36s
[23:43:59.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:20:0)
[23:43:59.155] Build status: STARTED
[23:43:59.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:21:0) after 6m53s
[23:50:52.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:21:0)
[23:50:52.243] Build status: STARTED
[23:50:52.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:22:0) after 6m49s
[23:57:41.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:22:0)
[23:57:41.305] Build status: STARTED
[23:57:41.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:23:0) after 7m31s
[00:05:12.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:23:0)
[00:05:12.368] Build status: STARTED
[00:05:12.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:24:0) after 1m9s
[00:06:21.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:24:0)
[00:06:21.678] Build status: STARTED
[00:06:21.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:25:0) after 4m13s
[00:10:34.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:25:0)
[00:10:34.701] Build status: STARTED
[00:10:34.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:26:0) after 3m59s
[00:14:34.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:26:0)
[00:14:34.273] Build status: STARTED
[00:14:34.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:27:0) after 7m29s
[00:22:03.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:27:0)
[00:22:03.473] Build status: STARTED
[00:22:03.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:28:0) after 3m53s
[00:25:56.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:28:0)
[00:25:56.535] Build status: STARTED
[00:25:56.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:29:0) after 2m12s
[00:28:08.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:29:0)
[00:28:08.606] Build status: STARTED
[00:28:08.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:30:0) after 8m31s
[00:36:39.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:30:0)
[00:36:39.916] Build status: STARTED
[00:36:39.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:31:0) after 3m54s
[00:40:33.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:31:0)
[00:40:33.953] Build status: STARTED
[00:40:33.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:32:0) after 7m48s
[00:48:22.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:32:0)
[00:48:22.159] Build status: STARTED
[00:48:22.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:33:0) after 3m49s
[00:52:11.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:33:0)
[00:52:11.212] Build status: STARTED
[00:52:11.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:34:0) after 2m54s
[00:55:05.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:34:0)
[00:55:05.384] Build status: STARTED
[00:55:05.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:35:0) after 6m22s
[01:01:27.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:35:0)
[01:01:27.465] Build status: STARTED
[01:01:27.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:36:0) after 4m19s
[01:05:47.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:36:0)
[01:05:47.133] Build status: STARTED
[01:05:47.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:37:0) after 1m12s
[01:06:59.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:37:0)
[01:06:59.455] Build status: STARTED
[01:06:59.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:38:0) after 8m52s
[01:15:51.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:38:0)
[01:15:51.510] Build status: STARTED
[01:15:51.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:39:0) after 9m18s
[01:25:09.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:39:0)
[01:25:10.017] Build status: STARTED
[01:25:10.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:40:0) after 5m56s
[01:31:06.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:40:0)
[01:31:06.103] Build status: STARTED
[01:31:06.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:41:0) after 1m5s
[01:32:11.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:41:0)
[01:32:11.243] Build status: STARTED
[01:32:11.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:42:0) after 5m39s
[01:37:50.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:42:0)
[01:37:50.367] Build status: STARTED
[01:37:50.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:43:0) after 3m54s
[01:41:44.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:43:0)
[01:41:44.463] Build status: STARTED
[01:41:44.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:44:0) after 7m35s
[01:49:19.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:44:0)
[01:49:19.843] Build status: STARTED
[01:49:19.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:45:0) after 7m28s
[01:56:47.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:45:0)
[01:56:47.920] Build status: STARTED
[01:56:47.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:46:0) after 1m24s
[01:58:12.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:46:0)
[01:58:12.074] Build status: STARTED
[01:58:12.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:47:0) after 5m16s
[02:03:28.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:47:0)
[02:03:28.127] Build status: STARTED
[02:03:28.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:48:0) after 4m50s
[02:08:18.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:48:0)
[02:08:18.544] Build status: STARTED
[02:08:18.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:49:0) after 1m38s
[02:09:57.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:49:0)
[02:09:57.140] Build status: STARTED
[02:09:57.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:50:0) after 2m30s
[02:12:27.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:50:0)
[02:12:27.490] Build status: STARTED
[02:12:27.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:51:0) after 7m57s
[02:20:24.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:51:0)
[02:20:24.641] Build status: STARTED
[02:20:24.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:52:0) after 7m20s
[02:27:44.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:52:0)
[02:27:44.785] Build status: STARTED
[02:27:44.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:53:0) after 8m57s
[02:36:41.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:53:0)
[02:36:42.078] Build status: STARTED
[02:36:42.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:54:0) after 1m51s
[02:38:33.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:54:0)
[02:38:33.145] Build status: STARTED
[02:38:33.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:55:0) after 6m25s
[02:44:58.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:55:0)
[02:44:58.252] Build status: STARTED
[02:44:58.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:56:0) after 9m51s
[02:54:49.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:56:0)
[02:54:49.443] Build status: STARTED
[02:54:49.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:57:0) after 1m5s
[02:55:54.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:57:0)
[02:55:54.614] Build status: STARTED
[02:55:54.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:58:0) after 4m51s
[03:00:45.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:58:0)
[03:00:45.707] Build status: STARTED
[03:00:45.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:59:0) after 5m10s
[03:05:55.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:59:0)
[03:05:55.957] Build status: STARTED
[03:05:55.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:60:0) after 8m27s
[03:14:23.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:60:0)
[03:14:23.146] Build status: STARTED
[03:14:23.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:61:0) after 3m11s
[03:17:34.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:61:0)
[03:17:34.305] Build status: STARTED
[03:17:34.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:62:0) after 6m53s
[03:24:27.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:62:0)
[03:24:27.401] Build status: STARTED
[03:24:27.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:63:0) after 8m22s
[03:32:49.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:63:0)
[03:32:49.538] Build status: STARTED
[03:32:49.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:64:0) after 6m34s
[03:39:23.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:64:0)
[03:39:23.744] Build status: STARTED
[03:39:23.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:65:0) after 1m4s
[03:40:27.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:65:0)
[03:40:27.801] Build status: STARTED
[03:40:27.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:66:0) after 9m21s
[03:49:48.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:66:0)
[03:49:48.850] Build status: STARTED
[03:49:48.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:67:0) after 8m6s
[03:57:54.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:67:0)
[03:57:54.926] Build status: STARTED
[03:57:54.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:68:0) after 1m39s
[03:59:33.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:68:0)
[03:59:33.987] Build status: STARTED
[03:59:33.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:69:0) after 4m37s
[04:04:10.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:69:0)
[04:04:11.020] Build status: STARTED
[04:04:11.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:70:0) after 6m41s
[04:10:52.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:70:0)
[04:10:52.095] Build status: STARTED
[04:10:52.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:71:0) after 3m57s
[04:14:49.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:71:0)
[04:14:49.177] Build status: STARTED
[04:14:49.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:72:0) after 1m16s
[04:16:05.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:72:0)
[04:16:05.269] Build status: STARTED
[04:16:05.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:73:0) after 2m58s
[04:19:03.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:73:0)
[04:19:03.319] Build status: STARTED
[04:19:03.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:74:0) after 2m15s
[04:21:18.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:74:0)
[04:21:18.522] Build status: STARTED
[04:21:18.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:75:0) after 2m26s
[04:23:44.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:75:0)
[04:23:44.685] Build status: STARTED
[04:23:44.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:76:0) after 9m48s
[04:33:33.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:76:0)
[04:33:33.069] Build status: STARTED
[04:33:33.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:77:0) after 4m59s
[04:38:32.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:77:0)
[04:38:32.288] Build status: STARTED
[04:38:32.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:78:0) after 2m39s
[04:41:11.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:78:0)
[04:41:11.346] Build status: STARTED
[04:41:11.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:79:0) after 8m57s
[04:50:08.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:79:0)
[04:50:08.452] Build status: STARTED
[04:50:08.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:80:0) after 7m16s
[04:57:24.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:80:0)
[04:57:24.579] Build status: STARTED
[04:57:24.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:81:0) after 2m11s
[04:59:35.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:81:0)
[04:59:35.715] Build status: STARTED
[04:59:35.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:82:0) after 7m17s
[05:06:52.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:82:0)
[05:06:52.785] Build status: STARTED
[05:06:52.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:83:0) after 1m42s
[05:08:34.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:83:0)
[05:08:34.937] Build status: STARTED
[05:08:34.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:84:0) after 7m23s
[05:15:57.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:84:0)
[05:15:58.004] Build status: STARTED
[05:15:58.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:85:0) after 3m46s
[05:19:44.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:85:0)
[05:19:44.105] Build status: STARTED
[05:19:44.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:86:0) after 2m1s
[05:21:45.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:86:0)
[05:21:45.186] Build status: STARTED
[05:21:45.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:87:0) after 1m51s
[05:23:36.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:87:0)
[05:23:36.260] Build status: STARTED
[05:23:36.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:88:0) after 1m6s
[05:24:42.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:88:0)
[05:24:42.312] Build status: STARTED
[05:24:42.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:89:0) after 4m46s
[05:29:28.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:89:0)
[05:29:28.627] Build status: STARTED
[05:29:28.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:90:0) after 5m59s
[05:35:28.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:90:0)
[05:35:28.309] Build status: STARTED
[05:35:28.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:91:0) after 9m57s
[05:45:25.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:91:0)
[05:45:25.624] Build status: STARTED
[05:45:25.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:92:0) after 7m31s
[05:52:56.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:92:0)
[05:52:56.677] Build status: STARTED
[05:52:56.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:93:0) after 8m7s
[06:01:03.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:93:0)
[06:01:03.748] Build status: STARTED
[06:01:03.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:94:0) after 8m18s
[06:09:21.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:94:0)
[06:09:21.919] Build status: STARTED
[06:09:21.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:95:0) after 8m48s
[06:18:09.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:95:0)
[06:18:10.023] Build status: STARTED
[06:18:10.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:96:0) after 1m29s
[06:19:39.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:96:0)
[06:19:39.359] Build status: STARTED
[06:19:39.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:97:0) after 2m41s
[06:22:20.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:97:0)
[06:22:20.415] Build status: STARTED
[06:22:20.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:98:0) after 5m39s
[06:27:59.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:98:0)
[06:27:59.568] Build status: STARTED
[06:27:59.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:99:0) after 7m24s
[06:35:23.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:99:0)
[06:35:23.677] Build status: STARTED
[06:35:23.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:100:0) after 6m14s
[06:41:37.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:100:0)
[06:41:37.709] Build status: STARTED
[06:41:37.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:101:0) after 5m25s
[06:47:02.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:101:0)
[06:47:02.886] Build status: STARTED
[06:47:02.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:102:0) after 1m35s
[06:48:37.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:102:0)
[06:48:37.956] Build status: STARTED
[06:48:37.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:103:0) after 7m39s
[06:56:17.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:103:0)
[06:56:17.188] Build status: STARTED
[06:56:17.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:104:0) after 2m51s
[06:59:08.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:104:0)
[06:59:08.504] Build status: STARTED
[06:59:08.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:105:0) after 5m34s
[07:04:42.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:105:0)
[07:04:42.788] Build status: STARTED
[07:04:42.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:106:0) after 4m21s
[07:09:03.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:106:0)
[07:09:03.850] Build status: STARTED
[07:09:03.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:107:0) after 3m54s
[07:12:57.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:107:0)
[07:12:57.902] Build status: STARTED
[07:12:57.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:108:0) after 8m52s
[07:21:50.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:108:0)
[07:21:50.108] Build status: STARTED
[07:21:50.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:109:0) after 6m46s
[07:28:36.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:109:0)
[07:28:36.247] Build status: STARTED
[07:28:36.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:110:0) after 9m56s
[07:38:32.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:110:0)
[07:38:32.441] Build status: STARTED
[07:38:32.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:111:0) after 6m15s
[07:44:47.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:111:0)
[07:44:47.516] Build status: STARTED
[07:44:47.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:112:0) after 7m6s
[07:51:53.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:112:0)
[07:51:53.710] Build status: STARTED
[07:51:53.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:113:0) after 7m20s
[07:59:14.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:113:0)
[07:59:14.181] Build status: STARTED
[07:59:14.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:114:0) after 4m44s
[08:03:58.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:114:0)
[08:03:58.252] Build status: STARTED
[08:03:58.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:115:0) after 1m54s
[08:05:52.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:115:0)
[08:05:52.374] Build status: STARTED
[08:05:52.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:116:0) after 5m45s
[08:11:37.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:116:0)
[08:11:37.444] Build status: STARTED
[08:11:37.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:117:0) after 3m25s
[08:15:02.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:117:0)
[08:15:02.701] Build status: STARTED
[08:15:02.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:118:0) after 7m30s
[08:22:32.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:118:0)
[08:22:32.851] Build status: STARTED
[08:22:32.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:119:0) after 7m54s
[08:30:26.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:119:0)
[08:30:26.947] Build status: STARTED
[08:30:26.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:120:0) after 1m53s
[08:32:20.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:120:0)
[08:32:20.279] Build status: STARTED
[08:32:20.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:121:0) after 8m23s
[08:40:43.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:121:0)
[08:40:43.374] Build status: STARTED
[08:40:43.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:122:0) after 8m8s
[08:48:51.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:122:0)
[08:48:51.687] Build status: STARTED
[08:48:51.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:123:0) after 4m22s
[08:53:13.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:123:0)
[08:53:13.797] Build status: STARTED
[08:53:13.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:124:0) after 7m23s
[09:00:37.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:124:0)
[09:00:37.185] Build status: STARTED
[09:00:37.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:125:0) after 8m18s
[09:08:55.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:125:0)
[09:08:55.348] Build status: STARTED
[09:08:55.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:126:0) after 5m39s
[09:14:34.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:126:0)
[09:14:34.403] Build status: STARTED
[09:14:34.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:127:0) after 3m39s
[09:18:13.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:127:0)
[09:18:13.476] Build status: STARTED
[09:18:13.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:128:0) after 1m38s
[09:19:51.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:128:0)
[09:19:51.525] Build status: STARTED
[09:19:51.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:129:0) after 5m44s
[09:25:35.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:129:0)
[09:25:35.758] Build status: STARTED
[09:25:35.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:130:0) after 1m45s
[09:27:20.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:130:0)
[09:27:21.037] Build status: STARTED
[09:27:21.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:131:0) after 5m9s
[09:32:30.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:131:0)
[09:32:30.288] Build status: STARTED
[09:32:30.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8977318246458520544:132:0) after 2m31s
[09:33:32.028] Received PubSub notification, asking Buildbucket for the build status
[09:33:32.139] Build:
{
"id": "8811888184441534561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26966,
"createdBy": "project:chromium",
"createTime": "2022-06-08T21:59:41.662469321Z",
"startTime": "2022-06-08T22:19:32.082217Z",
"endTime": "2022-06-09T09:33:31.627451298Z",
"updateTime": "2022-06-09T09:33:31.627451298Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb5bcd1d3b0c4f14c803556d624925dd9d00e0af",
"ref": "refs/heads/main"
}
}
}
[09:33:32.139] Invocation finished in 11h33m51.783325076s with status FAILED