[03:40:42.560] New invocation is queued and will start shortly
[03:40:43.834] Starting the invocation (attempt 1)
[03:40:43.864] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aaaa685f66b1ef6e6dfd0a58a72b6b15d1af7ad0"
[03:40:43.864] Popped gitiles commit info from properties and tags
[03:40:43.864] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:40:43.864] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:40:43.864] Buildbucket request:
{
"requestId": "8917955777300715136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aaaa685f66b1ef6e6dfd0a58a72b6b15d1af7ad0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8917955777300715136"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:40:44.605] Scheduled build:
{
"id": "8752525715139045425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30582,
"createdBy": "project:chromium",
"createTime": "2024-03-25T03:40:43.994754748Z",
"updateTime": "2024-03-25T03:40:43.994754748Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aaaa685f66b1ef6e6dfd0a58a72b6b15d1af7ad0",
"ref": "refs/heads/main"
}
}
}
[03:40:44.605] Task URL: https://cr-buildbucket.appspot.com/build/8752525715139045425
[03:40:44.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:2:0) after 8m8s
[03:40:44.685] Received PubSub notification, asking Buildbucket for the build status
[03:40:44.706] Build status: SCHEDULED
[03:40:45.522] Received PubSub notification, asking Buildbucket for the build status
[03:40:45.539] Build status: STARTED
[03:48:52.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:2:0)
[03:48:52.717] Build status: STARTED
[03:48:52.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:5:0) after 5m38s
[03:54:30.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:5:0)
[03:54:30.777] Build status: STARTED
[03:54:30.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:6:0) after 7m23s
[04:01:53.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:6:0)
[04:01:53.879] Build status: STARTED
[04:01:53.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:7:0) after 3m47s
[04:05:40.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:7:0)
[04:05:40.929] Build status: STARTED
[04:05:40.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:8:0) after 4m58s
[04:10:38.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:8:0)
[04:10:38.981] Build status: STARTED
[04:10:38.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:9:0) after 3m49s
[04:14:28.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:9:0)
[04:14:28.028] Build status: STARTED
[04:14:28.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:10:0) after 4m16s
[04:18:44.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:10:0)
[04:18:44.118] Build status: STARTED
[04:18:44.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:11:0) after 5m52s
[04:24:36.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:11:0)
[04:24:36.186] Build status: STARTED
[04:24:36.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:12:0) after 5m57s
[04:30:33.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:12:0)
[04:30:33.343] Build status: STARTED
[04:30:33.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:13:0) after 8m11s
[04:38:44.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:13:0)
[04:38:44.336] Build status: STARTED
[04:38:44.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:14:0) after 3m34s
[04:42:18.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:14:0)
[04:42:18.543] Build status: STARTED
[04:42:18.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:15:0) after 6m54s
[04:49:12.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:15:0)
[04:49:12.765] Build status: STARTED
[04:49:12.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:16:0) after 1m24s
[04:50:36.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:16:0)
[04:50:36.829] Build status: STARTED
[04:50:36.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:17:0) after 7m33s
[04:58:09.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:17:0)
[04:58:09.980] Build status: STARTED
[04:58:09.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:18:0) after 8m25s
[05:06:35.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:18:0)
[05:06:35.118] Build status: STARTED
[05:06:35.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:19:0) after 4m4s
[05:10:39.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:19:0)
[05:10:39.155] Build status: STARTED
[05:10:39.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:20:0) after 6m22s
[05:17:01.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:20:0)
[05:17:01.217] Build status: STARTED
[05:17:01.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:21:0) after 3m25s
[05:20:26.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:21:0)
[05:20:26.330] Build status: STARTED
[05:20:26.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:22:0) after 2m8s
[05:22:34.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:22:0)
[05:22:34.378] Build status: STARTED
[05:22:34.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:23:0) after 2m57s
[05:25:31.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:23:0)
[05:25:31.428] Build status: STARTED
[05:25:31.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:24:0) after 4m25s
[05:29:56.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:24:0)
[05:29:56.478] Build status: STARTED
[05:29:56.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:25:0) after 7m58s
[05:37:54.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:25:0)
[05:37:54.790] Build status: STARTED
[05:37:54.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:26:0) after 6m31s
[05:44:26.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:26:0)
[05:44:26.034] Build status: STARTED
[05:44:26.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:27:0) after 3m13s
[05:47:39.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:27:0)
[05:47:39.073] Build status: STARTED
[05:47:39.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:28:0) after 7m13s
[05:54:52.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:28:0)
[05:54:52.172] Build status: STARTED
[05:54:52.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:29:0) after 1m49s
[05:56:41.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:29:0)
[05:56:41.238] Build status: STARTED
[05:56:41.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:30:0) after 4m14s
[06:00:55.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:30:0)
[06:00:55.397] Build status: STARTED
[06:00:55.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:31:0) after 4m57s
[06:05:52.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:31:0)
[06:05:52.500] Build status: STARTED
[06:05:52.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:32:0) after 3m38s
[06:09:30.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:32:0)
[06:09:30.554] Build status: STARTED
[06:09:30.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:33:0) after 4m48s
[06:14:18.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:33:0)
[06:14:18.806] Build status: STARTED
[06:14:18.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:34:0) after 6m2s
[06:20:20.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:34:0)
[06:20:21.062] Build status: STARTED
[06:20:21.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:35:0) after 3m32s
[06:23:53.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:35:0)
[06:23:53.103] Build status: STARTED
[06:23:53.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:36:0) after 3m32s
[06:27:25.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:36:0)
[06:27:25.536] Build status: STARTED
[06:27:25.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:37:0) after 5m29s
[06:32:54.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:37:0)
[06:32:54.540] Build status: STARTED
[06:32:54.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:38:0) after 4m50s
[06:37:44.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:38:0)
[06:37:44.938] Build status: STARTED
[06:37:44.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:39:0) after 9m1s
[06:46:45.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:39:0)
[06:46:45.980] Build status: STARTED
[06:46:45.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:40:0) after 4m30s
[06:51:15.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:40:0)
[06:51:16.025] Build status: STARTED
[06:51:16.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:41:0) after 9m12s
[07:00:28.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:41:0)
[07:00:28.282] Build status: STARTED
[07:00:28.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:42:0) after 6m11s
[07:06:39.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:42:0)
[07:06:39.491] Build status: STARTED
[07:06:39.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:43:0) after 3m51s
[07:10:30.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:43:0)
[07:10:30.557] Build status: STARTED
[07:10:30.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:44:0) after 9m19s
[07:19:49.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:44:0)
[07:19:49.651] Build status: STARTED
[07:19:49.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:45:0) after 9m33s
[07:29:22.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:45:0)
[07:29:22.690] Build status: STARTED
[07:29:22.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:46:0) after 5m58s
[07:35:20.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:46:0)
[07:35:20.752] Build status: STARTED
[07:35:20.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:47:0) after 2m27s
[07:37:47.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:47:0)
[07:37:47.808] Build status: STARTED
[07:37:47.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:48:0) after 1m11s
[07:38:58.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:48:0)
[07:38:58.897] Build status: STARTED
[07:38:58.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:49:0) after 7m41s
[07:46:40.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:49:0)
[07:46:40.070] Build status: STARTED
[07:46:40.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:50:0) after 5m33s
[07:52:13.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:50:0)
[07:52:13.183] Build status: STARTED
[07:52:13.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:51:0) after 2m6s
[07:54:19.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:51:0)
[07:54:19.244] Build status: STARTED
[07:54:19.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:52:0) after 2m55s
[07:57:14.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:52:0)
[07:57:14.429] Build status: STARTED
[07:57:14.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:53:0) after 4m50s
[08:02:04.449] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:53:0)
[08:02:04.490] Build status: STARTED
[08:02:04.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:54:0) after 5m45s
[08:07:49.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:54:0)
[08:07:49.609] Build status: STARTED
[08:07:49.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:55:0) after 8m9s
[08:15:59.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:55:0)
[08:15:59.098] Build status: STARTED
[08:15:59.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:56:0) after 7m47s
[08:23:46.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:56:0)
[08:23:46.230] Build status: STARTED
[08:23:46.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:57:0) after 4m16s
[08:28:02.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:57:0)
[08:28:02.242] Build status: STARTED
[08:28:02.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:58:0) after 5m1s
[08:33:03.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:58:0)
[08:33:03.573] Build status: STARTED
[08:33:03.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:59:0) after 8m20s
[08:41:23.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:59:0)
[08:41:23.672] Build status: STARTED
[08:41:23.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:60:0) after 9m36s
[08:50:59.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:60:0)
[08:50:59.715] Build status: STARTED
[08:50:59.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:61:0) after 3m52s
[08:54:51.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:61:0)
[08:54:51.758] Build status: STARTED
[08:54:51.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:62:0) after 7m6s
[09:01:57.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:62:0)
[09:01:57.809] Build status: STARTED
[09:01:57.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:63:0) after 4m13s
[09:06:10.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:63:0)
[09:06:10.947] Build status: STARTED
[09:06:10.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:64:0) after 6m32s
[09:12:42.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:64:0)
[09:12:43.005] Build status: STARTED
[09:12:43.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:65:0) after 6m25s
[09:19:08.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:65:0)
[09:19:08.432] Build status: STARTED
[09:19:08.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:66:0) after 7m59s
[09:27:07.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:66:0)
[09:27:07.571] Build status: STARTED
[09:27:07.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:67:0) after 7m8s
[09:34:15.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:67:0)
[09:34:15.848] Build status: STARTED
[09:34:15.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:68:0) after 9m42s
[09:43:57.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:68:0)
[09:43:57.895] Build status: STARTED
[09:43:57.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:69:0) after 8m23s
[09:52:20.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:69:0)
[09:52:20.991] Build status: STARTED
[09:52:20.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:70:0) after 7m19s
[09:59:40.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:70:0)
[09:59:40.029] Build status: STARTED
[09:59:40.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:71:0) after 7m19s
[10:06:59.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:71:0)
[10:06:59.195] Build status: STARTED
[10:06:59.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:72:0) after 6m55s
[10:13:54.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:72:0)
[10:13:54.419] Build status: STARTED
[10:13:54.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:73:0) after 4m50s
[10:18:44.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:73:0)
[10:18:44.676] Build status: STARTED
[10:18:44.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:74:0) after 8m17s
[10:27:01.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:74:0)
[10:27:01.725] Build status: STARTED
[10:27:01.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:75:0) after 9m32s
[10:36:33.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:75:0)
[10:36:33.785] Build status: STARTED
[10:36:33.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:76:0) after 8m34s
[10:45:07.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:76:0)
[10:45:07.802] Build status: STARTED
[10:45:07.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:77:0) after 6m4s
[10:51:11.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:77:0)
[10:51:11.842] Build status: STARTED
[10:51:11.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:78:0) after 8m58s
[11:00:10.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:78:0)
[11:00:10.129] Build status: STARTED
[11:00:10.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:79:0) after 6m15s
[11:06:25.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:79:0)
[11:06:25.198] Build status: STARTED
[11:06:25.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:80:0) after 3m31s
[11:09:56.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:80:0)
[11:09:56.304] Build status: STARTED
[11:09:56.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:81:0) after 6m33s
[11:16:29.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:81:0)
[11:16:29.496] Build status: STARTED
[11:16:29.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:82:0) after 4m29s
[11:20:58.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:82:0)
[11:20:58.715] Build status: STARTED
[11:20:58.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:83:0) after 8m51s
[11:29:49.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:83:0)
[11:29:49.772] Build status: STARTED
[11:29:49.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:84:0) after 6m58s
[11:36:47.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:84:0)
[11:36:47.866] Build status: STARTED
[11:36:47.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:85:0) after 7m27s
[11:44:15.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:85:0)
[11:44:15.047] Build status: STARTED
[11:44:15.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:86:0) after 3m31s
[11:47:46.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:86:0)
[11:47:46.104] Build status: STARTED
[11:47:46.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:87:0) after 6m29s
[11:54:15.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:87:0)
[11:54:15.498] Build status: STARTED
[11:54:15.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:88:0) after 9m22s
[12:03:37.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:88:0)
[12:03:37.641] Build status: STARTED
[12:03:37.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:89:0) after 2m20s
[12:05:57.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:89:0)
[12:05:57.749] Build status: STARTED
[12:05:57.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:90:0) after 2m43s
[12:08:40.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:90:0)
[12:08:40.863] Build status: STARTED
[12:08:40.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:91:0) after 6m47s
[12:15:27.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:91:0)
[12:15:27.982] Build status: STARTED
[12:15:27.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:92:0) after 2m44s
[12:18:12.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:92:0)
[12:18:12.070] Build status: STARTED
[12:18:12.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:93:0) after 6m12s
[12:24:24.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:93:0)
[12:24:24.140] Build status: STARTED
[12:24:24.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:94:0) after 2m22s
[12:26:46.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:94:0)
[12:26:46.197] Build status: STARTED
[12:26:46.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:95:0) after 2m35s
[12:29:21.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:95:0)
[12:29:21.295] Build status: STARTED
[12:29:21.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:96:0) after 1m16s
[12:30:37.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:96:0)
[12:30:37.386] Build status: STARTED
[12:30:37.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:97:0) after 6m14s
[12:36:51.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:97:0)
[12:36:51.425] Build status: STARTED
[12:36:51.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:98:0) after 3m10s
[12:40:01.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:98:0)
[12:40:01.490] Build status: STARTED
[12:40:01.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:99:0) after 5m8s
[12:45:09.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:99:0)
[12:45:09.546] Build status: STARTED
[12:45:09.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:100:0) after 7m54s
[12:53:03.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:100:0)
[12:53:05.728] Build status: STARTED
[12:53:05.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:101:0) after 3m50s
[12:56:55.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:101:0)
[12:56:55.840] Build status: STARTED
[12:56:55.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:102:0) after 7m48s
[13:04:43.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:102:0)
[13:04:43.909] Build status: STARTED
[13:04:43.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:103:0) after 7m4s
[13:11:47.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:103:0)
[13:11:47.964] Build status: STARTED
[13:11:47.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:104:0) after 2m33s
[13:14:21.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:104:0)
[13:14:21.238] Build status: STARTED
[13:14:21.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:105:0) after 1m7s
[13:15:28.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:105:0)
[13:15:28.433] Build status: STARTED
[13:15:28.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:106:0) after 8m38s
[13:24:06.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:106:0)
[13:24:06.521] Build status: STARTED
[13:24:06.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:107:0) after 8m30s
[13:32:36.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:107:0)
[13:32:36.719] Build status: STARTED
[13:32:36.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:108:0) after 4m11s
[13:36:48.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:108:0)
[13:36:48.319] Build status: STARTED
[13:36:48.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:109:0) after 8m13s
[13:45:01.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:109:0)
[13:45:01.473] Build status: STARTED
[13:45:01.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:110:0) after 2m34s
[13:47:35.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:110:0)
[13:47:35.786] Build status: STARTED
[13:47:35.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:111:0) after 5m40s
[13:53:15.812] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:111:0)
[13:53:15.864] Build status: STARTED
[13:53:15.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:112:0) after 5m16s
[13:58:31.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:112:0)
[13:58:31.981] Build status: STARTED
[13:58:31.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:113:0) after 1m42s
[14:00:14.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:113:0)
[14:00:14.334] Build status: STARTED
[14:00:14.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:114:0) after 3m50s
[14:04:04.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:114:0)
[14:04:04.510] Build status: STARTED
[14:04:04.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:115:0) after 4m53s
[14:08:57.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:115:0)
[14:08:57.687] Build status: STARTED
[14:08:57.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:116:0) after 3m50s
[14:12:48.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:116:0)
[14:12:48.397] Build status: STARTED
[14:12:48.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:117:0) after 1m24s
[14:14:12.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:117:0)
[14:14:12.815] Build status: STARTED
[14:14:12.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:118:0) after 4m31s
[14:18:44.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:118:0)
[14:18:44.259] Build status: STARTED
[14:18:44.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:119:0) after 2m34s
[14:21:18.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:119:0)
[14:21:18.457] Build status: STARTED
[14:21:18.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:120:0) after 7m44s
[14:29:02.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:120:0)
[14:29:02.634] Build status: STARTED
[14:29:02.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:121:0) after 7m37s
[14:36:39.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:121:0)
[14:36:39.795] Build status: STARTED
[14:36:39.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:122:0) after 1m21s
[14:38:01.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:122:0)
[14:38:01.083] Build status: STARTED
[14:38:01.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:123:0) after 4m14s
[14:42:15.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:123:0)
[14:42:15.198] Build status: STARTED
[14:42:15.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:124:0) after 4m9s
[14:46:24.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:124:0)
[14:46:24.582] Build status: STARTED
[14:46:24.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:125:0) after 5m7s
[14:51:31.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:125:0)
[14:51:31.950] Build status: STARTED
[14:51:31.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:126:0) after 6m4s
[14:57:36.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:126:0)
[14:57:36.194] Build status: STARTED
[14:57:36.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:127:0) after 1m25s
[14:59:01.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:127:0)
[14:59:01.565] Build status: STARTED
[14:59:01.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:128:0) after 7m24s
[15:06:25.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:128:0)
[15:06:25.659] Build status: STARTED
[15:06:25.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:129:0) after 1m29s
[15:07:54.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:129:0)
[15:07:54.764] Build status: STARTED
[15:07:54.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:130:0) after 9m52s
[15:17:46.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:130:0)
[15:17:46.843] Build status: STARTED
[15:17:46.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:131:0) after 3m49s
[15:21:35.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:131:0)
[15:21:35.923] Build status: STARTED
[15:21:35.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:132:0) after 4m49s
[15:26:25.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:132:0)
[15:26:25.092] Build status: STARTED
[15:26:25.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:133:0) after 8m29s
[15:34:54.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:133:0)
[15:34:54.168] Build status: STARTED
[15:34:54.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:134:0) after 7m53s
[15:42:47.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:134:0)
[15:42:47.462] Build status: STARTED
[15:42:47.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:135:0) after 6m24s
[15:49:12.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:135:0)
[15:49:12.309] Build status: STARTED
[15:49:12.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:136:0) after 9m39s
[15:58:51.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:136:0)
[15:58:51.385] Build status: STARTED
[15:58:51.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:137:0) after 2m10s
[16:01:01.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:137:0)
[16:01:01.469] Build status: STARTED
[16:01:01.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:138:0) after 6m28s
[16:07:29.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:138:0)
[16:07:29.597] Build status: STARTED
[16:07:29.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:139:0) after 2m59s
[16:10:28.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:139:0)
[16:10:30.777] Build status: STARTED
[16:10:30.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:140:0) after 9m9s
[16:19:39.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:140:0)
[16:19:39.830] Build status: STARTED
[16:19:39.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:141:0) after 9m15s
[16:28:54.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:141:0)
[16:28:54.892] Build status: STARTED
[16:28:54.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:142:0) after 1m45s
[16:30:39.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:142:0)
[16:30:39.960] Build status: STARTED
[16:30:39.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:143:0) after 3m21s
[16:34:01.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:143:0)
[16:34:01.027] Build status: STARTED
[16:34:01.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:144:0) after 4m54s
[16:38:55.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:144:0)
[16:38:55.106] Build status: STARTED
[16:38:55.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:145:0) after 4m0s
[16:42:55.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:145:0)
[16:42:55.215] Build status: STARTED
[16:42:55.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:146:0) after 1m33s
[16:44:28.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:146:0)
[16:44:28.405] Build status: STARTED
[16:44:28.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:147:0) after 1m49s
[16:46:17.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:147:0)
[16:46:17.560] Build status: STARTED
[16:46:17.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:148:0) after 4m33s
[16:50:50.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:148:0)
[16:50:50.632] Build status: STARTED
[16:50:50.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:149:0) after 7m37s
[16:58:27.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:149:0)
[16:58:27.680] Build status: STARTED
[16:58:27.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:150:0) after 3m52s
[17:02:19.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:150:0)
[17:02:19.737] Build status: STARTED
[17:02:19.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:151:0) after 5m4s
[17:07:23.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:151:0)
[17:07:23.797] Build status: STARTED
[17:07:23.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:152:0) after 9m32s
[17:16:55.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:152:0)
[17:16:55.829] Build status: STARTED
[17:16:55.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:153:0) after 6m21s
[17:23:16.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:153:0)
[17:23:17.018] Build status: STARTED
[17:23:17.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:154:0) after 1m44s
[17:25:01.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:154:0)
[17:25:01.076] Build status: STARTED
[17:25:01.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:155:0) after 6m25s
[17:31:26.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:155:0)
[17:31:26.299] Build status: STARTED
[17:31:26.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:156:0) after 6m50s
[17:38:16.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:156:0)
[17:38:16.359] Build status: STARTED
[17:38:16.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:157:0) after 1m59s
[17:40:15.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:157:0)
[17:40:15.483] Build status: STARTED
[17:40:15.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:158:0) after 9m22s
[17:49:37.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:158:0)
[17:49:37.595] Build status: STARTED
[17:49:37.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:159:0) after 1m38s
[17:51:15.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:159:0)
[17:51:15.655] Build status: STARTED
[17:51:15.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:160:0) after 1m37s
[17:52:52.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:160:0)
[17:52:52.709] Build status: STARTED
[17:52:52.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:161:0) after 3m38s
[17:56:30.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:161:0)
[17:56:30.848] Build status: STARTED
[17:56:30.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:162:0) after 5m25s
[18:01:55.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:162:0)
[18:01:55.907] Build status: STARTED
[18:01:55.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:163:0) after 4m47s
[18:06:42.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:163:0)
[18:06:42.948] Build status: STARTED
[18:06:42.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:164:0) after 7m14s
[18:13:57.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:164:0)
[18:13:57.166] Build status: STARTED
[18:13:57.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:165:0) after 5m49s
[18:19:46.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:165:0)
[18:19:46.221] Build status: STARTED
[18:19:46.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:166:0) after 6m10s
[18:25:56.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:166:0)
[18:25:56.308] Build status: STARTED
[18:25:56.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:167:0) after 4m3s
[18:29:59.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:167:0)
[18:29:59.360] Build status: STARTED
[18:29:59.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:168:0) after 8m43s
[18:38:42.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:168:0)
[18:38:42.481] Build status: STARTED
[18:38:42.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:169:0) after 3m58s
[18:42:40.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:169:0)
[18:42:40.535] Build status: STARTED
[18:42:40.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:170:0) after 6m1s
[18:48:41.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:170:0)
[18:48:41.708] Build status: STARTED
[18:48:41.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:171:0) after 1m45s
[18:50:26.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:171:0)
[18:50:26.771] Build status: STARTED
[18:50:26.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:172:0) after 6m29s
[18:56:55.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:172:0)
[18:56:55.867] Build status: STARTED
[18:56:55.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:173:0) after 3m40s
[19:00:35.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:173:0)
[19:00:35.923] Build status: STARTED
[19:00:35.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:174:0) after 9m19s
[19:09:54.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:174:0)
[19:09:54.932] Build status: STARTED
[19:09:54.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:175:0) after 8m40s
[19:18:35.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:175:0)
[19:18:35.090] Build status: STARTED
[19:18:35.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:176:0) after 5m30s
[19:24:05.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:176:0)
[19:24:05.185] Build status: STARTED
[19:24:05.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:177:0) after 1m33s
[19:25:38.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:177:0)
[19:25:38.337] Build status: STARTED
[19:25:38.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:178:0) after 2m40s
[19:28:18.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:178:0)
[19:28:18.390] Build status: STARTED
[19:28:18.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:179:0) after 2m1s
[19:30:19.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:179:0)
[19:30:19.648] Build status: STARTED
[19:30:19.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:180:0) after 7m26s
[19:37:45.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:180:0)
[19:37:45.687] Build status: STARTED
[19:37:45.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:181:0) after 9m51s
[19:47:36.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:181:0)
[19:47:36.785] Build status: STARTED
[19:47:36.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:182:0) after 4m0s
[19:51:36.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:182:0)
[19:51:36.859] Build status: STARTED
[19:51:36.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:183:0) after 7m38s
[19:59:14.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:183:0)
[19:59:14.917] Build status: STARTED
[19:59:14.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:184:0) after 1m31s
[20:00:45.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:184:0)
[20:00:46.008] Build status: STARTED
[20:00:46.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:185:0) after 7m43s
[20:08:29.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:185:0)
[20:08:29.060] Build status: STARTED
[20:08:29.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:186:0) after 4m3s
[20:12:32.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:186:0)
[20:12:32.233] Build status: STARTED
[20:12:32.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:187:0) after 1m58s
[20:14:30.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:187:0)
[20:14:30.275] Build status: STARTED
[20:14:30.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:188:0) after 5m48s
[20:20:18.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:188:0)
[20:20:18.375] Build status: STARTED
[20:20:18.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:189:0) after 7m44s
[20:28:02.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:189:0)
[20:28:02.533] Build status: STARTED
[20:28:02.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:190:0) after 7m49s
[20:35:51.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:190:0)
[20:35:51.786] Build status: STARTED
[20:35:51.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:191:0) after 1m2s
[20:36:53.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:191:0)
[20:36:53.922] Build status: STARTED
[20:36:53.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:192:0) after 9m23s
[20:46:16.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:192:0)
[20:46:16.976] Build status: STARTED
[20:46:16.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:193:0) after 4m19s
[20:50:36.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:193:0)
[20:50:36.085] Build status: STARTED
[20:50:36.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:194:0) after 9m23s
[20:59:59.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:194:0)
[20:59:59.178] Build status: STARTED
[20:59:59.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:195:0) after 5m36s
[21:05:35.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:195:0)
[21:05:35.252] Build status: STARTED
[21:05:35.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:196:0) after 9m19s
[21:14:54.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:196:0)
[21:14:54.355] Build status: STARTED
[21:14:54.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:197:0) after 7m11s
[21:22:05.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:197:0)
[21:22:05.485] Build status: STARTED
[21:22:05.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:198:0) after 2m55s
[21:25:00.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:198:0)
[21:25:00.728] Build status: STARTED
[21:25:00.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:199:0) after 3m15s
[21:28:15.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:199:0)
[21:28:15.941] Build status: STARTED
[21:28:15.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:200:0) after 8m27s
[21:36:42.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:200:0)
[21:36:43.011] Build status: STARTED
[21:36:43.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:201:0) after 6m47s
[21:43:30.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:201:0)
[21:43:30.126] Build status: STARTED
[21:43:30.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:202:0) after 7m9s
[21:50:39.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:202:0)
[21:50:39.172] Build status: STARTED
[21:50:39.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:203:0) after 7m10s
[21:57:49.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:203:0)
[21:57:49.229] Build status: STARTED
[21:57:49.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:204:0) after 7m4s
[22:04:53.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:204:0)
[22:04:53.282] Build status: STARTED
[22:04:53.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:205:0) after 7m58s
[22:12:51.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:205:0)
[22:12:51.338] Build status: STARTED
[22:12:51.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:206:0) after 5m46s
[22:18:37.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:206:0)
[22:18:37.464] Build status: STARTED
[22:18:37.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:207:0) after 3m16s
[22:21:53.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:207:0)
[22:21:53.509] Build status: STARTED
[22:21:53.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:208:0) after 4m3s
[22:25:56.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:208:0)
[22:25:56.550] Build status: STARTED
[22:25:56.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:209:0) after 3m20s
[22:29:16.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:209:0)
[22:29:16.605] Build status: STARTED
[22:29:16.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:210:0) after 1m34s
[22:30:50.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:210:0)
[22:30:50.718] Build status: STARTED
[22:30:50.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:211:0) after 8m18s
[22:39:08.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:211:0)
[22:39:08.869] Build status: STARTED
[22:39:08.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:212:0) after 7m10s
[22:46:18.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:212:0)
[22:46:19.021] Build status: STARTED
[22:46:19.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:213:0) after 6m52s
[22:53:11.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:213:0)
[22:53:11.157] Build status: STARTED
[22:53:11.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:214:0) after 7m8s
[23:00:19.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:214:0)
[23:00:19.524] Build status: STARTED
[23:00:19.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:215:0) after 9m51s
[23:10:10.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:215:0)
[23:10:10.682] Build status: STARTED
[23:10:10.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:216:0) after 6m50s
[23:17:00.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:216:0)
[23:17:00.870] Build status: STARTED
[23:17:00.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:217:0) after 4m14s
[23:21:14.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:217:0)
[23:21:14.928] Build status: STARTED
[23:21:14.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:218:0) after 7m16s
[23:28:30.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:218:0)
[23:28:30.973] Build status: STARTED
[23:28:30.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:219:0) after 9m54s
[23:38:24.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:219:0)
[23:38:24.970] Build status: STARTED
[23:38:24.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:220:0) after 3m40s
[23:42:04.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:220:0)
[23:42:05.017] Build status: STARTED
[23:42:05.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8917955777300715136:221:0) after 6m41s
[23:44:13.593] Received PubSub notification, asking Buildbucket for the build status
[23:44:13.645] Build:
{
"id": "8752525715139045425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30582,
"createdBy": "project:chromium",
"createTime": "2024-03-25T03:40:43.994754748Z",
"startTime": "2024-03-25T03:40:45.075538Z",
"endTime": "2024-03-25T23:44:12.926259Z",
"updateTime": "2024-03-25T23:44:12.926259Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aaaa685f66b1ef6e6dfd0a58a72b6b15d1af7ad0",
"ref": "refs/heads/main"
}
}
}
[23:44:13.645] Invocation finished in 20h3m31.096593586s with status FAILED