[21:08:13.467] New invocation is queued and will start shortly
[21:08:15.036] Starting the invocation (attempt 1)
[21:08:15.066] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/725267ab6eb26876dd86efec76745bd43b2e8caf"
[21:08:15.066] Popped gitiles commit info from properties and tags
[21:08:15.066] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:08:15.066] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:08:15.066] Buildbucket request:
{
"requestId": "8945974932932975488",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "725267ab6eb26876dd86efec76745bd43b2e8caf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945974932932975488"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:08:15.651] Scheduled build:
{
"id": "8780544870529243729",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28942,
"createdBy": "project:chromium",
"createTime": "2023-05-20T21:08:15.131465343Z",
"updateTime": "2023-05-20T21:08:15.131465343Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "725267ab6eb26876dd86efec76745bd43b2e8caf",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:08:15.651] Task URL: https://cr-buildbucket.appspot.com/build/8780544870529243729
[21:08:15.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:2:0) after 7m12s
[21:12:17.074] Received PubSub notification, asking Buildbucket for the build status
[21:12:17.106] Build status: STARTED
[21:15:27.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:2:0)
[21:15:27.696] Build status: STARTED
[21:15:27.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:4:0) after 5m43s
[21:21:10.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:4:0)
[21:21:10.829] Build status: STARTED
[21:21:10.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:5:0) after 6m47s
[21:27:57.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:5:0)
[21:27:57.943] Build status: STARTED
[21:27:57.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:6:0) after 7m5s
[21:35:03.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:6:0)
[21:35:03.434] Build status: STARTED
[21:35:03.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:7:0) after 3m33s
[21:38:36.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:7:0)
[21:38:36.469] Build status: STARTED
[21:38:36.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:8:0) after 8m21s
[21:46:57.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:8:0)
[21:46:57.520] Build status: STARTED
[21:46:57.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:9:0) after 2m47s
[21:49:44.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:9:0)
[21:49:44.590] Build status: STARTED
[21:49:44.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:10:0) after 9m36s
[21:59:20.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:10:0)
[21:59:21.009] Build status: STARTED
[21:59:21.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:11:0) after 3m1s
[22:02:22.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:11:0)
[22:02:22.068] Build status: STARTED
[22:02:22.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:12:0) after 8m40s
[22:11:02.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:12:0)
[22:11:02.521] Build status: STARTED
[22:11:02.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:13:0) after 2m40s
[22:13:42.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:13:0)
[22:13:42.562] Build status: STARTED
[22:13:42.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:14:0) after 3m39s
[22:17:21.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:14:0)
[22:17:21.755] Build status: STARTED
[22:17:21.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:15:0) after 9m26s
[22:26:47.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:15:0)
[22:26:47.790] Build status: STARTED
[22:26:47.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:16:0) after 4m37s
[22:31:25.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:16:0)
[22:31:25.124] Build status: STARTED
[22:31:25.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:17:0) after 7m12s
[22:38:37.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:17:0)
[22:38:37.299] Build status: STARTED
[22:38:37.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:18:0) after 2m58s
[22:41:35.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:18:0)
[22:41:35.480] Build status: STARTED
[22:41:35.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:19:0) after 5m10s
[22:46:45.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:19:0)
[22:46:45.577] Build status: STARTED
[22:46:45.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:20:0) after 4m30s
[22:51:15.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:20:0)
[22:51:15.715] Build status: STARTED
[22:51:15.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:21:0) after 6m5s
[22:57:20.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:21:0)
[22:57:20.757] Build status: STARTED
[22:57:20.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:22:0) after 8m9s
[23:05:29.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:22:0)
[23:05:29.797] Build status: STARTED
[23:05:29.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:23:0) after 9m55s
[23:15:24.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:23:0)
[23:15:24.847] Build status: STARTED
[23:15:24.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:24:0) after 2m42s
[23:18:06.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:24:0)
[23:18:06.889] Build status: STARTED
[23:18:06.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:25:0) after 2m52s
[23:20:59.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:25:0)
[23:20:59.090] Build status: STARTED
[23:20:59.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:26:0) after 5m0s
[23:25:59.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:26:0)
[23:25:59.125] Build status: STARTED
[23:25:59.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:27:0) after 7m53s
[23:33:52.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:27:0)
[23:33:52.224] Build status: STARTED
[23:33:52.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:28:0) after 9m9s
[23:43:01.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:28:0)
[23:43:01.590] Build status: STARTED
[23:43:01.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:29:0) after 4m27s
[23:47:28.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:29:0)
[23:47:28.863] Build status: STARTED
[23:47:28.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:30:0) after 5m34s
[23:53:03.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:30:0)
[23:53:03.276] Build status: STARTED
[23:53:03.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:31:0) after 3m38s
[23:56:41.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:31:0)
[23:56:41.322] Build status: STARTED
[23:56:41.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:32:0) after 1m48s
[23:58:29.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:32:0)
[23:58:29.350] Build status: STARTED
[23:58:29.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:33:0) after 2m53s
[00:01:22.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:33:0)
[00:01:22.387] Build status: STARTED
[00:01:22.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:34:0) after 2m17s
[00:03:39.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:34:0)
[00:03:39.705] Build status: STARTED
[00:03:39.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:35:0) after 4m47s
[00:08:26.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:35:0)
[00:08:26.758] Build status: STARTED
[00:08:26.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:36:0) after 8m17s
[00:16:43.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:36:0)
[00:16:43.800] Build status: STARTED
[00:16:43.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:37:0) after 3m2s
[00:19:45.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:37:0)
[00:19:45.845] Build status: STARTED
[00:19:45.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:38:0) after 4m40s
[00:24:25.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:38:0)
[00:24:25.888] Build status: STARTED
[00:24:25.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:39:0) after 1m10s
[00:25:36.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:39:0)
[00:25:36.498] Build status: STARTED
[00:25:36.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:40:0) after 6m30s
[00:32:06.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:40:0)
[00:32:06.534] Build status: STARTED
[00:32:06.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:41:0) after 6m4s
[00:38:11.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:41:0)
[00:38:11.160] Build status: STARTED
[00:38:11.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:42:0) after 5m14s
[00:43:25.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:42:0)
[00:43:25.738] Build status: STARTED
[00:43:25.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:43:0) after 9m12s
[00:52:37.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:43:0)
[00:52:37.905] Build status: STARTED
[00:52:37.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:44:0) after 9m41s
[01:02:18.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:44:0)
[01:02:19.026] Build status: STARTED
[01:02:19.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:45:0) after 6m23s
[01:08:42.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:45:0)
[01:08:42.077] Build status: STARTED
[01:08:42.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:46:0) after 3m8s
[01:11:50.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:46:0)
[01:11:50.461] Build status: STARTED
[01:11:50.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:47:0) after 3m50s
[01:15:40.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:47:0)
[01:15:40.836] Build status: STARTED
[01:15:40.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:48:0) after 1m47s
[01:17:27.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:48:0)
[01:17:27.968] Build status: STARTED
[01:17:27.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:49:0) after 4m36s
[01:22:04.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:49:0)
[01:22:04.099] Build status: STARTED
[01:22:04.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:50:0) after 2m27s
[01:24:31.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:50:0)
[01:24:31.151] Build status: STARTED
[01:24:31.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:51:0) after 3m58s
[01:28:29.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:51:0)
[01:28:29.194] Build status: STARTED
[01:28:29.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:52:0) after 9m54s
[01:38:23.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:52:0)
[01:38:23.275] Build status: STARTED
[01:38:23.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:53:0) after 5m5s
[01:43:28.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:53:0)
[01:43:28.316] Build status: STARTED
[01:43:28.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:54:0) after 8m19s
[01:51:47.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:54:0)
[01:51:47.335] Build status: STARTED
[01:51:47.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:55:0) after 3m58s
[01:55:45.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:55:0)
[01:55:45.380] Build status: STARTED
[01:55:45.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:56:0) after 9m46s
[02:05:31.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:56:0)
[02:05:31.434] Build status: STARTED
[02:05:31.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:57:0) after 5m39s
[02:11:10.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:57:0)
[02:11:10.528] Build status: STARTED
[02:11:10.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:58:0) after 7m44s
[02:18:54.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:58:0)
[02:18:54.730] Build status: STARTED
[02:18:54.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:59:0) after 3m57s
[02:22:51.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:59:0)
[02:22:51.916] Build status: STARTED
[02:22:51.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:60:0) after 2m25s
[02:25:16.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:60:0)
[02:25:16.982] Build status: STARTED
[02:25:16.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:61:0) after 1m0s
[02:26:17.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:61:0)
[02:26:17.141] Build status: STARTED
[02:26:17.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:62:0) after 8m47s
[02:35:04.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:62:0)
[02:35:04.500] Build status: STARTED
[02:35:04.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:63:0) after 5m32s
[02:40:36.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:63:0)
[02:40:36.550] Build status: STARTED
[02:40:36.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:64:0) after 5m0s
[02:45:36.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:64:0)
[02:45:36.606] Build status: STARTED
[02:45:36.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:65:0) after 8m10s
[02:53:46.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:65:0)
[02:53:46.675] Build status: STARTED
[02:53:46.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:66:0) after 3m52s
[02:57:39.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:66:0)
[02:57:39.037] Build status: STARTED
[02:57:39.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:67:0) after 7m43s
[03:05:22.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:67:0)
[03:05:22.342] Build status: STARTED
[03:05:22.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:68:0) after 2m26s
[03:07:48.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:68:0)
[03:07:48.496] Build status: STARTED
[03:07:48.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:69:0) after 1m51s
[03:09:39.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:69:0)
[03:09:39.537] Build status: STARTED
[03:09:39.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:70:0) after 6m33s
[03:16:12.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:70:0)
[03:16:12.664] Build status: STARTED
[03:16:12.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:71:0) after 3m36s
[03:19:49.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:71:0)
[03:19:49.244] Build status: STARTED
[03:19:49.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:72:0) after 1m38s
[03:21:28.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:72:0)
[03:21:28.028] Build status: STARTED
[03:21:28.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:73:0) after 6m39s
[03:28:07.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:73:0)
[03:28:07.053] Build status: STARTED
[03:28:07.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:74:0) after 4m48s
[03:32:55.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:74:0)
[03:32:55.114] Build status: STARTED
[03:32:55.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:75:0) after 3m20s
[03:36:15.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:75:0)
[03:36:15.267] Build status: STARTED
[03:36:15.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:76:0) after 3m9s
[03:39:24.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:76:0)
[03:39:24.942] Build status: STARTED
[03:39:24.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:77:0) after 6m58s
[03:46:22.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:77:0)
[03:46:22.993] Build status: STARTED
[03:46:22.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:78:0) after 5m48s
[03:52:11.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:78:0)
[03:52:11.241] Build status: STARTED
[03:52:11.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:79:0) after 5m33s
[03:57:44.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:79:0)
[03:57:44.385] Build status: STARTED
[03:57:44.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:80:0) after 8m52s
[04:06:36.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:80:0)
[04:06:36.464] Build status: STARTED
[04:06:36.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:81:0) after 2m21s
[04:08:57.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:81:0)
[04:08:57.753] Build status: STARTED
[04:08:57.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:82:0) after 4m42s
[04:13:39.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:82:0)
[04:13:39.827] Build status: STARTED
[04:13:39.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:83:0) after 5m13s
[04:18:52.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:83:0)
[04:18:52.898] Build status: STARTED
[04:18:52.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:84:0) after 7m21s
[04:26:13.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:84:0)
[04:26:13.963] Build status: STARTED
[04:26:13.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:85:0) after 6m26s
[04:32:40.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:85:0)
[04:32:40.114] Build status: STARTED
[04:32:40.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:86:0) after 2m7s
[04:34:47.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:86:0)
[04:34:47.167] Build status: STARTED
[04:34:47.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:87:0) after 4m36s
[04:39:23.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:87:0)
[04:39:23.561] Build status: STARTED
[04:39:23.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:88:0) after 1m30s
[04:40:53.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:88:0)
[04:40:53.802] Build status: STARTED
[04:40:53.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:89:0) after 5m17s
[04:46:10.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:89:0)
[04:46:11.017] Build status: STARTED
[04:46:11.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:90:0) after 9m6s
[04:55:17.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:90:0)
[04:55:17.276] Build status: STARTED
[04:55:17.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:91:0) after 9m50s
[05:05:07.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:91:0)
[05:05:07.418] Build status: STARTED
[05:05:07.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:92:0) after 2m0s
[05:07:07.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:92:0)
[05:07:07.455] Build status: STARTED
[05:07:07.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:93:0) after 3m17s
[05:10:24.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:93:0)
[05:10:24.622] Build status: STARTED
[05:10:24.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:94:0) after 4m58s
[05:15:22.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:94:0)
[05:15:22.664] Build status: STARTED
[05:15:22.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:95:0) after 4m6s
[05:19:28.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:95:0)
[05:19:28.701] Build status: STARTED
[05:19:28.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:96:0) after 1m39s
[05:21:07.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:96:0)
[05:21:07.743] Build status: STARTED
[05:21:07.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:97:0) after 8m18s
[05:29:25.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:97:0)
[05:29:25.784] Build status: STARTED
[05:29:25.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:98:0) after 8m57s
[05:38:22.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:98:0)
[05:38:22.843] Build status: STARTED
[05:38:22.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:99:0) after 3m19s
[05:41:42.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:99:0)
[05:41:42.103] Build status: STARTED
[05:41:42.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:100:0) after 9m23s
[05:51:05.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:100:0)
[05:51:05.410] Build status: STARTED
[05:51:05.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:101:0) after 7m28s
[05:58:33.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:101:0)
[05:58:33.465] Build status: STARTED
[05:58:33.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:102:0) after 4m16s
[06:02:49.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:102:0)
[06:02:49.798] Build status: STARTED
[06:02:49.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:103:0) after 8m10s
[06:11:00.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:103:0)
[06:11:00.174] Build status: STARTED
[06:11:00.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:104:0) after 4m4s
[06:15:04.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:104:0)
[06:15:04.440] Build status: STARTED
[06:15:04.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:105:0) after 2m55s
[06:17:59.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:105:0)
[06:17:59.863] Build status: STARTED
[06:17:59.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:106:0) after 8m36s
[06:26:36.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:106:0)
[06:26:36.222] Build status: STARTED
[06:26:36.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:107:0) after 3m43s
[06:30:19.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:107:0)
[06:30:19.558] Build status: STARTED
[06:30:19.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:108:0) after 7m8s
[06:37:27.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:108:0)
[06:37:27.614] Build status: STARTED
[06:37:27.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:109:0) after 7m23s
[06:44:50.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:109:0)
[06:44:50.666] Build status: STARTED
[06:44:50.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:110:0) after 3m27s
[06:48:17.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:110:0)
[06:48:17.979] Build status: STARTED
[06:48:17.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:111:0) after 8m41s
[06:56:59.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:111:0)
[06:56:59.088] Build status: STARTED
[06:56:59.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:112:0) after 9m1s
[07:06:00.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:112:0)
[07:06:00.127] Build status: STARTED
[07:06:00.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:113:0) after 1m49s
[07:07:49.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:113:0)
[07:07:49.170] Build status: STARTED
[07:07:49.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:114:0) after 6m44s
[07:14:33.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:114:0)
[07:14:33.211] Build status: STARTED
[07:14:33.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:115:0) after 6m24s
[07:20:57.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:115:0)
[07:20:57.263] Build status: STARTED
[07:20:57.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:116:0) after 6m57s
[07:27:54.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:116:0)
[07:27:54.388] Build status: STARTED
[07:27:54.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:117:0) after 3m19s
[07:31:13.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:117:0)
[07:31:13.463] Build status: STARTED
[07:31:13.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:118:0) after 9m33s
[07:40:46.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:118:0)
[07:40:46.711] Build status: STARTED
[07:40:46.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:119:0) after 3m25s
[07:44:11.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:119:0)
[07:44:11.771] Build status: STARTED
[07:44:11.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:120:0) after 5m47s
[07:49:58.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:120:0)
[07:49:58.797] Build status: STARTED
[07:49:58.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:121:0) after 2m47s
[07:52:46.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:121:0)
[07:52:46.079] Build status: STARTED
[07:52:46.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:122:0) after 2m56s
[07:55:42.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:122:0)
[07:55:42.272] Build status: STARTED
[07:55:42.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:123:0) after 9m49s
[08:05:31.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:123:0)
[08:05:31.411] Build status: STARTED
[08:05:31.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:124:0) after 5m57s
[08:11:28.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:124:0)
[08:11:28.458] Build status: STARTED
[08:11:28.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:125:0) after 4m59s
[08:16:27.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:125:0)
[08:16:27.525] Build status: STARTED
[08:16:27.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:126:0) after 6m48s
[08:23:15.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:126:0)
[08:23:15.757] Build status: STARTED
[08:23:15.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:127:0) after 7m22s
[08:30:37.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:127:0)
[08:30:37.902] Build status: STARTED
[08:30:37.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:128:0) after 6m56s
[08:37:33.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:128:0)
[08:37:33.951] Build status: STARTED
[08:37:33.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:129:0) after 3m1s
[08:40:34.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:129:0)
[08:40:34.991] Build status: STARTED
[08:40:34.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:130:0) after 4m42s
[08:45:17.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:130:0)
[08:45:17.235] Build status: STARTED
[08:45:17.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:131:0) after 3m12s
[08:48:29.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:131:0)
[08:48:29.375] Build status: STARTED
[08:48:29.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:132:0) after 7m25s
[08:55:54.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:132:0)
[08:55:54.819] Build status: STARTED
[08:55:54.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:133:0) after 3m54s
[08:59:48.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:133:0)
[08:59:49.016] Build status: STARTED
[08:59:49.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:134:0) after 3m26s
[09:03:15.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:134:0)
[09:03:15.250] Build status: STARTED
[09:03:15.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:135:0) after 9m34s
[09:12:49.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:135:0)
[09:12:49.284] Build status: STARTED
[09:12:49.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:136:0) after 3m56s
[09:16:45.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:136:0)
[09:16:45.570] Build status: STARTED
[09:16:45.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:137:0) after 5m40s
[09:22:25.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:137:0)
[09:22:25.626] Build status: STARTED
[09:22:25.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:138:0) after 7m6s
[09:29:31.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:138:0)
[09:29:31.774] Build status: STARTED
[09:29:31.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:139:0) after 3m53s
[09:33:25.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:139:0)
[09:33:25.034] Build status: STARTED
[09:33:25.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:140:0) after 2m50s
[09:36:15.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:140:0)
[09:36:15.273] Build status: STARTED
[09:36:15.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:141:0) after 5m13s
[09:41:28.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:141:0)
[09:41:28.614] Build status: STARTED
[09:41:28.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:142:0) after 6m21s
[09:47:49.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:142:0)
[09:47:49.657] Build status: STARTED
[09:47:49.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:143:0) after 9m21s
[09:57:11.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:143:0)
[09:57:11.233] Build status: STARTED
[09:57:11.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:144:0) after 5m56s
[10:03:07.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:144:0)
[10:03:07.349] Build status: STARTED
[10:03:07.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:145:0) after 5m25s
[10:08:33.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:145:0)
[10:08:33.409] Build status: STARTED
[10:08:33.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:146:0) after 5m42s
[10:14:15.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:146:0)
[10:14:15.465] Build status: STARTED
[10:14:15.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:147:0) after 7m29s
[10:21:44.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:147:0)
[10:21:44.530] Build status: STARTED
[10:21:44.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:148:0) after 4m12s
[10:25:56.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:148:0)
[10:25:56.574] Build status: STARTED
[10:25:56.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:149:0) after 5m29s
[10:31:25.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:149:0)
[10:31:25.618] Build status: STARTED
[10:31:25.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:150:0) after 5m28s
[10:36:53.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:150:0)
[10:36:53.656] Build status: STARTED
[10:36:53.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:151:0) after 8m15s
[10:45:08.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:151:0)
[10:45:08.879] Build status: STARTED
[10:45:08.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:152:0) after 8m34s
[10:53:43.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:152:0)
[10:53:43.031] Build status: STARTED
[10:53:43.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:153:0) after 3m53s
[10:57:36.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:153:0)
[10:57:36.087] Build status: STARTED
[10:57:36.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:154:0) after 5m20s
[11:02:56.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:154:0)
[11:02:56.135] Build status: STARTED
[11:02:56.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:155:0) after 3m10s
[11:06:06.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:155:0)
[11:06:06.198] Build status: STARTED
[11:06:06.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:156:0) after 2m10s
[11:08:16.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:156:0)
[11:08:16.249] Build status: STARTED
[11:08:16.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:157:0) after 5m26s
[11:13:42.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:157:0)
[11:13:42.347] Build status: STARTED
[11:13:42.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:158:0) after 2m54s
[11:16:36.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:158:0)
[11:16:36.587] Build status: STARTED
[11:16:36.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:159:0) after 8m4s
[11:24:40.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:159:0)
[11:24:40.753] Build status: STARTED
[11:24:40.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:160:0) after 7m41s
[11:32:22.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:160:0)
[11:32:22.152] Build status: STARTED
[11:32:22.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:161:0) after 3m25s
[11:35:47.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:161:0)
[11:35:47.193] Build status: STARTED
[11:35:47.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:162:0) after 8m47s
[11:44:34.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:162:0)
[11:44:34.469] Build status: STARTED
[11:44:34.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:163:0) after 8m39s
[11:53:13.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:163:0)
[11:53:13.568] Build status: STARTED
[11:53:13.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:164:0) after 3m21s
[11:56:34.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:164:0)
[11:56:34.615] Build status: STARTED
[11:56:34.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:165:0) after 9m26s
[12:06:00.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:165:0)
[12:06:00.669] Build status: STARTED
[12:06:00.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:166:0) after 6m23s
[12:12:23.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:166:0)
[12:12:23.723] Build status: STARTED
[12:12:23.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:167:0) after 8m12s
[12:20:35.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:167:0)
[12:20:35.767] Build status: STARTED
[12:20:35.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:168:0) after 5m16s
[12:25:51.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:168:0)
[12:25:51.993] Build status: STARTED
[12:25:51.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:169:0) after 2m41s
[12:28:33.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:169:0)
[12:28:33.188] Build status: STARTED
[12:28:33.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:170:0) after 6m0s
[12:34:33.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:170:0)
[12:34:33.301] Build status: STARTED
[12:34:33.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:171:0) after 3m30s
[12:38:03.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:171:0)
[12:38:03.449] Build status: STARTED
[12:38:03.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:172:0) after 6m59s
[12:45:02.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:172:0)
[12:45:02.490] Build status: STARTED
[12:45:02.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:173:0) after 6m54s
[12:51:56.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:173:0)
[12:51:56.704] Build status: STARTED
[12:51:56.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:174:0) after 9m20s
[13:01:16.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:174:0)
[13:01:16.752] Build status: STARTED
[13:01:16.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:175:0) after 8m8s
[13:09:25.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:175:0)
[13:09:25.569] Build status: STARTED
[13:09:25.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:176:0) after 8m40s
[13:18:05.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:176:0)
[13:18:05.619] Build status: STARTED
[13:18:05.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:177:0) after 8m14s
[13:26:19.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:177:0)
[13:26:19.666] Build status: STARTED
[13:26:19.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:178:0) after 3m54s
[13:30:14.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:178:0)
[13:30:14.274] Build status: STARTED
[13:30:14.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:179:0) after 1m27s
[13:31:41.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:179:0)
[13:31:41.318] Build status: STARTED
[13:31:41.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:180:0) after 9m8s
[13:40:49.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:180:0)
[13:40:49.370] Build status: STARTED
[13:40:49.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:181:0) after 2m47s
[13:43:36.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:181:0)
[13:43:36.498] Build status: STARTED
[13:43:36.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:182:0) after 6m1s
[13:49:37.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:182:0)
[13:49:37.516] Build status: STARTED
[13:49:37.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:183:0) after 5m44s
[13:55:21.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:183:0)
[13:55:21.554] Build status: STARTED
[13:55:21.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:184:0) after 5m38s
[14:00:59.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:184:0)
[14:01:00.016] Build status: STARTED
[14:01:00.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:185:0) after 6m0s
[14:07:00.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:185:0)
[14:07:00.123] Build status: STARTED
[14:07:00.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:186:0) after 8m29s
[14:15:29.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:186:0)
[14:15:29.702] Build status: STARTED
[14:15:29.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:187:0) after 9m30s
[14:24:59.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:187:0)
[14:24:59.746] Build status: STARTED
[14:24:59.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:188:0) after 5m14s
[14:30:13.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:188:0)
[14:30:13.903] Build status: STARTED
[14:30:13.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:189:0) after 6m12s
[14:36:26.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:189:0)
[14:36:26.370] Build status: STARTED
[14:36:26.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:190:0) after 3m39s
[14:40:05.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:190:0)
[14:40:05.539] Build status: STARTED
[14:40:05.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:191:0) after 6m49s
[14:46:55.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:191:0)
[14:46:55.790] Build status: STARTED
[14:46:55.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:192:0) after 3m29s
[14:50:24.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:192:0)
[14:50:24.843] Build status: STARTED
[14:50:24.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:193:0) after 3m48s
[14:54:12.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:193:0)
[14:54:12.894] Build status: STARTED
[14:54:12.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:194:0) after 1m35s
[14:55:48.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:194:0)
[14:55:48.057] Build status: STARTED
[14:55:48.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:195:0) after 8m9s
[15:03:57.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:195:0)
[15:03:57.315] Build status: STARTED
[15:03:57.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:196:0) after 7m3s
[15:11:00.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:196:0)
[15:11:00.393] Build status: STARTED
[15:11:00.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:197:0) after 2m57s
[15:13:57.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:197:0)
[15:13:57.511] Build status: STARTED
[15:13:57.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:198:0) after 2m36s
[15:16:33.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:198:0)
[15:16:33.557] Build status: STARTED
[15:16:33.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:199:0) after 8m58s
[15:25:31.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:199:0)
[15:25:31.593] Build status: STARTED
[15:25:31.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:200:0) after 7m7s
[15:32:39.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:200:0)
[15:32:39.278] Build status: STARTED
[15:32:39.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:201:0) after 8m0s
[15:40:39.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:201:0)
[15:40:39.641] Build status: STARTED
[15:40:39.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:202:0) after 6m1s
[15:46:41.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:202:0)
[15:46:41.056] Build status: STARTED
[15:46:41.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:203:0) after 3m36s
[15:50:17.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:203:0)
[15:50:17.708] Build status: STARTED
[15:50:17.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:204:0) after 2m7s
[15:52:24.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:204:0)
[15:52:24.757] Build status: STARTED
[15:52:24.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:205:0) after 3m14s
[15:55:38.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:205:0)
[15:55:38.823] Build status: STARTED
[15:55:38.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:206:0) after 2m11s
[15:57:49.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:206:0)
[15:57:49.870] Build status: STARTED
[15:57:49.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:207:0) after 7m10s
[16:05:00.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:207:0)
[16:05:00.062] Build status: STARTED
[16:05:00.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:208:0) after 2m22s
[16:07:22.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:208:0)
[16:07:22.122] Build status: STARTED
[16:07:22.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:209:0) after 6m33s
[16:13:55.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:209:0)
[16:13:55.169] Build status: STARTED
[16:13:55.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:210:0) after 5m23s
[16:19:18.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:210:0)
[16:19:18.338] Build status: STARTED
[16:19:18.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:211:0) after 2m31s
[16:21:49.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:211:0)
[16:21:49.443] Build status: STARTED
[16:21:49.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:212:0) after 9m31s
[16:31:20.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:212:0)
[16:31:20.728] Build status: STARTED
[16:31:20.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:213:0) after 6m11s
[16:37:32.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:213:0)
[16:37:32.093] Build status: STARTED
[16:37:32.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:214:0) after 3m58s
[16:41:31.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:214:0)
[16:41:31.257] Build status: STARTED
[16:41:31.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:215:0) after 4m28s
[16:45:59.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:215:0)
[16:45:59.345] Build status: STARTED
[16:45:59.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:216:0) after 8m16s
[16:54:15.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:216:0)
[16:54:15.408] Build status: STARTED
[16:54:15.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:217:0) after 4m10s
[16:58:25.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:217:0)
[16:58:25.460] Build status: STARTED
[16:58:25.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:218:0) after 9m38s
[17:08:03.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:218:0)
[17:08:03.560] Build status: STARTED
[17:08:03.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8945974932932975488:219:0) after 4m37s
[17:12:35.160] Received PubSub notification, asking Buildbucket for the build status
[17:12:35.176] Build:
{
"id": "8780544870529243729",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28942,
"createdBy": "project:chromium",
"createTime": "2023-05-20T21:08:15.131465343Z",
"startTime": "2023-05-20T21:12:16.191937Z",
"endTime": "2023-05-21T17:12:29.677888329Z",
"updateTime": "2023-05-21T17:12:29.677888329Z",
"status": "CANCELED",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "725267ab6eb26876dd86efec76745bd43b2e8caf",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:12:35.176] Invocation finished in 20h4m21.720212988s with status ABORTED