[14:02:50.116] New invocation is queued and will start shortly
[14:02:51.225] Starting the invocation (attempt 1)
[14:02:51.252] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8e77e725c8360eb85d4bbc9b50137cf9e5d0c449"
[14:02:51.252] Popped gitiles commit info from properties and tags
[14:02:51.252] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:02:51.253] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:02:51.253] Buildbucket request:
{
"requestId": "8918097830456628560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e77e725c8360eb85d4bbc9b50137cf9e5d0c449",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8918097830456628560"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:02:51.991] Scheduled build:
{
"id": "8752667768550087985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30580,
"createdBy": "project:chromium",
"createTime": "2024-03-23T14:02:51.304603263Z",
"updateTime": "2024-03-23T14:02:51.304603263Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e77e725c8360eb85d4bbc9b50137cf9e5d0c449",
"ref": "refs/heads/main"
}
}
}
[14:02:51.991] Task URL: https://cr-buildbucket.appspot.com/build/8752667768550087985
[14:02:51.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:2:0) after 7m0s
[14:02:53.042] Received PubSub notification, asking Buildbucket for the build status
[14:02:53.084] Build status: SCHEDULED
[14:02:58.144] Received PubSub notification, asking Buildbucket for the build status
[14:02:58.174] Build status: STARTED
[14:09:52.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:2:0)
[14:09:52.066] Build status: STARTED
[14:09:52.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:5:0) after 4m44s
[14:14:36.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:5:0)
[14:14:36.152] Build status: STARTED
[14:14:36.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:6:0) after 5m21s
[14:19:57.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:6:0)
[14:19:57.378] Build status: STARTED
[14:19:57.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:7:0) after 2m7s
[14:22:04.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:7:0)
[14:22:04.462] Build status: STARTED
[14:22:04.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:8:0) after 9m27s
[14:31:31.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:8:0)
[14:31:31.693] Build status: STARTED
[14:31:31.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:9:0) after 3m44s
[14:35:15.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:9:0)
[14:35:15.858] Build status: STARTED
[14:35:15.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:10:0) after 1m26s
[14:36:41.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:10:0)
[14:36:41.970] Build status: STARTED
[14:36:41.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:11:0) after 8m46s
[14:45:28.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:11:0)
[14:45:28.201] Build status: STARTED
[14:45:28.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:12:0) after 7m22s
[14:52:50.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:12:0)
[14:52:50.350] Build status: STARTED
[14:52:50.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:13:0) after 6m44s
[14:59:34.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:13:0)
[14:59:34.789] Build status: STARTED
[14:59:34.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:14:0) after 4m12s
[15:03:46.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:14:0)
[15:03:46.907] Build status: STARTED
[15:03:46.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:15:0) after 3m34s
[15:07:20.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:15:0)
[15:07:20.953] Build status: STARTED
[15:07:20.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:16:0) after 5m1s
[15:12:22.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:16:0)
[15:12:22.148] Build status: STARTED
[15:12:22.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:17:0) after 6m7s
[15:18:29.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:17:0)
[15:18:29.339] Build status: STARTED
[15:18:29.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:18:0) after 8m35s
[15:27:04.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:18:0)
[15:27:04.806] Build status: STARTED
[15:27:04.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:19:0) after 7m13s
[15:34:17.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:19:0)
[15:34:17.915] Build status: STARTED
[15:34:17.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:20:0) after 2m7s
[15:36:24.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:20:0)
[15:36:24.980] Build status: STARTED
[15:36:24.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:21:0) after 5m38s
[15:42:03.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:21:0)
[15:42:03.088] Build status: STARTED
[15:42:03.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:22:0) after 2m58s
[15:45:01.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:22:0)
[15:45:01.146] Build status: STARTED
[15:45:01.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:23:0) after 6m42s
[15:51:43.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:23:0)
[15:51:43.191] Build status: STARTED
[15:51:43.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:24:0) after 4m59s
[15:56:42.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:24:0)
[15:56:42.295] Build status: STARTED
[15:56:42.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:25:0) after 5m9s
[16:01:51.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:25:0)
[16:01:51.499] Build status: STARTED
[16:01:51.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:26:0) after 9m4s
[16:10:55.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:26:0)
[16:10:55.608] Build status: STARTED
[16:10:55.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:27:0) after 7m34s
[16:18:29.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:27:0)
[16:18:29.737] Build status: STARTED
[16:18:29.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:28:0) after 9m59s
[16:28:28.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:28:0)
[16:28:28.805] Build status: STARTED
[16:28:28.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:29:0) after 8m53s
[16:37:21.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:29:0)
[16:37:21.948] Build status: STARTED
[16:37:21.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:30:0) after 5m2s
[16:42:24.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:30:0)
[16:42:24.268] Build status: STARTED
[16:42:24.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:31:0) after 6m47s
[16:49:11.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:31:0)
[16:49:11.312] Build status: STARTED
[16:49:11.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:32:0) after 8m59s
[16:58:10.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:32:0)
[16:58:10.385] Build status: STARTED
[16:58:10.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:33:0) after 7m55s
[17:06:05.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:33:0)
[17:06:05.571] Build status: STARTED
[17:06:05.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:34:0) after 1m5s
[17:07:10.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:34:0)
[17:07:10.693] Build status: STARTED
[17:07:10.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:35:0) after 9m45s
[17:16:55.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:35:0)
[17:16:55.784] Build status: STARTED
[17:16:55.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:36:0) after 6m38s
[17:23:33.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:36:0)
[17:23:33.839] Build status: STARTED
[17:23:33.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:37:0) after 7m3s
[17:30:37.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:37:0)
[17:30:37.204] Build status: STARTED
[17:30:37.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:38:0) after 5m10s
[17:35:47.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:38:0)
[17:35:47.505] Build status: STARTED
[17:35:47.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:39:0) after 7m11s
[17:42:58.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:39:0)
[17:42:58.721] Build status: STARTED
[17:42:58.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:40:0) after 7m23s
[17:50:21.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:40:0)
[17:50:21.822] Build status: STARTED
[17:50:21.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:41:0) after 8m13s
[17:58:35.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:41:0)
[17:58:35.144] Build status: STARTED
[17:58:35.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:42:0) after 8m39s
[18:07:14.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:42:0)
[18:07:14.255] Build status: STARTED
[18:07:14.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:43:0) after 2m11s
[18:09:25.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:43:0)
[18:09:25.568] Build status: STARTED
[18:09:25.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:44:0) after 6m59s
[18:16:24.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:44:0)
[18:16:24.899] Build status: STARTED
[18:16:24.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:45:0) after 5m15s
[18:21:39.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:45:0)
[18:21:39.965] Build status: STARTED
[18:21:39.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:46:0) after 8m49s
[18:30:28.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:46:0)
[18:30:29.105] Build status: STARTED
[18:30:29.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:47:0) after 6m53s
[18:37:22.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:47:0)
[18:37:22.176] Build status: STARTED
[18:37:22.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:48:0) after 4m51s
[18:42:13.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:48:0)
[18:42:13.400] Build status: STARTED
[18:42:13.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:49:0) after 7m2s
[18:49:15.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:49:0)
[18:49:15.443] Build status: STARTED
[18:49:15.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:50:0) after 1m47s
[18:51:02.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:50:0)
[18:51:02.607] Build status: STARTED
[18:51:02.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:51:0) after 5m12s
[18:56:14.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:51:0)
[18:56:14.660] Build status: STARTED
[18:56:14.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:52:0) after 1m2s
[18:57:16.752] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:52:0)
[18:57:16.831] Build status: STARTED
[18:57:16.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:53:0) after 6m41s
[19:03:57.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:53:0)
[19:03:57.980] Build status: STARTED
[19:03:57.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:54:0) after 9m42s
[19:13:40.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:54:0)
[19:13:40.215] Build status: STARTED
[19:13:40.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:55:0) after 6m33s
[19:20:13.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:55:0)
[19:20:13.279] Build status: STARTED
[19:20:13.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:56:0) after 7m42s
[19:27:55.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:56:0)
[19:27:55.338] Build status: STARTED
[19:27:55.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:57:0) after 7m33s
[19:35:28.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:57:0)
[19:35:28.951] Build status: STARTED
[19:35:28.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:58:0) after 1m59s
[19:37:28.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:58:0)
[19:37:28.039] Build status: STARTED
[19:37:28.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:59:0) after 2m48s
[19:40:16.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:59:0)
[19:40:16.200] Build status: STARTED
[19:40:16.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:60:0) after 1m27s
[19:41:43.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:60:0)
[19:41:43.367] Build status: STARTED
[19:41:43.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:61:0) after 8m50s
[19:50:33.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:61:0)
[19:50:33.551] Build status: STARTED
[19:50:33.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:62:0) after 1m13s
[19:51:46.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:62:0)
[19:51:46.602] Build status: STARTED
[19:51:46.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:63:0) after 5m58s
[19:57:44.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:63:0)
[19:57:44.881] Build status: STARTED
[19:57:44.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:64:0) after 2m20s
[20:00:04.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:64:0)
[20:00:04.957] Build status: STARTED
[20:00:04.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:65:0) after 2m30s
[20:02:35.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:65:0)
[20:02:35.102] Build status: STARTED
[20:02:35.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:66:0) after 4m42s
[20:07:17.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:66:0)
[20:07:17.150] Build status: STARTED
[20:07:17.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:67:0) after 6m4s
[20:13:21.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:67:0)
[20:13:21.217] Build status: STARTED
[20:13:21.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:68:0) after 4m59s
[20:18:20.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:68:0)
[20:18:20.543] Build status: STARTED
[20:18:20.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:69:0) after 8m14s
[20:26:34.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:69:0)
[20:26:34.746] Build status: STARTED
[20:26:34.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:70:0) after 5m58s
[20:32:32.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:70:0)
[20:32:32.844] Build status: STARTED
[20:32:32.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:71:0) after 7m7s
[20:39:39.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:71:0)
[20:39:39.958] Build status: STARTED
[20:39:39.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:72:0) after 8m31s
[20:48:11.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:72:0)
[20:48:11.118] Build status: STARTED
[20:48:11.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:73:0) after 2m42s
[20:50:53.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:73:0)
[20:50:53.266] Build status: STARTED
[20:50:53.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:74:0) after 6m47s
[20:57:40.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:74:0)
[20:57:40.373] Build status: STARTED
[20:57:40.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:75:0) after 9m2s
[21:06:42.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:75:0)
[21:06:42.586] Build status: STARTED
[21:06:42.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:76:0) after 3m30s
[21:10:12.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:76:0)
[21:10:12.702] Build status: STARTED
[21:10:12.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:77:0) after 6m47s
[21:16:59.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:77:0)
[21:16:59.935] Build status: STARTED
[21:16:59.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:78:0) after 9m21s
[21:26:21.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:78:0)
[21:26:21.076] Build status: STARTED
[21:26:21.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:79:0) after 1m22s
[21:27:43.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:79:0)
[21:27:43.139] Build status: STARTED
[21:27:43.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:80:0) after 1m47s
[21:29:30.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:80:0)
[21:29:30.222] Build status: STARTED
[21:29:30.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:81:0) after 3m46s
[21:33:16.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:81:0)
[21:33:16.466] Build status: STARTED
[21:33:16.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:82:0) after 4m0s
[21:37:16.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:82:0)
[21:37:16.488] Build status: STARTED
[21:37:16.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:83:0) after 5m35s
[21:42:51.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:83:0)
[21:42:51.764] Build status: STARTED
[21:42:51.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:84:0) after 4m6s
[21:46:57.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:84:0)
[21:46:57.856] Build status: STARTED
[21:46:57.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:85:0) after 4m34s
[21:51:31.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:85:0)
[21:51:32.056] Build status: STARTED
[21:51:32.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:86:0) after 8m16s
[21:59:48.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:86:0)
[21:59:48.180] Build status: STARTED
[21:59:48.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:87:0) after 8m36s
[22:08:24.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:87:0)
[22:08:24.230] Build status: STARTED
[22:08:24.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:88:0) after 4m2s
[22:12:26.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:88:0)
[22:12:26.373] Build status: STARTED
[22:12:26.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:89:0) after 1m19s
[22:13:45.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:89:0)
[22:13:45.425] Build status: STARTED
[22:13:45.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:90:0) after 5m15s
[22:19:00.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:90:0)
[22:19:00.478] Build status: STARTED
[22:19:00.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:91:0) after 2m57s
[22:21:57.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:91:0)
[22:21:57.602] Build status: STARTED
[22:21:57.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:92:0) after 4m50s
[22:26:47.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:92:0)
[22:26:47.616] Build status: STARTED
[22:26:47.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:93:0) after 9m34s
[22:36:21.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:93:0)
[22:36:21.695] Build status: STARTED
[22:36:21.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:94:0) after 2m10s
[22:38:31.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:94:0)
[22:38:31.750] Build status: STARTED
[22:38:31.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:95:0) after 7m52s
[22:46:23.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:95:0)
[22:46:23.892] Build status: STARTED
[22:46:23.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:96:0) after 9m49s
[22:56:12.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:96:0)
[22:56:12.945] Build status: STARTED
[22:56:12.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:97:0) after 3m25s
[22:59:38.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:97:0)
[22:59:38.082] Build status: STARTED
[22:59:38.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:98:0) after 1m6s
[23:00:44.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:98:0)
[23:00:44.206] Build status: STARTED
[23:00:44.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:99:0) after 4m53s
[23:05:37.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:99:0)
[23:05:37.671] Build status: STARTED
[23:05:37.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:100:0) after 9m24s
[23:15:02.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:100:0)
[23:15:02.444] Build status: STARTED
[23:15:02.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:101:0) after 3m15s
[23:18:17.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:101:0)
[23:18:17.673] Build status: STARTED
[23:18:17.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:102:0) after 6m32s
[23:24:50.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:102:0)
[23:24:50.166] Build status: STARTED
[23:24:50.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:103:0) after 1m58s
[23:26:48.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:103:0)
[23:26:48.231] Build status: STARTED
[23:26:48.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:104:0) after 3m26s
[23:30:14.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:104:0)
[23:30:14.440] Build status: STARTED
[23:30:14.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:105:0) after 4m6s
[23:34:20.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:105:0)
[23:34:20.589] Build status: STARTED
[23:34:20.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:106:0) after 2m49s
[23:37:09.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:106:0)
[23:37:09.652] Build status: STARTED
[23:37:09.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:107:0) after 5m0s
[23:42:09.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:107:0)
[23:42:09.814] Build status: STARTED
[23:42:09.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:108:0) after 3m37s
[23:45:46.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:108:0)
[23:45:46.921] Build status: STARTED
[23:45:46.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:109:0) after 5m13s
[23:51:00.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:109:0)
[23:51:00.613] Build status: STARTED
[23:51:00.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:110:0) after 8m22s
[23:59:22.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:110:0)
[23:59:22.727] Build status: STARTED
[23:59:22.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:111:0) after 6m48s
[00:06:10.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:111:0)
[00:06:10.899] Build status: STARTED
[00:06:10.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:112:0) after 9m57s
[00:16:07.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:112:0)
[00:16:08.025] Build status: STARTED
[00:16:08.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:113:0) after 8m56s
[00:25:04.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:113:0)
[00:25:04.195] Build status: STARTED
[00:25:04.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:114:0) after 2m8s
[00:27:12.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:114:0)
[00:27:12.411] Build status: STARTED
[00:27:12.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:115:0) after 5m16s
[00:32:28.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:115:0)
[00:32:28.536] Build status: STARTED
[00:32:28.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:116:0) after 2m59s
[00:35:27.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:116:0)
[00:35:27.645] Build status: STARTED
[00:35:27.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:117:0) after 3m58s
[00:39:25.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:117:0)
[00:39:25.813] Build status: STARTED
[00:39:25.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:118:0) after 6m41s
[00:46:06.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:118:0)
[00:46:06.878] Build status: STARTED
[00:46:06.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:119:0) after 2m6s
[00:48:12.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:119:0)
[00:48:12.983] Build status: STARTED
[00:48:12.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:120:0) after 1m3s
[00:49:16.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:120:0)
[00:49:16.034] Build status: STARTED
[00:49:16.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:121:0) after 5m27s
[00:54:43.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:121:0)
[00:54:43.956] Build status: STARTED
[00:54:43.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:122:0) after 5m41s
[01:00:25.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:122:0)
[01:00:25.073] Build status: STARTED
[01:00:25.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:123:0) after 7m35s
[01:08:00.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:123:0)
[01:08:00.250] Build status: STARTED
[01:08:00.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:124:0) after 8m49s
[01:16:49.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:124:0)
[01:16:49.302] Build status: STARTED
[01:16:49.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:125:0) after 1m27s
[01:18:16.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:125:0)
[01:18:17.031] Build status: STARTED
[01:18:17.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:126:0) after 3m31s
[01:21:48.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:126:0)
[01:21:48.213] Build status: STARTED
[01:21:48.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:127:0) after 3m29s
[01:25:17.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:127:0)
[01:25:17.391] Build status: STARTED
[01:25:17.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:128:0) after 3m40s
[01:28:57.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:128:0)
[01:28:57.636] Build status: STARTED
[01:28:57.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:129:0) after 1m37s
[01:30:34.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:129:0)
[01:30:34.849] Build status: STARTED
[01:30:34.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:130:0) after 5m50s
[01:36:25.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:130:0)
[01:36:25.486] Build status: STARTED
[01:36:25.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:131:0) after 8m22s
[01:44:47.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:131:0)
[01:44:47.608] Build status: STARTED
[01:44:47.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:132:0) after 2m53s
[01:47:40.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:132:0)
[01:47:40.732] Build status: STARTED
[01:47:40.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:133:0) after 8m13s
[01:55:53.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:133:0)
[01:55:53.931] Build status: STARTED
[01:55:53.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:134:0) after 4m15s
[02:00:09.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:134:0)
[02:00:09.107] Build status: STARTED
[02:00:09.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:135:0) after 4m24s
[02:04:33.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:135:0)
[02:04:33.126] Build status: STARTED
[02:04:33.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:136:0) after 3m0s
[02:07:33.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:136:0)
[02:07:33.179] Build status: STARTED
[02:07:33.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:137:0) after 6m2s
[02:13:35.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:137:0)
[02:13:35.348] Build status: STARTED
[02:13:35.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:138:0) after 5m57s
[02:19:32.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:138:0)
[02:19:32.470] Build status: STARTED
[02:19:32.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:139:0) after 2m44s
[02:22:16.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:139:0)
[02:22:16.665] Build status: STARTED
[02:22:16.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:140:0) after 9m13s
[02:31:30.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:140:0)
[02:31:30.087] Build status: STARTED
[02:31:30.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:141:0) after 2m31s
[02:34:01.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:141:0)
[02:34:01.145] Build status: STARTED
[02:34:01.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:142:0) after 7m5s
[02:41:06.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:142:0)
[02:41:06.177] Build status: STARTED
[02:41:06.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:143:0) after 9m12s
[02:50:18.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:143:0)
[02:50:18.239] Build status: STARTED
[02:50:18.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:144:0) after 3m35s
[02:53:53.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:144:0)
[02:53:53.284] Build status: STARTED
[02:53:53.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:145:0) after 4m19s
[02:58:12.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:145:0)
[02:58:12.330] Build status: STARTED
[02:58:12.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:146:0) after 6m27s
[03:04:39.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:146:0)
[03:04:39.471] Build status: STARTED
[03:04:39.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:147:0) after 7m45s
[03:12:24.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:147:0)
[03:12:24.557] Build status: STARTED
[03:12:24.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:148:0) after 2m42s
[03:15:06.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:148:0)
[03:15:06.656] Build status: STARTED
[03:15:06.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:149:0) after 9m29s
[03:24:35.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:149:0)
[03:24:35.709] Build status: STARTED
[03:24:35.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:150:0) after 3m49s
[03:28:24.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:150:0)
[03:28:24.806] Build status: STARTED
[03:28:24.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:151:0) after 9m28s
[03:37:52.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:151:0)
[03:37:52.873] Build status: STARTED
[03:37:52.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:152:0) after 1m38s
[03:39:30.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:152:0)
[03:39:31.184] Build status: STARTED
[03:39:31.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:153:0) after 8m9s
[03:47:40.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:153:0)
[03:47:40.302] Build status: STARTED
[03:47:40.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:154:0) after 2m15s
[03:49:55.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:154:0)
[03:49:55.346] Build status: STARTED
[03:49:55.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:155:0) after 3m21s
[03:53:16.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:155:0)
[03:53:16.396] Build status: STARTED
[03:53:16.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:156:0) after 7m53s
[04:01:09.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:156:0)
[04:01:09.469] Build status: STARTED
[04:01:09.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:157:0) after 1m24s
[04:02:33.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:157:0)
[04:02:33.521] Build status: STARTED
[04:02:33.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:158:0) after 8m21s
[04:10:54.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:158:0)
[04:10:54.570] Build status: STARTED
[04:10:54.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:159:0) after 7m9s
[04:18:04.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:159:0)
[04:18:04.609] Build status: STARTED
[04:18:04.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:160:0) after 6m18s
[04:24:22.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:160:0)
[04:24:22.773] Build status: STARTED
[04:24:22.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:161:0) after 4m12s
[04:28:35.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:161:0)
[04:28:35.599] Build status: STARTED
[04:28:35.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:162:0) after 2m22s
[04:30:57.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:162:0)
[04:30:57.786] Build status: STARTED
[04:30:57.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:163:0) after 2m33s
[04:33:30.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:163:0)
[04:33:30.978] Build status: STARTED
[04:33:30.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:164:0) after 1m3s
[04:34:34.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:164:0)
[04:34:34.167] Build status: STARTED
[04:34:34.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:165:0) after 3m45s
[04:38:19.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:165:0)
[04:38:19.545] Build status: STARTED
[04:38:19.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:166:0) after 3m57s
[04:42:16.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:166:0)
[04:42:16.918] Build status: STARTED
[04:42:16.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:167:0) after 6m31s
[04:48:48.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:167:0)
[04:48:48.189] Build status: STARTED
[04:48:48.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:168:0) after 5m24s
[04:54:12.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:168:0)
[04:54:12.269] Build status: STARTED
[04:54:12.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:169:0) after 5m0s
[04:59:12.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:169:0)
[04:59:12.346] Build status: STARTED
[04:59:12.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:170:0) after 9m11s
[05:08:23.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:170:0)
[05:08:23.491] Build status: STARTED
[05:08:23.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:171:0) after 2m59s
[05:11:22.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:171:0)
[05:11:22.637] Build status: STARTED
[05:11:22.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:172:0) after 4m27s
[05:15:49.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:172:0)
[05:15:49.729] Build status: STARTED
[05:15:49.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:173:0) after 8m55s
[05:24:44.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:173:0)
[05:24:44.909] Build status: STARTED
[05:24:44.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:174:0) after 3m3s
[05:27:47.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:174:0)
[05:27:47.960] Build status: STARTED
[05:27:47.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:175:0) after 2m16s
[05:30:04.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:175:0)
[05:30:04.119] Build status: STARTED
[05:30:04.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:176:0) after 7m22s
[05:37:26.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:176:0)
[05:37:26.260] Build status: STARTED
[05:37:26.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:177:0) after 5m35s
[05:43:01.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:177:0)
[05:43:01.357] Build status: STARTED
[05:43:01.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:178:0) after 4m51s
[05:47:52.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:178:0)
[05:47:52.577] Build status: STARTED
[05:47:52.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:179:0) after 8m47s
[05:56:39.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:179:0)
[05:56:39.722] Build status: STARTED
[05:56:39.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:180:0) after 5m34s
[06:02:13.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:180:0)
[06:02:13.797] Build status: STARTED
[06:02:13.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:181:0) after 8m9s
[06:10:22.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:181:0)
[06:10:22.884] Build status: STARTED
[06:10:22.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:182:0) after 5m41s
[06:16:04.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:182:0)
[06:16:04.152] Build status: STARTED
[06:16:04.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:183:0) after 9m59s
[06:26:03.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:183:0)
[06:26:03.218] Build status: STARTED
[06:26:03.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:184:0) after 7m41s
[06:33:44.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:184:0)
[06:33:44.637] Build status: STARTED
[06:33:44.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:185:0) after 8m46s
[06:42:30.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:185:0)
[06:42:30.707] Build status: STARTED
[06:42:30.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:186:0) after 1m36s
[06:44:06.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:186:0)
[06:44:06.803] Build status: STARTED
[06:44:06.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:187:0) after 4m18s
[06:48:25.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:187:0)
[06:48:25.087] Build status: STARTED
[06:48:25.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:188:0) after 5m34s
[06:53:59.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:188:0)
[06:53:59.187] Build status: STARTED
[06:53:59.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:189:0) after 4m56s
[06:58:55.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:189:0)
[06:58:55.348] Build status: STARTED
[06:58:55.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:190:0) after 9m49s
[07:08:44.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:190:0)
[07:08:44.566] Build status: STARTED
[07:08:44.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:191:0) after 9m4s
[07:17:48.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:191:0)
[07:17:48.680] Build status: STARTED
[07:17:48.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:192:0) after 9m46s
[07:27:34.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:192:0)
[07:27:34.764] Build status: STARTED
[07:27:34.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:193:0) after 9m12s
[07:36:46.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:193:0)
[07:36:46.848] Build status: STARTED
[07:36:46.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:194:0) after 2m53s
[07:39:40.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:194:0)
[07:39:40.105] Build status: STARTED
[07:39:40.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:195:0) after 8m22s
[07:48:02.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:195:0)
[07:48:02.681] Build status: STARTED
[07:48:02.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:196:0) after 6m42s
[07:54:44.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:196:0)
[07:54:44.739] Build status: STARTED
[07:54:44.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:197:0) after 4m34s
[07:59:18.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:197:0)
[07:59:18.851] Build status: STARTED
[07:59:18.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:198:0) after 2m17s
[08:01:36.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:198:0)
[08:01:36.074] Build status: STARTED
[08:01:36.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:199:0) after 3m23s
[08:04:59.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:199:0)
[08:04:59.200] Build status: STARTED
[08:04:59.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:200:0) after 2m4s
[08:07:03.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:200:0)
[08:07:03.400] Build status: STARTED
[08:07:03.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:201:0) after 5m46s
[08:12:49.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:201:0)
[08:12:49.451] Build status: STARTED
[08:12:49.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:202:0) after 2m2s
[08:14:51.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:202:0)
[08:14:51.583] Build status: STARTED
[08:14:51.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:203:0) after 2m42s
[08:17:33.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:203:0)
[08:17:33.739] Build status: STARTED
[08:17:33.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:204:0) after 7m33s
[08:25:06.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:204:0)
[08:25:07.020] Build status: STARTED
[08:25:07.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:205:0) after 6m8s
[08:31:15.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:205:0)
[08:31:15.271] Build status: STARTED
[08:31:15.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:206:0) after 2m9s
[08:33:24.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:206:0)
[08:33:24.324] Build status: STARTED
[08:33:24.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:207:0) after 7m42s
[08:41:06.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:207:0)
[08:41:06.568] Build status: STARTED
[08:41:06.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:208:0) after 7m9s
[08:48:15.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:208:0)
[08:48:15.632] Build status: STARTED
[08:48:15.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:209:0) after 7m58s
[08:56:13.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:209:0)
[08:56:13.768] Build status: STARTED
[08:56:13.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:210:0) after 7m37s
[09:03:50.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:210:0)
[09:03:50.908] Build status: STARTED
[09:03:50.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:211:0) after 4m25s
[09:08:15.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:211:0)
[09:08:15.962] Build status: STARTED
[09:08:15.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:212:0) after 1m1s
[09:09:16.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:212:0)
[09:09:17.019] Build status: STARTED
[09:09:17.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:213:0) after 8m23s
[09:17:40.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:213:0)
[09:17:40.230] Build status: STARTED
[09:17:40.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:214:0) after 7m32s
[09:25:12.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:214:0)
[09:25:12.618] Build status: STARTED
[09:25:12.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:215:0) after 3m2s
[09:28:14.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:215:0)
[09:28:14.920] Build status: STARTED
[09:28:14.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:216:0) after 7m50s
[09:36:04.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:216:0)
[09:36:04.968] Build status: STARTED
[09:36:04.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:217:0) after 7m3s
[09:43:08.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:217:0)
[09:43:08.036] Build status: STARTED
[09:43:08.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:218:0) after 4m19s
[09:47:27.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:218:0)
[09:47:27.293] Build status: STARTED
[09:47:27.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:219:0) after 6m46s
[09:54:13.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:219:0)
[09:54:13.321] Build status: STARTED
[09:54:13.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:220:0) after 1m32s
[09:55:45.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:220:0)
[09:55:45.385] Build status: STARTED
[09:55:45.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:221:0) after 2m31s
[09:58:16.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:221:0)
[09:58:16.431] Build status: STARTED
[09:58:16.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:222:0) after 6m45s
[10:05:01.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:222:0)
[10:05:01.575] Build status: STARTED
[10:05:01.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918097830456628560:223:0) after 5m11s
[10:06:23.471] Received PubSub notification, asking Buildbucket for the build status
[10:06:23.526] Build:
{
"id": "8752667768550087985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30580,
"createdBy": "project:chromium",
"createTime": "2024-03-23T14:02:51.304603263Z",
"startTime": "2024-03-23T14:02:57.300910248Z",
"endTime": "2024-03-24T10:06:22.637881Z",
"updateTime": "2024-03-24T10:06:22.637881Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e77e725c8360eb85d4bbc9b50137cf9e5d0c449",
"ref": "refs/heads/main"
}
}
}
[10:06:23.526] Invocation finished in 20h3m33.422830692s with status FAILED