[09:51:00.685] New invocation is queued and will start shortly
[09:51:01.774] Starting the invocation (attempt 1)
[09:51:01.809] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/505125afd3350a9d3d056247b585b4cea0f32d8c"
[09:51:01.809] Popped gitiles commit info from properties and tags
[09:51:01.809] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:51:01.809] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:51:01.809] Buildbucket request:
{
"requestId": "8960331860187372448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "505125afd3350a9d3d056247b585b4cea0f32d8c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8960331860187372448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:51:02.239] Scheduled build:
{
"id": "8794901798266377329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28501,
"createdBy": "project:chromium",
"createTime": "2022-12-13T09:51:01.886038964Z",
"updateTime": "2022-12-13T09:51:01.886038964Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "505125afd3350a9d3d056247b585b4cea0f32d8c",
"ref": "refs/heads/main"
}
}
}
[09:51:02.239] Task URL: https://cr-buildbucket.appspot.com/build/8794901798266377329
[09:51:02.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:2:0) after 2m23s
[09:53:25.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:2:0)
[09:53:25.287] Build status: SCHEDULED
[09:53:25.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:3:0) after 5m14s
[09:56:27.059] Received PubSub notification, asking Buildbucket for the build status
[09:56:27.099] Build status: STARTED
[09:58:39.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:3:0)
[09:58:39.350] Build status: STARTED
[09:58:39.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:5:0) after 6m9s
[10:04:48.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:5:0)
[10:04:48.558] Build status: STARTED
[10:04:48.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:6:0) after 6m32s
[10:11:20.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:6:0)
[10:11:20.691] Build status: STARTED
[10:11:20.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:7:0) after 9m50s
[10:21:10.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:7:0)
[10:21:10.811] Build status: STARTED
[10:21:10.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:8:0) after 1m0s
[10:22:10.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:8:0)
[10:22:11.011] Build status: STARTED
[10:22:11.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:9:0) after 6m28s
[10:28:39.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:9:0)
[10:28:39.587] Build status: STARTED
[10:28:39.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:10:0) after 8m38s
[10:37:17.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:10:0)
[10:37:17.828] Build status: STARTED
[10:37:17.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:11:0) after 7m28s
[10:44:46.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:11:0)
[10:44:46.155] Build status: STARTED
[10:44:46.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:12:0) after 1m38s
[10:46:24.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:12:0)
[10:46:24.259] Build status: STARTED
[10:46:24.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:13:0) after 3m41s
[10:50:05.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:13:0)
[10:50:05.418] Build status: STARTED
[10:50:05.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:14:0) after 3m48s
[10:53:53.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:14:0)
[10:53:54.088] Build status: STARTED
[10:53:54.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:15:0) after 1m47s
[10:55:41.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:15:0)
[10:55:41.218] Build status: STARTED
[10:55:41.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:16:0) after 2m38s
[10:58:19.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:16:0)
[10:58:19.280] Build status: STARTED
[10:58:19.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:17:0) after 1m39s
[10:59:58.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:17:0)
[10:59:58.460] Build status: STARTED
[10:59:58.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:18:0) after 7m15s
[11:07:13.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:18:0)
[11:07:13.693] Build status: STARTED
[11:07:13.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:19:0) after 2m28s
[11:09:41.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:19:0)
[11:09:41.746] Build status: STARTED
[11:09:41.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:20:0) after 4m25s
[11:14:06.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:20:0)
[11:14:06.908] Build status: STARTED
[11:14:06.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:21:0) after 4m39s
[11:18:46.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:21:0)
[11:18:46.029] Build status: STARTED
[11:18:46.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:22:0) after 7m6s
[11:25:52.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:22:0)
[11:25:52.110] Build status: STARTED
[11:25:52.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:23:0) after 6m20s
[11:32:12.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:23:0)
[11:32:12.399] Build status: STARTED
[11:32:12.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:24:0) after 7m46s
[11:39:58.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:24:0)
[11:39:58.480] Build status: STARTED
[11:39:58.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:25:0) after 5m9s
[11:45:07.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:25:0)
[11:45:07.541] Build status: STARTED
[11:45:07.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:26:0) after 2m10s
[11:47:17.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:26:0)
[11:47:17.871] Build status: STARTED
[11:47:17.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:27:0) after 9m46s
[11:57:04.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:27:0)
[11:57:04.072] Build status: STARTED
[11:57:04.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:28:0) after 1m23s
[11:58:27.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:28:0)
[11:58:27.293] Build status: STARTED
[11:58:27.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:29:0) after 8m2s
[12:06:29.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:29:0)
[12:06:29.418] Build status: STARTED
[12:06:29.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:30:0) after 1m23s
[12:07:52.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:30:0)
[12:07:52.479] Build status: STARTED
[12:07:52.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:31:0) after 7m46s
[12:15:38.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:31:0)
[12:15:38.642] Build status: STARTED
[12:15:38.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:32:0) after 8m3s
[12:23:41.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:32:0)
[12:23:41.723] Build status: STARTED
[12:23:41.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:33:0) after 2m37s
[12:26:18.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:33:0)
[12:26:19.015] Build status: STARTED
[12:26:19.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:34:0) after 1m48s
[12:28:07.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:34:0)
[12:28:07.238] Build status: STARTED
[12:28:07.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:35:0) after 6m0s
[12:34:07.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:35:0)
[12:34:07.318] Build status: STARTED
[12:34:07.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:36:0) after 2m19s
[12:36:26.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:36:0)
[12:36:26.529] Build status: STARTED
[12:36:26.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:37:0) after 3m5s
[12:39:31.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:37:0)
[12:39:31.591] Build status: STARTED
[12:39:31.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:38:0) after 5m6s
[12:44:37.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:38:0)
[12:44:37.643] Build status: STARTED
[12:44:37.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:39:0) after 1m19s
[12:45:56.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:39:0)
[12:45:57.014] Build status: STARTED
[12:45:57.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:40:0) after 3m39s
[12:49:36.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:40:0)
[12:49:36.041] Build status: STARTED
[12:49:36.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:41:0) after 2m54s
[12:52:30.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:41:0)
[12:52:30.096] Build status: STARTED
[12:52:30.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:42:0) after 4m58s
[12:57:28.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:42:0)
[12:57:28.208] Build status: STARTED
[12:57:28.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:43:0) after 5m30s
[13:02:58.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:43:0)
[13:02:58.300] Build status: STARTED
[13:02:58.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:44:0) after 4m51s
[13:07:49.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:44:0)
[13:07:49.425] Build status: STARTED
[13:07:49.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:45:0) after 1m25s
[13:09:14.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:45:0)
[13:09:14.870] Build status: STARTED
[13:09:14.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:46:0) after 1m39s
[13:10:54.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:46:0)
[13:10:54.192] Build status: STARTED
[13:10:54.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:47:0) after 8m26s
[13:19:20.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:47:0)
[13:19:20.395] Build status: STARTED
[13:19:20.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:48:0) after 5m29s
[13:24:49.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:48:0)
[13:24:49.951] Build status: STARTED
[13:24:49.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:49:0) after 3m31s
[13:28:21.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:49:0)
[13:28:21.154] Build status: STARTED
[13:28:21.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:50:0) after 8m11s
[13:36:32.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:50:0)
[13:36:33.668] Build status: STARTED
[13:36:33.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:51:0) after 5m8s
[13:41:41.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:51:0)
[13:41:41.704] Build status: STARTED
[13:41:41.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:52:0) after 1m42s
[13:43:23.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:52:0)
[13:43:23.737] Build status: STARTED
[13:43:23.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:53:0) after 3m30s
[13:46:53.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:53:0)
[13:46:53.792] Build status: STARTED
[13:46:53.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:54:0) after 6m45s
[13:53:39.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:54:0)
[13:53:39.101] Build status: STARTED
[13:53:39.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:55:0) after 7m45s
[14:01:24.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:55:0)
[14:01:24.260] Build status: STARTED
[14:01:24.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:56:0) after 7m36s
[14:09:00.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:56:0)
[14:09:00.377] Build status: STARTED
[14:09:00.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:57:0) after 4m6s
[14:13:06.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:57:0)
[14:13:06.446] Build status: STARTED
[14:13:06.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:58:0) after 9m50s
[14:22:56.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:58:0)
[14:22:56.607] Build status: STARTED
[14:22:56.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:59:0) after 8m55s
[14:31:51.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:59:0)
[14:31:51.828] Build status: STARTED
[14:31:51.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:60:0) after 2m14s
[14:34:05.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:60:0)
[14:34:05.882] Build status: STARTED
[14:34:05.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:61:0) after 8m39s
[14:42:45.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:61:0)
[14:42:45.461] Build status: STARTED
[14:42:45.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:62:0) after 1m10s
[14:43:55.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:62:0)
[14:43:55.857] Build status: STARTED
[14:43:55.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:63:0) after 7m55s
[14:51:51.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:63:0)
[14:51:51.130] Build status: STARTED
[14:51:51.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:64:0) after 6m59s
[14:58:50.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:64:0)
[14:58:50.256] Build status: STARTED
[14:58:50.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:65:0) after 3m31s
[15:02:21.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:65:0)
[15:02:21.310] Build status: STARTED
[15:02:21.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:66:0) after 9m26s
[15:11:47.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:66:0)
[15:11:47.369] Build status: STARTED
[15:11:47.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:67:0) after 6m37s
[15:18:24.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:67:0)
[15:18:24.834] Build status: STARTED
[15:18:24.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:68:0) after 7m54s
[15:26:18.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:68:0)
[15:26:18.885] Build status: STARTED
[15:26:18.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:69:0) after 9m46s
[15:36:04.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:69:0)
[15:36:04.976] Build status: STARTED
[15:36:04.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:70:0) after 4m24s
[15:40:29.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:70:0)
[15:40:29.193] Build status: STARTED
[15:40:29.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:71:0) after 8m53s
[15:49:22.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:71:0)
[15:49:22.213] Build status: STARTED
[15:49:22.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:72:0) after 1m54s
[15:51:16.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:72:0)
[15:51:16.252] Build status: STARTED
[15:51:16.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:73:0) after 1m19s
[15:52:35.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:73:0)
[15:52:35.310] Build status: STARTED
[15:52:35.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:74:0) after 5m18s
[15:57:53.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:74:0)
[15:57:53.628] Build status: STARTED
[15:57:53.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:75:0) after 9m49s
[16:07:42.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:75:0)
[16:07:42.716] Build status: STARTED
[16:07:42.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:76:0) after 2m50s
[16:10:32.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:76:0)
[16:10:32.778] Build status: STARTED
[16:10:32.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:77:0) after 9m7s
[16:19:39.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:77:0)
[16:19:39.826] Build status: STARTED
[16:19:39.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:78:0) after 6m17s
[16:25:56.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:78:0)
[16:25:56.989] Build status: STARTED
[16:25:56.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:79:0) after 7m8s
[16:33:05.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:79:0)
[16:33:05.050] Build status: STARTED
[16:33:05.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:80:0) after 2m24s
[16:35:29.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:80:0)
[16:35:29.105] Build status: STARTED
[16:35:29.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:81:0) after 3m13s
[16:38:42.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:81:0)
[16:38:42.256] Build status: STARTED
[16:38:42.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:82:0) after 7m52s
[16:46:34.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:82:0)
[16:46:34.305] Build status: STARTED
[16:46:34.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:83:0) after 1m39s
[16:48:13.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:83:0)
[16:48:13.713] Build status: STARTED
[16:48:13.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:84:0) after 4m42s
[16:52:55.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:84:0)
[16:52:55.910] Build status: STARTED
[16:52:55.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:85:0) after 7m43s
[17:00:39.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:85:0)
[17:00:39.041] Build status: STARTED
[17:00:39.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:86:0) after 9m57s
[17:10:36.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:86:0)
[17:10:36.323] Build status: STARTED
[17:10:36.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:87:0) after 8m41s
[17:19:17.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:87:0)
[17:19:17.691] Build status: STARTED
[17:19:17.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:88:0) after 6m14s
[17:25:31.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:88:0)
[17:25:31.765] Build status: STARTED
[17:25:31.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:89:0) after 1m36s
[17:27:07.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:89:0)
[17:27:07.896] Build status: STARTED
[17:27:07.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:90:0) after 5m48s
[17:32:56.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:90:0)
[17:32:56.048] Build status: STARTED
[17:32:56.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:91:0) after 6m12s
[17:39:08.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:91:0)
[17:39:08.198] Build status: STARTED
[17:39:08.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:92:0) after 5m47s
[17:44:55.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:92:0)
[17:44:55.310] Build status: STARTED
[17:44:55.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:93:0) after 1m24s
[17:46:19.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:93:0)
[17:46:19.328] Build status: STARTED
[17:46:19.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:94:0) after 3m55s
[17:50:14.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:94:0)
[17:50:14.421] Build status: STARTED
[17:50:14.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:95:0) after 6m57s
[17:57:12.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:95:0)
[17:57:12.109] Build status: STARTED
[17:57:12.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:96:0) after 6m5s
[18:03:17.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:96:0)
[18:03:17.413] Build status: STARTED
[18:03:17.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:97:0) after 1m32s
[18:04:49.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:97:0)
[18:04:49.471] Build status: STARTED
[18:04:49.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:98:0) after 6m38s
[18:11:27.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:98:0)
[18:11:27.544] Build status: STARTED
[18:11:27.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:99:0) after 4m41s
[18:16:08.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:99:0)
[18:16:08.594] Build status: STARTED
[18:16:08.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:100:0) after 1m28s
[18:17:37.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:100:0)
[18:17:37.376] Build status: STARTED
[18:17:37.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:101:0) after 1m3s
[18:18:41.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:101:0)
[18:18:41.621] Build status: STARTED
[18:18:41.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:102:0) after 4m22s
[18:23:03.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:102:0)
[18:23:03.788] Build status: STARTED
[18:23:03.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:103:0) after 2m29s
[18:25:32.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:103:0)
[18:25:32.854] Build status: STARTED
[18:25:32.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:104:0) after 8m32s
[18:34:04.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:104:0)
[18:34:04.950] Build status: STARTED
[18:34:04.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:105:0) after 2m27s
[18:36:32.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:105:0)
[18:36:32.072] Build status: STARTED
[18:36:32.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:106:0) after 1m8s
[18:37:40.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:106:0)
[18:37:40.144] Build status: STARTED
[18:37:40.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:107:0) after 4m59s
[18:42:39.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:107:0)
[18:42:39.212] Build status: STARTED
[18:42:39.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:108:0) after 8m35s
[18:51:14.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:108:0)
[18:51:14.269] Build status: STARTED
[18:51:14.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:109:0) after 2m23s
[18:53:37.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:109:0)
[18:53:37.674] Build status: STARTED
[18:53:37.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:110:0) after 8m12s
[19:01:49.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:110:0)
[19:01:49.770] Build status: STARTED
[19:01:49.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:111:0) after 1m57s
[19:03:47.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:111:0)
[19:03:47.625] Build status: STARTED
[19:03:47.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:112:0) after 9m44s
[19:13:31.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:112:0)
[19:13:31.961] Build status: STARTED
[19:13:31.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:113:0) after 1m34s
[19:15:06.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:113:0)
[19:15:06.028] Build status: STARTED
[19:15:06.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:114:0) after 6m55s
[19:22:01.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:114:0)
[19:22:01.290] Build status: STARTED
[19:22:01.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:115:0) after 3m29s
[19:25:30.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:115:0)
[19:25:30.623] Build status: STARTED
[19:25:30.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:116:0) after 6m10s
[19:31:41.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:116:0)
[19:31:41.123] Build status: STARTED
[19:31:41.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:117:0) after 9m29s
[19:41:10.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:117:0)
[19:41:10.353] Build status: STARTED
[19:41:10.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:118:0) after 4m34s
[19:45:44.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:118:0)
[19:45:44.694] Build status: STARTED
[19:45:44.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:119:0) after 7m22s
[19:53:06.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:119:0)
[19:53:06.786] Build status: STARTED
[19:53:06.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:120:0) after 6m55s
[20:00:01.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:120:0)
[20:00:02.049] Build status: STARTED
[20:00:02.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:121:0) after 8m22s
[20:08:24.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:121:0)
[20:08:24.482] Build status: STARTED
[20:08:24.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:122:0) after 1m40s
[20:10:05.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:122:0)
[20:10:05.261] Build status: STARTED
[20:10:05.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:123:0) after 2m51s
[20:12:56.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:123:0)
[20:12:56.341] Build status: STARTED
[20:12:56.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:124:0) after 8m21s
[20:21:17.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:124:0)
[20:21:17.507] Build status: STARTED
[20:21:17.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:125:0) after 2m17s
[20:23:34.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:125:0)
[20:23:34.568] Build status: STARTED
[20:23:34.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:126:0) after 3m5s
[20:26:39.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:126:0)
[20:26:39.786] Build status: STARTED
[20:26:39.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:127:0) after 3m59s
[20:30:38.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:127:0)
[20:30:38.826] Build status: STARTED
[20:30:38.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:128:0) after 1m2s
[20:31:40.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:128:0)
[20:31:40.884] Build status: STARTED
[20:31:40.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:129:0) after 1m40s
[20:33:20.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:129:0)
[20:33:20.966] Build status: STARTED
[20:33:20.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:130:0) after 7m4s
[20:40:25.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:130:0)
[20:40:25.108] Build status: STARTED
[20:40:25.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:131:0) after 2m29s
[20:42:54.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:131:0)
[20:42:54.176] Build status: STARTED
[20:42:54.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:132:0) after 1m14s
[20:44:08.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:132:0)
[20:44:08.294] Build status: STARTED
[20:44:08.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:133:0) after 6m44s
[20:50:52.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:133:0)
[20:50:52.367] Build status: STARTED
[20:50:52.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:134:0) after 7m30s
[20:58:22.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:134:0)
[20:58:22.475] Build status: STARTED
[20:58:22.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:135:0) after 9m1s
[21:07:23.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:135:0)
[21:07:23.654] Build status: STARTED
[21:07:23.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:136:0) after 3m45s
[21:11:08.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:136:0)
[21:11:08.999] Build status: STARTED
[21:11:08.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:137:0) after 3m31s
[21:14:40.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:137:0)
[21:14:40.542] Build status: STARTED
[21:14:40.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:138:0) after 4m25s
[21:19:05.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:138:0)
[21:19:05.943] Build status: STARTED
[21:19:05.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:139:0) after 1m34s
[21:20:39.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:139:0)
[21:20:40.001] Build status: STARTED
[21:20:40.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:140:0) after 7m37s
[21:28:17.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:140:0)
[21:28:17.090] Build status: STARTED
[21:28:17.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:141:0) after 2m5s
[21:30:22.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:141:0)
[21:30:22.717] Build status: STARTED
[21:30:22.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:142:0) after 9m48s
[21:40:10.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:142:0)
[21:40:11.038] Build status: STARTED
[21:40:11.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:143:0) after 1m19s
[21:41:30.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:143:0)
[21:41:30.108] Build status: STARTED
[21:41:30.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:144:0) after 8m16s
[21:49:46.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:144:0)
[21:49:46.447] Build status: STARTED
[21:49:46.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:145:0) after 9m50s
[21:59:36.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:145:0)
[21:59:36.705] Build status: STARTED
[21:59:36.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:146:0) after 7m20s
[22:06:57.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:146:0)
[22:06:57.378] Build status: STARTED
[22:06:57.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:147:0) after 8m12s
[22:15:10.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:147:0)
[22:15:10.286] Build status: STARTED
[22:15:10.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:148:0) after 3m8s
[22:18:18.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:148:0)
[22:18:18.508] Build status: STARTED
[22:18:18.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:149:0) after 5m50s
[22:24:08.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:149:0)
[22:24:08.741] Build status: STARTED
[22:24:08.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:150:0) after 3m3s
[22:27:12.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:150:0)
[22:27:12.074] Build status: STARTED
[22:27:12.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:151:0) after 7m16s
[22:34:28.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:151:0)
[22:34:28.226] Build status: STARTED
[22:34:28.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:152:0) after 5m1s
[22:39:29.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:152:0)
[22:39:29.407] Build status: STARTED
[22:39:29.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:153:0) after 3m58s
[22:43:27.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:153:0)
[22:43:27.481] Build status: STARTED
[22:43:27.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:154:0) after 2m54s
[22:46:21.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:154:0)
[22:46:21.778] Build status: STARTED
[22:46:21.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:155:0) after 7m3s
[22:53:25.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:155:0)
[22:53:25.717] Build status: STARTED
[22:53:25.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:156:0) after 8m36s
[23:02:02.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:156:0)
[23:02:02.328] Build status: STARTED
[23:02:02.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:157:0) after 5m16s
[23:07:18.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:157:0)
[23:07:18.651] Build status: STARTED
[23:07:18.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:158:0) after 5m34s
[23:12:52.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:158:0)
[23:12:52.954] Build status: STARTED
[23:12:52.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:159:0) after 8m18s
[23:21:11.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:159:0)
[23:21:11.163] Build status: STARTED
[23:21:11.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:160:0) after 6m30s
[23:27:41.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:160:0)
[23:27:41.555] Build status: STARTED
[23:27:41.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:161:0) after 6m14s
[23:33:55.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:161:0)
[23:33:55.665] Build status: STARTED
[23:33:55.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:162:0) after 7m22s
[23:41:17.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:162:0)
[23:41:17.789] Build status: STARTED
[23:41:17.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:163:0) after 5m33s
[23:46:50.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:163:0)
[23:46:50.847] Build status: STARTED
[23:46:50.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:164:0) after 9m2s
[23:55:52.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:164:0)
[23:55:52.969] Build status: STARTED
[23:55:52.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8960331860187372448:165:0) after 8m26s
[23:58:34.521] Received PubSub notification, asking Buildbucket for the build status
[23:58:34.599] Build:
{
"id": "8794901798266377329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28501,
"createdBy": "project:chromium",
"createTime": "2022-12-13T09:51:01.886038964Z",
"startTime": "2022-12-13T09:56:26.372549Z",
"endTime": "2022-12-13T23:58:33.405020260Z",
"updateTime": "2022-12-13T23:58:33.405020260Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "505125afd3350a9d3d056247b585b4cea0f32d8c",
"ref": "refs/heads/main"
}
}
}
[23:58:34.599] Invocation finished in 14h7m33.928481549s with status FAILED