[18:44:26.146] New invocation is queued and will start shortly
[18:44:27.328] Starting the invocation (attempt 1)
[18:44:27.374] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f88e5eb18ae01fab833a5d3d6b3f1db508f1eb65"
[18:44:27.374] Popped gitiles commit info from properties and tags
[18:44:27.374] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:44:27.374] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:44:27.374] Buildbucket request:
{
"requestId": "8949607857986959216",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f88e5eb18ae01fab833a5d3d6b3f1db508f1eb65",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8949607857986959216"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:44:27.835] Scheduled build:
{
"id": "8784177795959153905",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28878,
"createdBy": "project:chromium",
"createTime": "2023-04-10T18:44:27.455106438Z",
"updateTime": "2023-04-10T18:44:27.455106438Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f88e5eb18ae01fab833a5d3d6b3f1db508f1eb65",
"ref": "refs/heads/main"
}
}
}
[18:44:27.835] Task URL: https://cr-buildbucket.appspot.com/build/8784177795959153905
[18:44:27.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:2:0) after 8m4s
[18:45:38.490] Received PubSub notification, asking Buildbucket for the build status
[18:45:38.518] Build status: STARTED
[18:52:31.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:2:0)
[18:52:31.922] Build status: STARTED
[18:52:31.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:4:0) after 5m36s
[18:58:07.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:4:0)
[18:58:07.976] Build status: STARTED
[18:58:07.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:5:0) after 6m23s
[19:04:31.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:5:0)
[19:04:31.247] Build status: STARTED
[19:04:31.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:6:0) after 2m49s
[19:07:20.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:6:0)
[19:07:20.387] Build status: STARTED
[19:07:20.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:7:0) after 4m9s
[19:11:29.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:7:0)
[19:11:29.522] Build status: STARTED
[19:11:29.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:8:0) after 4m6s
[19:15:35.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:8:0)
[19:15:35.676] Build status: STARTED
[19:15:35.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:9:0) after 1m44s
[19:17:19.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:9:0)
[19:17:19.744] Build status: STARTED
[19:17:19.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:10:0) after 4m59s
[19:22:19.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:10:0)
[19:22:19.116] Build status: STARTED
[19:22:19.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:11:0) after 7m19s
[19:29:38.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:11:0)
[19:29:38.489] Build status: STARTED
[19:29:38.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:12:0) after 7m53s
[19:37:31.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:12:0)
[19:37:31.641] Build status: STARTED
[19:37:31.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:13:0) after 4m17s
[19:41:48.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:13:0)
[19:41:48.697] Build status: STARTED
[19:41:48.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:14:0) after 3m31s
[19:45:19.841] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:14:0)
[19:45:19.871] Build status: STARTED
[19:45:19.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:15:0) after 1m44s
[19:47:04.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:15:0)
[19:47:04.221] Build status: STARTED
[19:47:04.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:16:0) after 8m38s
[19:55:42.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:16:0)
[19:55:42.642] Build status: STARTED
[19:55:42.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:17:0) after 7m47s
[20:03:29.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:17:0)
[20:03:29.731] Build status: STARTED
[20:03:29.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:18:0) after 4m36s
[20:08:05.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:18:0)
[20:08:05.939] Build status: STARTED
[20:08:05.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:19:0) after 4m18s
[20:12:24.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:19:0)
[20:12:24.127] Build status: STARTED
[20:12:24.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:20:0) after 4m19s
[20:16:43.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:20:0)
[20:16:43.462] Build status: STARTED
[20:16:43.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:21:0) after 9m5s
[20:25:48.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:21:0)
[20:25:48.884] Build status: STARTED
[20:25:48.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:22:0) after 1m47s
[20:27:36.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:22:0)
[20:27:36.068] Build status: STARTED
[20:27:36.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:23:0) after 9m29s
[20:37:05.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:23:0)
[20:37:05.852] Build status: STARTED
[20:37:05.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:24:0) after 9m7s
[20:46:12.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:24:0)
[20:46:12.960] Build status: STARTED
[20:46:12.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:25:0) after 4m37s
[20:50:50.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:25:0)
[20:50:50.174] Build status: STARTED
[20:50:50.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:26:0) after 9m54s
[21:00:44.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:26:0)
[21:00:44.349] Build status: STARTED
[21:00:44.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:27:0) after 3m2s
[21:03:47.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:27:0)
[21:03:47.295] Build status: STARTED
[21:03:47.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:28:0) after 1m43s
[21:05:30.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:28:0)
[21:05:30.853] Build status: STARTED
[21:05:30.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:29:0) after 2m3s
[21:07:34.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:29:0)
[21:07:34.542] Build status: STARTED
[21:07:34.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:30:0) after 5m42s
[21:13:16.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:30:0)
[21:13:16.717] Build status: STARTED
[21:13:16.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:31:0) after 8m42s
[21:21:58.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:31:0)
[21:21:58.867] Build status: STARTED
[21:21:58.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:32:0) after 4m4s
[21:26:02.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:32:0)
[21:26:02.945] Build status: STARTED
[21:26:02.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:33:0) after 4m7s
[21:30:10.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:33:0)
[21:30:10.091] Build status: STARTED
[21:30:10.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:34:0) after 3m24s
[21:33:34.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:34:0)
[21:33:34.325] Build status: STARTED
[21:33:34.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:35:0) after 3m36s
[21:37:10.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:35:0)
[21:37:10.575] Build status: STARTED
[21:37:10.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:36:0) after 9m21s
[21:46:31.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:36:0)
[21:46:31.784] Build status: STARTED
[21:46:31.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:37:0) after 3m7s
[21:49:38.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:37:0)
[21:49:38.849] Build status: STARTED
[21:49:38.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:38:0) after 3m53s
[21:53:32.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:38:0)
[21:53:32.047] Build status: STARTED
[21:53:32.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:39:0) after 2m5s
[21:55:37.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:39:0)
[21:55:37.219] Build status: STARTED
[21:55:37.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:40:0) after 5m25s
[22:01:02.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:40:0)
[22:01:02.333] Build status: STARTED
[22:01:02.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:41:0) after 4m25s
[22:05:27.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:41:0)
[22:05:27.581] Build status: STARTED
[22:05:27.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:42:0) after 4m54s
[22:10:21.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:42:0)
[22:10:21.776] Build status: STARTED
[22:10:21.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:43:0) after 9m1s
[22:19:22.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:43:0)
[22:19:22.887] Build status: STARTED
[22:19:22.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:44:0) after 6m33s
[22:25:55.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:44:0)
[22:25:55.947] Build status: STARTED
[22:25:55.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:45:0) after 3m18s
[22:29:14.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:45:0)
[22:29:14.262] Build status: STARTED
[22:29:14.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:46:0) after 3m33s
[22:32:47.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:46:0)
[22:32:47.435] Build status: STARTED
[22:32:47.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:47:0) after 2m49s
[22:35:37.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:47:0)
[22:35:37.137] Build status: STARTED
[22:35:37.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:48:0) after 3m40s
[22:39:17.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:48:0)
[22:39:17.605] Build status: STARTED
[22:39:17.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:49:0) after 3m31s
[22:42:48.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:49:0)
[22:42:48.663] Build status: STARTED
[22:42:48.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:50:0) after 5m29s
[22:48:17.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:50:0)
[22:48:17.906] Build status: STARTED
[22:48:17.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:51:0) after 9m15s
[22:57:32.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:51:0)
[22:57:32.997] Build status: STARTED
[22:57:32.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:52:0) after 6m24s
[23:03:57.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:52:0)
[23:03:57.279] Build status: STARTED
[23:03:57.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:53:0) after 5m18s
[23:09:15.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:53:0)
[23:09:15.482] Build status: STARTED
[23:09:15.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:54:0) after 1m38s
[23:10:53.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:54:0)
[23:10:53.829] Build status: STARTED
[23:10:53.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:55:0) after 2m27s
[23:13:20.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:55:0)
[23:13:20.888] Build status: STARTED
[23:13:20.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:56:0) after 9m25s
[23:22:46.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:56:0)
[23:22:46.048] Build status: STARTED
[23:22:46.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:57:0) after 8m20s
[23:31:06.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:57:0)
[23:31:06.257] Build status: STARTED
[23:31:06.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:58:0) after 2m6s
[23:33:12.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:58:0)
[23:33:12.342] Build status: STARTED
[23:33:12.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:59:0) after 2m18s
[23:35:30.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:59:0)
[23:35:30.800] Build status: STARTED
[23:35:30.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:60:0) after 3m55s
[23:39:25.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:60:0)
[23:39:25.895] Build status: STARTED
[23:39:25.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:61:0) after 1m32s
[23:40:58.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:61:0)
[23:40:58.295] Build status: STARTED
[23:40:58.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:62:0) after 2m17s
[23:43:15.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:62:0)
[23:43:15.343] Build status: STARTED
[23:43:15.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:63:0) after 3m47s
[23:47:02.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:63:0)
[23:47:02.401] Build status: STARTED
[23:47:02.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:64:0) after 5m25s
[23:52:27.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:64:0)
[23:52:27.589] Build status: STARTED
[23:52:27.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:65:0) after 8m0s
[00:00:27.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:65:0)
[00:00:27.648] Build status: STARTED
[00:00:27.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:66:0) after 5m59s
[00:06:26.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:66:0)
[00:06:26.696] Build status: STARTED
[00:06:26.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:67:0) after 8m24s
[00:14:50.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:67:0)
[00:14:50.846] Build status: STARTED
[00:14:50.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:68:0) after 6m16s
[00:21:06.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:68:0)
[00:21:06.980] Build status: STARTED
[00:21:06.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:69:0) after 9m4s
[00:30:11.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:69:0)
[00:30:11.052] Build status: STARTED
[00:30:11.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:70:0) after 6m2s
[00:36:13.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:70:0)
[00:36:13.430] Build status: STARTED
[00:36:13.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:71:0) after 6m45s
[00:42:58.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:71:0)
[00:42:58.599] Build status: STARTED
[00:42:58.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:72:0) after 8m34s
[00:51:32.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:72:0)
[00:51:32.784] Build status: STARTED
[00:51:32.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:73:0) after 7m50s
[00:59:22.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:73:0)
[00:59:22.904] Build status: STARTED
[00:59:22.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:74:0) after 7m18s
[01:06:40.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:74:0)
[01:06:40.990] Build status: STARTED
[01:06:40.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:75:0) after 5m57s
[01:12:38.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:75:0)
[01:12:38.085] Build status: STARTED
[01:12:38.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:76:0) after 3m46s
[01:16:24.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:76:0)
[01:16:24.427] Build status: STARTED
[01:16:24.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:77:0) after 8m10s
[01:24:34.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:77:0)
[01:24:34.640] Build status: STARTED
[01:24:34.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:78:0) after 1m41s
[01:26:15.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:78:0)
[01:26:15.784] Build status: STARTED
[01:26:15.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:79:0) after 6m47s
[01:33:02.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:79:0)
[01:33:02.963] Build status: STARTED
[01:33:02.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:80:0) after 8m25s
[01:41:28.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:80:0)
[01:41:28.189] Build status: STARTED
[01:41:28.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:81:0) after 9m22s
[01:50:50.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:81:0)
[01:50:50.299] Build status: STARTED
[01:50:50.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:82:0) after 8m12s
[01:59:02.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:82:0)
[01:59:02.313] Build status: STARTED
[01:59:02.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:83:0) after 4m34s
[02:03:36.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:83:0)
[02:03:36.435] Build status: STARTED
[02:03:36.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:84:0) after 8m37s
[02:12:13.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:84:0)
[02:12:13.500] Build status: STARTED
[02:12:13.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:85:0) after 4m23s
[02:16:36.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:85:0)
[02:16:36.549] Build status: STARTED
[02:16:36.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:86:0) after 7m46s
[02:24:22.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:86:0)
[02:24:22.645] Build status: STARTED
[02:24:22.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:87:0) after 4m34s
[02:28:56.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:87:0)
[02:28:56.688] Build status: STARTED
[02:28:56.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:88:0) after 5m48s
[02:34:44.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:88:0)
[02:34:44.738] Build status: STARTED
[02:34:44.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:89:0) after 9m31s
[02:44:16.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:89:0)
[02:44:16.247] Build status: STARTED
[02:44:16.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:90:0) after 7m54s
[02:52:10.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:90:0)
[02:52:10.408] Build status: STARTED
[02:52:10.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:91:0) after 5m55s
[02:58:05.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:91:0)
[02:58:05.640] Build status: STARTED
[02:58:05.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:92:0) after 6m9s
[03:04:14.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:92:0)
[03:04:14.748] Build status: STARTED
[03:04:14.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:93:0) after 6m13s
[03:10:27.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:93:0)
[03:10:27.798] Build status: STARTED
[03:10:27.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:94:0) after 2m35s
[03:13:03.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:94:0)
[03:13:03.238] Build status: STARTED
[03:13:03.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:95:0) after 5m8s
[03:18:11.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:95:0)
[03:18:11.398] Build status: STARTED
[03:18:11.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:96:0) after 4m21s
[03:22:32.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:96:0)
[03:22:32.474] Build status: STARTED
[03:22:32.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:97:0) after 5m44s
[03:28:16.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:97:0)
[03:28:16.530] Build status: STARTED
[03:28:16.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:98:0) after 2m57s
[03:31:13.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:98:0)
[03:31:13.660] Build status: STARTED
[03:31:13.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:99:0) after 5m41s
[03:36:54.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:99:0)
[03:36:54.742] Build status: STARTED
[03:36:54.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:100:0) after 1m59s
[03:38:53.841] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:100:0)
[03:38:53.864] Build status: STARTED
[03:38:53.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:101:0) after 5m42s
[03:44:35.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:101:0)
[03:44:35.943] Build status: STARTED
[03:44:35.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:102:0) after 3m35s
[03:48:11.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:102:0)
[03:48:11.144] Build status: STARTED
[03:48:11.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:103:0) after 5m34s
[03:53:45.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:103:0)
[03:53:45.255] Build status: STARTED
[03:53:45.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:104:0) after 2m13s
[03:55:58.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:104:0)
[03:55:58.344] Build status: STARTED
[03:55:58.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:105:0) after 1m26s
[03:57:24.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:105:0)
[03:57:24.395] Build status: STARTED
[03:57:24.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:106:0) after 7m10s
[04:04:35.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:106:0)
[04:04:35.104] Build status: STARTED
[04:04:35.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:107:0) after 9m27s
[04:14:02.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:107:0)
[04:14:02.169] Build status: STARTED
[04:14:02.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:108:0) after 9m49s
[04:23:51.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:108:0)
[04:23:51.315] Build status: STARTED
[04:23:51.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:109:0) after 3m29s
[04:27:20.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:109:0)
[04:27:20.458] Build status: STARTED
[04:27:20.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:110:0) after 5m33s
[04:32:53.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:110:0)
[04:32:53.688] Build status: STARTED
[04:32:53.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:111:0) after 7m37s
[04:40:30.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:111:0)
[04:40:30.734] Build status: STARTED
[04:40:30.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:112:0) after 1m41s
[04:42:11.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:112:0)
[04:42:11.823] Build status: STARTED
[04:42:11.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:113:0) after 5m50s
[04:48:01.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:113:0)
[04:48:01.869] Build status: STARTED
[04:48:01.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:114:0) after 7m34s
[04:55:35.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:114:0)
[04:55:35.932] Build status: STARTED
[04:55:35.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:115:0) after 1m1s
[04:56:36.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:115:0)
[04:56:36.965] Build status: STARTED
[04:56:36.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:116:0) after 5m58s
[05:02:34.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:116:0)
[05:02:35.000] Build status: STARTED
[05:02:35.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:117:0) after 7m46s
[05:10:21.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:117:0)
[05:10:21.047] Build status: STARTED
[05:10:21.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:118:0) after 4m28s
[05:14:49.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:118:0)
[05:14:49.298] Build status: STARTED
[05:14:49.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:119:0) after 8m28s
[05:23:17.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:119:0)
[05:23:17.416] Build status: STARTED
[05:23:17.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:120:0) after 1m11s
[05:24:28.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:120:0)
[05:24:28.457] Build status: STARTED
[05:24:28.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:121:0) after 4m45s
[05:29:13.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:121:0)
[05:29:13.698] Build status: STARTED
[05:29:13.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:122:0) after 5m1s
[05:34:14.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:122:0)
[05:34:14.747] Build status: STARTED
[05:34:14.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:123:0) after 6m52s
[05:41:06.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:123:0)
[05:41:06.865] Build status: STARTED
[05:41:06.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:124:0) after 8m27s
[05:49:34.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:124:0)
[05:49:34.210] Build status: STARTED
[05:49:34.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:125:0) after 4m17s
[05:53:51.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:125:0)
[05:53:51.255] Build status: STARTED
[05:53:51.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:126:0) after 6m7s
[05:59:58.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:126:0)
[05:59:58.305] Build status: STARTED
[05:59:58.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:127:0) after 6m3s
[06:06:01.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:127:0)
[06:06:01.341] Build status: STARTED
[06:06:01.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:128:0) after 1m35s
[06:07:36.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:128:0)
[06:07:36.388] Build status: STARTED
[06:07:36.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:129:0) after 8m43s
[06:16:19.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:129:0)
[06:16:19.553] Build status: STARTED
[06:16:19.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:130:0) after 7m51s
[06:24:10.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:130:0)
[06:24:10.688] Build status: STARTED
[06:24:10.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:131:0) after 3m43s
[06:27:53.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:131:0)
[06:27:53.702] Build status: STARTED
[06:27:53.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:132:0) after 1m13s
[06:29:06.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:132:0)
[06:29:06.991] Build status: STARTED
[06:29:06.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:133:0) after 3m27s
[06:32:34.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:133:0)
[06:32:34.111] Build status: STARTED
[06:32:34.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:134:0) after 3m53s
[06:36:27.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:134:0)
[06:36:27.171] Build status: STARTED
[06:36:27.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:135:0) after 6m39s
[06:43:06.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:135:0)
[06:43:06.236] Build status: STARTED
[06:43:06.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:136:0) after 6m49s
[06:49:55.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:136:0)
[06:49:55.285] Build status: STARTED
[06:49:55.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:137:0) after 2m50s
[06:52:45.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:137:0)
[06:52:45.448] Build status: STARTED
[06:52:45.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:138:0) after 5m43s
[06:58:28.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:138:0)
[06:58:28.696] Build status: STARTED
[06:58:28.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:139:0) after 1m25s
[06:59:53.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:139:0)
[06:59:53.858] Build status: STARTED
[06:59:53.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:140:0) after 9m31s
[07:09:24.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:140:0)
[07:09:24.938] Build status: STARTED
[07:09:24.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:141:0) after 7m0s
[07:16:25.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:141:0)
[07:16:25.133] Build status: STARTED
[07:16:25.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:142:0) after 9m16s
[07:25:41.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:142:0)
[07:25:41.325] Build status: STARTED
[07:25:41.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:143:0) after 1m43s
[07:27:24.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:143:0)
[07:27:24.493] Build status: STARTED
[07:27:24.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:144:0) after 2m10s
[07:29:34.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:144:0)
[07:29:34.667] Build status: STARTED
[07:29:34.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:145:0) after 9m39s
[07:39:13.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:145:0)
[07:39:13.807] Build status: STARTED
[07:39:13.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:146:0) after 6m16s
[07:45:29.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:146:0)
[07:45:29.955] Build status: STARTED
[07:45:29.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:147:0) after 8m8s
[07:53:37.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:147:0)
[07:53:38.009] Build status: STARTED
[07:53:38.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:148:0) after 9m16s
[08:02:54.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:148:0)
[08:02:54.099] Build status: STARTED
[08:02:54.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:149:0) after 5m33s
[08:08:27.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:149:0)
[08:08:27.563] Build status: STARTED
[08:08:27.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:150:0) after 7m41s
[08:16:08.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:150:0)
[08:16:08.656] Build status: STARTED
[08:16:08.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:151:0) after 2m4s
[08:18:12.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:151:0)
[08:18:12.893] Build status: STARTED
[08:18:12.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:152:0) after 8m25s
[08:26:38.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:152:0)
[08:26:38.545] Build status: STARTED
[08:26:38.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:153:0) after 8m55s
[08:35:33.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:153:0)
[08:35:33.792] Build status: STARTED
[08:35:33.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:154:0) after 2m26s
[08:37:59.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:154:0)
[08:37:59.827] Build status: STARTED
[08:37:59.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:155:0) after 4m26s
[08:42:25.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:155:0)
[08:42:25.870] Build status: STARTED
[08:42:25.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:156:0) after 6m57s
[08:49:23.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:156:0)
[08:49:23.066] Build status: STARTED
[08:49:23.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:157:0) after 7m38s
[08:57:01.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:157:0)
[08:57:01.214] Build status: STARTED
[08:57:01.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:158:0) after 6m7s
[09:03:08.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:158:0)
[09:03:08.557] Build status: STARTED
[09:03:08.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:159:0) after 1m13s
[09:04:21.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:159:0)
[09:04:21.739] Build status: STARTED
[09:04:21.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:160:0) after 2m10s
[09:06:31.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:160:0)
[09:06:31.824] Build status: STARTED
[09:06:31.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:161:0) after 5m38s
[09:12:09.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:161:0)
[09:12:09.987] Build status: STARTED
[09:12:09.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:162:0) after 2m31s
[09:14:41.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:162:0)
[09:14:41.144] Build status: STARTED
[09:14:41.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:163:0) after 7m54s
[09:22:35.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:163:0)
[09:22:35.189] Build status: STARTED
[09:22:35.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:164:0) after 7m0s
[09:29:35.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:164:0)
[09:29:35.195] Build status: STARTED
[09:29:35.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:165:0) after 4m54s
[09:34:29.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:165:0)
[09:34:29.391] Build status: STARTED
[09:34:29.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:166:0) after 6m0s
[09:40:29.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:166:0)
[09:40:29.768] Build status: STARTED
[09:40:29.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8949607857986959216:167:0) after 6m43s
[09:42:31.262] Received PubSub notification, asking Buildbucket for the build status
[09:42:31.297] Build:
{
"id": "8784177795959153905",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28878,
"createdBy": "project:chromium",
"createTime": "2023-04-10T18:44:27.455106438Z",
"startTime": "2023-04-10T18:45:37.685671Z",
"endTime": "2023-04-11T09:42:30.838715189Z",
"updateTime": "2023-04-11T09:42:30.838715189Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f88e5eb18ae01fab833a5d3d6b3f1db508f1eb65",
"ref": "refs/heads/main"
}
}
}
[09:42:31.297] Invocation finished in 14h58m5.159367889s with status FAILED