[07:39:21.057] New invocation is queued and will start shortly
[07:39:22.127] Starting the invocation (attempt 1)
[07:39:22.156] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3155a6536e23ace14cff1bb14acf7fa135ad838a"
[07:39:22.156] Popped gitiles commit info from properties and tags
[07:39:22.156] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:39:22.157] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:39:22.157] Buildbucket request:
{
"requestId": "8935335380811636128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3155a6536e23ace14cff1bb14acf7fa135ad838a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8935335380811636128"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:39:22.717] Scheduled build:
{
"id": "8769905318947690929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 29428,
"createdBy": "project:chromium",
"createTime": "2023-09-15T07:39:22.213977585Z",
"updateTime": "2023-09-15T07:39:22.213977585Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3155a6536e23ace14cff1bb14acf7fa135ad838a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:39:22.717] Task URL: https://cr-buildbucket.appspot.com/build/8769905318947690929
[07:39:22.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:2:0) after 3m7s
[07:39:23.647] Received PubSub notification, asking Buildbucket for the build status
[07:39:23.666] Build status: SCHEDULED
[07:42:29.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:2:0)
[07:42:29.806] Build status: SCHEDULED
[07:42:29.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:4:0) after 5m30s
[07:43:51.066] Received PubSub notification, asking Buildbucket for the build status
[07:43:51.088] Build status: STARTED
[07:47:59.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:4:0)
[07:47:59.857] Build status: STARTED
[07:47:59.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:6:0) after 6m9s
[07:54:08.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:6:0)
[07:54:09.019] Build status: STARTED
[07:54:09.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:7:0) after 6m0s
[08:00:09.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:7:0)
[08:00:09.183] Build status: STARTED
[08:00:09.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:8:0) after 3m27s
[08:03:36.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:8:0)
[08:03:36.240] Build status: STARTED
[08:03:36.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:9:0) after 5m49s
[08:09:25.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:9:0)
[08:09:25.539] Build status: STARTED
[08:09:25.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:10:0) after 1m37s
[08:11:02.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:10:0)
[08:11:02.716] Build status: STARTED
[08:11:02.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:11:0) after 5m2s
[08:16:04.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:11:0)
[08:16:04.794] Build status: STARTED
[08:16:04.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:12:0) after 6m17s
[08:22:21.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:12:0)
[08:22:21.970] Build status: STARTED
[08:22:21.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:13:0) after 4m7s
[08:26:29.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:13:0)
[08:26:29.120] Build status: STARTED
[08:26:29.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:14:0) after 5m28s
[08:31:57.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:14:0)
[08:31:57.174] Build status: STARTED
[08:31:57.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:15:0) after 4m57s
[08:36:54.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:15:0)
[08:36:54.235] Build status: STARTED
[08:36:54.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:16:0) after 8m55s
[08:45:49.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:16:0)
[08:45:49.346] Build status: STARTED
[08:45:49.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:17:0) after 9m58s
[08:55:47.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:17:0)
[08:55:47.409] Build status: STARTED
[08:55:47.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:18:0) after 6m28s
[09:02:15.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:18:0)
[09:02:15.771] Build status: STARTED
[09:02:15.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:19:0) after 2m33s
[09:04:48.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:19:0)
[09:04:48.932] Build status: STARTED
[09:04:48.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:20:0) after 2m8s
[09:06:57.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:20:0)
[09:06:57.090] Build status: STARTED
[09:06:57.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:21:0) after 1m1s
[09:07:58.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:21:0)
[09:07:58.444] Build status: STARTED
[09:07:58.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:22:0) after 6m45s
[09:14:43.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:22:0)
[09:14:43.617] Build status: STARTED
[09:14:43.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:23:0) after 2m50s
[09:17:33.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:23:0)
[09:17:33.692] Build status: STARTED
[09:17:33.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:24:0) after 4m57s
[09:22:31.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:24:0)
[09:22:31.081] Build status: STARTED
[09:22:31.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:25:0) after 6m24s
[09:28:55.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:25:0)
[09:28:55.174] Build status: STARTED
[09:28:55.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:26:0) after 8m32s
[09:37:27.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:26:0)
[09:37:27.628] Build status: STARTED
[09:37:27.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:27:0) after 3m37s
[09:41:04.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:27:0)
[09:41:04.976] Build status: STARTED
[09:41:04.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:28:0) after 9m23s
[09:50:28.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:28:0)
[09:50:28.136] Build status: STARTED
[09:50:28.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:29:0) after 7m55s
[09:58:23.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:29:0)
[09:58:23.331] Build status: STARTED
[09:58:23.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:30:0) after 4m48s
[10:03:11.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:30:0)
[10:03:11.482] Build status: STARTED
[10:03:11.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:31:0) after 3m23s
[10:06:34.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:31:0)
[10:06:34.688] Build status: STARTED
[10:06:34.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:32:0) after 8m45s
[10:15:19.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:32:0)
[10:15:19.951] Build status: STARTED
[10:15:19.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:33:0) after 9m23s
[10:24:43.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:33:0)
[10:24:43.340] Build status: STARTED
[10:24:43.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:34:0) after 3m58s
[10:28:41.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:34:0)
[10:28:42.215] Build status: STARTED
[10:28:42.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:35:0) after 6m16s
[10:34:58.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:35:0)
[10:34:58.275] Build status: STARTED
[10:34:58.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:36:0) after 1m39s
[10:36:37.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:36:0)
[10:36:37.678] Build status: STARTED
[10:36:37.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:37:0) after 9m38s
[10:46:15.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:37:0)
[10:46:15.752] Build status: STARTED
[10:46:15.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:38:0) after 3m27s
[10:49:42.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:38:0)
[10:49:42.874] Build status: STARTED
[10:49:42.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:39:0) after 2m13s
[10:51:55.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:39:0)
[10:51:55.954] Build status: STARTED
[10:51:55.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:40:0) after 5m56s
[10:57:51.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:40:0)
[10:57:52.006] Build status: STARTED
[10:57:52.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:41:0) after 4m34s
[11:02:26.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:41:0)
[11:02:26.087] Build status: STARTED
[11:02:26.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:42:0) after 6m34s
[11:09:00.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:42:0)
[11:09:00.779] Build status: STARTED
[11:09:00.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:43:0) after 1m52s
[11:10:52.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:43:0)
[11:10:52.948] Build status: STARTED
[11:10:52.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:44:0) after 5m32s
[11:16:25.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:44:0)
[11:16:25.328] Build status: STARTED
[11:16:25.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:45:0) after 6m42s
[11:23:07.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:45:0)
[11:23:07.372] Build status: STARTED
[11:23:07.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:46:0) after 2m6s
[11:25:13.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:46:0)
[11:25:13.411] Build status: STARTED
[11:25:13.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:47:0) after 4m24s
[11:29:37.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:47:0)
[11:29:37.791] Build status: STARTED
[11:29:37.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:48:0) after 7m43s
[11:37:21.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:48:0)
[11:37:21.088] Build status: STARTED
[11:37:21.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:49:0) after 4m40s
[11:42:01.206] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:49:0)
[11:42:01.275] Build status: STARTED
[11:42:01.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:50:0) after 8m17s
[11:50:18.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:50:0)
[11:50:18.342] Build status: STARTED
[11:50:18.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:51:0) after 4m45s
[11:55:03.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:51:0)
[11:55:03.503] Build status: STARTED
[11:55:03.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:52:0) after 7m39s
[12:02:42.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:52:0)
[12:02:42.633] Build status: STARTED
[12:02:42.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:53:0) after 4m8s
[12:06:50.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:53:0)
[12:06:50.938] Build status: STARTED
[12:06:50.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:54:0) after 9m24s
[12:16:15.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:54:0)
[12:16:15.225] Build status: STARTED
[12:16:15.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:55:0) after 4m30s
[12:20:45.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:55:0)
[12:20:45.296] Build status: STARTED
[12:20:45.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:56:0) after 9m12s
[12:29:57.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:56:0)
[12:29:57.472] Build status: STARTED
[12:29:57.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:57:0) after 1m55s
[12:31:52.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:57:0)
[12:31:52.831] Build status: STARTED
[12:31:52.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:58:0) after 6m31s
[12:38:23.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:58:0)
[12:38:24.034] Build status: STARTED
[12:38:24.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:59:0) after 9m12s
[12:47:36.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:59:0)
[12:47:36.261] Build status: STARTED
[12:47:36.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:60:0) after 2m51s
[12:50:27.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:60:0)
[12:50:27.394] Build status: STARTED
[12:50:27.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:61:0) after 2m45s
[12:53:12.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:61:0)
[12:53:12.451] Build status: STARTED
[12:53:12.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:62:0) after 2m11s
[12:55:23.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:62:0)
[12:55:23.737] Build status: STARTED
[12:55:23.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:63:0) after 4m46s
[13:00:09.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:63:0)
[13:00:09.783] Build status: STARTED
[13:00:09.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:64:0) after 9m16s
[13:09:25.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:64:0)
[13:09:25.966] Build status: STARTED
[13:09:25.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:65:0) after 7m19s
[13:16:45.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:65:0)
[13:16:45.127] Build status: STARTED
[13:16:45.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:66:0) after 1m8s
[13:17:53.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:66:0)
[13:17:53.180] Build status: STARTED
[13:17:53.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:67:0) after 6m7s
[13:24:00.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:67:0)
[13:24:00.556] Build status: STARTED
[13:24:00.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:68:0) after 1m23s
[13:25:23.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:68:0)
[13:25:23.739] Build status: STARTED
[13:25:23.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:69:0) after 4m57s
[13:30:21.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:69:0)
[13:30:21.087] Build status: STARTED
[13:30:21.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:70:0) after 2m4s
[13:32:25.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:70:0)
[13:32:25.245] Build status: STARTED
[13:32:25.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:71:0) after 6m58s
[13:39:23.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:71:0)
[13:39:23.291] Build status: STARTED
[13:39:23.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:72:0) after 9m40s
[13:49:03.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:72:0)
[13:49:03.575] Build status: STARTED
[13:49:03.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:73:0) after 9m15s
[13:58:18.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:73:0)
[13:58:18.674] Build status: STARTED
[13:58:18.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:74:0) after 4m17s
[14:02:35.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:74:0)
[14:02:35.822] Build status: STARTED
[14:02:35.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:75:0) after 1m4s
[14:03:39.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:75:0)
[14:03:39.997] Build status: STARTED
[14:03:39.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:76:0) after 5m48s
[14:09:28.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:76:0)
[14:09:28.203] Build status: STARTED
[14:09:28.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:77:0) after 9m6s
[14:18:34.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:77:0)
[14:18:34.443] Build status: STARTED
[14:18:34.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:78:0) after 8m14s
[14:26:48.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:78:0)
[14:26:48.648] Build status: STARTED
[14:26:48.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:79:0) after 6m41s
[14:33:29.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:79:0)
[14:33:29.686] Build status: STARTED
[14:33:29.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:80:0) after 7m8s
[14:40:37.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:80:0)
[14:40:37.775] Build status: STARTED
[14:40:37.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:81:0) after 9m6s
[14:49:44.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:81:0)
[14:49:44.163] Build status: STARTED
[14:49:44.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:82:0) after 2m47s
[14:52:31.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:82:0)
[14:52:31.375] Build status: STARTED
[14:52:31.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:83:0) after 6m46s
[14:59:17.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:83:0)
[14:59:17.570] Build status: STARTED
[14:59:17.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:84:0) after 6m35s
[15:05:53.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:84:0)
[15:05:53.386] Build status: STARTED
[15:05:53.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:85:0) after 5m9s
[15:11:02.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:85:0)
[15:11:02.507] Build status: STARTED
[15:11:02.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:86:0) after 8m30s
[15:19:32.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:86:0)
[15:19:32.599] Build status: STARTED
[15:19:32.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:87:0) after 7m20s
[15:26:52.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:87:0)
[15:26:52.753] Build status: STARTED
[15:26:52.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:88:0) after 4m26s
[15:31:18.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:88:0)
[15:31:18.823] Build status: STARTED
[15:31:18.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:89:0) after 4m36s
[15:35:55.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:89:0)
[15:35:55.122] Build status: STARTED
[15:35:55.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:90:0) after 9m55s
[15:45:50.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:90:0)
[15:45:50.218] Build status: STARTED
[15:45:50.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:91:0) after 5m19s
[15:51:09.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:91:0)
[15:51:09.313] Build status: STARTED
[15:51:09.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:92:0) after 4m39s
[15:55:48.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:92:0)
[15:55:48.578] Build status: STARTED
[15:55:48.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:93:0) after 6m55s
[16:02:44.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:93:0)
[16:02:44.196] Build status: STARTED
[16:02:44.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:94:0) after 5m38s
[16:08:22.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:94:0)
[16:08:22.218] Build status: STARTED
[16:08:22.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:95:0) after 7m18s
[16:15:40.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:95:0)
[16:15:40.361] Build status: STARTED
[16:15:40.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:96:0) after 8m42s
[16:24:22.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:96:0)
[16:24:22.535] Build status: STARTED
[16:24:22.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:97:0) after 9m6s
[16:33:28.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:97:0)
[16:33:28.676] Build status: STARTED
[16:33:28.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:98:0) after 1m23s
[16:34:51.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:98:0)
[16:34:51.815] Build status: STARTED
[16:34:51.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:99:0) after 9m47s
[16:44:38.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:99:0)
[16:44:38.970] Build status: STARTED
[16:44:38.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:100:0) after 9m32s
[16:54:10.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:100:0)
[16:54:11.015] Build status: STARTED
[16:54:11.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:101:0) after 1m37s
[16:55:48.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:101:0)
[16:55:48.089] Build status: STARTED
[16:55:48.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:102:0) after 3m38s
[16:59:26.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:102:0)
[16:59:26.312] Build status: STARTED
[16:59:26.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:103:0) after 5m17s
[17:04:43.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:103:0)
[17:04:43.395] Build status: STARTED
[17:04:43.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:104:0) after 2m8s
[17:06:51.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:104:0)
[17:06:51.782] Build status: STARTED
[17:06:51.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:105:0) after 3m28s
[17:10:20.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:105:0)
[17:10:20.067] Build status: STARTED
[17:10:20.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:106:0) after 2m12s
[17:12:32.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:106:0)
[17:12:32.141] Build status: STARTED
[17:12:32.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:107:0) after 8m21s
[17:20:53.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:107:0)
[17:20:53.433] Build status: STARTED
[17:20:53.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:108:0) after 3m19s
[17:24:12.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:108:0)
[17:24:12.492] Build status: STARTED
[17:24:12.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:109:0) after 5m0s
[17:29:12.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:109:0)
[17:29:12.569] Build status: STARTED
[17:29:12.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:110:0) after 3m11s
[17:32:23.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:110:0)
[17:32:23.679] Build status: STARTED
[17:32:23.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:111:0) after 9m21s
[17:41:44.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:111:0)
[17:41:44.692] Build status: STARTED
[17:41:44.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:112:0) after 7m29s
[17:49:13.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:112:0)
[17:49:13.849] Build status: STARTED
[17:49:13.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:113:0) after 9m50s
[17:59:03.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:113:0)
[17:59:03.943] Build status: STARTED
[17:59:03.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:114:0) after 4m10s
[18:03:14.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:114:0)
[18:03:14.092] Build status: STARTED
[18:03:14.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:115:0) after 9m0s
[18:12:14.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:115:0)
[18:12:14.242] Build status: STARTED
[18:12:14.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:116:0) after 8m6s
[18:20:20.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:116:0)
[18:20:20.611] Build status: STARTED
[18:20:20.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:117:0) after 3m5s
[18:23:25.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:117:0)
[18:23:25.740] Build status: STARTED
[18:23:25.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:118:0) after 7m38s
[18:31:04.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:118:0)
[18:31:04.180] Build status: STARTED
[18:31:04.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:119:0) after 8m10s
[18:39:14.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:119:0)
[18:39:14.308] Build status: STARTED
[18:39:14.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:120:0) after 6m25s
[18:45:39.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:120:0)
[18:45:39.548] Build status: STARTED
[18:45:39.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:121:0) after 8m18s
[18:53:57.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:121:0)
[18:53:57.616] Build status: STARTED
[18:53:57.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:122:0) after 7m52s
[19:01:49.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:122:0)
[19:01:49.725] Build status: STARTED
[19:01:49.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:123:0) after 7m18s
[19:09:07.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:123:0)
[19:09:07.813] Build status: STARTED
[19:09:07.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:124:0) after 2m27s
[19:11:34.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:124:0)
[19:11:34.901] Build status: STARTED
[19:11:34.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:125:0) after 3m0s
[19:14:34.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:125:0)
[19:14:34.930] Build status: STARTED
[19:14:34.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:126:0) after 3m1s
[19:17:35.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:126:0)
[19:17:35.979] Build status: STARTED
[19:17:35.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:127:0) after 4m26s
[19:22:02.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:127:0)
[19:22:02.104] Build status: STARTED
[19:22:02.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:128:0) after 8m27s
[19:30:29.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:128:0)
[19:30:29.182] Build status: STARTED
[19:30:29.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:129:0) after 5m57s
[19:36:26.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:129:0)
[19:36:26.291] Build status: STARTED
[19:36:26.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:130:0) after 8m55s
[19:45:21.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:130:0)
[19:45:21.347] Build status: STARTED
[19:45:21.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:131:0) after 2m28s
[19:47:49.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:131:0)
[19:47:49.451] Build status: STARTED
[19:47:49.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:132:0) after 3m59s
[19:51:48.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:132:0)
[19:51:48.509] Build status: STARTED
[19:51:48.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:133:0) after 6m2s
[19:57:50.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:133:0)
[19:57:50.630] Build status: STARTED
[19:57:50.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:134:0) after 5m48s
[20:03:38.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:134:0)
[20:03:38.777] Build status: STARTED
[20:03:38.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:135:0) after 2m5s
[20:05:43.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:135:0)
[20:05:43.930] Build status: STARTED
[20:05:43.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:136:0) after 7m25s
[20:13:08.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:136:0)
[20:13:08.991] Build status: STARTED
[20:13:08.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:137:0) after 7m2s
[20:20:11.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:137:0)
[20:20:11.178] Build status: STARTED
[20:20:11.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:138:0) after 8m46s
[20:28:57.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:138:0)
[20:28:57.518] Build status: STARTED
[20:28:57.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:139:0) after 3m58s
[20:32:55.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:139:0)
[20:32:55.796] Build status: STARTED
[20:32:55.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:140:0) after 7m51s
[20:40:47.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:140:0)
[20:40:47.225] Build status: STARTED
[20:40:47.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:141:0) after 9m30s
[20:50:17.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:141:0)
[20:50:17.279] Build status: STARTED
[20:50:17.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:142:0) after 9m40s
[20:59:57.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:142:0)
[20:59:57.849] Build status: STARTED
[20:59:57.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:143:0) after 2m54s
[21:02:51.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:143:0)
[21:02:51.896] Build status: STARTED
[21:02:51.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:144:0) after 8m51s
[21:11:42.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:144:0)
[21:11:42.987] Build status: STARTED
[21:11:42.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:145:0) after 4m53s
[21:16:36.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:145:0)
[21:16:36.074] Build status: STARTED
[21:16:36.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:146:0) after 9m15s
[21:25:51.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:146:0)
[21:25:51.666] Build status: STARTED
[21:25:51.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:147:0) after 1m26s
[21:27:17.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:147:0)
[21:27:17.836] Build status: STARTED
[21:27:17.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:148:0) after 8m12s
[21:35:29.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:148:0)
[21:35:29.840] Build status: STARTED
[21:35:29.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:149:0) after 3m2s
[21:38:31.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:149:0)
[21:38:31.901] Build status: STARTED
[21:38:31.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:150:0) after 6m0s
[21:44:32.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:150:0)
[21:44:32.086] Build status: STARTED
[21:44:32.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:151:0) after 1m39s
[21:46:11.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:151:0)
[21:46:11.307] Build status: STARTED
[21:46:11.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:152:0) after 8m30s
[21:54:41.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:152:0)
[21:54:42.179] Build status: STARTED
[21:54:42.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:153:0) after 5m28s
[22:00:10.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:153:0)
[22:00:10.445] Build status: STARTED
[22:00:10.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:154:0) after 6m21s
[22:06:31.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:154:0)
[22:06:31.495] Build status: STARTED
[22:06:31.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:155:0) after 1m39s
[22:08:10.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:155:0)
[22:08:10.634] Build status: STARTED
[22:08:10.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:156:0) after 6m59s
[22:15:09.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:156:0)
[22:15:09.734] Build status: STARTED
[22:15:09.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:157:0) after 8m29s
[22:23:39.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:157:0)
[22:23:39.031] Build status: STARTED
[22:23:39.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:158:0) after 4m56s
[22:28:35.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:158:0)
[22:28:35.201] Build status: STARTED
[22:28:35.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:159:0) after 5m54s
[22:34:29.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:159:0)
[22:34:29.274] Build status: STARTED
[22:34:29.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:160:0) after 6m33s
[22:41:02.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:160:0)
[22:41:02.565] Build status: STARTED
[22:41:02.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:161:0) after 2m21s
[22:43:23.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:161:0)
[22:43:23.606] Build status: STARTED
[22:43:23.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8935335380811636128:162:0) after 4m2s
[22:44:00.941] Received PubSub notification, asking Buildbucket for the build status
[22:44:00.994] Build:
{
"id": "8769905318947690929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 29428,
"createdBy": "project:chromium",
"createTime": "2023-09-15T07:39:22.213977585Z",
"startTime": "2023-09-15T07:43:50.551523Z",
"endTime": "2023-09-15T22:44:00.707552088Z",
"updateTime": "2023-09-15T22:44:00.707552088Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3155a6536e23ace14cff1bb14acf7fa135ad838a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:44:00.994] Invocation finished in 15h4m39.943088144s with status FAILED