[05:29:07.392] New invocation is queued and will start shortly
[05:29:08.590] Starting the invocation (attempt 1)
[05:29:08.616] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0e832e67fc3d6c0ea183e2a333fd9bd214767f1c"
[05:29:08.616] Popped gitiles commit info from properties and tags
[05:29:08.616] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:29:08.616] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:29:08.616] Buildbucket request:
{
"requestId": "8920485671553162256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0e832e67fc3d6c0ea183e2a333fd9bd214767f1c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8920485671553162256"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:29:09.134] Scheduled build:
{
"id": "8755055609550479793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30309,
"createdBy": "project:chromium",
"createTime": "2024-02-26T05:29:08.671822627Z",
"updateTime": "2024-02-26T05:29:08.671822627Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0e832e67fc3d6c0ea183e2a333fd9bd214767f1c",
"ref": "refs/heads/main"
}
}
}
[05:29:09.134] Task URL: https://cr-buildbucket.appspot.com/build/8755055609550479793
[05:29:09.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:2:0) after 4m44s
[05:29:10.072] Received PubSub notification, asking Buildbucket for the build status
[05:29:10.139] Build status: SCHEDULED
[05:29:10.513] Received PubSub notification, asking Buildbucket for the build status
[05:29:10.559] Build status: STARTED
[05:33:53.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:2:0)
[05:33:53.201] Build status: STARTED
[05:33:53.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:5:0) after 3m31s
[05:37:24.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:5:0)
[05:37:24.207] Build status: STARTED
[05:37:24.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:6:0) after 3m43s
[05:41:07.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:6:0)
[05:41:07.422] Build status: STARTED
[05:41:07.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:7:0) after 8m32s
[05:49:39.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:7:0)
[05:49:39.489] Build status: STARTED
[05:49:39.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:8:0) after 5m4s
[05:54:43.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:8:0)
[05:54:43.587] Build status: STARTED
[05:54:43.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:9:0) after 2m46s
[05:57:29.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:9:0)
[05:57:29.669] Build status: STARTED
[05:57:29.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:10:0) after 8m32s
[06:06:01.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:10:0)
[06:06:01.775] Build status: STARTED
[06:06:01.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:11:0) after 6m54s
[06:12:55.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:11:0)
[06:12:55.842] Build status: STARTED
[06:12:55.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:12:0) after 3m44s
[06:16:39.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:12:0)
[06:16:40.032] Build status: STARTED
[06:16:40.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:13:0) after 8m35s
[06:25:15.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:13:0)
[06:25:15.093] Build status: STARTED
[06:25:15.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:14:0) after 3m46s
[06:29:01.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:14:0)
[06:29:01.306] Build status: STARTED
[06:29:01.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:15:0) after 6m48s
[06:35:49.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:15:0)
[06:35:49.499] Build status: STARTED
[06:35:49.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:16:0) after 6m42s
[06:42:31.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:16:0)
[06:42:31.644] Build status: STARTED
[06:42:31.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:17:0) after 2m29s
[06:45:00.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:17:0)
[06:45:00.743] Build status: STARTED
[06:45:00.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:18:0) after 7m27s
[06:52:27.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:18:0)
[06:52:27.870] Build status: STARTED
[06:52:27.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:19:0) after 6m56s
[06:59:24.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:19:0)
[06:59:24.089] Build status: STARTED
[06:59:24.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:20:0) after 6m29s
[07:05:53.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:20:0)
[07:05:53.235] Build status: STARTED
[07:05:53.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:21:0) after 1m5s
[07:06:58.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:21:0)
[07:06:58.720] Build status: STARTED
[07:06:58.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:22:0) after 1m4s
[07:08:02.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:22:0)
[07:08:02.878] Build status: STARTED
[07:08:02.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:23:0) after 6m18s
[07:14:20.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:23:0)
[07:14:20.938] Build status: STARTED
[07:14:20.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:24:0) after 5m39s
[07:19:59.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:24:0)
[07:19:59.970] Build status: STARTED
[07:19:59.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:25:0) after 1m0s
[07:21:00.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:25:0)
[07:21:00.385] Build status: STARTED
[07:21:00.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:26:0) after 2m34s
[07:23:34.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:26:0)
[07:23:34.428] Build status: STARTED
[07:23:34.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:27:0) after 4m43s
[07:28:17.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:27:0)
[07:28:17.708] Build status: STARTED
[07:28:17.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:28:0) after 3m6s
[07:31:23.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:28:0)
[07:31:23.780] Build status: STARTED
[07:31:23.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:29:0) after 3m42s
[07:35:05.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:29:0)
[07:35:05.826] Build status: STARTED
[07:35:05.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:30:0) after 1m1s
[07:36:06.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:30:0)
[07:36:06.884] Build status: STARTED
[07:36:06.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:31:0) after 3m13s
[07:39:20.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:31:0)
[07:39:20.045] Build status: STARTED
[07:39:20.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:32:0) after 4m2s
[07:43:22.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:32:0)
[07:43:22.102] Build status: STARTED
[07:43:22.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:33:0) after 8m29s
[07:51:51.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:33:0)
[07:51:51.158] Build status: STARTED
[07:51:51.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:34:0) after 7m22s
[07:59:13.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:34:0)
[07:59:13.283] Build status: STARTED
[07:59:13.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:35:0) after 2m54s
[08:02:07.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:35:0)
[08:02:07.488] Build status: STARTED
[08:02:07.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:36:0) after 3m29s
[08:05:36.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:36:0)
[08:05:36.539] Build status: STARTED
[08:05:36.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:37:0) after 4m33s
[08:10:09.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:37:0)
[08:10:09.889] Build status: STARTED
[08:10:09.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:38:0) after 3m20s
[08:13:29.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:38:0)
[08:13:29.990] Build status: STARTED
[08:13:29.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:39:0) after 9m54s
[08:23:24.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:39:0)
[08:23:24.049] Build status: STARTED
[08:23:24.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:40:0) after 9m46s
[08:33:10.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:40:0)
[08:33:10.115] Build status: STARTED
[08:33:10.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:41:0) after 8m27s
[08:41:37.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:41:0)
[08:41:37.151] Build status: STARTED
[08:41:37.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:42:0) after 6m18s
[08:47:55.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:42:0)
[08:47:55.237] Build status: STARTED
[08:47:55.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:43:0) after 3m11s
[08:51:06.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:43:0)
[08:51:06.595] Build status: STARTED
[08:51:06.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:44:0) after 4m44s
[08:55:50.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:44:0)
[08:55:50.834] Build status: STARTED
[08:55:50.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:45:0) after 4m27s
[09:00:18.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:45:0)
[09:00:18.087] Build status: STARTED
[09:00:18.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:46:0) after 3m0s
[09:03:18.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:46:0)
[09:03:18.688] Build status: STARTED
[09:03:18.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:47:0) after 9m29s
[09:12:47.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:47:0)
[09:12:47.967] Build status: STARTED
[09:12:47.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:48:0) after 8m39s
[09:21:27.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:48:0)
[09:21:27.453] Build status: STARTED
[09:21:27.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:49:0) after 5m2s
[09:26:29.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:49:0)
[09:26:29.604] Build status: STARTED
[09:26:29.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:50:0) after 3m16s
[09:29:45.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:50:0)
[09:29:45.849] Build status: STARTED
[09:29:45.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:51:0) after 7m29s
[09:37:14.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:51:0)
[09:37:14.903] Build status: STARTED
[09:37:14.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:52:0) after 4m30s
[09:41:44.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:52:0)
[09:41:44.952] Build status: STARTED
[09:41:44.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:53:0) after 1m51s
[09:43:36.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:53:0)
[09:43:36.306] Build status: STARTED
[09:43:36.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:54:0) after 9m25s
[09:53:01.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:54:0)
[09:53:01.491] Build status: STARTED
[09:53:01.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:55:0) after 3m2s
[09:56:03.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:55:0)
[09:56:03.559] Build status: STARTED
[09:56:03.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:56:0) after 4m35s
[10:00:38.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:56:0)
[10:00:38.603] Build status: STARTED
[10:00:38.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:57:0) after 1m47s
[10:02:25.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:57:0)
[10:02:25.731] Build status: STARTED
[10:02:25.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:58:0) after 3m9s
[10:05:34.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:58:0)
[10:05:34.907] Build status: STARTED
[10:05:34.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:59:0) after 7m26s
[10:13:01.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:59:0)
[10:13:01.063] Build status: STARTED
[10:13:01.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:60:0) after 3m15s
[10:16:16.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:60:0)
[10:16:16.113] Build status: STARTED
[10:16:16.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:61:0) after 2m2s
[10:18:18.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:61:0)
[10:18:18.154] Build status: STARTED
[10:18:18.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:62:0) after 5m43s
[10:24:01.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:62:0)
[10:24:01.529] Build status: STARTED
[10:24:01.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:63:0) after 6m36s
[10:30:37.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:63:0)
[10:30:37.602] Build status: STARTED
[10:30:37.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:64:0) after 7m42s
[10:38:19.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:64:0)
[10:38:19.671] Build status: STARTED
[10:38:19.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:65:0) after 5m25s
[10:43:44.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:65:0)
[10:43:44.782] Build status: STARTED
[10:43:44.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:66:0) after 2m43s
[10:46:27.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:66:0)
[10:46:27.804] Build status: STARTED
[10:46:27.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:67:0) after 6m41s
[10:53:08.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:67:0)
[10:53:09.020] Build status: STARTED
[10:53:09.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:68:0) after 6m18s
[10:59:27.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:68:0)
[10:59:27.334] Build status: STARTED
[10:59:27.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:69:0) after 6m19s
[11:05:46.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:69:0)
[11:05:46.459] Build status: STARTED
[11:05:46.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:70:0) after 6m6s
[11:11:52.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:70:0)
[11:11:52.830] Build status: STARTED
[11:11:52.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:71:0) after 6m8s
[11:18:00.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:71:0)
[11:18:01.007] Build status: STARTED
[11:18:01.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:72:0) after 5m22s
[11:23:23.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:72:0)
[11:23:23.153] Build status: STARTED
[11:23:23.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:73:0) after 9m0s
[11:32:23.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:73:0)
[11:32:23.175] Build status: STARTED
[11:32:23.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:74:0) after 1m24s
[11:33:47.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:74:0)
[11:33:47.516] Build status: STARTED
[11:33:47.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:75:0) after 8m17s
[11:42:04.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:75:0)
[11:42:04.852] Build status: STARTED
[11:42:04.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:76:0) after 5m51s
[11:47:56.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:76:0)
[11:47:56.079] Build status: STARTED
[11:47:56.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:77:0) after 3m17s
[11:51:13.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:77:0)
[11:51:13.471] Build status: STARTED
[11:51:13.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:78:0) after 3m20s
[11:54:33.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:78:0)
[11:54:33.556] Build status: STARTED
[11:54:33.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:79:0) after 2m13s
[11:56:46.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:79:0)
[11:56:46.936] Build status: STARTED
[11:56:46.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:80:0) after 2m42s
[11:59:29.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:80:0)
[11:59:29.135] Build status: STARTED
[11:59:29.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:81:0) after 9m8s
[12:08:37.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:81:0)
[12:08:37.219] Build status: STARTED
[12:08:37.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:82:0) after 3m4s
[12:11:41.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:82:0)
[12:11:41.724] Build status: STARTED
[12:11:41.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:83:0) after 1m57s
[12:13:38.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:83:0)
[12:13:38.988] Build status: STARTED
[12:13:38.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:84:0) after 9m26s
[12:23:05.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:84:0)
[12:23:05.131] Build status: STARTED
[12:23:05.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:85:0) after 4m1s
[12:27:06.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:85:0)
[12:27:06.191] Build status: STARTED
[12:27:06.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:86:0) after 2m21s
[12:29:27.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:86:0)
[12:29:27.290] Build status: STARTED
[12:29:27.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:87:0) after 5m4s
[12:34:31.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:87:0)
[12:34:31.337] Build status: STARTED
[12:34:31.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:88:0) after 4m18s
[12:38:49.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:88:0)
[12:38:49.577] Build status: STARTED
[12:38:49.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:89:0) after 1m23s
[12:40:12.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:89:0)
[12:40:12.904] Build status: STARTED
[12:40:12.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:90:0) after 9m7s
[12:49:19.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:90:0)
[12:49:19.999] Build status: STARTED
[12:49:20.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:91:0) after 6m33s
[12:55:53.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:91:0)
[12:55:53.408] Build status: STARTED
[12:55:53.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:92:0) after 5m26s
[13:01:19.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:92:0)
[13:01:19.563] Build status: STARTED
[13:01:19.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:93:0) after 7m37s
[13:08:56.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:93:0)
[13:08:56.921] Build status: STARTED
[13:08:56.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:94:0) after 8m1s
[13:16:57.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:94:0)
[13:16:58.006] Build status: STARTED
[13:16:58.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:95:0) after 8m20s
[13:25:18.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:95:0)
[13:25:18.083] Build status: STARTED
[13:25:18.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:96:0) after 5m13s
[13:30:31.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:96:0)
[13:30:31.728] Build status: STARTED
[13:30:31.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:97:0) after 8m46s
[13:39:17.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:97:0)
[13:39:17.890] Build status: STARTED
[13:39:17.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:98:0) after 4m16s
[13:43:34.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:98:0)
[13:43:34.104] Build status: STARTED
[13:43:34.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:99:0) after 1m43s
[13:45:17.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:99:0)
[13:45:17.357] Build status: STARTED
[13:45:17.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:100:0) after 5m43s
[13:51:00.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:100:0)
[13:51:00.901] Build status: STARTED
[13:51:00.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:101:0) after 1m8s
[13:52:09.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:101:0)
[13:52:09.131] Build status: STARTED
[13:52:09.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:102:0) after 4m6s
[13:56:15.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:102:0)
[13:56:15.348] Build status: STARTED
[13:56:15.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:103:0) after 1m25s
[13:57:40.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:103:0)
[13:57:40.408] Build status: STARTED
[13:57:40.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:104:0) after 7m31s
[14:05:11.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:104:0)
[14:05:11.597] Build status: STARTED
[14:05:11.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:105:0) after 1m40s
[14:06:51.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:105:0)
[14:06:51.907] Build status: STARTED
[14:06:51.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:106:0) after 6m8s
[14:13:00.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:106:0)
[14:13:00.033] Build status: STARTED
[14:13:00.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:107:0) after 3m36s
[14:16:36.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:107:0)
[14:16:36.544] Build status: STARTED
[14:16:36.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:108:0) after 1m27s
[14:18:03.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:108:0)
[14:18:03.838] Build status: STARTED
[14:18:03.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:109:0) after 7m50s
[14:25:53.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:109:0)
[14:25:53.978] Build status: STARTED
[14:25:53.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:110:0) after 9m56s
[14:35:50.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:110:0)
[14:35:50.056] Build status: STARTED
[14:35:50.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:111:0) after 6m19s
[14:42:09.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:111:0)
[14:42:09.217] Build status: STARTED
[14:42:09.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:112:0) after 7m23s
[14:49:32.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:112:0)
[14:49:32.480] Build status: STARTED
[14:49:32.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:113:0) after 2m9s
[14:51:41.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:113:0)
[14:51:41.538] Build status: STARTED
[14:51:41.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:114:0) after 1m47s
[14:53:28.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:114:0)
[14:53:28.641] Build status: STARTED
[14:53:28.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:115:0) after 6m23s
[14:59:51.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:115:0)
[14:59:51.787] Build status: STARTED
[14:59:51.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:116:0) after 5m14s
[15:05:05.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:116:0)
[15:05:05.843] Build status: STARTED
[15:05:05.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:117:0) after 3m23s
[15:08:28.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:117:0)
[15:08:28.891] Build status: STARTED
[15:08:28.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:118:0) after 3m8s
[15:11:36.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:118:0)
[15:11:36.957] Build status: STARTED
[15:11:36.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:119:0) after 9m2s
[15:20:39.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:119:0)
[15:20:39.135] Build status: STARTED
[15:20:39.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:120:0) after 1m44s
[15:22:23.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:120:0)
[15:22:23.241] Build status: STARTED
[15:22:23.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:121:0) after 5m1s
[15:27:24.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:121:0)
[15:27:24.420] Build status: STARTED
[15:27:24.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:122:0) after 1m3s
[15:28:27.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:122:0)
[15:28:27.918] Build status: STARTED
[15:28:27.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:123:0) after 3m53s
[15:32:21.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:123:0)
[15:32:21.145] Build status: STARTED
[15:32:21.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:124:0) after 3m14s
[15:35:35.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:124:0)
[15:35:35.578] Build status: STARTED
[15:35:35.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:125:0) after 5m56s
[15:41:31.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:125:0)
[15:41:31.794] Build status: STARTED
[15:41:31.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:126:0) after 5m54s
[15:47:25.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:126:0)
[15:47:25.842] Build status: STARTED
[15:47:25.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:127:0) after 6m54s
[15:54:19.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:127:0)
[15:54:19.929] Build status: STARTED
[15:54:19.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:128:0) after 9m55s
[16:04:14.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:128:0)
[16:04:15.039] Build status: STARTED
[16:04:15.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:129:0) after 5m40s
[16:09:55.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:129:0)
[16:09:55.529] Build status: STARTED
[16:09:55.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:130:0) after 9m38s
[16:19:33.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:130:0)
[16:19:33.703] Build status: STARTED
[16:19:33.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:131:0) after 6m7s
[16:25:40.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:131:0)
[16:25:40.796] Build status: STARTED
[16:25:40.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:132:0) after 9m7s
[16:34:47.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:132:0)
[16:34:47.890] Build status: STARTED
[16:34:47.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:133:0) after 7m10s
[16:41:57.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:133:0)
[16:41:57.944] Build status: STARTED
[16:41:57.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:134:0) after 5m1s
[16:46:59.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:134:0)
[16:46:59.052] Build status: STARTED
[16:46:59.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:135:0) after 4m14s
[16:51:13.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:135:0)
[16:51:13.097] Build status: STARTED
[16:51:13.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:136:0) after 1m46s
[16:52:59.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:136:0)
[16:52:59.181] Build status: STARTED
[16:52:59.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:137:0) after 9m58s
[17:02:57.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:137:0)
[17:02:57.234] Build status: STARTED
[17:02:57.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:138:0) after 3m31s
[17:06:28.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:138:0)
[17:06:28.300] Build status: STARTED
[17:06:28.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:139:0) after 3m26s
[17:09:54.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:139:0)
[17:09:54.399] Build status: STARTED
[17:09:54.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:140:0) after 1m1s
[17:10:55.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:140:0)
[17:10:55.578] Build status: STARTED
[17:10:55.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:141:0) after 7m5s
[17:18:00.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:141:0)
[17:18:00.784] Build status: STARTED
[17:18:00.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:142:0) after 9m26s
[17:27:26.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:142:0)
[17:27:29.430] Build status: STARTED
[17:27:29.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:143:0) after 7m47s
[17:35:16.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:143:0)
[17:35:16.572] Build status: STARTED
[17:35:16.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:144:0) after 1m24s
[17:36:40.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:144:0)
[17:36:40.658] Build status: STARTED
[17:36:40.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:145:0) after 4m46s
[17:41:26.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:145:0)
[17:41:26.794] Build status: STARTED
[17:41:26.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:146:0) after 6m31s
[17:47:58.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:146:0)
[17:47:58.046] Build status: STARTED
[17:47:58.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:147:0) after 8m35s
[17:56:33.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:147:0)
[17:56:33.090] Build status: STARTED
[17:56:33.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:148:0) after 9m31s
[18:06:04.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:148:0)
[18:06:04.346] Build status: STARTED
[18:06:04.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:149:0) after 9m6s
[18:15:10.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:149:0)
[18:15:10.480] Build status: STARTED
[18:15:10.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:150:0) after 4m37s
[18:19:47.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:150:0)
[18:19:47.580] Build status: STARTED
[18:19:47.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:151:0) after 6m22s
[18:26:09.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:151:0)
[18:26:09.655] Build status: STARTED
[18:26:09.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:152:0) after 4m2s
[18:30:11.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:152:0)
[18:30:11.923] Build status: STARTED
[18:30:11.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:153:0) after 7m52s
[18:38:03.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:153:0)
[18:38:03.986] Build status: STARTED
[18:38:03.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:154:0) after 4m58s
[18:43:02.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:154:0)
[18:43:02.161] Build status: STARTED
[18:43:02.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:155:0) after 9m5s
[18:52:07.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:155:0)
[18:52:07.273] Build status: STARTED
[18:52:07.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:156:0) after 4m0s
[18:56:07.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:156:0)
[18:56:07.380] Build status: STARTED
[18:56:07.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:157:0) after 9m27s
[19:05:34.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:157:0)
[19:05:34.441] Build status: STARTED
[19:05:34.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:158:0) after 5m0s
[19:10:34.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:158:0)
[19:10:34.487] Build status: STARTED
[19:10:34.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:159:0) after 2m9s
[19:12:43.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:159:0)
[19:12:43.608] Build status: STARTED
[19:12:43.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:160:0) after 6m28s
[19:19:11.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:160:0)
[19:19:11.666] Build status: STARTED
[19:19:11.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:161:0) after 8m44s
[19:27:55.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:161:0)
[19:27:55.834] Build status: STARTED
[19:27:55.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:162:0) after 8m11s
[19:36:06.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:162:0)
[19:36:06.931] Build status: STARTED
[19:36:06.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:163:0) after 9m24s
[19:45:30.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:163:0)
[19:45:30.942] Build status: STARTED
[19:45:30.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:164:0) after 6m49s
[19:52:20.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:164:0)
[19:52:20.524] Build status: STARTED
[19:52:20.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:165:0) after 4m50s
[19:57:10.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:165:0)
[19:57:10.667] Build status: STARTED
[19:57:10.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:166:0) after 6m44s
[20:03:54.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:166:0)
[20:03:54.804] Build status: STARTED
[20:03:54.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:167:0) after 2m20s
[20:06:14.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:167:0)
[20:06:14.854] Build status: STARTED
[20:06:14.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:168:0) after 8m56s
[20:15:10.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:168:0)
[20:15:10.927] Build status: STARTED
[20:15:10.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:169:0) after 5m41s
[20:20:52.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:169:0)
[20:20:52.296] Build status: STARTED
[20:20:52.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:170:0) after 6m28s
[20:27:20.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:170:0)
[20:27:20.362] Build status: STARTED
[20:27:20.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:171:0) after 2m19s
[20:29:39.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:171:0)
[20:29:39.492] Build status: STARTED
[20:29:39.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:172:0) after 1m52s
[20:31:31.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:172:0)
[20:31:31.588] Build status: STARTED
[20:31:31.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:173:0) after 9m19s
[20:40:50.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:173:0)
[20:40:50.940] Build status: STARTED
[20:40:50.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:174:0) after 4m34s
[20:45:25.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:174:0)
[20:45:25.103] Build status: STARTED
[20:45:25.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:175:0) after 9m11s
[20:54:36.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:175:0)
[20:54:36.396] Build status: STARTED
[20:54:36.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:176:0) after 5m41s
[21:00:17.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:176:0)
[21:00:17.406] Build status: STARTED
[21:00:17.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8920485671553162256:177:0) after 6m38s
[21:03:36.730] Received PubSub notification, asking Buildbucket for the build status
[21:03:36.819] Build:
{
"id": "8755055609550479793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30309,
"createdBy": "project:chromium",
"createTime": "2024-02-26T05:29:08.671822627Z",
"startTime": "2024-02-26T05:29:09.781474Z",
"endTime": "2024-02-26T21:03:35.819459Z",
"updateTime": "2024-02-26T21:03:35.819459Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0e832e67fc3d6c0ea183e2a333fd9bd214767f1c",
"ref": "refs/heads/main"
}
}
}
[21:03:36.819] Invocation finished in 15h34m29.441144852s with status FAILED