[08:43:22.379] New invocation is queued and will start shortly
[08:43:23.453] Starting the invocation (attempt 1)
[08:43:23.493] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ad47b21469e63ad4662d680c475975f8029b1e38"
[08:43:23.493] Popped gitiles commit info from properties and tags
[08:43:23.493] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:43:23.493] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:43:23.493] Buildbucket request:
{
"requestId": "8918480317153285712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ad47b21469e63ad4662d680c475975f8029b1e38",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8918480317153285712"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:43:24.090] Scheduled build:
{
"id": "8753050255247326769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30558,
"createdBy": "project:chromium",
"createTime": "2024-03-19T08:43:23.565617602Z",
"updateTime": "2024-03-19T08:43:23.565617602Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ad47b21469e63ad4662d680c475975f8029b1e38",
"ref": "refs/heads/main"
}
}
}
[08:43:24.090] Task URL: https://cr-buildbucket.appspot.com/build/8753050255247326769
[08:43:24.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:2:0) after 4m25s
[08:45:23.007] Received PubSub notification, asking Buildbucket for the build status
[08:45:23.042] Build status: STARTED
[08:45:25.154] Received PubSub notification, asking Buildbucket for the build status
[08:45:25.186] Build status: STARTED
[08:47:49.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:2:0)
[08:47:49.540] Build status: STARTED
[08:47:49.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:5:0) after 2m46s
[08:50:35.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:5:0)
[08:50:35.716] Build status: STARTED
[08:50:35.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:6:0) after 2m32s
[08:53:07.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:6:0)
[08:53:07.855] Build status: STARTED
[08:53:07.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:7:0) after 1m44s
[08:54:51.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:7:0)
[08:54:51.951] Build status: STARTED
[08:54:51.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:8:0) after 7m29s
[09:02:21.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:8:0)
[09:02:21.377] Build status: STARTED
[09:02:21.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:9:0) after 4m15s
[09:06:36.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:9:0)
[09:06:36.507] Build status: STARTED
[09:06:36.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:10:0) after 6m29s
[09:13:05.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:10:0)
[09:13:05.893] Build status: STARTED
[09:13:05.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:11:0) after 7m5s
[09:20:11.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:11:0)
[09:20:11.271] Build status: STARTED
[09:20:11.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:12:0) after 2m43s
[09:22:54.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:12:0)
[09:22:54.464] Build status: STARTED
[09:22:54.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:13:0) after 7m19s
[09:30:13.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:13:0)
[09:30:13.696] Build status: STARTED
[09:30:13.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:14:0) after 5m16s
[09:35:29.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:14:0)
[09:35:29.831] Build status: STARTED
[09:35:29.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:15:0) after 9m21s
[09:44:50.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:15:0)
[09:44:50.899] Build status: STARTED
[09:44:50.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:16:0) after 4m5s
[09:48:55.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:16:0)
[09:48:56.000] Build status: STARTED
[09:48:56.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:17:0) after 3m43s
[09:52:39.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:17:0)
[09:52:39.117] Build status: STARTED
[09:52:39.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:18:0) after 3m2s
[09:55:41.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:18:0)
[09:55:41.297] Build status: STARTED
[09:55:41.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:19:0) after 9m50s
[10:05:31.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:19:0)
[10:05:31.370] Build status: STARTED
[10:05:31.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:20:0) after 5m26s
[10:10:57.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:20:0)
[10:10:57.542] Build status: STARTED
[10:10:57.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:21:0) after 8m24s
[10:19:21.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:21:0)
[10:19:21.996] Build status: STARTED
[10:19:21.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:22:0) after 6m25s
[10:25:47.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:22:0)
[10:25:47.058] Build status: STARTED
[10:25:47.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:23:0) after 7m36s
[10:33:23.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:23:0)
[10:33:23.495] Build status: STARTED
[10:33:23.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:24:0) after 4m7s
[10:37:30.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:24:0)
[10:37:30.684] Build status: STARTED
[10:37:30.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:25:0) after 4m14s
[10:41:44.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:25:0)
[10:41:44.821] Build status: STARTED
[10:41:44.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:26:0) after 4m19s
[10:46:03.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:26:0)
[10:46:03.905] Build status: STARTED
[10:46:03.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:27:0) after 1m21s
[10:47:24.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:27:0)
[10:47:24.952] Build status: STARTED
[10:47:24.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:28:0) after 9m24s
[10:56:49.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:28:0)
[10:56:49.030] Build status: STARTED
[10:56:49.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:29:0) after 3m20s
[11:00:09.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:29:0)
[11:00:09.416] Build status: STARTED
[11:00:09.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:30:0) after 2m51s
[11:03:00.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:30:0)
[11:03:00.575] Build status: STARTED
[11:03:00.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:31:0) after 8m40s
[11:11:40.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:31:0)
[11:11:40.697] Build status: STARTED
[11:11:40.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:32:0) after 5m11s
[11:16:51.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:32:0)
[11:16:51.894] Build status: STARTED
[11:16:51.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:33:0) after 6m9s
[11:23:00.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:33:0)
[11:23:00.980] Build status: STARTED
[11:23:00.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:34:0) after 9m0s
[11:32:01.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:34:0)
[11:32:01.045] Build status: STARTED
[11:32:01.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:35:0) after 4m37s
[11:36:38.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:35:0)
[11:36:38.216] Build status: STARTED
[11:36:38.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:36:0) after 1m29s
[11:38:07.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:36:0)
[11:38:07.303] Build status: STARTED
[11:38:07.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:37:0) after 3m57s
[11:42:04.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:37:0)
[11:42:04.404] Build status: STARTED
[11:42:04.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:38:0) after 5m22s
[11:47:26.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:38:0)
[11:47:26.572] Build status: STARTED
[11:47:26.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:39:0) after 4m13s
[11:51:39.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:39:0)
[11:51:39.744] Build status: STARTED
[11:51:39.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:40:0) after 4m54s
[11:56:33.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:40:0)
[11:56:33.801] Build status: STARTED
[11:56:33.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:41:0) after 4m8s
[12:00:41.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:41:0)
[12:00:41.933] Build status: STARTED
[12:00:41.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:42:0) after 6m54s
[12:07:36.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:42:0)
[12:07:36.079] Build status: STARTED
[12:07:36.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:43:0) after 9m9s
[12:16:45.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:43:0)
[12:16:45.638] Build status: STARTED
[12:16:45.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:44:0) after 2m53s
[12:19:38.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:44:0)
[12:19:38.818] Build status: STARTED
[12:19:38.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:45:0) after 5m9s
[12:24:47.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:45:0)
[12:24:47.997] Build status: STARTED
[12:24:47.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:46:0) after 8m2s
[12:32:50.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:46:0)
[12:32:50.161] Build status: STARTED
[12:32:50.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:47:0) after 9m2s
[12:41:52.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:47:0)
[12:41:52.227] Build status: STARTED
[12:41:52.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:48:0) after 9m44s
[12:51:36.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:48:0)
[12:51:36.398] Build status: STARTED
[12:51:36.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:49:0) after 4m28s
[12:56:04.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:49:0)
[12:56:04.464] Build status: STARTED
[12:56:04.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:50:0) after 7m11s
[13:03:15.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:50:0)
[13:03:15.543] Build status: STARTED
[13:03:15.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:51:0) after 5m17s
[13:08:32.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:51:0)
[13:08:33.089] Build status: STARTED
[13:08:33.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:52:0) after 1m46s
[13:10:19.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:52:0)
[13:10:19.347] Build status: STARTED
[13:10:19.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:53:0) after 3m53s
[13:14:12.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:53:0)
[13:14:12.531] Build status: STARTED
[13:14:12.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:54:0) after 9m23s
[13:23:35.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:54:0)
[13:23:35.643] Build status: STARTED
[13:23:35.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:55:0) after 8m32s
[13:32:07.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:55:0)
[13:32:07.706] Build status: STARTED
[13:32:07.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:56:0) after 8m53s
[13:41:00.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:56:0)
[13:41:00.798] Build status: STARTED
[13:41:00.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:57:0) after 5m51s
[13:46:51.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:57:0)
[13:46:51.920] Build status: STARTED
[13:46:51.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:58:0) after 8m37s
[13:55:28.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:58:0)
[13:55:28.977] Build status: STARTED
[13:55:28.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:59:0) after 1m7s
[13:56:36.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:59:0)
[13:56:36.155] Build status: STARTED
[13:56:36.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:60:0) after 8m53s
[14:05:29.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:60:0)
[14:05:29.502] Build status: STARTED
[14:05:29.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:61:0) after 9m28s
[14:14:57.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:61:0)
[14:14:57.696] Build status: STARTED
[14:14:57.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:62:0) after 5m2s
[14:19:59.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:62:0)
[14:19:59.877] Build status: STARTED
[14:19:59.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:63:0) after 9m34s
[14:29:34.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:63:0)
[14:29:34.104] Build status: STARTED
[14:29:34.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:64:0) after 5m59s
[14:35:33.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:64:0)
[14:35:33.236] Build status: STARTED
[14:35:33.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:65:0) after 7m36s
[14:43:09.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:65:0)
[14:43:09.453] Build status: STARTED
[14:43:09.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:66:0) after 5m6s
[14:48:15.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:66:0)
[14:48:15.594] Build status: STARTED
[14:48:15.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:67:0) after 1m49s
[14:50:04.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:67:0)
[14:50:04.715] Build status: STARTED
[14:50:04.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:68:0) after 9m18s
[14:59:22.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:68:0)
[14:59:22.817] Build status: STARTED
[14:59:22.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:69:0) after 2m52s
[15:02:14.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:69:0)
[15:02:14.975] Build status: STARTED
[15:02:14.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:70:0) after 5m9s
[15:07:24.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:70:0)
[15:07:24.204] Build status: STARTED
[15:07:24.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:71:0) after 3m27s
[15:10:51.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:71:0)
[15:10:51.391] Build status: STARTED
[15:10:51.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:72:0) after 5m54s
[15:16:45.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:72:0)
[15:16:45.461] Build status: STARTED
[15:16:45.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:73:0) after 5m26s
[15:22:11.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:73:0)
[15:22:11.551] Build status: STARTED
[15:22:11.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:74:0) after 9m52s
[15:32:03.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:74:0)
[15:32:03.803] Build status: STARTED
[15:32:03.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:75:0) after 4m18s
[15:36:21.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:75:0)
[15:36:21.956] Build status: STARTED
[15:36:21.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:76:0) after 1m20s
[15:37:42.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:76:0)
[15:37:42.068] Build status: STARTED
[15:37:42.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:77:0) after 2m57s
[15:40:39.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:77:0)
[15:40:39.183] Build status: STARTED
[15:40:39.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:78:0) after 9m9s
[15:49:48.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:78:0)
[15:49:48.313] Build status: STARTED
[15:49:48.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:79:0) after 5m16s
[15:55:04.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:79:0)
[15:55:04.383] Build status: STARTED
[15:55:04.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:80:0) after 8m5s
[16:03:09.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:80:0)
[16:03:09.441] Build status: STARTED
[16:03:09.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:81:0) after 9m39s
[16:12:48.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:81:0)
[16:12:48.566] Build status: STARTED
[16:12:48.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:82:0) after 2m32s
[16:15:20.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:82:0)
[16:15:20.992] Build status: STARTED
[16:15:20.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:83:0) after 6m49s
[16:22:10.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:83:0)
[16:22:10.135] Build status: STARTED
[16:22:10.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:84:0) after 5m4s
[16:27:14.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:84:0)
[16:27:14.223] Build status: STARTED
[16:27:14.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:85:0) after 3m0s
[16:30:14.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:85:0)
[16:30:14.288] Build status: STARTED
[16:30:14.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:86:0) after 5m1s
[16:35:15.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:86:0)
[16:35:15.466] Build status: STARTED
[16:35:15.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:87:0) after 5m29s
[16:40:44.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:87:0)
[16:40:44.573] Build status: STARTED
[16:40:44.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:88:0) after 4m27s
[16:45:11.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:88:0)
[16:45:11.936] Build status: STARTED
[16:45:11.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:89:0) after 8m15s
[16:53:27.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:89:0)
[16:53:27.044] Build status: STARTED
[16:53:27.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:90:0) after 9m59s
[17:03:26.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:90:0)
[17:03:26.239] Build status: STARTED
[17:03:26.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:91:0) after 7m44s
[17:11:10.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:91:0)
[17:11:10.336] Build status: STARTED
[17:11:10.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:92:0) after 3m38s
[17:14:48.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:92:0)
[17:14:48.480] Build status: STARTED
[17:14:48.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:93:0) after 4m35s
[17:19:23.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:93:0)
[17:19:23.844] Build status: STARTED
[17:19:23.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:94:0) after 6m9s
[17:25:33.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:94:0)
[17:25:33.101] Build status: STARTED
[17:25:33.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:95:0) after 4m29s
[17:30:02.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:95:0)
[17:30:02.625] Build status: STARTED
[17:30:02.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:96:0) after 2m46s
[17:32:48.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:96:0)
[17:32:48.997] Build status: STARTED
[17:32:48.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:97:0) after 2m44s
[17:35:33.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:97:0)
[17:35:33.145] Build status: STARTED
[17:35:33.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:98:0) after 6m22s
[17:41:55.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:98:0)
[17:41:55.198] Build status: STARTED
[17:41:55.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:99:0) after 8m23s
[17:50:18.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:99:0)
[17:50:18.466] Build status: STARTED
[17:50:18.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:100:0) after 5m13s
[17:55:31.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:100:0)
[17:55:31.582] Build status: STARTED
[17:55:31.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:101:0) after 1m46s
[17:57:17.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:101:0)
[17:57:17.655] Build status: STARTED
[17:57:17.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:102:0) after 2m26s
[17:59:43.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:102:0)
[17:59:43.713] Build status: STARTED
[17:59:43.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:103:0) after 3m48s
[18:03:31.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:103:0)
[18:03:31.824] Build status: STARTED
[18:03:31.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:104:0) after 9m17s
[18:12:48.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:104:0)
[18:12:48.896] Build status: STARTED
[18:12:48.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:105:0) after 5m0s
[18:17:49.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:105:0)
[18:17:49.160] Build status: STARTED
[18:17:49.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:106:0) after 3m40s
[18:21:29.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:106:0)
[18:21:29.236] Build status: STARTED
[18:21:29.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:107:0) after 7m50s
[18:29:19.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:107:0)
[18:29:19.341] Build status: STARTED
[18:29:19.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:108:0) after 5m28s
[18:34:47.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:108:0)
[18:34:47.513] Build status: STARTED
[18:34:47.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:109:0) after 7m41s
[18:42:28.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:109:0)
[18:42:28.915] Build status: STARTED
[18:42:28.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:110:0) after 3m41s
[18:46:09.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:110:0)
[18:46:09.997] Build status: STARTED
[18:46:09.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:111:0) after 4m43s
[18:50:53.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:111:0)
[18:50:53.119] Build status: STARTED
[18:50:53.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:112:0) after 6m2s
[18:56:55.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:112:0)
[18:56:55.201] Build status: STARTED
[18:56:55.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:113:0) after 1m22s
[18:58:17.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:113:0)
[18:58:17.259] Build status: STARTED
[18:58:17.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:114:0) after 7m20s
[19:05:37.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:114:0)
[19:05:37.340] Build status: STARTED
[19:05:37.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:115:0) after 8m8s
[19:13:45.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:115:0)
[19:13:45.415] Build status: STARTED
[19:13:45.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:116:0) after 6m19s
[19:20:04.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:116:0)
[19:20:04.615] Build status: STARTED
[19:20:04.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:117:0) after 9m20s
[19:29:24.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:117:0)
[19:29:24.713] Build status: STARTED
[19:29:24.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:118:0) after 4m0s
[19:33:24.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:118:0)
[19:33:24.806] Build status: STARTED
[19:33:24.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:119:0) after 7m4s
[19:40:28.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:119:0)
[19:40:28.995] Build status: STARTED
[19:40:28.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:120:0) after 1m16s
[19:41:45.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:120:0)
[19:41:45.116] Build status: STARTED
[19:41:45.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:121:0) after 9m1s
[19:50:46.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:121:0)
[19:50:46.279] Build status: STARTED
[19:50:46.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:122:0) after 3m28s
[19:54:14.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:122:0)
[19:54:14.342] Build status: STARTED
[19:54:14.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:123:0) after 2m35s
[19:56:49.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:123:0)
[19:56:49.572] Build status: STARTED
[19:56:49.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:124:0) after 6m44s
[20:03:33.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:124:0)
[20:03:33.743] Build status: STARTED
[20:03:33.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:125:0) after 6m17s
[20:09:50.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:125:0)
[20:09:50.836] Build status: STARTED
[20:09:50.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:126:0) after 8m35s
[20:18:25.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:126:0)
[20:18:25.891] Build status: STARTED
[20:18:25.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:127:0) after 6m13s
[20:24:38.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:127:0)
[20:24:38.993] Build status: STARTED
[20:24:38.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:128:0) after 3m59s
[20:28:38.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:128:0)
[20:28:38.103] Build status: STARTED
[20:28:38.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:129:0) after 1m13s
[20:29:51.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:129:0)
[20:29:51.207] Build status: STARTED
[20:29:51.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:130:0) after 1m41s
[20:31:32.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:130:0)
[20:31:32.289] Build status: STARTED
[20:31:32.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:131:0) after 7m51s
[20:39:23.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:131:0)
[20:39:23.456] Build status: STARTED
[20:39:23.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:132:0) after 2m19s
[20:41:42.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:132:0)
[20:41:42.560] Build status: STARTED
[20:41:42.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:133:0) after 9m31s
[20:51:13.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:133:0)
[20:51:13.773] Build status: STARTED
[20:51:13.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:134:0) after 8m3s
[20:59:16.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:134:0)
[20:59:16.956] Build status: STARTED
[20:59:16.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:135:0) after 1m27s
[21:00:44.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:135:0)
[21:00:44.286] Build status: STARTED
[21:00:44.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:136:0) after 6m27s
[21:07:11.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:136:0)
[21:07:11.375] Build status: STARTED
[21:07:11.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:137:0) after 9m43s
[21:16:54.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:137:0)
[21:16:54.435] Build status: STARTED
[21:16:54.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:138:0) after 4m33s
[21:21:27.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:138:0)
[21:21:27.527] Build status: STARTED
[21:21:27.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:139:0) after 6m53s
[21:28:20.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:139:0)
[21:28:20.780] Build status: STARTED
[21:28:20.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:140:0) after 2m23s
[21:30:43.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:140:0)
[21:30:43.833] Build status: STARTED
[21:30:43.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:141:0) after 1m51s
[21:32:34.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:141:0)
[21:32:34.965] Build status: STARTED
[21:32:34.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:142:0) after 9m38s
[21:42:13.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:142:0)
[21:42:13.356] Build status: STARTED
[21:42:13.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:143:0) after 8m54s
[21:51:07.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:143:0)
[21:51:07.425] Build status: STARTED
[21:51:07.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:144:0) after 7m31s
[21:58:38.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:144:0)
[21:58:38.491] Build status: STARTED
[21:58:38.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:145:0) after 8m27s
[22:07:05.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:145:0)
[22:07:05.801] Build status: STARTED
[22:07:05.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:146:0) after 4m0s
[22:11:06.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:146:0)
[22:11:06.133] Build status: STARTED
[22:11:06.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:147:0) after 2m32s
[22:13:38.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:147:0)
[22:13:38.273] Build status: STARTED
[22:13:38.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:148:0) after 7m52s
[22:21:30.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:148:0)
[22:21:30.572] Build status: STARTED
[22:21:30.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:149:0) after 4m6s
[22:25:36.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:149:0)
[22:25:36.639] Build status: STARTED
[22:25:36.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:150:0) after 9m50s
[22:35:26.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:150:0)
[22:35:26.698] Build status: STARTED
[22:35:26.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:151:0) after 2m41s
[22:38:07.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:151:0)
[22:38:07.777] Build status: STARTED
[22:38:07.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:152:0) after 9m12s
[22:47:19.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:152:0)
[22:47:19.885] Build status: STARTED
[22:47:19.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:153:0) after 2m43s
[22:50:02.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:153:0)
[22:50:03.009] Build status: STARTED
[22:50:03.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:154:0) after 1m18s
[22:51:21.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:154:0)
[22:51:21.192] Build status: STARTED
[22:51:21.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:155:0) after 3m0s
[22:54:21.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:155:0)
[22:54:21.433] Build status: STARTED
[22:54:21.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:156:0) after 6m45s
[23:01:06.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:156:0)
[23:01:06.513] Build status: STARTED
[23:01:06.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:157:0) after 3m8s
[23:04:14.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:157:0)
[23:04:14.580] Build status: STARTED
[23:04:14.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:158:0) after 9m55s
[23:14:09.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:158:0)
[23:14:09.697] Build status: STARTED
[23:14:09.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:159:0) after 3m47s
[23:17:56.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:159:0)
[23:17:56.945] Build status: STARTED
[23:17:56.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:160:0) after 6m10s
[23:24:06.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:160:0)
[23:24:07.014] Build status: STARTED
[23:24:07.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:161:0) after 6m45s
[23:30:52.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:161:0)
[23:30:52.093] Build status: STARTED
[23:30:52.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:162:0) after 6m33s
[23:37:25.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:162:0)
[23:37:25.297] Build status: STARTED
[23:37:25.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:163:0) after 5m5s
[23:42:30.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:163:0)
[23:42:30.496] Build status: STARTED
[23:42:30.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:164:0) after 1m44s
[23:44:14.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:164:0)
[23:44:14.676] Build status: STARTED
[23:44:14.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:165:0) after 1m3s
[23:45:17.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:165:0)
[23:45:17.835] Build status: STARTED
[23:45:17.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:166:0) after 7m3s
[23:52:20.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:166:0)
[23:52:20.948] Build status: STARTED
[23:52:20.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:167:0) after 6m24s
[23:58:45.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:167:0)
[23:58:45.044] Build status: STARTED
[23:58:45.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:168:0) after 6m10s
[00:04:55.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:168:0)
[00:04:55.378] Build status: STARTED
[00:04:55.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:169:0) after 8m10s
[00:13:05.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:169:0)
[00:13:05.441] Build status: STARTED
[00:13:05.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:170:0) after 9m29s
[00:22:34.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:170:0)
[00:22:34.525] Build status: STARTED
[00:22:34.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:171:0) after 9m51s
[00:32:25.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:171:0)
[00:32:25.735] Build status: STARTED
[00:32:25.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:172:0) after 5m57s
[00:38:22.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:172:0)
[00:38:22.811] Build status: STARTED
[00:38:22.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:173:0) after 2m8s
[00:40:30.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:173:0)
[00:40:30.889] Build status: STARTED
[00:40:30.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:174:0) after 1m56s
[00:42:26.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:174:0)
[00:42:27.068] Build status: STARTED
[00:42:27.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:175:0) after 7m46s
[00:50:13.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:175:0)
[00:50:13.222] Build status: STARTED
[00:50:13.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:176:0) after 7m48s
[00:58:01.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:176:0)
[00:58:01.386] Build status: STARTED
[00:58:01.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:177:0) after 1m17s
[00:59:18.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:177:0)
[00:59:18.585] Build status: STARTED
[00:59:18.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:178:0) after 7m48s
[01:07:06.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:178:0)
[01:07:06.712] Build status: STARTED
[01:07:06.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:179:0) after 7m13s
[01:14:19.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:179:0)
[01:14:19.830] Build status: STARTED
[01:14:19.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:180:0) after 8m18s
[01:22:37.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:180:0)
[01:22:37.894] Build status: STARTED
[01:22:37.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:181:0) after 8m55s
[01:31:32.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:181:0)
[01:31:33.056] Build status: STARTED
[01:31:33.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:182:0) after 1m28s
[01:33:01.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:182:0)
[01:33:01.153] Build status: STARTED
[01:33:01.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:183:0) after 4m38s
[01:37:39.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:183:0)
[01:37:39.227] Build status: STARTED
[01:37:39.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:184:0) after 4m34s
[01:42:13.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:184:0)
[01:42:13.370] Build status: STARTED
[01:42:13.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:185:0) after 8m9s
[01:50:22.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:185:0)
[01:50:22.560] Build status: STARTED
[01:50:22.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:186:0) after 2m40s
[01:53:02.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:186:0)
[01:53:02.975] Build status: STARTED
[01:53:02.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:187:0) after 2m34s
[01:55:37.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:187:0)
[01:55:37.218] Build status: STARTED
[01:55:37.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:188:0) after 1m4s
[01:56:41.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:188:0)
[01:56:41.708] Build status: STARTED
[01:56:41.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:189:0) after 3m40s
[02:00:22.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:189:0)
[02:00:22.406] Build status: STARTED
[02:00:22.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:190:0) after 7m9s
[02:07:31.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:190:0)
[02:07:31.490] Build status: STARTED
[02:07:31.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:191:0) after 6m48s
[02:14:19.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:191:0)
[02:14:19.654] Build status: STARTED
[02:14:19.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:192:0) after 9m33s
[02:23:52.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:192:0)
[02:23:53.029] Build status: STARTED
[02:23:53.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:193:0) after 6m38s
[02:30:31.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:193:0)
[02:30:31.111] Build status: STARTED
[02:30:31.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:194:0) after 2m7s
[02:32:38.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:194:0)
[02:32:38.167] Build status: STARTED
[02:32:38.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:195:0) after 5m26s
[02:38:04.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:195:0)
[02:38:04.467] Build status: STARTED
[02:38:04.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:196:0) after 1m36s
[02:39:40.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:196:0)
[02:39:40.560] Build status: STARTED
[02:39:40.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:197:0) after 5m17s
[02:44:57.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:197:0)
[02:44:57.634] Build status: STARTED
[02:44:57.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:198:0) after 9m19s
[02:54:16.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:198:0)
[02:54:16.745] Build status: STARTED
[02:54:16.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:199:0) after 8m29s
[03:02:45.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:199:0)
[03:02:45.972] Build status: STARTED
[03:02:45.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:200:0) after 3m2s
[03:05:48.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:200:0)
[03:05:48.165] Build status: STARTED
[03:05:48.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:201:0) after 9m50s
[03:15:38.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:201:0)
[03:15:38.408] Build status: STARTED
[03:15:38.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:202:0) after 7m20s
[03:22:58.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:202:0)
[03:22:58.601] Build status: STARTED
[03:22:58.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:203:0) after 4m6s
[03:27:04.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:203:0)
[03:27:04.984] Build status: STARTED
[03:27:04.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:204:0) after 4m15s
[03:31:20.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:204:0)
[03:31:20.057] Build status: STARTED
[03:31:20.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:205:0) after 9m16s
[03:40:36.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:205:0)
[03:40:36.203] Build status: STARTED
[03:40:36.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:206:0) after 7m43s
[03:48:19.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:206:0)
[03:48:19.371] Build status: STARTED
[03:48:19.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:207:0) after 7m7s
[03:55:26.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:207:0)
[03:55:26.468] Build status: STARTED
[03:55:26.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:208:0) after 3m29s
[03:58:55.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:208:0)
[03:58:55.573] Build status: STARTED
[03:58:55.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:209:0) after 4m55s
[04:03:51.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:209:0)
[04:03:51.263] Build status: STARTED
[04:03:51.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:210:0) after 5m5s
[04:08:56.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:210:0)
[04:08:56.500] Build status: STARTED
[04:08:56.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:211:0) after 6m4s
[04:15:00.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:211:0)
[04:15:00.649] Build status: STARTED
[04:15:00.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:212:0) after 9m17s
[04:24:17.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:212:0)
[04:24:18.050] Build status: STARTED
[04:24:18.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:213:0) after 8m54s
[04:33:12.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:213:0)
[04:33:12.187] Build status: STARTED
[04:33:12.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:214:0) after 1m31s
[04:34:43.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:214:0)
[04:34:43.252] Build status: STARTED
[04:34:43.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:215:0) after 7m17s
[04:42:00.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:215:0)
[04:42:00.460] Build status: STARTED
[04:42:00.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:216:0) after 1m39s
[04:43:39.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:216:0)
[04:43:39.790] Build status: STARTED
[04:43:39.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918480317153285712:217:0) after 4m28s
[04:46:54.936] Received PubSub notification, asking Buildbucket for the build status
[04:46:54.961] Build:
{
"id": "8753050255247326769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30558,
"createdBy": "project:chromium",
"createTime": "2024-03-19T08:43:23.565617602Z",
"startTime": "2024-03-19T08:43:24.648029Z",
"endTime": "2024-03-20T04:46:53.997637Z",
"updateTime": "2024-03-20T04:46:53.997637Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ad47b21469e63ad4662d680c475975f8029b1e38",
"ref": "refs/heads/main"
}
}
}
[04:46:54.961] Invocation finished in 20h3m32.596455826s with status FAILED