[19:58:54.219] New invocation is queued and will start shortly
[19:58:55.311] Starting the invocation (attempt 1)
[19:58:55.350] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/342a5489295dd2b61aca406bb444380f6219ce23"
[19:58:55.350] Popped gitiles commit info from properties and tags
[19:58:55.350] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:58:55.350] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:58:55.351] Buildbucket request:
{
"requestId": "8996713595409428256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "342a5489295dd2b61aca406bb444380f6219ce23",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8996713595409428256"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:58:55.868] Scheduled build:
{
"id": "8831283533485000577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26246,
"createdBy": "project:chromium",
"createTime": "2021-11-06T19:58:55.421990180Z",
"updateTime": "2021-11-06T19:58:55.421990180Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "342a5489295dd2b61aca406bb444380f6219ce23",
"ref": "refs/heads/main"
}
}
}
[19:58:55.868] Task URL: https://cr-buildbucket.appspot.com/build/8831283533485000577
[19:58:55.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:2:0) after 2m35s
[20:01:30.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:2:0)
[20:01:30.910] Build status: SCHEDULED
[20:01:30.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:3:0) after 5m40s
[20:07:10.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:3:0)
[20:07:10.958] Build status: SCHEDULED
[20:07:10.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:4:0) after 7m23s
[20:14:34.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:4:0)
[20:14:34.197] Build status: SCHEDULED
[20:14:34.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:5:0) after 9m32s
[20:24:06.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:5:0)
[20:24:06.255] Build status: SCHEDULED
[20:24:06.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:6:0) after 2m23s
[20:26:29.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:6:0)
[20:26:29.345] Build status: SCHEDULED
[20:26:29.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:7:0) after 1m57s
[20:28:26.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:7:0)
[20:28:26.569] Build status: SCHEDULED
[20:28:26.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:8:0) after 4m38s
[20:33:04.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:8:0)
[20:33:04.640] Build status: SCHEDULED
[20:33:04.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:9:0) after 1m43s
[20:34:47.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:9:0)
[20:34:47.689] Build status: SCHEDULED
[20:34:47.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:10:0) after 6m50s
[20:41:37.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:10:0)
[20:41:37.891] Build status: SCHEDULED
[20:41:37.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:11:0) after 3m39s
[20:45:16.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:11:0)
[20:45:16.991] Build status: SCHEDULED
[20:45:16.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:12:0) after 4m26s
[20:49:43.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:12:0)
[20:49:43.051] Build status: SCHEDULED
[20:49:43.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:13:0) after 5m29s
[20:50:19.895] Received PubSub notification, asking Buildbucket for the build status
[20:50:19.926] Build status: STARTED
[20:55:12.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:13:0)
[20:55:12.536] Build status: STARTED
[20:55:12.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:15:0) after 2m56s
[20:58:08.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:15:0)
[20:58:08.582] Build status: STARTED
[20:58:08.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:16:0) after 9m59s
[21:08:07.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:16:0)
[21:08:07.853] Build status: STARTED
[21:08:07.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:17:0) after 3m3s
[21:11:11.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:17:0)
[21:11:11.059] Build status: STARTED
[21:11:11.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:18:0) after 9m33s
[21:20:44.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:18:0)
[21:20:44.393] Build status: STARTED
[21:20:44.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:19:0) after 9m20s
[21:30:04.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:19:0)
[21:30:04.453] Build status: STARTED
[21:30:04.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:20:0) after 2m52s
[21:32:56.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:20:0)
[21:32:56.740] Build status: STARTED
[21:32:56.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:21:0) after 4m22s
[21:37:18.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:21:0)
[21:37:18.795] Build status: STARTED
[21:37:18.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:22:0) after 9m58s
[21:47:16.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:22:0)
[21:47:16.854] Build status: STARTED
[21:47:16.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:23:0) after 5m54s
[21:53:11.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:23:0)
[21:53:11.189] Build status: STARTED
[21:53:11.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:24:0) after 9m42s
[22:02:53.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:24:0)
[22:02:53.274] Build status: STARTED
[22:02:53.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:25:0) after 8m59s
[22:11:52.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:25:0)
[22:11:52.532] Build status: STARTED
[22:11:52.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:26:0) after 5m57s
[22:17:49.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:26:0)
[22:17:49.589] Build status: STARTED
[22:17:49.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:27:0) after 6m13s
[22:24:02.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:27:0)
[22:24:02.815] Build status: STARTED
[22:24:02.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:28:0) after 1m44s
[22:25:46.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:28:0)
[22:25:46.859] Build status: STARTED
[22:25:46.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:29:0) after 6m6s
[22:31:52.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:29:0)
[22:31:52.961] Build status: STARTED
[22:31:52.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:30:0) after 7m42s
[22:39:35.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:30:0)
[22:39:35.215] Build status: STARTED
[22:39:35.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:31:0) after 4m50s
[22:44:25.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:31:0)
[22:44:25.291] Build status: STARTED
[22:44:25.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:32:0) after 8m24s
[22:52:49.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:32:0)
[22:52:49.652] Build status: STARTED
[22:52:49.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:33:0) after 2m13s
[22:55:02.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:33:0)
[22:55:02.715] Build status: STARTED
[22:55:02.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:34:0) after 4m7s
[22:59:09.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:34:0)
[22:59:09.792] Build status: STARTED
[22:59:09.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:35:0) after 4m49s
[23:03:58.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:35:0)
[23:03:58.843] Build status: STARTED
[23:03:58.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:36:0) after 4m0s
[23:07:58.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:36:0)
[23:07:58.909] Build status: STARTED
[23:07:58.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:37:0) after 9m30s
[23:17:29.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:37:0)
[23:17:29.099] Build status: STARTED
[23:17:29.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:38:0) after 4m33s
[23:22:02.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:38:0)
[23:22:02.290] Build status: STARTED
[23:22:02.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:39:0) after 6m50s
[23:28:52.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:39:0)
[23:28:52.332] Build status: STARTED
[23:28:52.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:40:0) after 4m33s
[23:33:25.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:40:0)
[23:33:25.385] Build status: STARTED
[23:33:25.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:41:0) after 1m30s
[23:34:55.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:41:0)
[23:34:55.698] Build status: STARTED
[23:34:55.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:42:0) after 9m29s
[23:44:25.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:42:0)
[23:44:25.214] Build status: STARTED
[23:44:25.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:43:0) after 4m9s
[23:48:34.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:43:0)
[23:48:34.266] Build status: STARTED
[23:48:34.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:44:0) after 8m40s
[23:57:14.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:44:0)
[23:57:14.530] Build status: STARTED
[23:57:14.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:45:0) after 9m22s
[00:06:37.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:45:0)
[00:06:37.130] Build status: STARTED
[00:06:37.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:46:0) after 3m48s
[00:10:25.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:46:0)
[00:10:25.379] Build status: STARTED
[00:10:25.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:47:0) after 6m8s
[00:16:33.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:47:0)
[00:16:33.431] Build status: STARTED
[00:16:33.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:48:0) after 7m29s
[00:24:02.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:48:0)
[00:24:02.700] Build status: STARTED
[00:24:02.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:49:0) after 7m28s
[00:31:30.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:49:0)
[00:31:30.822] Build status: STARTED
[00:31:30.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:50:0) after 1m51s
[00:33:21.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:50:0)
[00:33:22.023] Build status: STARTED
[00:33:22.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:51:0) after 1m19s
[00:34:41.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:51:0)
[00:34:41.068] Build status: STARTED
[00:34:41.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:52:0) after 5m56s
[00:40:37.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:52:0)
[00:40:37.117] Build status: STARTED
[00:40:37.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:53:0) after 6m43s
[00:47:20.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:53:0)
[00:47:20.373] Build status: STARTED
[00:47:20.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:54:0) after 6m52s
[00:54:12.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:54:0)
[00:54:12.553] Build status: STARTED
[00:54:12.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:55:0) after 3m55s
[00:58:07.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:55:0)
[00:58:07.891] Build status: STARTED
[00:58:07.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:56:0) after 1m40s
[00:59:47.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:56:0)
[00:59:47.941] Build status: STARTED
[00:59:47.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:57:0) after 6m40s
[01:06:28.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:57:0)
[01:06:28.280] Build status: STARTED
[01:06:28.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:58:0) after 6m3s
[01:12:31.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:58:0)
[01:12:31.697] Build status: STARTED
[01:12:31.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:59:0) after 5m18s
[01:17:49.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:59:0)
[01:17:49.752] Build status: STARTED
[01:17:49.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:60:0) after 6m21s
[01:24:11.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:60:0)
[01:24:11.050] Build status: STARTED
[01:24:11.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:61:0) after 3m31s
[01:27:42.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:61:0)
[01:27:42.305] Build status: STARTED
[01:27:42.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:62:0) after 1m46s
[01:29:28.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:62:0)
[01:29:28.563] Build status: STARTED
[01:29:28.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:63:0) after 4m0s
[01:33:28.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:63:0)
[01:33:28.704] Build status: STARTED
[01:33:28.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:64:0) after 7m39s
[01:41:07.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:64:0)
[01:41:07.758] Build status: STARTED
[01:41:07.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:65:0) after 1m15s
[01:42:22.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:65:0)
[01:42:22.811] Build status: STARTED
[01:42:22.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:66:0) after 9m37s
[01:52:00.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:66:0)
[01:52:00.063] Build status: STARTED
[01:52:00.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:67:0) after 4m25s
[01:56:26.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:67:0)
[01:56:26.091] Build status: STARTED
[01:56:26.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:68:0) after 1m56s
[01:58:22.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:68:0)
[01:58:22.351] Build status: STARTED
[01:58:22.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:69:0) after 5m37s
[02:03:59.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:69:0)
[02:03:59.578] Build status: STARTED
[02:03:59.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:70:0) after 4m54s
[02:08:53.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:70:0)
[02:08:53.634] Build status: STARTED
[02:08:53.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:71:0) after 8m41s
[02:17:35.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:71:0)
[02:17:35.101] Build status: STARTED
[02:17:35.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:72:0) after 8m43s
[02:26:18.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:72:0)
[02:26:18.146] Build status: STARTED
[02:26:18.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:73:0) after 9m8s
[02:35:26.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:73:0)
[02:35:26.841] Build status: STARTED
[02:35:26.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:74:0) after 6m58s
[02:42:24.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:74:0)
[02:42:24.892] Build status: STARTED
[02:42:24.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:75:0) after 2m9s
[02:44:33.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:75:0)
[02:44:33.939] Build status: STARTED
[02:44:33.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:76:0) after 3m9s
[02:47:43.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:76:0)
[02:47:43.517] Build status: STARTED
[02:47:43.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:77:0) after 1m38s
[02:49:21.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:77:0)
[02:49:21.625] Build status: STARTED
[02:49:21.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:78:0) after 8m1s
[02:57:22.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:78:0)
[02:57:22.686] Build status: STARTED
[02:57:22.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:79:0) after 1m35s
[02:58:57.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:79:0)
[02:58:57.744] Build status: STARTED
[02:58:57.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:80:0) after 3m58s
[03:02:55.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:80:0)
[03:02:55.813] Build status: STARTED
[03:02:55.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:81:0) after 6m57s
[03:09:53.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:81:0)
[03:09:53.052] Build status: STARTED
[03:09:53.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:82:0) after 1m28s
[03:11:21.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:82:0)
[03:11:21.110] Build status: STARTED
[03:11:21.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:83:0) after 5m59s
[03:17:20.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:83:0)
[03:17:20.117] Build status: STARTED
[03:17:20.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:84:0) after 1m38s
[03:18:58.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:84:0)
[03:18:58.643] Build status: STARTED
[03:18:58.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:85:0) after 4m10s
[03:23:09.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:85:0)
[03:23:09.089] Build status: STARTED
[03:23:09.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:86:0) after 4m55s
[03:28:04.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:86:0)
[03:28:04.149] Build status: STARTED
[03:28:04.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:87:0) after 9m22s
[03:37:26.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:87:0)
[03:37:26.210] Build status: STARTED
[03:37:26.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:88:0) after 2m23s
[03:39:49.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:88:0)
[03:39:49.265] Build status: STARTED
[03:39:49.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:89:0) after 8m40s
[03:48:29.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:89:0)
[03:48:29.334] Build status: STARTED
[03:48:29.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:90:0) after 8m31s
[03:57:00.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:90:0)
[03:57:00.563] Build status: STARTED
[03:57:00.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:91:0) after 3m0s
[04:00:00.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:91:0)
[04:00:00.650] Build status: STARTED
[04:00:00.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:92:0) after 8m20s
[04:08:20.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:92:0)
[04:08:20.698] Build status: STARTED
[04:08:20.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:93:0) after 5m37s
[04:13:57.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:93:0)
[04:13:57.761] Build status: STARTED
[04:13:57.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:94:0) after 3m32s
[04:17:29.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:94:0)
[04:17:30.030] Build status: STARTED
[04:17:30.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:95:0) after 7m55s
[04:25:25.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:95:0)
[04:25:25.088] Build status: STARTED
[04:25:25.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:96:0) after 9m46s
[04:35:11.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:96:0)
[04:35:11.136] Build status: STARTED
[04:35:11.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:97:0) after 3m48s
[04:38:59.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:97:0)
[04:38:59.196] Build status: STARTED
[04:38:59.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:98:0) after 4m26s
[04:43:25.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:98:0)
[04:43:25.394] Build status: STARTED
[04:43:25.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:99:0) after 2m10s
[04:45:35.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:99:0)
[04:45:35.457] Build status: STARTED
[04:45:35.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:100:0) after 5m31s
[04:51:06.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:100:0)
[04:51:06.507] Build status: STARTED
[04:51:06.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:101:0) after 2m9s
[04:53:15.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:101:0)
[04:53:15.945] Build status: STARTED
[04:53:15.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:102:0) after 9m15s
[05:02:31.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:102:0)
[05:02:31.961] Build status: STARTED
[05:02:31.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:103:0) after 5m43s
[05:08:15.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:103:0)
[05:08:15.498] Build status: STARTED
[05:08:15.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:104:0) after 7m48s
[05:16:03.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:104:0)
[05:16:03.724] Build status: STARTED
[05:16:03.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:105:0) after 5m59s
[05:22:03.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:105:0)
[05:22:03.113] Build status: STARTED
[05:22:03.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:106:0) after 4m50s
[05:26:53.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:106:0)
[05:26:53.982] Build status: STARTED
[05:26:53.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:107:0) after 5m11s
[05:32:05.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:107:0)
[05:32:05.037] Build status: STARTED
[05:32:05.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:108:0) after 5m48s
[05:37:53.062] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:108:0)
[05:37:53.090] Build status: STARTED
[05:37:53.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:109:0) after 9m11s
[05:47:04.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:109:0)
[05:47:04.142] Build status: STARTED
[05:47:04.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:110:0) after 5m19s
[05:52:23.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:110:0)
[05:52:23.386] Build status: STARTED
[05:52:23.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:111:0) after 4m4s
[05:56:27.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:111:0)
[05:56:27.574] Build status: STARTED
[05:56:27.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:112:0) after 2m24s
[05:58:51.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:112:0)
[05:58:51.883] Build status: STARTED
[05:58:51.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:113:0) after 7m17s
[06:06:09.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:113:0)
[06:06:09.173] Build status: STARTED
[06:06:09.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:114:0) after 3m43s
[06:09:52.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:114:0)
[06:09:52.270] Build status: STARTED
[06:09:52.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:115:0) after 7m53s
[06:17:45.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:115:0)
[06:17:45.340] Build status: STARTED
[06:17:45.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:116:0) after 7m28s
[06:25:13.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:116:0)
[06:25:13.544] Build status: STARTED
[06:25:13.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:117:0) after 3m26s
[06:28:39.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:117:0)
[06:28:39.673] Build status: STARTED
[06:28:39.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:118:0) after 8m27s
[06:37:07.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:118:0)
[06:37:07.045] Build status: STARTED
[06:37:07.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:119:0) after 8m35s
[06:45:42.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:119:0)
[06:45:42.322] Build status: STARTED
[06:45:42.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:120:0) after 9m52s
[06:55:34.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:120:0)
[06:55:34.513] Build status: STARTED
[06:55:34.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:121:0) after 9m54s
[07:05:28.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:121:0)
[07:05:28.696] Build status: STARTED
[07:05:28.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:122:0) after 6m42s
[07:12:10.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:122:0)
[07:12:10.856] Build status: STARTED
[07:12:10.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:123:0) after 4m48s
[07:16:59.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:123:0)
[07:16:59.158] Build status: STARTED
[07:16:59.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:124:0) after 9m53s
[07:26:52.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:124:0)
[07:26:52.188] Build status: STARTED
[07:26:52.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:125:0) after 4m49s
[07:31:41.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:125:0)
[07:31:41.504] Build status: STARTED
[07:31:41.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:126:0) after 3m38s
[07:35:19.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:126:0)
[07:35:19.530] Build status: STARTED
[07:35:19.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:127:0) after 2m7s
[07:37:27.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:127:0)
[07:37:27.079] Build status: STARTED
[07:37:27.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8996713595409428256:128:0) after 3m23s
[07:38:35.929] Received PubSub notification, asking Buildbucket for the build status
[07:38:35.959] Build:
{
"id": "8831283533485000577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26246,
"createdBy": "project:chromium",
"createTime": "2021-11-06T19:58:55.421990180Z",
"startTime": "2021-11-06T20:50:19.255391Z",
"endTime": "2021-11-07T07:38:35.330626037Z",
"updateTime": "2021-11-07T07:38:35.330626037Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "342a5489295dd2b61aca406bb444380f6219ce23",
"ref": "refs/heads/main"
}
}
}
[07:38:35.959] Invocation finished in 11h39m41.755902s with status FAILED