[18:22:36.809] New invocation is queued and will start shortly
[18:22:38.397] Starting the invocation (attempt 1)
[18:22:38.443] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/645787691ba30abd4c9120c7fb8900a287c9c541"
[18:22:38.443] Popped gitiles commit info from properties and tags
[18:22:38.443] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:22:38.443] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:22:38.443] Buildbucket request:
{
"requestId": "8964829521288149040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "645787691ba30abd4c9120c7fb8900a287c9c541",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8964829521288149040"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:22:39.173] Scheduled build:
{
"id": "8799399458818300689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28273,
"createdBy": "project:chromium",
"createTime": "2022-10-24T18:22:38.533561220Z",
"updateTime": "2022-10-24T18:22:38.533561220Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "645787691ba30abd4c9120c7fb8900a287c9c541",
"ref": "refs/heads/main"
}
}
}
[18:22:39.173] Task URL: https://cr-buildbucket.appspot.com/build/8799399458818300689
[18:22:39.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:2:0) after 3m38s
[18:26:17.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:2:0)
[18:26:17.320] Build status: SCHEDULED
[18:26:17.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:3:0) after 4m16s
[18:28:25.780] Received PubSub notification, asking Buildbucket for the build status
[18:28:25.826] Build status: STARTED
[18:30:33.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:3:0)
[18:30:33.404] Build status: STARTED
[18:30:33.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:5:0) after 2m11s
[18:32:44.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:5:0)
[18:32:44.602] Build status: STARTED
[18:32:44.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:6:0) after 8m6s
[18:40:50.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:6:0)
[18:40:50.766] Build status: STARTED
[18:40:50.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:7:0) after 4m23s
[18:45:13.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:7:0)
[18:45:14.045] Build status: STARTED
[18:45:14.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:8:0) after 5m15s
[18:50:29.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:8:0)
[18:50:29.093] Build status: STARTED
[18:50:29.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:9:0) after 8m10s
[18:58:39.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:9:0)
[18:58:39.151] Build status: STARTED
[18:58:39.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:10:0) after 2m13s
[19:00:52.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:10:0)
[19:00:52.596] Build status: STARTED
[19:00:52.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:11:0) after 7m34s
[19:08:26.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:11:0)
[19:08:26.715] Build status: STARTED
[19:08:26.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:12:0) after 3m9s
[19:11:35.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:12:0)
[19:11:35.787] Build status: STARTED
[19:11:35.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:13:0) after 3m55s
[19:15:31.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:13:0)
[19:15:31.315] Build status: STARTED
[19:15:31.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:14:0) after 3m34s
[19:19:05.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:14:0)
[19:19:05.527] Build status: STARTED
[19:19:05.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:15:0) after 4m20s
[19:23:25.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:15:0)
[19:23:25.675] Build status: STARTED
[19:23:25.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:16:0) after 7m23s
[19:30:49.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:16:0)
[19:30:49.086] Build status: STARTED
[19:30:49.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:17:0) after 2m28s
[19:33:17.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:17:0)
[19:33:17.154] Build status: STARTED
[19:33:17.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:18:0) after 7m59s
[19:41:16.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:18:0)
[19:41:16.394] Build status: STARTED
[19:41:16.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:19:0) after 4m13s
[19:45:29.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:19:0)
[19:45:29.844] Build status: STARTED
[19:45:29.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:20:0) after 1m21s
[19:46:50.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:20:0)
[19:46:50.906] Build status: STARTED
[19:46:50.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:21:0) after 5m34s
[19:52:25.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:21:0)
[19:52:25.285] Build status: STARTED
[19:52:25.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:22:0) after 5m35s
[19:58:00.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:22:0)
[19:58:00.786] Build status: STARTED
[19:58:00.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:23:0) after 4m28s
[20:02:28.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:23:0)
[20:02:28.911] Build status: STARTED
[20:02:28.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:24:0) after 4m58s
[20:07:26.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:24:0)
[20:07:27.001] Build status: STARTED
[20:07:27.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:25:0) after 1m38s
[20:09:05.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:25:0)
[20:09:05.082] Build status: STARTED
[20:09:05.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:26:0) after 8m43s
[20:17:48.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:26:0)
[20:17:48.250] Build status: STARTED
[20:17:48.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:27:0) after 1m42s
[20:19:30.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:27:0)
[20:19:30.304] Build status: STARTED
[20:19:30.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:28:0) after 8m46s
[20:28:16.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:28:0)
[20:28:16.994] Build status: STARTED
[20:28:16.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:29:0) after 1m46s
[20:30:03.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:29:0)
[20:30:03.055] Build status: STARTED
[20:30:03.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:30:0) after 8m44s
[20:38:47.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:30:0)
[20:38:47.176] Build status: STARTED
[20:38:47.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:31:0) after 8m47s
[20:47:34.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:31:0)
[20:47:34.454] Build status: STARTED
[20:47:34.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:32:0) after 6m55s
[20:54:29.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:32:0)
[20:54:29.511] Build status: STARTED
[20:54:29.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:33:0) after 7m35s
[21:02:05.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:33:0)
[21:02:05.109] Build status: STARTED
[21:02:05.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:34:0) after 9m21s
[21:11:26.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:34:0)
[21:11:26.283] Build status: STARTED
[21:11:26.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:35:0) after 2m14s
[21:13:40.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:35:0)
[21:13:40.347] Build status: STARTED
[21:13:40.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:36:0) after 7m40s
[21:21:20.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:36:0)
[21:21:20.509] Build status: STARTED
[21:21:20.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:37:0) after 1m56s
[21:23:16.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:37:0)
[21:23:16.876] Build status: STARTED
[21:23:16.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:38:0) after 9m47s
[21:33:03.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:38:0)
[21:33:03.967] Build status: STARTED
[21:33:03.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:39:0) after 7m24s
[21:40:28.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:39:0)
[21:40:28.203] Build status: STARTED
[21:40:28.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:40:0) after 8m38s
[21:49:06.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:40:0)
[21:49:06.683] Build status: STARTED
[21:49:06.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:41:0) after 6m44s
[21:55:50.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:41:0)
[21:55:50.856] Build status: STARTED
[21:55:50.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:42:0) after 2m19s
[21:58:09.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:42:0)
[21:58:09.874] Build status: STARTED
[21:58:09.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:43:0) after 1m32s
[21:59:41.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:43:0)
[21:59:41.965] Build status: STARTED
[21:59:41.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:44:0) after 3m50s
[22:03:32.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:44:0)
[22:03:32.137] Build status: STARTED
[22:03:32.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:45:0) after 3m6s
[22:06:38.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:45:0)
[22:06:38.294] Build status: STARTED
[22:06:38.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:46:0) after 3m56s
[22:10:34.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:46:0)
[22:10:34.349] Build status: STARTED
[22:10:34.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:47:0) after 1m27s
[22:12:01.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:47:0)
[22:12:01.551] Build status: STARTED
[22:12:01.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:48:0) after 7m41s
[22:19:42.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:48:0)
[22:19:42.604] Build status: STARTED
[22:19:42.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:49:0) after 3m39s
[22:23:21.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:49:0)
[22:23:21.689] Build status: STARTED
[22:23:21.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:50:0) after 7m25s
[22:30:46.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:50:0)
[22:30:46.930] Build status: STARTED
[22:30:46.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:51:0) after 5m27s
[22:36:13.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:51:0)
[22:36:14.037] Build status: STARTED
[22:36:14.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:52:0) after 6m49s
[22:43:03.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:52:0)
[22:43:03.151] Build status: STARTED
[22:43:03.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:53:0) after 4m9s
[22:47:12.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:53:0)
[22:47:12.334] Build status: STARTED
[22:47:12.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:54:0) after 3m6s
[22:50:18.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:54:0)
[22:50:18.462] Build status: STARTED
[22:50:18.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:55:0) after 8m52s
[22:59:10.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:55:0)
[22:59:10.806] Build status: STARTED
[22:59:10.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:56:0) after 6m28s
[23:05:38.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:56:0)
[23:05:38.885] Build status: STARTED
[23:05:38.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:57:0) after 1m43s
[23:07:21.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:57:0)
[23:07:22.056] Build status: STARTED
[23:07:22.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:58:0) after 6m16s
[23:13:38.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:58:0)
[23:13:38.181] Build status: STARTED
[23:13:38.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:59:0) after 5m23s
[23:19:01.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:59:0)
[23:19:01.331] Build status: STARTED
[23:19:01.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:60:0) after 9m57s
[23:28:58.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:60:0)
[23:28:58.415] Build status: STARTED
[23:28:58.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:61:0) after 8m49s
[23:37:47.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:61:0)
[23:37:47.488] Build status: STARTED
[23:37:47.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:62:0) after 9m18s
[23:47:05.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:62:0)
[23:47:05.539] Build status: STARTED
[23:47:05.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:63:0) after 6m7s
[23:53:12.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:63:0)
[23:53:12.833] Build status: STARTED
[23:53:12.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:64:0) after 6m44s
[23:59:57.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:64:0)
[23:59:57.046] Build status: STARTED
[23:59:57.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:65:0) after 6m48s
[00:06:45.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:65:0)
[00:06:45.269] Build status: STARTED
[00:06:45.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:66:0) after 2m59s
[00:09:44.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:66:0)
[00:09:44.380] Build status: STARTED
[00:09:44.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:67:0) after 3m12s
[00:12:56.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:67:0)
[00:12:56.447] Build status: STARTED
[00:12:56.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:68:0) after 1m15s
[00:14:11.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:68:0)
[00:14:11.774] Build status: STARTED
[00:14:11.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:69:0) after 8m51s
[00:23:02.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:69:0)
[00:23:03.053] Build status: STARTED
[00:23:03.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:70:0) after 4m42s
[00:27:45.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:70:0)
[00:27:45.269] Build status: STARTED
[00:27:45.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:71:0) after 2m35s
[00:30:20.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:71:0)
[00:30:20.376] Build status: STARTED
[00:30:20.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:72:0) after 1m51s
[00:32:11.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:72:0)
[00:32:11.571] Build status: STARTED
[00:32:11.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:73:0) after 8m0s
[00:40:11.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:73:0)
[00:40:11.810] Build status: STARTED
[00:40:11.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:74:0) after 4m42s
[00:44:54.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:74:0)
[00:44:54.246] Build status: STARTED
[00:44:54.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:75:0) after 8m50s
[00:53:44.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:75:0)
[00:53:44.471] Build status: STARTED
[00:53:44.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:76:0) after 7m47s
[01:01:32.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:76:0)
[01:01:32.107] Build status: STARTED
[01:01:32.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:77:0) after 8m14s
[01:09:46.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:77:0)
[01:09:46.209] Build status: STARTED
[01:09:46.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:78:0) after 7m30s
[01:17:16.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:78:0)
[01:17:16.694] Build status: STARTED
[01:17:16.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:79:0) after 1m58s
[01:19:14.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:79:0)
[01:19:14.893] Build status: STARTED
[01:19:14.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:80:0) after 6m1s
[01:25:16.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:80:0)
[01:25:16.323] Build status: STARTED
[01:25:16.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:81:0) after 7m30s
[01:32:46.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:81:0)
[01:32:46.519] Build status: STARTED
[01:32:46.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:82:0) after 7m5s
[01:39:51.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:82:0)
[01:39:51.566] Build status: STARTED
[01:39:51.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:83:0) after 6m48s
[01:46:39.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:83:0)
[01:46:39.644] Build status: STARTED
[01:46:39.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:84:0) after 4m10s
[01:50:49.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:84:0)
[01:50:49.935] Build status: STARTED
[01:50:49.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:85:0) after 4m37s
[01:55:26.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:85:0)
[01:55:27.022] Build status: STARTED
[01:55:27.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:86:0) after 8m12s
[02:03:39.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:86:0)
[02:03:39.418] Build status: STARTED
[02:03:39.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:87:0) after 6m54s
[02:10:33.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:87:0)
[02:10:33.697] Build status: STARTED
[02:10:33.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:88:0) after 5m34s
[02:16:07.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:88:0)
[02:16:07.801] Build status: STARTED
[02:16:07.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:89:0) after 1m26s
[02:17:33.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:89:0)
[02:17:33.851] Build status: STARTED
[02:17:33.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:90:0) after 7m58s
[02:25:31.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:90:0)
[02:25:31.910] Build status: STARTED
[02:25:31.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:91:0) after 7m50s
[02:33:22.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:91:0)
[02:33:22.047] Build status: STARTED
[02:33:22.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:92:0) after 3m19s
[02:36:41.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:92:0)
[02:36:41.101] Build status: STARTED
[02:36:41.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:93:0) after 1m8s
[02:37:49.206] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:93:0)
[02:37:49.228] Build status: STARTED
[02:37:49.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:94:0) after 1m13s
[02:39:02.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:94:0)
[02:39:02.703] Build status: STARTED
[02:39:02.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:95:0) after 6m40s
[02:45:42.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:95:0)
[02:45:42.870] Build status: STARTED
[02:45:42.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:96:0) after 4m58s
[02:50:40.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:96:0)
[02:50:40.926] Build status: STARTED
[02:50:40.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:97:0) after 1m16s
[02:51:57.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:97:0)
[02:51:57.106] Build status: STARTED
[02:51:57.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:98:0) after 8m15s
[03:00:12.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:98:0)
[03:00:12.612] Build status: STARTED
[03:00:12.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:99:0) after 6m46s
[03:06:58.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:99:0)
[03:06:58.877] Build status: STARTED
[03:06:58.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:100:0) after 7m36s
[03:14:35.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:100:0)
[03:14:35.022] Build status: STARTED
[03:14:35.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:101:0) after 2m6s
[03:16:41.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:101:0)
[03:16:41.176] Build status: STARTED
[03:16:41.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:102:0) after 2m42s
[03:19:23.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:102:0)
[03:19:23.489] Build status: STARTED
[03:19:23.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:103:0) after 9m24s
[03:28:47.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:103:0)
[03:28:47.811] Build status: STARTED
[03:28:47.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:104:0) after 6m18s
[03:35:05.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:104:0)
[03:35:05.873] Build status: STARTED
[03:35:05.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:105:0) after 8m8s
[03:43:14.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:105:0)
[03:43:14.055] Build status: STARTED
[03:43:14.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:106:0) after 8m13s
[03:51:27.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:106:0)
[03:51:27.237] Build status: STARTED
[03:51:27.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:107:0) after 8m0s
[03:59:27.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:107:0)
[03:59:27.258] Build status: STARTED
[03:59:27.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:108:0) after 4m2s
[04:03:29.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:108:0)
[04:03:29.333] Build status: STARTED
[04:03:29.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:109:0) after 9m29s
[04:12:58.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:109:0)
[04:12:58.496] Build status: STARTED
[04:12:58.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:110:0) after 9m59s
[04:22:57.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:110:0)
[04:22:57.551] Build status: STARTED
[04:22:57.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:111:0) after 6m42s
[04:29:39.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:111:0)
[04:29:39.852] Build status: STARTED
[04:29:39.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:112:0) after 6m1s
[04:35:40.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:112:0)
[04:35:40.904] Build status: STARTED
[04:35:40.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:113:0) after 3m38s
[04:39:19.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:113:0)
[04:39:19.032] Build status: STARTED
[04:39:19.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:114:0) after 1m26s
[04:40:45.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:114:0)
[04:40:45.217] Build status: STARTED
[04:40:45.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:115:0) after 7m53s
[04:48:38.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:115:0)
[04:48:38.396] Build status: STARTED
[04:48:38.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:116:0) after 4m45s
[04:53:23.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:116:0)
[04:53:23.451] Build status: STARTED
[04:53:23.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:117:0) after 4m15s
[04:57:38.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:117:0)
[04:57:38.503] Build status: STARTED
[04:57:38.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:118:0) after 7m29s
[05:05:07.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:118:0)
[05:05:07.564] Build status: STARTED
[05:05:07.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:119:0) after 8m3s
[05:13:10.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:119:0)
[05:13:10.829] Build status: STARTED
[05:13:10.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:120:0) after 9m51s
[05:23:01.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:120:0)
[05:23:02.047] Build status: STARTED
[05:23:02.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:121:0) after 1m21s
[05:24:23.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:121:0)
[05:24:23.173] Build status: STARTED
[05:24:23.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:122:0) after 1m29s
[05:25:52.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:122:0)
[05:25:52.335] Build status: STARTED
[05:25:52.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:123:0) after 5m39s
[05:31:31.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:123:0)
[05:31:31.446] Build status: STARTED
[05:31:31.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:124:0) after 3m11s
[05:34:42.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:124:0)
[05:34:42.506] Build status: STARTED
[05:34:42.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:125:0) after 8m18s
[05:43:00.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:125:0)
[05:43:00.661] Build status: STARTED
[05:43:00.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:126:0) after 4m56s
[05:47:56.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:126:0)
[05:47:56.714] Build status: STARTED
[05:47:56.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:127:0) after 3m18s
[05:51:14.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:127:0)
[05:51:14.886] Build status: STARTED
[05:51:14.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:128:0) after 2m47s
[05:54:01.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:128:0)
[05:54:02.008] Build status: STARTED
[05:54:02.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:129:0) after 7m11s
[06:01:13.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:129:0)
[06:01:13.119] Build status: STARTED
[06:01:13.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:130:0) after 9m28s
[06:10:41.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:130:0)
[06:10:41.170] Build status: STARTED
[06:10:41.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:131:0) after 4m23s
[06:15:04.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:131:0)
[06:15:04.233] Build status: STARTED
[06:15:04.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:132:0) after 3m24s
[06:18:28.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:132:0)
[06:18:28.305] Build status: STARTED
[06:18:28.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:133:0) after 5m34s
[06:24:02.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:133:0)
[06:24:02.353] Build status: STARTED
[06:24:02.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:134:0) after 4m17s
[06:28:19.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:134:0)
[06:28:19.453] Build status: STARTED
[06:28:19.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:135:0) after 3m14s
[06:31:33.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:135:0)
[06:31:33.527] Build status: STARTED
[06:31:33.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:136:0) after 3m56s
[06:35:29.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:136:0)
[06:35:29.587] Build status: STARTED
[06:35:29.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:137:0) after 2m4s
[06:37:33.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:137:0)
[06:37:33.672] Build status: STARTED
[06:37:33.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:138:0) after 9m34s
[06:47:07.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:138:0)
[06:47:07.831] Build status: STARTED
[06:47:07.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:139:0) after 3m15s
[06:50:22.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:139:0)
[06:50:23.012] Build status: STARTED
[06:50:23.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:140:0) after 9m25s
[06:59:48.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:140:0)
[06:59:48.062] Build status: STARTED
[06:59:48.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:141:0) after 5m8s
[07:04:56.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:141:0)
[07:04:56.232] Build status: STARTED
[07:04:56.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:142:0) after 7m30s
[07:12:26.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:142:0)
[07:12:26.284] Build status: STARTED
[07:12:26.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:143:0) after 7m20s
[07:19:46.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:143:0)
[07:19:46.644] Build status: STARTED
[07:19:46.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8964829521288149040:144:0) after 8m35s
[07:25:15.193] Received PubSub notification, asking Buildbucket for the build status
[07:25:15.238] Build:
{
"id": "8799399458818300689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28273,
"createdBy": "project:chromium",
"createTime": "2022-10-24T18:22:38.533561220Z",
"startTime": "2022-10-24T18:28:25.136561Z",
"endTime": "2022-10-25T07:25:14.558921845Z",
"updateTime": "2022-10-25T07:25:14.558921845Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "645787691ba30abd4c9120c7fb8900a287c9c541",
"ref": "refs/heads/main"
}
}
}
[07:25:15.239] Invocation finished in 13h2m38.444186302s with status FAILED