[10:30:40.783] New invocation is queued and will start shortly
[10:30:41.913] Starting the invocation (attempt 1)
[10:30:41.946] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/36723175960f3ea3575a68b7be76c55ea0723f18"
[10:30:41.946] Popped gitiles commit info from properties and tags
[10:30:41.946] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:30:41.946] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:30:41.946] Buildbucket request:
{
"requestId": "8958789216037281632",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "36723175960f3ea3575a68b7be76c55ea0723f18",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8958789216037281632"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:30:42.479] Scheduled build:
{
"id": "8793359154092754193",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28578,
"createdBy": "project:chromium",
"createTime": "2022-12-30T10:30:42.013531279Z",
"updateTime": "2022-12-30T10:30:42.013531279Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "36723175960f3ea3575a68b7be76c55ea0723f18",
"ref": "refs/heads/main"
}
}
}
[10:30:42.479] Task URL: https://cr-buildbucket.appspot.com/build/8793359154092754193
[10:30:42.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:2:0) after 9m20s
[10:35:24.528] Received PubSub notification, asking Buildbucket for the build status
[10:35:24.554] Build status: STARTED
[10:40:02.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:2:0)
[10:40:02.542] Build status: STARTED
[10:40:02.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:4:0) after 3m18s
[10:43:20.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:4:0)
[10:43:20.593] Build status: STARTED
[10:43:20.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:5:0) after 1m46s
[10:45:06.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:5:0)
[10:45:06.681] Build status: STARTED
[10:45:06.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:6:0) after 7m54s
[10:53:00.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:6:0)
[10:53:00.924] Build status: STARTED
[10:53:00.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:7:0) after 1m6s
[10:54:07.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:7:0)
[10:54:07.157] Build status: STARTED
[10:54:07.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:8:0) after 4m42s
[10:58:49.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:8:0)
[10:58:49.213] Build status: STARTED
[10:58:49.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:9:0) after 2m58s
[11:01:47.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:9:0)
[11:01:47.431] Build status: STARTED
[11:01:47.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:10:0) after 7m55s
[11:09:42.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:10:0)
[11:09:42.574] Build status: STARTED
[11:09:42.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:11:0) after 5m0s
[11:14:42.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:11:0)
[11:14:42.662] Build status: STARTED
[11:14:42.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:12:0) after 3m32s
[11:18:14.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:12:0)
[11:18:14.796] Build status: STARTED
[11:18:14.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:13:0) after 7m38s
[11:25:52.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:13:0)
[11:25:52.948] Build status: STARTED
[11:25:52.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:14:0) after 9m11s
[11:35:04.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:14:0)
[11:35:04.109] Build status: STARTED
[11:35:04.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:15:0) after 6m9s
[11:41:13.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:15:0)
[11:41:13.257] Build status: STARTED
[11:41:13.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:16:0) after 8m45s
[11:49:58.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:16:0)
[11:49:58.360] Build status: STARTED
[11:49:58.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:17:0) after 4m36s
[11:54:34.437] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:17:0)
[11:54:34.460] Build status: STARTED
[11:54:34.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:18:0) after 2m41s
[11:57:15.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:18:0)
[11:57:15.540] Build status: STARTED
[11:57:15.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:19:0) after 8m29s
[12:05:44.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:19:0)
[12:05:44.683] Build status: STARTED
[12:05:44.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:20:0) after 6m21s
[12:12:05.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:20:0)
[12:12:05.740] Build status: STARTED
[12:12:05.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:21:0) after 8m43s
[12:20:48.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:21:0)
[12:20:48.777] Build status: STARTED
[12:20:48.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:22:0) after 2m6s
[12:22:54.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:22:0)
[12:22:54.880] Build status: STARTED
[12:22:54.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:23:0) after 4m6s
[12:27:00.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:23:0)
[12:27:01.037] Build status: STARTED
[12:27:01.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:24:0) after 9m21s
[12:36:22.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:24:0)
[12:36:22.164] Build status: STARTED
[12:36:22.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:25:0) after 4m36s
[12:40:58.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:25:0)
[12:40:58.213] Build status: STARTED
[12:40:58.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:26:0) after 1m48s
[12:42:46.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:26:0)
[12:42:46.302] Build status: STARTED
[12:42:46.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:27:0) after 7m41s
[12:50:27.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:27:0)
[12:50:27.587] Build status: STARTED
[12:50:27.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:28:0) after 7m51s
[12:58:18.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:28:0)
[12:58:18.682] Build status: STARTED
[12:58:18.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:29:0) after 9m21s
[13:07:39.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:29:0)
[13:07:39.732] Build status: STARTED
[13:07:39.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:30:0) after 2m32s
[13:10:11.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:30:0)
[13:10:11.775] Build status: STARTED
[13:10:11.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:31:0) after 8m58s
[13:19:09.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:31:0)
[13:19:09.831] Build status: STARTED
[13:19:09.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:32:0) after 7m44s
[13:26:53.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:32:0)
[13:26:53.912] Build status: STARTED
[13:26:53.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:33:0) after 7m11s
[13:34:05.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:33:0)
[13:34:05.152] Build status: STARTED
[13:34:05.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:34:0) after 1m52s
[13:35:57.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:34:0)
[13:35:57.441] Build status: STARTED
[13:35:57.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:35:0) after 9m26s
[13:45:23.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:35:0)
[13:45:23.490] Build status: STARTED
[13:45:23.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:36:0) after 5m56s
[13:51:19.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:36:0)
[13:51:19.578] Build status: STARTED
[13:51:19.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:37:0) after 4m11s
[13:55:30.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:37:0)
[13:55:30.692] Build status: STARTED
[13:55:30.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:38:0) after 4m23s
[13:59:53.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:38:0)
[13:59:53.829] Build status: STARTED
[13:59:53.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:39:0) after 6m32s
[14:06:25.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:39:0)
[14:06:26.003] Build status: STARTED
[14:06:26.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:40:0) after 4m15s
[14:10:41.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:40:0)
[14:10:41.080] Build status: STARTED
[14:10:41.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:41:0) after 7m56s
[14:18:37.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:41:0)
[14:18:37.114] Build status: STARTED
[14:18:37.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:42:0) after 1m35s
[14:20:12.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:42:0)
[14:20:12.260] Build status: STARTED
[14:20:12.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:43:0) after 3m16s
[14:23:28.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:43:0)
[14:23:28.312] Build status: STARTED
[14:23:28.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:44:0) after 3m33s
[14:27:01.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:44:0)
[14:27:01.419] Build status: STARTED
[14:27:01.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:45:0) after 9m10s
[14:36:11.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:45:0)
[14:36:11.496] Build status: STARTED
[14:36:11.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:46:0) after 8m44s
[14:44:55.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:46:0)
[14:44:55.639] Build status: STARTED
[14:44:55.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:47:0) after 7m50s
[14:52:45.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:47:0)
[14:52:45.682] Build status: STARTED
[14:52:45.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:48:0) after 7m35s
[15:00:20.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:48:0)
[15:00:20.854] Build status: STARTED
[15:00:20.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:49:0) after 8m57s
[15:09:18.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:49:0)
[15:09:18.238] Build status: STARTED
[15:09:18.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:50:0) after 1m10s
[15:10:28.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:50:0)
[15:10:28.243] Build status: STARTED
[15:10:28.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:51:0) after 2m58s
[15:13:26.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:51:0)
[15:13:26.288] Build status: STARTED
[15:13:26.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:52:0) after 7m48s
[15:21:14.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:52:0)
[15:21:14.398] Build status: STARTED
[15:21:14.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:53:0) after 7m6s
[15:28:20.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:53:0)
[15:28:20.707] Build status: STARTED
[15:28:20.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:54:0) after 9m24s
[15:37:44.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:54:0)
[15:37:44.752] Build status: STARTED
[15:37:44.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:55:0) after 8m16s
[15:46:01.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:55:0)
[15:46:01.134] Build status: STARTED
[15:46:01.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:56:0) after 9m10s
[15:55:11.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:56:0)
[15:55:11.323] Build status: STARTED
[15:55:11.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:57:0) after 9m55s
[16:05:06.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:57:0)
[16:05:06.472] Build status: STARTED
[16:05:06.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:58:0) after 4m47s
[16:09:53.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:58:0)
[16:09:53.649] Build status: STARTED
[16:09:53.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:59:0) after 5m25s
[16:15:18.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:59:0)
[16:15:18.802] Build status: STARTED
[16:15:18.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:60:0) after 1m8s
[16:16:26.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:60:0)
[16:16:26.867] Build status: STARTED
[16:16:26.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:61:0) after 5m55s
[16:22:21.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:61:0)
[16:22:21.924] Build status: STARTED
[16:22:21.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:62:0) after 9m39s
[16:32:00.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:62:0)
[16:32:00.981] Build status: STARTED
[16:32:00.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:63:0) after 7m37s
[16:39:38.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:63:0)
[16:39:38.074] Build status: STARTED
[16:39:38.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:64:0) after 4m41s
[16:44:19.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:64:0)
[16:44:19.126] Build status: STARTED
[16:44:19.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:65:0) after 9m36s
[16:53:55.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:65:0)
[16:53:55.291] Build status: STARTED
[16:53:55.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:66:0) after 2m26s
[16:56:21.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:66:0)
[16:56:21.390] Build status: STARTED
[16:56:21.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:67:0) after 9m52s
[17:06:13.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:67:0)
[17:06:13.519] Build status: STARTED
[17:06:13.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:68:0) after 1m50s
[17:08:03.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:68:0)
[17:08:03.570] Build status: STARTED
[17:08:03.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:69:0) after 5m23s
[17:13:26.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:69:0)
[17:13:26.615] Build status: STARTED
[17:13:26.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:70:0) after 3m56s
[17:17:22.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:70:0)
[17:17:22.650] Build status: STARTED
[17:17:22.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:71:0) after 1m43s
[17:19:05.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:71:0)
[17:19:05.695] Build status: STARTED
[17:19:05.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:72:0) after 4m13s
[17:23:18.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:72:0)
[17:23:18.739] Build status: STARTED
[17:23:18.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:73:0) after 3m48s
[17:27:06.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:73:0)
[17:27:06.798] Build status: STARTED
[17:27:06.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:74:0) after 8m33s
[17:35:39.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:74:0)
[17:35:39.844] Build status: STARTED
[17:35:39.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:75:0) after 5m13s
[17:40:52.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:75:0)
[17:40:52.880] Build status: STARTED
[17:40:52.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:76:0) after 2m52s
[17:43:44.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:76:0)
[17:43:44.950] Build status: STARTED
[17:43:44.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:77:0) after 5m17s
[17:49:02.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:77:0)
[17:49:02.060] Build status: STARTED
[17:49:02.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:78:0) after 5m19s
[17:54:21.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:78:0)
[17:54:21.177] Build status: STARTED
[17:54:21.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:79:0) after 5m41s
[18:00:02.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:79:0)
[18:00:02.422] Build status: STARTED
[18:00:02.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:80:0) after 1m43s
[18:01:45.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:80:0)
[18:01:45.498] Build status: STARTED
[18:01:45.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:81:0) after 8m38s
[18:10:23.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:81:0)
[18:10:23.549] Build status: STARTED
[18:10:23.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:82:0) after 2m7s
[18:12:30.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:82:0)
[18:12:30.628] Build status: STARTED
[18:12:30.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:83:0) after 3m33s
[18:16:03.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:83:0)
[18:16:03.665] Build status: STARTED
[18:16:03.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:84:0) after 8m7s
[18:24:10.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:84:0)
[18:24:10.726] Build status: STARTED
[18:24:10.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:85:0) after 4m12s
[18:28:22.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:85:0)
[18:28:22.852] Build status: STARTED
[18:28:22.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:86:0) after 6m6s
[18:34:28.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:86:0)
[18:34:28.907] Build status: STARTED
[18:34:28.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:87:0) after 4m42s
[18:39:10.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:87:0)
[18:39:10.950] Build status: STARTED
[18:39:10.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:88:0) after 5m58s
[18:45:09.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:88:0)
[18:45:09.057] Build status: STARTED
[18:45:09.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:89:0) after 9m48s
[18:54:57.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:89:0)
[18:54:57.112] Build status: STARTED
[18:54:57.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:90:0) after 8m38s
[19:03:37.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:90:0)
[19:03:37.349] Build status: STARTED
[19:03:37.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:91:0) after 2m0s
[19:05:37.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:91:0)
[19:05:37.675] Build status: STARTED
[19:05:37.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:92:0) after 6m42s
[19:12:19.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:92:0)
[19:12:19.679] Build status: STARTED
[19:12:19.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:93:0) after 3m51s
[19:16:10.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:93:0)
[19:16:10.903] Build status: STARTED
[19:16:10.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:94:0) after 8m26s
[19:24:36.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:94:0)
[19:24:36.947] Build status: STARTED
[19:24:36.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:95:0) after 2m13s
[19:26:49.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:95:0)
[19:26:50.005] Build status: STARTED
[19:26:50.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:96:0) after 5m57s
[19:32:47.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:96:0)
[19:32:47.058] Build status: STARTED
[19:32:47.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:97:0) after 3m39s
[19:36:26.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:97:0)
[19:36:26.458] Build status: STARTED
[19:36:26.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:98:0) after 6m14s
[19:42:40.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:98:0)
[19:42:40.602] Build status: STARTED
[19:42:40.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:99:0) after 5m10s
[19:47:51.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:99:0)
[19:47:51.191] Build status: STARTED
[19:47:51.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:100:0) after 7m29s
[19:55:20.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:100:0)
[19:55:20.312] Build status: STARTED
[19:55:20.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:101:0) after 7m38s
[20:02:58.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:101:0)
[20:02:58.352] Build status: STARTED
[20:02:58.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:102:0) after 5m56s
[20:08:54.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:102:0)
[20:08:54.398] Build status: STARTED
[20:08:54.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:103:0) after 7m7s
[20:16:01.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:103:0)
[20:16:01.470] Build status: STARTED
[20:16:01.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:104:0) after 5m19s
[20:21:20.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:104:0)
[20:21:20.701] Build status: STARTED
[20:21:20.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:105:0) after 6m40s
[20:28:00.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:105:0)
[20:28:00.738] Build status: STARTED
[20:28:00.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:106:0) after 7m7s
[20:35:07.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:106:0)
[20:35:07.787] Build status: STARTED
[20:35:07.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:107:0) after 4m20s
[20:39:27.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:107:0)
[20:39:27.841] Build status: STARTED
[20:39:27.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:108:0) after 7m47s
[20:47:14.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:108:0)
[20:47:14.885] Build status: STARTED
[20:47:14.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:109:0) after 4m49s
[20:52:04.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:109:0)
[20:52:04.024] Build status: STARTED
[20:52:04.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:110:0) after 8m25s
[21:00:29.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:110:0)
[21:00:29.147] Build status: STARTED
[21:00:29.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:111:0) after 2m59s
[21:03:28.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:111:0)
[21:03:28.205] Build status: STARTED
[21:03:28.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:112:0) after 3m17s
[21:06:45.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:112:0)
[21:06:45.263] Build status: STARTED
[21:06:45.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:113:0) after 5m31s
[21:12:16.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:113:0)
[21:12:16.311] Build status: STARTED
[21:12:16.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:114:0) after 2m31s
[21:14:47.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:114:0)
[21:14:47.585] Build status: STARTED
[21:14:47.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:115:0) after 6m54s
[21:21:41.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:115:0)
[21:21:41.676] Build status: STARTED
[21:21:41.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:116:0) after 6m48s
[21:28:29.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:116:0)
[21:28:29.846] Build status: STARTED
[21:28:29.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:117:0) after 8m2s
[21:36:31.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:117:0)
[21:36:31.970] Build status: STARTED
[21:36:31.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:118:0) after 4m55s
[21:41:27.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:118:0)
[21:41:27.053] Build status: STARTED
[21:41:27.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:119:0) after 4m0s
[21:45:27.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:119:0)
[21:45:27.135] Build status: STARTED
[21:45:27.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:120:0) after 7m8s
[21:52:35.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:120:0)
[21:52:35.229] Build status: STARTED
[21:52:35.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:121:0) after 6m24s
[21:58:59.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:121:0)
[21:58:59.279] Build status: STARTED
[21:58:59.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:122:0) after 5m29s
[22:04:28.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:122:0)
[22:04:28.337] Build status: STARTED
[22:04:28.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:123:0) after 7m58s
[22:12:26.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:123:0)
[22:12:26.482] Build status: STARTED
[22:12:26.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:124:0) after 7m50s
[22:20:16.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:124:0)
[22:20:16.585] Build status: STARTED
[22:20:16.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:125:0) after 8m56s
[22:29:12.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:125:0)
[22:29:12.763] Build status: STARTED
[22:29:12.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:126:0) after 2m6s
[22:31:18.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:126:0)
[22:31:18.910] Build status: STARTED
[22:31:18.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:127:0) after 8m38s
[22:39:56.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:127:0)
[22:39:56.958] Build status: STARTED
[22:39:56.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:128:0) after 9m29s
[22:49:26.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:128:0)
[22:49:26.129] Build status: STARTED
[22:49:26.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:129:0) after 2m14s
[22:51:40.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:129:0)
[22:51:40.176] Build status: STARTED
[22:51:40.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:130:0) after 3m41s
[22:55:21.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:130:0)
[22:55:21.226] Build status: STARTED
[22:55:21.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:131:0) after 7m19s
[23:02:40.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:131:0)
[23:02:40.717] Build status: STARTED
[23:02:40.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:132:0) after 6m47s
[23:09:27.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:132:0)
[23:09:27.769] Build status: STARTED
[23:09:27.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:133:0) after 8m16s
[23:17:44.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:133:0)
[23:17:44.048] Build status: STARTED
[23:17:44.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:134:0) after 7m18s
[23:25:02.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:134:0)
[23:25:02.264] Build status: STARTED
[23:25:02.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:135:0) after 9m7s
[23:34:09.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:135:0)
[23:34:09.312] Build status: STARTED
[23:34:09.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:136:0) after 1m35s
[23:35:44.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:136:0)
[23:35:44.449] Build status: STARTED
[23:35:44.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:137:0) after 5m41s
[23:41:26.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:137:0)
[23:41:26.192] Build status: STARTED
[23:41:26.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:138:0) after 3m15s
[23:44:41.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:138:0)
[23:44:41.292] Build status: STARTED
[23:44:41.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:139:0) after 6m10s
[23:50:51.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:139:0)
[23:50:51.371] Build status: STARTED
[23:50:51.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:140:0) after 5m18s
[23:56:09.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:140:0)
[23:56:09.451] Build status: STARTED
[23:56:09.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:141:0) after 2m8s
[23:58:17.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:141:0)
[23:58:17.537] Build status: STARTED
[23:58:17.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:142:0) after 2m51s
[00:01:08.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:142:0)
[00:01:08.597] Build status: STARTED
[00:01:08.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:143:0) after 8m25s
[00:09:33.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:143:0)
[00:09:33.719] Build status: STARTED
[00:09:33.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958789216037281632:144:0) after 7m39s
[00:11:35.965] Received PubSub notification, asking Buildbucket for the build status
[00:11:36.014] Build:
{
"id": "8793359154092754193",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28578,
"createdBy": "project:chromium",
"createTime": "2022-12-30T10:30:42.013531279Z",
"startTime": "2022-12-30T10:35:23.807453Z",
"endTime": "2022-12-31T00:11:28.074716541Z",
"updateTime": "2022-12-31T00:11:28.074716541Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "36723175960f3ea3575a68b7be76c55ea0723f18",
"ref": "refs/heads/main"
}
}
}
[00:11:36.014] Invocation finished in 13h40m55.239140574s with status FAILED