[00:44:46.124] New invocation is queued and will start shortly
[00:44:47.254] Starting the invocation (attempt 1)
[00:44:47.300] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a6f5710c598be8747f7401cb36e08a5701dbaa09"
[00:44:47.300] Popped gitiles commit info from properties and tags
[00:44:47.300] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:44:47.301] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:44:47.301] Buildbucket request:
{
"requestId": "8998779340560066080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a6f5710c598be8747f7401cb36e08a5701dbaa09",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8998779340560066080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:44:48.026] Scheduled build:
{
"id": "8833349278585082993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25687,
"createdBy": "project:chromium",
"createTime": "2021-10-15T00:44:47.375836631Z",
"updateTime": "2021-10-15T00:44:47.652365150Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a6f5710c598be8747f7401cb36e08a5701dbaa09",
"ref": "refs/heads/main"
}
}
}
[00:44:48.026] Task URL: https://cr-buildbucket.appspot.com/build/8833349278585082993
[00:44:48.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:2:0) after 1m16s
[00:46:04.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:2:0)
[00:46:04.094] Build status: SCHEDULED
[00:46:04.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:3:0) after 2m29s
[00:48:33.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:3:0)
[00:48:33.418] Build status: SCHEDULED
[00:48:33.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:4:0) after 5m59s
[00:49:21.997] Received PubSub notification, asking Buildbucket for the build status
[00:49:22.024] Build status: STARTED
[00:54:32.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:4:0)
[00:54:32.852] Build status: STARTED
[00:54:32.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:6:0) after 7m7s
[01:01:39.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:6:0)
[01:01:40.018] Build status: STARTED
[01:01:40.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:7:0) after 8m35s
[01:10:15.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:7:0)
[01:10:15.413] Build status: STARTED
[01:10:15.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:8:0) after 5m32s
[01:15:47.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:8:0)
[01:15:47.672] Build status: STARTED
[01:15:47.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:9:0) after 7m50s
[01:23:37.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:9:0)
[01:23:37.727] Build status: STARTED
[01:23:37.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:10:0) after 9m9s
[01:32:46.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:10:0)
[01:32:46.940] Build status: STARTED
[01:32:46.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:11:0) after 1m58s
[01:34:45.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:11:0)
[01:34:45.090] Build status: STARTED
[01:34:45.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:12:0) after 6m25s
[01:41:10.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:12:0)
[01:41:10.178] Build status: STARTED
[01:41:10.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:13:0) after 7m45s
[01:48:55.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:13:0)
[01:48:55.481] Build status: STARTED
[01:48:55.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:14:0) after 2m29s
[01:51:24.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:14:0)
[01:51:24.555] Build status: STARTED
[01:51:24.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:15:0) after 9m40s
[02:01:04.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:15:0)
[02:01:04.642] Build status: STARTED
[02:01:04.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:16:0) after 5m40s
[02:06:44.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:16:0)
[02:06:44.807] Build status: STARTED
[02:06:44.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:17:0) after 3m46s
[02:10:31.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:17:0)
[02:10:31.402] Build status: STARTED
[02:10:31.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:18:0) after 1m10s
[02:11:41.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:18:0)
[02:11:41.591] Build status: STARTED
[02:11:41.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:19:0) after 3m0s
[02:14:41.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:19:0)
[02:14:41.713] Build status: STARTED
[02:14:41.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:20:0) after 4m29s
[02:19:10.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:20:0)
[02:19:11.020] Build status: STARTED
[02:19:11.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:21:0) after 1m27s
[02:20:38.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:21:0)
[02:20:38.169] Build status: STARTED
[02:20:38.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:22:0) after 5m44s
[02:26:22.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:22:0)
[02:26:22.194] Build status: STARTED
[02:26:22.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:23:0) after 6m7s
[02:32:29.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:23:0)
[02:32:29.348] Build status: STARTED
[02:32:29.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:24:0) after 3m25s
[02:35:54.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:24:0)
[02:35:54.660] Build status: STARTED
[02:35:54.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:25:0) after 3m3s
[02:38:57.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:25:0)
[02:38:57.859] Build status: STARTED
[02:38:57.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:26:0) after 2m25s
[02:41:22.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:26:0)
[02:41:22.968] Build status: STARTED
[02:41:22.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:27:0) after 3m47s
[02:45:10.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:27:0)
[02:45:10.085] Build status: STARTED
[02:45:10.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:28:0) after 9m9s
[02:54:19.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:28:0)
[02:54:19.156] Build status: STARTED
[02:54:19.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:29:0) after 2m11s
[02:56:30.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:29:0)
[02:56:30.365] Build status: STARTED
[02:56:30.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:30:0) after 5m26s
[03:01:56.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:30:0)
[03:01:56.495] Build status: STARTED
[03:01:56.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:31:0) after 9m56s
[03:11:52.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:31:0)
[03:11:52.586] Build status: STARTED
[03:11:52.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:32:0) after 2m19s
[03:14:11.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:32:0)
[03:14:11.846] Build status: STARTED
[03:14:11.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:33:0) after 1m33s
[03:15:45.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:33:0)
[03:15:45.034] Build status: STARTED
[03:15:45.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:34:0) after 9m38s
[03:25:23.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:34:0)
[03:25:23.338] Build status: STARTED
[03:25:23.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:35:0) after 5m26s
[03:30:49.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:35:0)
[03:30:49.449] Build status: STARTED
[03:30:49.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:36:0) after 7m54s
[03:38:43.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:36:0)
[03:38:43.789] Build status: STARTED
[03:38:43.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:37:0) after 3m11s
[03:41:54.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:37:0)
[03:41:54.850] Build status: STARTED
[03:41:54.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:38:0) after 9m48s
[03:51:43.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:38:0)
[03:51:43.413] Build status: STARTED
[03:51:43.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:39:0) after 3m40s
[03:55:23.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:39:0)
[03:55:23.781] Build status: STARTED
[03:55:23.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:40:0) after 1m22s
[03:56:45.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:40:0)
[03:56:45.990] Build status: STARTED
[03:56:45.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:41:0) after 1m55s
[03:58:41.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:41:0)
[03:58:41.145] Build status: STARTED
[03:58:41.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:42:0) after 7m40s
[04:06:21.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:42:0)
[04:06:21.237] Build status: STARTED
[04:06:21.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:43:0) after 6m42s
[04:13:03.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:43:0)
[04:13:03.310] Build status: STARTED
[04:13:03.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:44:0) after 7m54s
[04:20:57.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:44:0)
[04:20:57.476] Build status: STARTED
[04:20:57.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:45:0) after 6m53s
[04:27:50.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:45:0)
[04:27:50.574] Build status: STARTED
[04:27:50.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:46:0) after 3m27s
[04:31:17.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:46:0)
[04:31:17.759] Build status: STARTED
[04:31:17.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:47:0) after 4m52s
[04:36:09.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:47:0)
[04:36:09.999] Build status: STARTED
[04:36:09.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:48:0) after 3m35s
[04:39:45.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:48:0)
[04:39:45.057] Build status: STARTED
[04:39:45.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:49:0) after 3m15s
[04:43:00.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:49:0)
[04:43:00.192] Build status: STARTED
[04:43:00.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:50:0) after 6m30s
[04:49:30.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:50:0)
[04:49:30.220] Build status: STARTED
[04:49:30.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:51:0) after 3m16s
[04:52:46.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:51:0)
[04:52:46.329] Build status: STARTED
[04:52:46.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:52:0) after 9m27s
[05:02:13.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:52:0)
[05:02:13.443] Build status: STARTED
[05:02:13.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:53:0) after 7m49s
[05:10:02.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:53:0)
[05:10:02.512] Build status: STARTED
[05:10:02.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:54:0) after 3m37s
[05:13:39.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:54:0)
[05:13:39.681] Build status: STARTED
[05:13:39.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:55:0) after 1m10s
[05:14:49.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:55:0)
[05:14:49.775] Build status: STARTED
[05:14:49.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:56:0) after 4m50s
[05:19:39.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:56:0)
[05:19:39.801] Build status: STARTED
[05:19:39.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:57:0) after 5m21s
[05:25:00.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:57:0)
[05:25:00.909] Build status: STARTED
[05:25:00.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:58:0) after 8m52s
[05:33:52.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:58:0)
[05:33:52.992] Build status: STARTED
[05:33:52.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:59:0) after 5m9s
[05:39:02.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:59:0)
[05:39:02.318] Build status: STARTED
[05:39:02.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:60:0) after 4m57s
[05:43:59.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:60:0)
[05:43:59.372] Build status: STARTED
[05:43:59.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:61:0) after 2m28s
[05:46:27.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:61:0)
[05:46:27.560] Build status: STARTED
[05:46:27.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:62:0) after 7m51s
[05:54:18.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:62:0)
[05:54:18.786] Build status: STARTED
[05:54:18.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:63:0) after 3m17s
[05:57:35.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:63:0)
[05:57:35.842] Build status: STARTED
[05:57:35.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:64:0) after 4m14s
[06:01:49.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:64:0)
[06:01:49.946] Build status: STARTED
[06:01:49.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:65:0) after 5m12s
[06:07:02.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:65:0)
[06:07:02.393] Build status: STARTED
[06:07:02.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:66:0) after 5m20s
[06:12:22.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:66:0)
[06:12:32.207] Build status: STARTED
[06:12:32.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:67:0) after 6m5s
[06:18:37.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:67:0)
[06:18:37.286] Build status: STARTED
[06:18:37.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:68:0) after 4m14s
[06:22:51.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:68:0)
[06:22:51.345] Build status: STARTED
[06:22:51.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:69:0) after 9m16s
[06:32:07.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:69:0)
[06:32:07.654] Build status: STARTED
[06:32:07.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:70:0) after 5m6s
[06:37:13.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:70:0)
[06:37:13.895] Build status: STARTED
[06:37:13.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:71:0) after 1m49s
[06:39:03.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:71:0)
[06:39:03.190] Build status: STARTED
[06:39:03.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:72:0) after 4m52s
[06:43:55.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:72:0)
[06:43:55.302] Build status: STARTED
[06:43:55.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:73:0) after 2m9s
[06:46:04.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:73:0)
[06:46:04.370] Build status: STARTED
[06:46:04.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:74:0) after 1m47s
[06:47:51.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:74:0)
[06:47:51.430] Build status: STARTED
[06:47:51.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:75:0) after 3m1s
[06:50:52.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:75:0)
[06:50:52.503] Build status: STARTED
[06:50:52.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:76:0) after 1m14s
[06:52:06.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:76:0)
[06:52:06.847] Build status: STARTED
[06:52:06.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:77:0) after 8m10s
[07:00:17.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:77:0)
[07:00:17.309] Build status: STARTED
[07:00:17.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:78:0) after 4m1s
[07:04:18.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:78:0)
[07:04:18.322] Build status: STARTED
[07:04:18.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:79:0) after 4m28s
[07:08:46.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:79:0)
[07:08:46.604] Build status: STARTED
[07:08:46.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:80:0) after 5m38s
[07:14:24.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:80:0)
[07:14:24.643] Build status: STARTED
[07:14:24.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:81:0) after 9m26s
[07:23:50.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:81:0)
[07:23:50.723] Build status: STARTED
[07:23:50.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:82:0) after 6m48s
[07:30:38.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:82:0)
[07:30:38.810] Build status: STARTED
[07:30:38.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:83:0) after 3m33s
[07:34:11.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:83:0)
[07:34:11.868] Build status: STARTED
[07:34:11.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:84:0) after 3m0s
[07:37:11.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:84:0)
[07:37:11.961] Build status: STARTED
[07:37:11.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:85:0) after 7m44s
[07:44:56.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:85:0)
[07:44:56.057] Build status: STARTED
[07:44:56.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:86:0) after 1m40s
[07:46:36.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:86:0)
[07:46:36.118] Build status: STARTED
[07:46:36.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:87:0) after 6m44s
[07:53:20.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:87:0)
[07:53:20.195] Build status: STARTED
[07:53:20.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:88:0) after 6m8s
[07:59:28.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:88:0)
[07:59:28.261] Build status: STARTED
[07:59:28.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:89:0) after 1m47s
[08:01:15.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:89:0)
[08:01:15.383] Build status: STARTED
[08:01:15.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:90:0) after 8m32s
[08:09:47.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:90:0)
[08:09:47.762] Build status: STARTED
[08:09:47.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:91:0) after 4m44s
[08:14:31.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:91:0)
[08:14:31.960] Build status: STARTED
[08:14:31.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:92:0) after 1m58s
[08:16:29.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:92:0)
[08:16:30.023] Build status: STARTED
[08:16:30.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:93:0) after 1m22s
[08:17:52.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:93:0)
[08:17:52.404] Build status: STARTED
[08:17:52.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:94:0) after 8m53s
[08:26:45.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:94:0)
[08:26:45.826] Build status: STARTED
[08:26:45.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:95:0) after 5m11s
[08:31:56.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:95:0)
[08:31:57.011] Build status: STARTED
[08:31:57.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:96:0) after 8m34s
[08:40:31.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:96:0)
[08:40:31.072] Build status: STARTED
[08:40:31.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:97:0) after 9m0s
[08:49:31.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:97:0)
[08:49:31.129] Build status: STARTED
[08:49:31.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:98:0) after 7m11s
[08:56:42.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:98:0)
[08:56:42.582] Build status: STARTED
[08:56:42.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:99:0) after 5m9s
[09:01:51.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:99:0)
[09:01:51.714] Build status: STARTED
[09:01:51.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:100:0) after 8m17s
[09:10:08.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:100:0)
[09:10:08.974] Build status: STARTED
[09:10:08.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:101:0) after 6m52s
[09:17:01.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:101:0)
[09:17:01.072] Build status: STARTED
[09:17:01.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:102:0) after 5m9s
[09:22:10.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:102:0)
[09:22:10.595] Build status: STARTED
[09:22:10.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:103:0) after 4m47s
[09:26:57.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:103:0)
[09:26:57.887] Build status: STARTED
[09:26:57.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:104:0) after 9m53s
[09:36:51.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:104:0)
[09:36:51.073] Build status: STARTED
[09:36:51.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:105:0) after 6m45s
[09:43:36.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:105:0)
[09:43:36.145] Build status: STARTED
[09:43:36.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:106:0) after 7m31s
[09:51:07.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:106:0)
[09:51:07.324] Build status: STARTED
[09:51:07.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:107:0) after 3m45s
[09:54:52.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:107:0)
[09:54:52.483] Build status: STARTED
[09:54:52.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:108:0) after 2m7s
[09:56:59.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:108:0)
[09:56:59.818] Build status: STARTED
[09:56:59.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:109:0) after 3m14s
[10:00:13.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:109:0)
[10:00:13.881] Build status: STARTED
[10:00:13.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:110:0) after 6m46s
[10:07:00.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:110:0)
[10:07:00.095] Build status: STARTED
[10:07:00.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:111:0) after 1m23s
[10:08:23.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:111:0)
[10:08:23.248] Build status: STARTED
[10:08:23.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:112:0) after 7m34s
[10:15:57.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:112:0)
[10:15:57.442] Build status: STARTED
[10:15:57.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:113:0) after 6m28s
[10:22:25.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:113:0)
[10:22:25.535] Build status: STARTED
[10:22:25.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:114:0) after 1m39s
[10:24:04.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:114:0)
[10:24:04.837] Build status: STARTED
[10:24:04.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:115:0) after 4m31s
[10:28:35.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:115:0)
[10:28:35.960] Build status: STARTED
[10:28:35.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:116:0) after 9m25s
[10:38:01.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:116:0)
[10:38:01.042] Build status: STARTED
[10:38:01.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:117:0) after 6m58s
[10:44:59.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:117:0)
[10:44:59.161] Build status: STARTED
[10:44:59.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:118:0) after 5m0s
[10:49:59.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:118:0)
[10:49:59.379] Build status: STARTED
[10:49:59.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:119:0) after 1m18s
[10:51:17.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:119:0)
[10:51:17.520] Build status: STARTED
[10:51:17.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:120:0) after 6m29s
[10:57:46.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:120:0)
[10:57:46.695] Build status: STARTED
[10:57:46.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:121:0) after 3m42s
[11:01:28.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:121:0)
[11:01:28.796] Build status: STARTED
[11:01:28.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:122:0) after 9m26s
[11:10:54.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:122:0)
[11:10:54.869] Build status: STARTED
[11:10:54.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:123:0) after 6m7s
[11:17:01.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:123:0)
[11:17:01.930] Build status: STARTED
[11:17:01.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998779340560066080:124:0) after 6m32s
[11:18:08.407] Received PubSub notification, asking Buildbucket for the build status
[11:18:08.436] Build:
{
"id": "8833349278585082993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25687,
"createdBy": "project:chromium",
"createTime": "2021-10-15T00:44:47.375836631Z",
"startTime": "2021-10-15T00:49:20.998874Z",
"endTime": "2021-10-15T11:18:07.672827734Z",
"updateTime": "2021-10-15T11:18:07.673343605Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a6f5710c598be8747f7401cb36e08a5701dbaa09",
"ref": "refs/heads/main"
}
}
}
[11:18:08.436] Invocation finished in 10h33m22.327993006s with status FAILED