[16:25:08.512] New invocation is queued and will start shortly
[16:25:09.805] Starting the invocation (attempt 1)
[16:25:09.849] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cf1cc81c313249cbffdb3578762cd20d3a7976bb"
[16:25:09.849] Popped gitiles commit info from properties and tags
[16:25:09.849] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:25:09.849] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:25:09.849] Buildbucket request:
{
"requestId": "8988120332330120176",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cf1cc81c313249cbffdb3578762cd20d3a7976bb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8988120332330120176"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:25:10.416] Scheduled build:
{
"id": "8822690270160279393",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26512,
"createdBy": "project:chromium",
"createTime": "2022-02-09T16:25:09.948490421Z",
"updateTime": "2022-02-09T16:25:09.948490421Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cf1cc81c313249cbffdb3578762cd20d3a7976bb",
"ref": "refs/heads/main"
}
}
}
[16:25:10.416] Task URL: https://cr-buildbucket.appspot.com/build/8822690270160279393
[16:25:10.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:2:0) after 2m19s
[16:27:29.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:2:0)
[16:27:29.666] Build status: SCHEDULED
[16:27:29.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:3:0) after 2m28s
[16:29:57.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:3:0)
[16:29:57.911] Build status: SCHEDULED
[16:29:57.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:4:0) after 2m37s
[16:32:34.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:4:0)
[16:32:34.955] Build status: SCHEDULED
[16:32:34.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:5:0) after 6m3s
[16:38:38.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:5:0)
[16:38:38.122] Build status: SCHEDULED
[16:38:38.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:6:0) after 1m52s
[16:40:30.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:6:0)
[16:40:30.266] Build status: SCHEDULED
[16:40:30.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:7:0) after 5m48s
[16:46:18.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:7:0)
[16:46:18.542] Build status: SCHEDULED
[16:46:18.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:8:0) after 3m12s
[16:49:30.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:8:0)
[16:49:30.585] Build status: SCHEDULED
[16:49:30.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:9:0) after 2m37s
[16:52:07.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:9:0)
[16:52:07.788] Build status: SCHEDULED
[16:52:07.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:10:0) after 5m40s
[16:53:48.631] Received PubSub notification, asking Buildbucket for the build status
[16:53:48.694] Build status: STARTED
[16:57:47.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:10:0)
[16:57:47.927] Build status: STARTED
[16:57:47.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:12:0) after 9m50s
[17:07:37.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:12:0)
[17:07:38.047] Build status: STARTED
[17:07:38.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:13:0) after 4m44s
[17:12:22.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:13:0)
[17:12:22.106] Build status: STARTED
[17:12:22.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:14:0) after 6m59s
[17:19:21.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:14:0)
[17:19:21.347] Build status: STARTED
[17:19:21.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:15:0) after 8m42s
[17:28:03.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:15:0)
[17:28:03.437] Build status: STARTED
[17:28:03.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:16:0) after 7m10s
[17:35:13.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:16:0)
[17:35:13.587] Build status: STARTED
[17:35:13.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:17:0) after 5m16s
[17:40:29.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:17:0)
[17:40:29.641] Build status: STARTED
[17:40:29.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:18:0) after 2m33s
[17:43:02.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:18:0)
[17:43:02.743] Build status: STARTED
[17:43:02.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:19:0) after 3m9s
[17:46:11.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:19:0)
[17:46:11.967] Build status: STARTED
[17:46:11.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:20:0) after 3m14s
[17:49:26.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:20:0)
[17:49:26.120] Build status: STARTED
[17:49:26.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:21:0) after 2m37s
[17:52:03.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:21:0)
[17:52:03.175] Build status: STARTED
[17:52:03.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:22:0) after 1m53s
[17:53:56.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:22:0)
[17:53:56.763] Build status: STARTED
[17:53:56.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:23:0) after 9m42s
[18:03:39.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:23:0)
[18:03:39.078] Build status: STARTED
[18:03:39.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:24:0) after 9m18s
[18:12:57.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:24:0)
[18:12:57.315] Build status: STARTED
[18:12:57.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:25:0) after 5m54s
[18:18:51.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:25:0)
[18:18:51.655] Build status: STARTED
[18:18:51.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:26:0) after 1m45s
[18:20:36.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:26:0)
[18:20:36.879] Build status: STARTED
[18:20:36.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:27:0) after 8m47s
[18:29:24.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:27:0)
[18:29:24.400] Build status: STARTED
[18:29:24.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:28:0) after 8m19s
[18:37:43.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:28:0)
[18:37:43.611] Build status: STARTED
[18:37:43.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:29:0) after 4m42s
[18:42:25.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:29:0)
[18:42:25.680] Build status: STARTED
[18:42:25.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:30:0) after 1m36s
[18:44:01.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:30:0)
[18:44:01.807] Build status: STARTED
[18:44:01.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:31:0) after 6m10s
[18:50:12.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:31:0)
[18:50:12.062] Build status: STARTED
[18:50:12.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:32:0) after 9m3s
[18:59:15.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:32:0)
[18:59:15.681] Build status: STARTED
[18:59:15.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:33:0) after 5m46s
[19:05:01.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:33:0)
[19:05:01.974] Build status: STARTED
[19:05:01.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:34:0) after 3m22s
[19:08:24.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:34:0)
[19:08:24.142] Build status: STARTED
[19:08:24.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:35:0) after 8m4s
[19:16:28.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:35:0)
[19:16:28.307] Build status: STARTED
[19:16:28.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:36:0) after 5m24s
[19:21:52.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:36:0)
[19:21:52.398] Build status: STARTED
[19:21:52.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:37:0) after 1m41s
[19:23:34.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:37:0)
[19:23:34.331] Build status: STARTED
[19:23:34.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:38:0) after 4m57s
[19:28:31.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:38:0)
[19:28:31.378] Build status: STARTED
[19:28:31.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:39:0) after 5m36s
[19:34:07.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:39:0)
[19:34:07.794] Build status: STARTED
[19:34:07.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:40:0) after 7m36s
[19:41:43.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:40:0)
[19:41:43.958] Build status: STARTED
[19:41:43.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:41:0) after 2m41s
[19:44:25.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:41:0)
[19:44:25.251] Build status: STARTED
[19:44:25.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:42:0) after 3m13s
[19:47:38.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:42:0)
[19:47:38.587] Build status: STARTED
[19:47:38.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:43:0) after 6m58s
[19:54:36.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:43:0)
[19:54:36.860] Build status: STARTED
[19:54:36.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:44:0) after 9m19s
[20:03:56.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:44:0)
[20:03:56.445] Build status: STARTED
[20:03:56.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:45:0) after 8m54s
[20:12:50.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:45:0)
[20:12:50.501] Build status: STARTED
[20:12:50.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:46:0) after 3m56s
[20:16:46.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:46:0)
[20:16:46.568] Build status: STARTED
[20:16:46.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:47:0) after 7m18s
[20:24:05.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:47:0)
[20:24:05.205] Build status: STARTED
[20:24:05.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:48:0) after 4m13s
[20:28:18.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:48:0)
[20:28:18.393] Build status: STARTED
[20:28:18.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:49:0) after 1m0s
[20:29:18.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:49:0)
[20:29:18.669] Build status: STARTED
[20:29:18.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:50:0) after 9m29s
[20:38:47.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:50:0)
[20:38:47.722] Build status: STARTED
[20:38:47.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:51:0) after 7m38s
[20:46:25.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:51:0)
[20:46:25.880] Build status: STARTED
[20:46:25.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:52:0) after 1m50s
[20:48:15.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:52:0)
[20:48:15.940] Build status: STARTED
[20:48:15.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:53:0) after 1m58s
[20:50:14.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:53:0)
[20:50:14.597] Build status: STARTED
[20:50:14.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:54:0) after 1m51s
[20:52:05.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:54:0)
[20:52:05.755] Build status: STARTED
[20:52:05.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:55:0) after 5m7s
[20:57:12.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:55:0)
[20:57:12.909] Build status: STARTED
[20:57:12.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:56:0) after 6m56s
[21:04:09.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:56:0)
[21:04:09.049] Build status: STARTED
[21:04:09.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:57:0) after 2m11s
[21:06:20.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:57:0)
[21:06:20.358] Build status: STARTED
[21:06:20.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:58:0) after 4m14s
[21:10:34.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:58:0)
[21:10:34.362] Build status: STARTED
[21:10:34.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:59:0) after 1m11s
[21:11:45.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:59:0)
[21:11:45.703] Build status: STARTED
[21:11:45.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:60:0) after 1m9s
[21:12:55.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:60:0)
[21:12:55.501] Build status: STARTED
[21:12:55.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:61:0) after 4m40s
[21:17:35.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:61:0)
[21:17:35.551] Build status: STARTED
[21:17:35.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:62:0) after 1m22s
[21:18:57.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:62:0)
[21:18:57.598] Build status: STARTED
[21:18:57.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:63:0) after 4m17s
[21:23:14.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:63:0)
[21:23:14.655] Build status: STARTED
[21:23:14.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:64:0) after 2m0s
[21:25:14.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:64:0)
[21:25:14.754] Build status: STARTED
[21:25:14.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:65:0) after 1m18s
[21:26:32.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:65:0)
[21:26:32.980] Build status: STARTED
[21:26:32.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:66:0) after 3m1s
[21:29:34.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:66:0)
[21:29:34.104] Build status: STARTED
[21:29:34.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:67:0) after 8m16s
[21:37:50.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:67:0)
[21:37:50.185] Build status: STARTED
[21:37:50.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:68:0) after 3m33s
[21:41:23.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:68:0)
[21:41:23.319] Build status: STARTED
[21:41:23.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:69:0) after 8m2s
[21:49:25.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:69:0)
[21:49:25.541] Build status: STARTED
[21:49:25.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:70:0) after 2m59s
[21:52:24.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:70:0)
[21:52:24.673] Build status: STARTED
[21:52:24.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:71:0) after 1m34s
[21:53:58.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:71:0)
[21:53:58.783] Build status: STARTED
[21:53:58.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:72:0) after 6m41s
[22:00:40.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:72:0)
[22:00:40.027] Build status: STARTED
[22:00:40.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:73:0) after 1m55s
[22:02:35.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:73:0)
[22:02:35.110] Build status: STARTED
[22:02:35.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:74:0) after 8m55s
[22:11:30.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:74:0)
[22:11:30.453] Build status: STARTED
[22:11:30.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:75:0) after 6m23s
[22:17:53.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:75:0)
[22:17:53.553] Build status: STARTED
[22:17:53.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:76:0) after 4m11s
[22:22:04.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:76:0)
[22:22:04.600] Build status: STARTED
[22:22:04.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:77:0) after 5m13s
[22:27:17.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:77:0)
[22:27:17.745] Build status: STARTED
[22:27:17.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:78:0) after 7m9s
[22:34:26.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:78:0)
[22:34:26.894] Build status: STARTED
[22:34:26.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:79:0) after 2m53s
[22:37:20.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:79:0)
[22:37:20.425] Build status: STARTED
[22:37:20.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:80:0) after 5m9s
[22:42:29.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:80:0)
[22:42:29.474] Build status: STARTED
[22:42:29.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:81:0) after 4m34s
[22:47:03.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:81:0)
[22:47:03.597] Build status: STARTED
[22:47:03.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:82:0) after 9m57s
[22:57:01.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:82:0)
[22:57:01.037] Build status: STARTED
[22:57:01.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:83:0) after 8m44s
[23:05:45.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:83:0)
[23:05:45.341] Build status: STARTED
[23:05:45.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:84:0) after 1m31s
[23:07:16.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:84:0)
[23:07:16.550] Build status: STARTED
[23:07:16.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:85:0) after 9m52s
[23:17:08.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:85:0)
[23:17:08.777] Build status: STARTED
[23:17:08.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:86:0) after 6m44s
[23:23:52.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:86:0)
[23:23:53.019] Build status: STARTED
[23:23:53.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:87:0) after 2m38s
[23:26:31.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:87:0)
[23:26:31.180] Build status: STARTED
[23:26:31.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:88:0) after 3m42s
[23:30:13.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:88:0)
[23:30:13.272] Build status: STARTED
[23:30:13.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:89:0) after 1m13s
[23:31:26.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:89:0)
[23:31:26.471] Build status: STARTED
[23:31:26.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:90:0) after 5m31s
[23:36:57.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:90:0)
[23:36:57.898] Build status: STARTED
[23:36:57.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:91:0) after 1m22s
[23:38:19.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:91:0)
[23:38:20.014] Build status: STARTED
[23:38:20.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:92:0) after 2m32s
[23:40:52.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:92:0)
[23:40:52.068] Build status: STARTED
[23:40:52.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:93:0) after 4m42s
[23:45:34.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:93:0)
[23:45:34.177] Build status: STARTED
[23:45:34.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:94:0) after 9m31s
[23:55:05.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:94:0)
[23:55:05.235] Build status: STARTED
[23:55:05.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:95:0) after 6m34s
[00:01:39.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:95:0)
[00:01:39.425] Build status: STARTED
[00:01:39.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:96:0) after 1m58s
[00:03:37.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:96:0)
[00:03:37.494] Build status: STARTED
[00:03:37.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:97:0) after 5m21s
[00:08:58.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:97:0)
[00:08:58.860] Build status: STARTED
[00:08:58.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:98:0) after 9m40s
[00:18:38.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:98:0)
[00:18:38.994] Build status: STARTED
[00:18:38.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:99:0) after 1m28s
[00:20:07.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:99:0)
[00:20:07.340] Build status: STARTED
[00:20:07.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:100:0) after 1m14s
[00:21:21.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:100:0)
[00:21:21.400] Build status: STARTED
[00:21:21.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:101:0) after 1m43s
[00:23:04.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:101:0)
[00:23:04.581] Build status: STARTED
[00:23:04.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:102:0) after 8m30s
[00:31:34.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:102:0)
[00:31:34.889] Build status: STARTED
[00:31:34.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:103:0) after 4m2s
[00:35:36.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:103:0)
[00:35:37.007] Build status: STARTED
[00:35:37.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:104:0) after 3m54s
[00:39:31.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:104:0)
[00:39:31.085] Build status: STARTED
[00:39:31.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:105:0) after 1m4s
[00:40:35.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:105:0)
[00:40:35.238] Build status: STARTED
[00:40:35.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:106:0) after 2m56s
[00:43:31.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:106:0)
[00:43:31.351] Build status: STARTED
[00:43:31.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:107:0) after 1m11s
[00:44:42.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:107:0)
[00:44:42.417] Build status: STARTED
[00:44:42.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:108:0) after 5m15s
[00:49:57.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:108:0)
[00:49:57.464] Build status: STARTED
[00:49:57.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:109:0) after 7m47s
[00:57:44.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:109:0)
[00:57:44.525] Build status: STARTED
[00:57:44.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:110:0) after 8m47s
[01:06:31.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:110:0)
[01:06:31.627] Build status: STARTED
[01:06:31.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:111:0) after 7m25s
[01:13:56.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:111:0)
[01:13:56.737] Build status: STARTED
[01:13:56.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:112:0) after 5m28s
[01:19:24.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:112:0)
[01:19:24.890] Build status: STARTED
[01:19:24.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:113:0) after 5m39s
[01:25:04.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:113:0)
[01:25:04.261] Build status: STARTED
[01:25:04.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:114:0) after 9m13s
[01:34:17.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:114:0)
[01:34:17.355] Build status: STARTED
[01:34:17.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:115:0) after 4m45s
[01:39:02.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:115:0)
[01:39:02.528] Build status: STARTED
[01:39:02.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:116:0) after 1m22s
[01:40:24.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:116:0)
[01:40:24.575] Build status: STARTED
[01:40:24.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:117:0) after 1m22s
[01:41:46.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:117:0)
[01:41:46.624] Build status: STARTED
[01:41:46.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:118:0) after 1m44s
[01:43:30.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:118:0)
[01:43:30.681] Build status: STARTED
[01:43:30.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:119:0) after 4m13s
[01:47:43.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:119:0)
[01:47:43.754] Build status: STARTED
[01:47:43.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:120:0) after 4m28s
[01:52:11.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:120:0)
[01:52:12.000] Build status: STARTED
[01:52:12.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:121:0) after 3m47s
[01:55:59.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:121:0)
[01:55:59.159] Build status: STARTED
[01:55:59.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:122:0) after 7m39s
[02:03:38.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:122:0)
[02:03:38.425] Build status: STARTED
[02:03:38.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:123:0) after 2m30s
[02:06:08.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:123:0)
[02:06:08.513] Build status: STARTED
[02:06:08.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:124:0) after 6m41s
[02:12:49.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:124:0)
[02:12:49.892] Build status: STARTED
[02:12:49.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:125:0) after 5m0s
[02:17:49.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:125:0)
[02:17:49.973] Build status: STARTED
[02:17:49.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:126:0) after 7m22s
[02:25:12.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:126:0)
[02:25:12.026] Build status: STARTED
[02:25:12.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:127:0) after 9m59s
[02:35:11.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:127:0)
[02:35:11.140] Build status: STARTED
[02:35:11.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:128:0) after 8m47s
[02:43:58.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:128:0)
[02:43:58.218] Build status: STARTED
[02:43:58.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:129:0) after 1m27s
[02:45:25.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:129:0)
[02:45:25.371] Build status: STARTED
[02:45:25.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:130:0) after 6m48s
[02:52:13.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:130:0)
[02:52:13.541] Build status: STARTED
[02:52:13.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:131:0) after 8m33s
[03:00:46.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:131:0)
[03:00:46.626] Build status: STARTED
[03:00:46.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:132:0) after 4m19s
[03:05:05.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:132:0)
[03:05:05.717] Build status: STARTED
[03:05:05.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:133:0) after 5m27s
[03:10:32.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:133:0)
[03:10:32.851] Build status: STARTED
[03:10:32.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:134:0) after 3m42s
[03:14:14.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:134:0)
[03:14:14.904] Build status: STARTED
[03:14:14.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:135:0) after 8m29s
[03:22:43.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:135:0)
[03:22:43.983] Build status: STARTED
[03:22:43.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:136:0) after 6m21s
[03:29:05.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:136:0)
[03:29:05.078] Build status: STARTED
[03:29:05.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:137:0) after 9m51s
[03:38:56.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:137:0)
[03:38:56.136] Build status: STARTED
[03:38:56.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:138:0) after 2m12s
[03:41:08.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:138:0)
[03:41:08.381] Build status: STARTED
[03:41:08.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8988120332330120176:139:0) after 5m2s
[03:45:01.134] Received PubSub notification, asking Buildbucket for the build status
[03:45:01.165] Build:
{
"id": "8822690270160279393",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26512,
"createdBy": "project:chromium",
"createTime": "2022-02-09T16:25:09.948490421Z",
"startTime": "2022-02-09T16:53:47.853395Z",
"endTime": "2022-02-10T03:45:00.691252666Z",
"updateTime": "2022-02-10T03:45:00.691252666Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cf1cc81c313249cbffdb3578762cd20d3a7976bb",
"ref": "refs/heads/main"
}
}
}
[03:45:01.165] Invocation finished in 11h19m52.670382739s with status FAILED