[15:41:10.286] New invocation is queued and will start shortly
[15:41:11.382] Starting the invocation (attempt 1)
[15:41:11.425] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/678ed16bfdb381e11d33126671d7d5ffe2a1e28c"
[15:41:11.425] Popped gitiles commit info from properties and tags
[15:41:11.426] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:41:11.426] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:41:11.426] Buildbucket request:
{
"requestId": "9000263092216136560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "678ed16bfdb381e11d33126671d7d5ffe2a1e28c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9000263092216136560"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:41:12.005] Scheduled build:
{
"id": "8834833030285076721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25587,
"createdBy": "project:chromium",
"createTime": "2021-09-28T15:41:11.487354060Z",
"updateTime": "2021-09-28T15:41:11.787137147Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "678ed16bfdb381e11d33126671d7d5ffe2a1e28c",
"ref": "refs/heads/main"
}
}
}
[15:41:12.005] Task URL: https://cr-buildbucket.appspot.com/build/8834833030285076721
[15:41:12.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:2:0) after 3m29s
[15:44:41.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:2:0)
[15:44:41.349] Build status: SCHEDULED
[15:44:41.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:3:0) after 9m52s
[15:48:23.057] Received PubSub notification, asking Buildbucket for the build status
[15:48:23.087] Build status: STARTED
[15:54:33.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:3:0)
[15:54:33.407] Build status: STARTED
[15:54:33.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:5:0) after 7m39s
[16:02:12.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:5:0)
[16:02:12.467] Build status: STARTED
[16:02:12.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:6:0) after 3m53s
[16:06:05.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:6:0)
[16:06:05.530] Build status: STARTED
[16:06:05.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:7:0) after 1m49s
[16:07:54.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:7:0)
[16:07:54.710] Build status: STARTED
[16:07:54.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:8:0) after 8m19s
[16:16:13.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:8:0)
[16:16:13.802] Build status: STARTED
[16:16:13.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:9:0) after 8m22s
[16:24:35.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:9:0)
[16:24:35.960] Build status: STARTED
[16:24:35.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:10:0) after 4m37s
[16:29:13.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:10:0)
[16:29:13.195] Build status: STARTED
[16:29:13.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:11:0) after 5m15s
[16:34:28.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:11:0)
[16:34:28.294] Build status: STARTED
[16:34:28.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:12:0) after 4m54s
[16:39:22.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:12:0)
[16:39:22.890] Build status: STARTED
[16:39:22.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:13:0) after 4m36s
[16:43:58.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:13:0)
[16:43:59.001] Build status: STARTED
[16:43:59.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:14:0) after 3m1s
[16:47:00.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:14:0)
[16:47:00.082] Build status: STARTED
[16:47:00.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:15:0) after 1m46s
[16:48:46.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:15:0)
[16:48:46.134] Build status: STARTED
[16:48:46.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:16:0) after 5m51s
[16:54:37.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:16:0)
[16:54:37.210] Build status: STARTED
[16:54:37.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:17:0) after 3m7s
[16:57:44.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:17:0)
[16:57:44.454] Build status: STARTED
[16:57:44.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:18:0) after 1m42s
[16:59:26.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:18:0)
[16:59:26.922] Build status: STARTED
[16:59:26.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:19:0) after 4m51s
[17:04:17.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:19:0)
[17:04:17.982] Build status: STARTED
[17:04:17.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:20:0) after 1m57s
[17:06:15.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:20:0)
[17:06:15.033] Build status: STARTED
[17:06:15.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:21:0) after 6m49s
[17:13:04.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:21:0)
[17:13:04.285] Build status: STARTED
[17:13:04.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:22:0) after 5m59s
[17:19:03.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:22:0)
[17:19:03.494] Build status: STARTED
[17:19:03.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:23:0) after 4m28s
[17:23:31.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:23:0)
[17:23:31.563] Build status: STARTED
[17:23:31.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:24:0) after 7m51s
[17:31:22.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:24:0)
[17:31:22.726] Build status: STARTED
[17:31:22.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:25:0) after 6m6s
[17:37:28.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:25:0)
[17:37:28.780] Build status: STARTED
[17:37:28.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:26:0) after 4m34s
[17:42:02.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:26:0)
[17:42:02.848] Build status: STARTED
[17:42:02.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:27:0) after 7m27s
[17:49:29.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:27:0)
[17:49:29.988] Build status: STARTED
[17:49:29.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:28:0) after 7m32s
[17:57:02.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:28:0)
[17:57:02.067] Build status: STARTED
[17:57:02.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:29:0) after 6m36s
[18:03:38.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:29:0)
[18:03:38.880] Build status: STARTED
[18:03:38.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:30:0) after 6m10s
[18:09:48.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:30:0)
[18:09:48.941] Build status: STARTED
[18:09:48.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:31:0) after 6m9s
[18:15:58.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:31:0)
[18:15:58.126] Build status: STARTED
[18:15:58.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:32:0) after 1m14s
[18:17:12.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:32:0)
[18:17:12.326] Build status: STARTED
[18:17:12.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:33:0) after 9m32s
[18:26:44.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:33:0)
[18:26:44.497] Build status: STARTED
[18:26:44.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:34:0) after 3m53s
[18:30:38.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:34:0)
[18:30:38.118] Build status: STARTED
[18:30:38.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:35:0) after 9m4s
[18:39:42.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:35:0)
[18:39:42.186] Build status: STARTED
[18:39:42.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:36:0) after 3m15s
[18:42:57.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:36:0)
[18:42:57.267] Build status: STARTED
[18:42:57.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:37:0) after 3m24s
[18:46:21.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:37:0)
[18:46:21.368] Build status: STARTED
[18:46:21.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:38:0) after 4m24s
[18:50:45.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:38:0)
[18:50:45.437] Build status: STARTED
[18:50:45.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:39:0) after 4m44s
[18:55:29.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:39:0)
[18:55:29.625] Build status: STARTED
[18:55:29.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:40:0) after 4m29s
[18:59:58.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:40:0)
[18:59:58.953] Build status: STARTED
[18:59:58.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:41:0) after 1m54s
[19:01:53.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:41:0)
[19:01:53.094] Build status: STARTED
[19:01:53.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:42:0) after 4m50s
[19:06:43.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:42:0)
[19:06:43.185] Build status: STARTED
[19:06:43.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:43:0) after 8m50s
[19:15:33.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:43:0)
[19:15:33.415] Build status: STARTED
[19:15:33.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:44:0) after 9m4s
[19:24:37.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:44:0)
[19:24:37.640] Build status: STARTED
[19:24:37.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:45:0) after 6m51s
[19:31:28.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:45:0)
[19:31:28.710] Build status: STARTED
[19:31:28.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:46:0) after 9m32s
[19:41:00.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:46:0)
[19:41:00.747] Build status: STARTED
[19:41:00.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:47:0) after 4m53s
[19:45:53.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:47:0)
[19:45:53.835] Build status: STARTED
[19:45:53.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:48:0) after 1m12s
[19:47:06.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:48:0)
[19:47:06.318] Build status: STARTED
[19:47:06.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:49:0) after 7m9s
[19:54:15.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:49:0)
[19:54:15.609] Build status: STARTED
[19:54:15.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:50:0) after 4m21s
[19:58:36.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:50:0)
[19:58:36.692] Build status: STARTED
[19:58:36.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:51:0) after 9m6s
[20:07:42.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:51:0)
[20:07:42.851] Build status: STARTED
[20:07:42.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:52:0) after 8m5s
[20:15:47.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:52:0)
[20:15:47.972] Build status: STARTED
[20:15:47.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:53:0) after 1m59s
[20:17:47.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:53:0)
[20:17:47.153] Build status: STARTED
[20:17:47.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:54:0) after 2m53s
[20:20:40.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:54:0)
[20:20:40.212] Build status: STARTED
[20:20:40.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:55:0) after 7m27s
[20:28:07.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:55:0)
[20:28:07.579] Build status: STARTED
[20:28:07.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:56:0) after 6m5s
[20:34:12.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:56:0)
[20:34:12.793] Build status: STARTED
[20:34:12.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:57:0) after 6m47s
[20:41:00.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:57:0)
[20:41:00.208] Build status: STARTED
[20:41:00.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:58:0) after 1m3s
[20:42:03.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:58:0)
[20:42:03.281] Build status: STARTED
[20:42:03.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:59:0) after 4m53s
[20:46:56.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:59:0)
[20:46:56.555] Build status: STARTED
[20:46:56.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:60:0) after 8m4s
[20:55:00.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:60:0)
[20:55:00.825] Build status: STARTED
[20:55:00.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:61:0) after 5m8s
[21:00:08.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:61:0)
[21:00:09.005] Build status: STARTED
[21:00:09.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:62:0) after 6m32s
[21:06:41.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:62:0)
[21:06:41.066] Build status: STARTED
[21:06:41.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:63:0) after 6m16s
[21:12:57.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:63:0)
[21:12:57.121] Build status: STARTED
[21:12:57.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:64:0) after 4m10s
[21:17:07.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:64:0)
[21:17:07.386] Build status: STARTED
[21:17:07.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:65:0) after 6m42s
[21:23:49.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:65:0)
[21:23:49.487] Build status: STARTED
[21:23:49.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:66:0) after 6m48s
[21:30:37.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:66:0)
[21:30:37.674] Build status: STARTED
[21:30:37.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:67:0) after 4m47s
[21:35:24.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:67:0)
[21:35:24.981] Build status: STARTED
[21:35:24.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:68:0) after 3m10s
[21:38:35.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:68:0)
[21:38:35.281] Build status: STARTED
[21:38:35.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:69:0) after 7m57s
[21:46:32.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:69:0)
[21:46:32.449] Build status: STARTED
[21:46:32.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:70:0) after 8m39s
[21:55:11.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:70:0)
[21:55:11.795] Build status: STARTED
[21:55:11.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:71:0) after 8m55s
[22:04:06.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:71:0)
[22:04:06.823] Build status: STARTED
[22:04:06.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:72:0) after 5m34s
[22:09:41.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:72:0)
[22:09:41.226] Build status: STARTED
[22:09:41.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:73:0) after 3m31s
[22:13:12.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:73:0)
[22:13:12.332] Build status: STARTED
[22:13:12.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:74:0) after 7m52s
[22:21:04.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:74:0)
[22:21:04.516] Build status: STARTED
[22:21:04.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:75:0) after 1m40s
[22:22:44.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:75:0)
[22:22:44.654] Build status: STARTED
[22:22:44.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:76:0) after 2m19s
[22:25:03.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:76:0)
[22:25:03.778] Build status: STARTED
[22:25:03.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:77:0) after 5m54s
[22:30:57.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:77:0)
[22:30:57.832] Build status: STARTED
[22:30:57.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:78:0) after 7m12s
[22:38:10.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:78:0)
[22:38:10.083] Build status: STARTED
[22:38:10.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:79:0) after 6m54s
[22:45:04.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:79:0)
[22:45:04.358] Build status: STARTED
[22:45:04.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:80:0) after 1m35s
[22:46:39.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:80:0)
[22:46:39.421] Build status: STARTED
[22:46:39.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:81:0) after 7m56s
[22:54:35.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:81:0)
[22:54:35.755] Build status: STARTED
[22:54:35.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:82:0) after 7m45s
[23:02:20.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:82:0)
[23:02:20.899] Build status: STARTED
[23:02:20.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:83:0) after 3m39s
[23:05:59.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:83:0)
[23:05:59.952] Build status: STARTED
[23:05:59.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:84:0) after 3m54s
[23:09:54.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:84:0)
[23:09:54.072] Build status: STARTED
[23:09:54.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:85:0) after 2m7s
[23:12:01.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:85:0)
[23:12:01.158] Build status: STARTED
[23:12:01.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:86:0) after 7m47s
[23:19:48.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:86:0)
[23:19:48.241] Build status: STARTED
[23:19:48.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:87:0) after 3m43s
[23:23:31.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:87:0)
[23:23:31.568] Build status: STARTED
[23:23:31.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:88:0) after 3m12s
[23:26:43.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:88:0)
[23:26:43.947] Build status: STARTED
[23:26:43.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:89:0) after 2m7s
[23:28:51.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:89:0)
[23:28:51.105] Build status: STARTED
[23:28:51.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:90:0) after 6m23s
[23:35:14.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:90:0)
[23:35:14.173] Build status: STARTED
[23:35:14.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:91:0) after 8m19s
[23:43:33.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:91:0)
[23:43:33.233] Build status: STARTED
[23:43:33.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:92:0) after 5m45s
[23:49:18.258] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:92:0)
[23:49:18.305] Build status: STARTED
[23:49:18.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:93:0) after 2m50s
[23:52:08.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:93:0)
[23:52:08.426] Build status: STARTED
[23:52:08.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:94:0) after 4m24s
[23:56:32.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:94:0)
[23:56:32.489] Build status: STARTED
[23:56:32.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:95:0) after 1m15s
[23:57:47.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:95:0)
[23:57:47.654] Build status: STARTED
[23:57:47.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:96:0) after 1m26s
[23:59:13.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:96:0)
[23:59:13.848] Build status: STARTED
[23:59:13.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:97:0) after 1m53s
[00:01:07.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:97:0)
[00:01:07.084] Build status: STARTED
[00:01:07.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:98:0) after 1m53s
[00:03:00.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:98:0)
[00:03:00.154] Build status: STARTED
[00:03:00.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:99:0) after 8m44s
[00:11:44.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:99:0)
[00:11:44.213] Build status: STARTED
[00:11:44.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:100:0) after 6m36s
[00:18:20.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:100:0)
[00:18:20.235] Build status: STARTED
[00:18:20.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:101:0) after 5m28s
[00:23:48.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:101:0)
[00:23:48.355] Build status: STARTED
[00:23:48.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:102:0) after 5m7s
[00:28:55.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:102:0)
[00:28:55.367] Build status: STARTED
[00:28:55.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:103:0) after 2m0s
[00:30:55.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:103:0)
[00:30:55.695] Build status: STARTED
[00:30:55.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:104:0) after 5m32s
[00:36:27.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:104:0)
[00:36:27.990] Build status: STARTED
[00:36:27.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:105:0) after 1m37s
[00:38:05.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:105:0)
[00:38:05.139] Build status: STARTED
[00:38:05.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:106:0) after 3m57s
[00:42:02.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:106:0)
[00:42:02.562] Build status: STARTED
[00:42:02.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:107:0) after 2m35s
[00:44:37.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:107:0)
[00:44:37.618] Build status: STARTED
[00:44:37.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:108:0) after 4m51s
[00:49:28.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:108:0)
[00:49:29.000] Build status: STARTED
[00:49:29.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:109:0) after 3m18s
[00:52:47.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:109:0)
[00:52:47.057] Build status: STARTED
[00:52:47.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:110:0) after 4m35s
[00:57:22.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:110:0)
[00:57:22.124] Build status: STARTED
[00:57:22.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:111:0) after 9m8s
[01:06:30.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:111:0)
[01:06:30.205] Build status: STARTED
[01:06:30.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:112:0) after 2m15s
[01:08:45.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:112:0)
[01:08:45.261] Build status: STARTED
[01:08:45.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:113:0) after 8m10s
[01:16:55.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:113:0)
[01:16:55.363] Build status: STARTED
[01:16:55.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:114:0) after 8m33s
[01:25:28.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:114:0)
[01:25:28.441] Build status: STARTED
[01:25:28.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:115:0) after 3m56s
[01:29:24.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:115:0)
[01:29:24.934] Build status: STARTED
[01:29:24.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:116:0) after 2m12s
[01:31:37.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:116:0)
[01:31:37.049] Build status: STARTED
[01:31:37.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:117:0) after 8m55s
[01:40:32.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:117:0)
[01:40:32.106] Build status: STARTED
[01:40:32.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:118:0) after 8m31s
[01:49:03.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:118:0)
[01:49:03.182] Build status: STARTED
[01:49:03.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:119:0) after 7m52s
[01:56:55.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:119:0)
[01:56:55.242] Build status: STARTED
[01:56:55.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9000263092216136560:120:0) after 4m53s
[01:58:43.925] Received PubSub notification, asking Buildbucket for the build status
[01:58:43.983] Build:
{
"id": "8834833030285076721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25587,
"createdBy": "project:chromium",
"createTime": "2021-09-28T15:41:11.487354060Z",
"startTime": "2021-09-28T15:48:22.302283Z",
"endTime": "2021-09-29T01:58:43.143207783Z",
"updateTime": "2021-09-29T01:58:43.143575748Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "678ed16bfdb381e11d33126671d7d5ffe2a1e28c",
"ref": "refs/heads/main"
}
}
}
[01:58:43.983] Invocation finished in 10h17m33.721586619s with status FAILED