[23:19:34.304] New invocation is queued and will start shortly
[23:19:35.537] Starting the invocation (attempt 1)
[23:19:35.568] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c6ad2203d7dffe246e86fd2b939f9cadc1c0801d"
[23:19:35.568] Popped gitiles commit info from properties and tags
[23:19:35.568] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:19:35.568] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:19:35.568] Buildbucket request:
{
"requestId": "8999690670356243264",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c6ad2203d7dffe246e86fd2b939f9cadc1c0801d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8999690670356243264"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:19:36.122] Scheduled build:
{
"id": "8834260608265921457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25626,
"createdBy": "project:chromium",
"createTime": "2021-10-04T23:19:35.665614367Z",
"updateTime": "2021-10-04T23:19:35.969475857Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c6ad2203d7dffe246e86fd2b939f9cadc1c0801d",
"ref": "refs/heads/main"
}
}
}
[23:19:36.122] Task URL: https://cr-buildbucket.appspot.com/build/8834260608265921457
[23:19:36.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:2:0) after 2m0s
[23:21:36.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:2:0)
[23:21:36.388] Build status: SCHEDULED
[23:21:36.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:3:0) after 4m1s
[23:25:19.578] Received PubSub notification, asking Buildbucket for the build status
[23:25:19.610] Build status: STARTED
[23:25:37.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:3:0)
[23:25:37.702] Build status: STARTED
[23:25:37.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:5:0) after 1m5s
[23:26:42.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:5:0)
[23:26:42.759] Build status: STARTED
[23:26:42.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:6:0) after 2m4s
[23:28:46.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:6:0)
[23:28:46.982] Build status: STARTED
[23:28:46.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:7:0) after 3m55s
[23:32:42.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:7:0)
[23:32:42.033] Build status: STARTED
[23:32:42.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:8:0) after 8m40s
[23:41:22.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:8:0)
[23:41:22.146] Build status: STARTED
[23:41:22.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:9:0) after 4m51s
[23:46:13.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:9:0)
[23:46:13.592] Build status: STARTED
[23:46:13.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:10:0) after 3m49s
[23:50:02.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:10:0)
[23:50:02.918] Build status: STARTED
[23:50:02.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:11:0) after 5m2s
[23:55:05.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:11:0)
[23:55:05.427] Build status: STARTED
[23:55:05.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:12:0) after 6m19s
[00:01:24.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:12:0)
[00:01:24.491] Build status: STARTED
[00:01:24.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:13:0) after 3m43s
[00:05:07.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:13:0)
[00:05:07.543] Build status: STARTED
[00:05:07.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:14:0) after 8m36s
[00:13:43.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:14:0)
[00:13:43.702] Build status: STARTED
[00:13:43.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:15:0) after 3m8s
[00:16:51.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:15:0)
[00:16:52.000] Build status: STARTED
[00:16:52.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:16:0) after 9m13s
[00:26:05.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:16:0)
[00:26:05.289] Build status: STARTED
[00:26:05.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:17:0) after 6m33s
[00:32:38.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:17:0)
[00:32:38.351] Build status: STARTED
[00:32:38.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:18:0) after 9m29s
[00:42:07.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:18:0)
[00:42:07.487] Build status: STARTED
[00:42:07.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:19:0) after 1m36s
[00:43:43.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:19:0)
[00:43:43.616] Build status: STARTED
[00:43:43.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:20:0) after 7m57s
[00:51:40.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:20:0)
[00:51:40.818] Build status: STARTED
[00:51:40.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:21:0) after 3m35s
[00:55:15.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:21:0)
[00:55:16.000] Build status: STARTED
[00:55:16.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:22:0) after 1m54s
[00:57:11.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:22:0)
[00:57:11.110] Build status: STARTED
[00:57:11.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:23:0) after 2m26s
[00:59:37.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:23:0)
[00:59:37.161] Build status: STARTED
[00:59:37.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:24:0) after 1m41s
[01:01:18.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:24:0)
[01:01:18.356] Build status: STARTED
[01:01:18.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:25:0) after 4m2s
[01:05:20.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:25:0)
[01:05:20.414] Build status: STARTED
[01:05:20.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:26:0) after 1m22s
[01:06:42.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:26:0)
[01:06:42.965] Build status: STARTED
[01:06:42.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:27:0) after 4m1s
[01:10:44.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:27:0)
[01:10:44.061] Build status: STARTED
[01:10:44.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:28:0) after 8m4s
[01:18:48.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:28:0)
[01:18:48.142] Build status: STARTED
[01:18:48.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:29:0) after 9m57s
[01:28:45.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:29:0)
[01:28:45.255] Build status: STARTED
[01:28:45.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:30:0) after 2m12s
[01:30:57.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:30:0)
[01:30:57.342] Build status: STARTED
[01:30:57.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:31:0) after 7m25s
[01:38:22.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:31:0)
[01:38:22.944] Build status: STARTED
[01:38:22.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:32:0) after 8m11s
[01:46:34.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:32:0)
[01:46:34.055] Build status: STARTED
[01:46:34.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:33:0) after 9m0s
[01:55:34.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:33:0)
[01:55:34.402] Build status: STARTED
[01:55:34.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:34:0) after 2m4s
[01:57:38.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:34:0)
[01:57:38.511] Build status: STARTED
[01:57:38.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:35:0) after 2m11s
[01:59:49.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:35:0)
[01:59:49.673] Build status: STARTED
[01:59:49.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:36:0) after 9m32s
[02:09:21.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:36:0)
[02:09:21.782] Build status: STARTED
[02:09:21.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:37:0) after 1m26s
[02:10:47.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:37:0)
[02:10:47.853] Build status: STARTED
[02:10:47.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:38:0) after 4m25s
[02:15:12.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:38:0)
[02:15:12.909] Build status: STARTED
[02:15:12.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:39:0) after 6m20s
[02:21:33.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:39:0)
[02:21:33.142] Build status: STARTED
[02:21:33.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:40:0) after 3m41s
[02:25:14.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:40:0)
[02:25:14.200] Build status: STARTED
[02:25:14.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:41:0) after 9m57s
[02:35:11.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:41:0)
[02:35:11.259] Build status: STARTED
[02:35:11.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:42:0) after 2m39s
[02:37:50.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:42:0)
[02:37:50.331] Build status: STARTED
[02:37:50.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:43:0) after 2m1s
[02:39:51.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:43:0)
[02:39:51.751] Build status: STARTED
[02:39:51.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:44:0) after 1m59s
[02:41:50.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:44:0)
[02:41:50.807] Build status: STARTED
[02:41:50.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:45:0) after 9m38s
[02:51:29.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:45:0)
[02:51:29.199] Build status: STARTED
[02:51:29.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:46:0) after 3m41s
[02:55:10.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:46:0)
[02:55:10.317] Build status: STARTED
[02:55:10.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:47:0) after 7m14s
[03:02:24.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:47:0)
[03:02:24.810] Build status: STARTED
[03:02:24.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:48:0) after 9m36s
[03:12:00.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:48:0)
[03:12:00.919] Build status: STARTED
[03:12:00.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:49:0) after 7m57s
[03:19:58.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:49:0)
[03:19:58.061] Build status: STARTED
[03:19:58.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:50:0) after 2m40s
[03:22:38.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:50:0)
[03:22:38.217] Build status: STARTED
[03:22:38.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:51:0) after 8m31s
[03:31:09.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:51:0)
[03:31:09.369] Build status: STARTED
[03:31:09.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:52:0) after 5m13s
[03:36:22.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:52:0)
[03:36:22.508] Build status: STARTED
[03:36:22.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:53:0) after 3m50s
[03:40:12.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:53:0)
[03:40:12.718] Build status: STARTED
[03:40:12.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:54:0) after 5m10s
[03:45:22.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:54:0)
[03:45:22.965] Build status: STARTED
[03:45:22.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:55:0) after 5m39s
[03:51:01.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:55:0)
[03:51:20.361] Build status: STARTED
[03:51:20.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:56:0) after 6m47s
[03:58:07.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:56:0)
[03:58:07.449] Build status: STARTED
[03:58:07.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:57:0) after 2m21s
[04:00:28.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:57:0)
[04:00:28.594] Build status: STARTED
[04:00:28.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:58:0) after 4m44s
[04:05:12.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:58:0)
[04:05:12.714] Build status: STARTED
[04:05:12.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:59:0) after 4m19s
[04:09:31.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:59:0)
[04:09:31.765] Build status: STARTED
[04:09:31.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:60:0) after 1m43s
[04:11:14.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:60:0)
[04:11:14.835] Build status: STARTED
[04:11:14.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:61:0) after 7m59s
[04:19:13.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:61:0)
[04:19:13.975] Build status: STARTED
[04:19:13.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:62:0) after 2m58s
[04:22:11.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:62:0)
[04:22:12.032] Build status: STARTED
[04:22:12.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:63:0) after 5m6s
[04:27:18.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:63:0)
[04:27:18.167] Build status: STARTED
[04:27:18.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:64:0) after 4m31s
[04:31:49.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:64:0)
[04:31:49.301] Build status: STARTED
[04:31:49.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:65:0) after 8m18s
[04:40:07.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:65:0)
[04:40:07.344] Build status: STARTED
[04:40:07.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:66:0) after 2m34s
[04:42:41.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:66:0)
[04:42:41.537] Build status: STARTED
[04:42:41.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:67:0) after 7m7s
[04:49:48.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:67:0)
[04:49:48.706] Build status: STARTED
[04:49:48.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:68:0) after 6m33s
[04:56:21.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:68:0)
[04:56:21.935] Build status: STARTED
[04:56:21.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:69:0) after 5m44s
[05:02:06.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:69:0)
[05:02:06.181] Build status: STARTED
[05:02:06.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:70:0) after 1m31s
[05:03:37.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:70:0)
[05:03:37.339] Build status: STARTED
[05:03:37.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:71:0) after 1m51s
[05:05:28.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:71:0)
[05:05:28.410] Build status: STARTED
[05:05:28.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:72:0) after 9m39s
[05:15:07.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:72:0)
[05:15:07.463] Build status: STARTED
[05:15:07.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:73:0) after 9m8s
[05:24:15.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:73:0)
[05:24:15.688] Build status: STARTED
[05:24:15.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:74:0) after 2m53s
[05:27:08.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:74:0)
[05:27:08.881] Build status: STARTED
[05:27:08.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:75:0) after 8m23s
[05:35:31.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:75:0)
[05:35:31.980] Build status: STARTED
[05:35:31.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:76:0) after 3m27s
[05:38:59.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:76:0)
[05:38:59.115] Build status: STARTED
[05:38:59.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:77:0) after 2m55s
[05:41:54.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:77:0)
[05:41:54.356] Build status: STARTED
[05:41:54.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:78:0) after 4m10s
[05:46:04.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:78:0)
[05:46:04.426] Build status: STARTED
[05:46:04.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:79:0) after 3m4s
[05:49:08.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:79:0)
[05:49:08.660] Build status: STARTED
[05:49:08.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:80:0) after 2m4s
[05:51:12.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:80:0)
[05:51:12.819] Build status: STARTED
[05:51:12.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:81:0) after 3m23s
[05:54:35.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:81:0)
[05:54:35.876] Build status: STARTED
[05:54:35.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:82:0) after 8m51s
[06:03:26.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:82:0)
[06:03:26.933] Build status: STARTED
[06:03:26.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:83:0) after 5m37s
[06:09:04.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:83:0)
[06:09:04.139] Build status: STARTED
[06:09:04.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:84:0) after 5m43s
[06:14:47.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:84:0)
[06:14:47.235] Build status: STARTED
[06:14:47.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:85:0) after 4m4s
[06:18:51.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:85:0)
[06:18:51.370] Build status: STARTED
[06:18:51.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:86:0) after 1m16s
[06:20:07.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:86:0)
[06:20:07.433] Build status: STARTED
[06:20:07.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:87:0) after 2m23s
[06:22:30.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:87:0)
[06:22:30.585] Build status: STARTED
[06:22:30.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:88:0) after 7m27s
[06:29:57.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:88:0)
[06:29:57.909] Build status: STARTED
[06:29:57.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:89:0) after 1m46s
[06:31:43.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:89:0)
[06:31:43.973] Build status: STARTED
[06:31:43.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:90:0) after 8m51s
[06:40:35.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:90:0)
[06:40:35.097] Build status: STARTED
[06:40:35.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:91:0) after 3m57s
[06:44:32.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:91:0)
[06:44:32.345] Build status: STARTED
[06:44:32.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:92:0) after 2m32s
[06:47:04.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:92:0)
[06:47:04.615] Build status: STARTED
[06:47:04.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:93:0) after 3m56s
[06:51:00.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:93:0)
[06:51:00.677] Build status: STARTED
[06:51:00.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:94:0) after 5m55s
[06:56:55.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:94:0)
[06:56:55.736] Build status: STARTED
[06:56:55.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:95:0) after 2m47s
[06:59:42.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:95:0)
[06:59:42.801] Build status: STARTED
[06:59:42.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:96:0) after 9m16s
[07:08:58.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:96:0)
[07:08:58.861] Build status: STARTED
[07:08:58.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:97:0) after 8m52s
[07:17:50.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:97:0)
[07:17:50.940] Build status: STARTED
[07:17:50.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:98:0) after 6m39s
[07:24:29.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:98:0)
[07:24:29.996] Build status: STARTED
[07:24:29.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:99:0) after 1m6s
[07:25:36.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:99:0)
[07:25:36.225] Build status: STARTED
[07:25:36.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:100:0) after 2m10s
[07:27:46.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:100:0)
[07:27:46.446] Build status: STARTED
[07:27:46.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:101:0) after 8m50s
[07:36:36.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:101:0)
[07:36:36.510] Build status: STARTED
[07:36:36.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:102:0) after 3m19s
[07:39:55.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:102:0)
[07:39:55.568] Build status: STARTED
[07:39:55.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:103:0) after 7m55s
[07:47:50.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:103:0)
[07:47:50.646] Build status: STARTED
[07:47:50.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:104:0) after 6m3s
[07:53:53.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:104:0)
[07:53:53.818] Build status: STARTED
[07:53:53.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:105:0) after 5m5s
[07:58:58.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:105:0)
[07:58:59.051] Build status: STARTED
[07:58:59.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:106:0) after 9m25s
[08:08:24.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:106:0)
[08:08:24.205] Build status: STARTED
[08:08:24.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:107:0) after 7m46s
[08:16:10.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:107:0)
[08:16:10.279] Build status: STARTED
[08:16:10.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:108:0) after 8m9s
[08:24:19.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:108:0)
[08:24:19.344] Build status: STARTED
[08:24:19.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:109:0) after 9m32s
[08:33:51.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:109:0)
[08:33:51.549] Build status: STARTED
[08:33:51.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:110:0) after 5m29s
[08:39:20.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:110:0)
[08:39:20.604] Build status: STARTED
[08:39:20.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:111:0) after 3m36s
[08:42:56.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:111:0)
[08:42:56.885] Build status: STARTED
[08:42:56.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:112:0) after 3m21s
[08:46:17.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:112:0)
[08:46:17.951] Build status: STARTED
[08:46:17.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:113:0) after 8m54s
[08:55:12.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:113:0)
[08:55:13.049] Build status: STARTED
[08:55:13.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:114:0) after 4m21s
[08:59:34.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:114:0)
[08:59:34.310] Build status: STARTED
[08:59:34.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:115:0) after 8m45s
[09:08:19.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:115:0)
[09:08:19.398] Build status: STARTED
[09:08:19.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:116:0) after 9m52s
[09:18:11.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:116:0)
[09:18:11.687] Build status: STARTED
[09:18:11.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:117:0) after 1m1s
[09:19:12.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:117:0)
[09:19:12.739] Build status: STARTED
[09:19:12.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:118:0) after 9m31s
[09:28:43.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:118:0)
[09:28:43.815] Build status: STARTED
[09:28:43.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:119:0) after 2m42s
[09:31:25.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:119:0)
[09:31:25.899] Build status: STARTED
[09:31:25.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999690670356243264:120:0) after 8m57s
[09:33:54.425] Received PubSub notification, asking Buildbucket for the build status
[09:33:54.455] Build:
{
"id": "8834260608265921457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25626,
"createdBy": "project:chromium",
"createTime": "2021-10-04T23:19:35.665614367Z",
"startTime": "2021-10-04T23:25:18.688233Z",
"endTime": "2021-10-05T09:33:53.872078092Z",
"updateTime": "2021-10-05T09:33:53.872530136Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c6ad2203d7dffe246e86fd2b939f9cadc1c0801d",
"ref": "refs/heads/main"
}
}
}
[09:33:54.455] Invocation finished in 10h14m20.16747188s with status FAILED