[21:57:00.816] New invocation is queued and will start shortly
[21:57:02.124] Starting the invocation (attempt 1)
[21:57:02.166] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6aafc063c8b66f71b256202a15e316acc7c2c3e0"
[21:57:02.166] Popped gitiles commit info from properties and tags
[21:57:02.166] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:57:02.166] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:57:02.166] Buildbucket request:
{
"requestId": "8984928558945123712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6aafc063c8b66f71b256202a15e316acc7c2c3e0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8984928558945123712"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:57:02.810] Scheduled build:
{
"id": "8819498496753343345",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26599,
"createdBy": "project:chromium",
"createTime": "2022-03-16T21:57:02.270713314Z",
"updateTime": "2022-03-16T21:57:02.270713314Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6aafc063c8b66f71b256202a15e316acc7c2c3e0",
"ref": "refs/heads/main"
}
}
}
[21:57:02.810] Task URL: https://cr-buildbucket.appspot.com/build/8819498496753343345
[21:57:02.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:2:0) after 8m52s
[22:05:54.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:2:0)
[22:05:54.882] Build status: SCHEDULED
[22:05:54.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:3:0) after 3m43s
[22:09:38.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:3:0)
[22:09:38.324] Build status: SCHEDULED
[22:09:38.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:4:0) after 2m59s
[22:12:37.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:4:0)
[22:12:37.392] Build status: SCHEDULED
[22:12:37.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:5:0) after 1m26s
[22:14:03.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:5:0)
[22:14:03.625] Build status: SCHEDULED
[22:14:03.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:6:0) after 2m2s
[22:16:05.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:6:0)
[22:16:05.778] Build status: SCHEDULED
[22:16:05.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:7:0) after 6m11s
[22:17:45.352] Received PubSub notification, asking Buildbucket for the build status
[22:17:45.370] Build status: STARTED
[22:22:17.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:7:0)
[22:22:17.123] Build status: STARTED
[22:22:17.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:9:0) after 6m31s
[22:28:48.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:9:0)
[22:28:48.186] Build status: STARTED
[22:28:48.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:10:0) after 5m6s
[22:33:54.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:10:0)
[22:33:54.329] Build status: STARTED
[22:33:54.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:11:0) after 4m36s
[22:38:30.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:11:0)
[22:38:30.483] Build status: STARTED
[22:38:30.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:12:0) after 1m0s
[22:39:30.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:12:0)
[22:39:30.621] Build status: STARTED
[22:39:30.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:13:0) after 6m19s
[22:45:49.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:13:0)
[22:45:50.009] Build status: STARTED
[22:45:50.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:14:0) after 1m11s
[22:47:01.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:14:0)
[22:47:01.163] Build status: STARTED
[22:47:01.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:15:0) after 3m22s
[22:50:23.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:15:0)
[22:50:23.219] Build status: STARTED
[22:50:23.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:16:0) after 4m16s
[22:54:39.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:16:0)
[22:54:39.277] Build status: STARTED
[22:54:39.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:17:0) after 7m29s
[23:02:08.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:17:0)
[23:02:08.444] Build status: STARTED
[23:02:08.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:18:0) after 5m5s
[23:07:13.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:18:0)
[23:07:13.946] Build status: STARTED
[23:07:13.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:19:0) after 7m43s
[23:14:57.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:19:0)
[23:14:57.041] Build status: STARTED
[23:14:57.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:20:0) after 4m1s
[23:18:58.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:20:0)
[23:18:58.139] Build status: STARTED
[23:18:58.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:21:0) after 3m45s
[23:22:43.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:21:0)
[23:22:43.403] Build status: STARTED
[23:22:43.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:22:0) after 5m14s
[23:27:57.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:22:0)
[23:27:57.695] Build status: STARTED
[23:27:57.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:23:0) after 8m40s
[23:36:37.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:23:0)
[23:36:37.954] Build status: STARTED
[23:36:37.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:24:0) after 3m36s
[23:40:14.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:24:0)
[23:40:14.026] Build status: STARTED
[23:40:14.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:25:0) after 2m17s
[23:42:31.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:25:0)
[23:42:31.081] Build status: STARTED
[23:42:31.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:26:0) after 6m2s
[23:48:33.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:26:0)
[23:48:33.750] Build status: STARTED
[23:48:33.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:27:0) after 3m16s
[23:51:49.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:27:0)
[23:51:49.897] Build status: STARTED
[23:51:49.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:28:0) after 7m21s
[23:59:10.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:28:0)
[23:59:10.991] Build status: STARTED
[23:59:10.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:29:0) after 1m36s
[00:00:47.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:29:0)
[00:00:47.044] Build status: STARTED
[00:00:47.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:30:0) after 7m27s
[00:08:14.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:30:0)
[00:08:14.128] Build status: STARTED
[00:08:14.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:31:0) after 9m38s
[00:17:52.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:31:0)
[00:17:52.245] Build status: STARTED
[00:17:52.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:32:0) after 8m27s
[00:26:19.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:32:0)
[00:26:19.594] Build status: STARTED
[00:26:19.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:33:0) after 5m36s
[00:31:55.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:33:0)
[00:31:55.854] Build status: STARTED
[00:31:55.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:34:0) after 5m31s
[00:37:26.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:34:0)
[00:37:27.005] Build status: STARTED
[00:37:27.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:35:0) after 7m32s
[00:44:59.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:35:0)
[00:44:59.111] Build status: STARTED
[00:44:59.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:36:0) after 4m4s
[00:49:03.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:36:0)
[00:49:03.353] Build status: STARTED
[00:49:03.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:37:0) after 8m14s
[00:57:17.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:37:0)
[00:57:17.464] Build status: STARTED
[00:57:17.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:38:0) after 4m11s
[01:01:28.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:38:0)
[01:01:28.618] Build status: STARTED
[01:01:28.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:39:0) after 6m8s
[01:07:37.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:39:0)
[01:07:37.215] Build status: STARTED
[01:07:37.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:40:0) after 4m48s
[01:12:25.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:40:0)
[01:12:25.308] Build status: STARTED
[01:12:25.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:41:0) after 9m0s
[01:21:25.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:41:0)
[01:21:25.845] Build status: STARTED
[01:21:25.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:42:0) after 1m34s
[01:22:59.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:42:0)
[01:22:59.885] Build status: STARTED
[01:22:59.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:43:0) after 1m46s
[01:24:45.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:43:0)
[01:24:46.061] Build status: STARTED
[01:24:46.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:44:0) after 5m43s
[01:30:29.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:44:0)
[01:30:29.247] Build status: STARTED
[01:30:29.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:45:0) after 5m18s
[01:35:47.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:45:0)
[01:35:47.303] Build status: STARTED
[01:35:47.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:46:0) after 5m45s
[01:41:32.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:46:0)
[01:41:32.356] Build status: STARTED
[01:41:32.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:47:0) after 1m16s
[01:42:48.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:47:0)
[01:42:48.645] Build status: STARTED
[01:42:48.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:48:0) after 3m14s
[01:46:02.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:48:0)
[01:46:02.796] Build status: STARTED
[01:46:02.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:49:0) after 6m39s
[01:52:42.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:49:0)
[01:52:42.253] Build status: STARTED
[01:52:42.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:50:0) after 6m39s
[01:59:21.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:50:0)
[01:59:21.317] Build status: STARTED
[01:59:21.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:51:0) after 7m21s
[02:06:42.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:51:0)
[02:06:42.464] Build status: STARTED
[02:06:42.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:52:0) after 6m40s
[02:13:22.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:52:0)
[02:13:22.529] Build status: STARTED
[02:13:22.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:53:0) after 8m45s
[02:22:07.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:53:0)
[02:22:07.794] Build status: STARTED
[02:22:07.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:54:0) after 2m57s
[02:25:05.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:54:0)
[02:25:05.043] Build status: STARTED
[02:25:05.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:55:0) after 9m22s
[02:34:27.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:55:0)
[02:34:27.098] Build status: STARTED
[02:34:27.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:56:0) after 8m48s
[02:43:15.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:56:0)
[02:43:15.292] Build status: STARTED
[02:43:15.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:57:0) after 4m36s
[02:47:51.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:57:0)
[02:47:51.368] Build status: STARTED
[02:47:51.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:58:0) after 9m42s
[02:57:33.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:58:0)
[02:57:33.595] Build status: STARTED
[02:57:33.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:59:0) after 3m27s
[03:01:00.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:59:0)
[03:01:00.842] Build status: STARTED
[03:01:00.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:60:0) after 2m13s
[03:03:13.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:60:0)
[03:03:13.895] Build status: STARTED
[03:03:13.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:61:0) after 4m42s
[03:07:55.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:61:0)
[03:07:55.990] Build status: STARTED
[03:07:55.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:62:0) after 5m8s
[03:13:04.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:62:0)
[03:13:04.106] Build status: STARTED
[03:13:04.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:63:0) after 9m59s
[03:23:03.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:63:0)
[03:23:03.390] Build status: STARTED
[03:23:03.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:64:0) after 7m6s
[03:30:09.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:64:0)
[03:30:09.559] Build status: STARTED
[03:30:09.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:65:0) after 5m54s
[03:36:03.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:65:0)
[03:36:03.698] Build status: STARTED
[03:36:03.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:66:0) after 4m13s
[03:40:16.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:66:0)
[03:40:16.817] Build status: STARTED
[03:40:16.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:67:0) after 9m0s
[03:49:16.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:67:0)
[03:49:17.009] Build status: STARTED
[03:49:17.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:68:0) after 8m37s
[03:57:54.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:68:0)
[03:57:54.497] Build status: STARTED
[03:57:54.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:69:0) after 4m38s
[04:02:32.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:69:0)
[04:02:32.654] Build status: STARTED
[04:02:32.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:70:0) after 2m55s
[04:05:27.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:70:0)
[04:05:27.758] Build status: STARTED
[04:05:27.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:71:0) after 4m49s
[04:10:16.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:71:0)
[04:10:16.961] Build status: STARTED
[04:10:16.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:72:0) after 7m12s
[04:17:29.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:72:0)
[04:17:29.122] Build status: STARTED
[04:17:29.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:73:0) after 5m49s
[04:23:18.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:73:0)
[04:23:18.178] Build status: STARTED
[04:23:18.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:74:0) after 2m46s
[04:26:04.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:74:0)
[04:26:04.419] Build status: STARTED
[04:26:04.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:75:0) after 7m56s
[04:34:00.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:75:0)
[04:34:00.489] Build status: STARTED
[04:34:00.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:76:0) after 3m47s
[04:37:47.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:76:0)
[04:37:47.557] Build status: STARTED
[04:37:47.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:77:0) after 9m17s
[04:47:04.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:77:0)
[04:47:04.721] Build status: STARTED
[04:47:04.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:78:0) after 6m56s
[04:54:00.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:78:0)
[04:54:00.812] Build status: STARTED
[04:54:00.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:79:0) after 7m35s
[05:01:35.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:79:0)
[05:01:35.871] Build status: STARTED
[05:01:35.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:80:0) after 9m5s
[05:10:40.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:80:0)
[05:10:40.944] Build status: STARTED
[05:10:40.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:81:0) after 8m14s
[05:18:54.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:81:0)
[05:18:54.998] Build status: STARTED
[05:18:54.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:82:0) after 3m3s
[05:21:58.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:82:0)
[05:21:58.071] Build status: STARTED
[05:21:58.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:83:0) after 6m59s
[05:28:57.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:83:0)
[05:28:57.188] Build status: STARTED
[05:28:57.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:84:0) after 6m4s
[05:35:01.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:84:0)
[05:35:01.215] Build status: STARTED
[05:35:01.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:85:0) after 7m34s
[05:42:35.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:85:0)
[05:42:35.285] Build status: STARTED
[05:42:35.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:86:0) after 6m25s
[05:49:00.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:86:0)
[05:49:00.407] Build status: STARTED
[05:49:00.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:87:0) after 5m39s
[05:54:39.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:87:0)
[05:54:39.488] Build status: STARTED
[05:54:39.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:88:0) after 7m47s
[06:02:27.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:88:0)
[06:02:27.181] Build status: STARTED
[06:02:27.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:89:0) after 7m52s
[06:10:19.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:89:0)
[06:10:19.327] Build status: STARTED
[06:10:19.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:90:0) after 3m16s
[06:13:35.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:90:0)
[06:13:35.490] Build status: STARTED
[06:13:35.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:91:0) after 1m15s
[06:14:50.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:91:0)
[06:14:50.560] Build status: STARTED
[06:14:50.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:92:0) after 3m41s
[06:18:31.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:92:0)
[06:18:31.731] Build status: STARTED
[06:18:31.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:93:0) after 9m18s
[06:27:49.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:93:0)
[06:27:49.968] Build status: STARTED
[06:27:49.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:94:0) after 3m22s
[06:31:12.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:94:0)
[06:31:12.155] Build status: STARTED
[06:31:12.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:95:0) after 4m14s
[06:35:26.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:95:0)
[06:35:26.203] Build status: STARTED
[06:35:26.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:96:0) after 4m17s
[06:39:43.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:96:0)
[06:39:43.447] Build status: STARTED
[06:39:43.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:97:0) after 5m44s
[06:45:27.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:97:0)
[06:45:27.617] Build status: STARTED
[06:45:27.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:98:0) after 8m6s
[06:53:33.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:98:0)
[06:53:33.869] Build status: STARTED
[06:53:33.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:99:0) after 8m37s
[07:02:11.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:99:0)
[07:02:11.060] Build status: STARTED
[07:02:11.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:100:0) after 1m40s
[07:03:51.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:100:0)
[07:03:51.217] Build status: STARTED
[07:03:51.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:101:0) after 9m58s
[07:13:49.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:101:0)
[07:13:49.265] Build status: STARTED
[07:13:49.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:102:0) after 8m8s
[07:21:57.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:102:0)
[07:21:57.533] Build status: STARTED
[07:21:57.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:103:0) after 3m56s
[07:25:53.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:103:0)
[07:25:53.668] Build status: STARTED
[07:25:53.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:104:0) after 4m32s
[07:30:25.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:104:0)
[07:30:25.731] Build status: STARTED
[07:30:25.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:105:0) after 6m48s
[07:37:13.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:105:0)
[07:37:13.799] Build status: STARTED
[07:37:13.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:106:0) after 1m3s
[07:38:16.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:106:0)
[07:38:16.913] Build status: STARTED
[07:38:16.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:107:0) after 9m17s
[07:47:33.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:107:0)
[07:47:33.979] Build status: STARTED
[07:47:33.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:108:0) after 7m59s
[07:55:33.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:108:0)
[07:55:33.034] Build status: STARTED
[07:55:33.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:109:0) after 2m37s
[07:58:10.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:109:0)
[07:58:10.148] Build status: STARTED
[07:58:10.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:110:0) after 7m29s
[08:05:39.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:110:0)
[08:05:39.253] Build status: STARTED
[08:05:39.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:111:0) after 5m58s
[08:11:37.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:111:0)
[08:11:37.436] Build status: STARTED
[08:11:37.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:112:0) after 5m36s
[08:17:13.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:112:0)
[08:17:13.504] Build status: STARTED
[08:17:13.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:113:0) after 3m18s
[08:20:31.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:113:0)
[08:20:31.588] Build status: STARTED
[08:20:31.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:114:0) after 8m6s
[08:28:37.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:114:0)
[08:28:37.839] Build status: STARTED
[08:28:37.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:115:0) after 8m50s
[08:37:27.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:115:0)
[08:37:27.958] Build status: STARTED
[08:37:27.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:116:0) after 3m49s
[08:41:16.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:116:0)
[08:41:17.018] Build status: STARTED
[08:41:17.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:117:0) after 3m33s
[08:44:50.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:117:0)
[08:44:50.239] Build status: STARTED
[08:44:50.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:118:0) after 2m26s
[08:47:16.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:118:0)
[08:47:16.354] Build status: STARTED
[08:47:16.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:119:0) after 4m12s
[08:51:28.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:119:0)
[08:51:28.550] Build status: STARTED
[08:51:28.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:120:0) after 2m1s
[08:53:29.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:120:0)
[08:53:29.589] Build status: STARTED
[08:53:29.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:121:0) after 6m35s
[09:00:04.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:121:0)
[09:00:04.653] Build status: STARTED
[09:00:04.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:122:0) after 8m46s
[09:08:50.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:122:0)
[09:08:50.958] Build status: STARTED
[09:08:50.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:123:0) after 7m28s
[09:16:19.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:123:0)
[09:16:19.224] Build status: STARTED
[09:16:19.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:124:0) after 2m29s
[09:18:48.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:124:0)
[09:18:48.334] Build status: STARTED
[09:18:48.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8984928558945123712:125:0) after 4m15s
[09:20:12.921] Received PubSub notification, asking Buildbucket for the build status
[09:20:12.966] Build:
{
"id": "8819498496753343345",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26599,
"createdBy": "project:chromium",
"createTime": "2022-03-16T21:57:02.270713314Z",
"startTime": "2022-03-16T22:17:44.293559Z",
"endTime": "2022-03-17T09:20:10.999861798Z",
"updateTime": "2022-03-17T09:20:10.999861798Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6aafc063c8b66f71b256202a15e316acc7c2c3e0",
"ref": "refs/heads/main"
}
}
}
[09:20:12.966] Invocation finished in 11h23m12.169086616s with status FAILED