[01:28:51.133] New invocation is queued and will start shortly
[01:28:52.159] Starting the invocation (attempt 1)
[01:28:52.190] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f66b0dfe03cf5bef9d6e20b7940bb26c420df1a3"
[01:28:52.190] Popped gitiles commit info from properties and tags
[01:28:52.190] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:28:52.191] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:28:52.191] Buildbucket request:
{
"requestId": "8992887764251527744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f66b0dfe03cf5bef9d6e20b7940bb26c420df1a3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8992887764251527744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:28:52.668] Scheduled build:
{
"id": "8827457702431621041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26366,
"createdBy": "project:chromium",
"createTime": "2021-12-19T01:28:52.236428045Z",
"updateTime": "2021-12-19T01:28:52.236428045Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f66b0dfe03cf5bef9d6e20b7940bb26c420df1a3",
"ref": "refs/heads/main"
}
}
}
[01:28:52.668] Task URL: https://cr-buildbucket.appspot.com/build/8827457702431621041
[01:28:52.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:2:0) after 6m19s
[01:35:12.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:2:0)
[01:35:12.154] Build status: SCHEDULED
[01:35:12.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:3:0) after 9m56s
[01:36:09.257] Received PubSub notification, asking Buildbucket for the build status
[01:36:09.288] Build status: STARTED
[01:45:08.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:3:0)
[01:45:08.192] Build status: STARTED
[01:45:08.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:5:0) after 6m47s
[01:51:55.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:5:0)
[01:51:55.294] Build status: STARTED
[01:51:55.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:6:0) after 8m16s
[02:00:11.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:6:0)
[02:00:11.364] Build status: STARTED
[02:00:11.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:7:0) after 7m50s
[02:08:01.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:7:0)
[02:08:01.406] Build status: STARTED
[02:08:01.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:8:0) after 1m15s
[02:09:16.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:8:0)
[02:09:16.577] Build status: STARTED
[02:09:16.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:9:0) after 7m59s
[02:17:15.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:9:0)
[02:17:15.781] Build status: STARTED
[02:17:15.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:10:0) after 1m8s
[02:18:23.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:10:0)
[02:18:23.819] Build status: STARTED
[02:18:23.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:11:0) after 5m24s
[02:23:47.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:11:0)
[02:23:47.926] Build status: STARTED
[02:23:47.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:12:0) after 5m15s
[02:29:02.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:12:0)
[02:29:03.007] Build status: STARTED
[02:29:03.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:13:0) after 3m36s
[02:32:39.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:13:0)
[02:32:39.258] Build status: STARTED
[02:32:39.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:14:0) after 9m43s
[02:42:22.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:14:0)
[02:42:22.276] Build status: STARTED
[02:42:22.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:15:0) after 3m46s
[02:46:08.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:15:0)
[02:46:08.531] Build status: STARTED
[02:46:08.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:16:0) after 5m58s
[02:52:06.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:16:0)
[02:52:06.643] Build status: STARTED
[02:52:06.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:17:0) after 8m19s
[03:00:25.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:17:0)
[03:00:25.906] Build status: STARTED
[03:00:25.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:18:0) after 4m37s
[03:05:02.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:18:0)
[03:05:02.956] Build status: STARTED
[03:05:02.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:19:0) after 2m16s
[03:07:18.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:19:0)
[03:07:18.999] Build status: STARTED
[03:07:18.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:20:0) after 4m50s
[03:12:09.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:20:0)
[03:12:09.048] Build status: STARTED
[03:12:09.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:21:0) after 7m8s
[03:19:17.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:21:0)
[03:19:17.138] Build status: STARTED
[03:19:17.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:22:0) after 4m42s
[03:23:59.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:22:0)
[03:23:59.172] Build status: STARTED
[03:23:59.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:23:0) after 9m21s
[03:33:20.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:23:0)
[03:33:20.210] Build status: STARTED
[03:33:20.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:24:0) after 8m16s
[03:41:36.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:24:0)
[03:41:36.253] Build status: STARTED
[03:41:36.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:25:0) after 9m45s
[03:51:21.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:25:0)
[03:51:21.312] Build status: STARTED
[03:51:21.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:26:0) after 9m39s
[04:01:00.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:26:0)
[04:01:00.665] Build status: STARTED
[04:01:00.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:27:0) after 9m27s
[04:10:27.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:27:0)
[04:10:27.756] Build status: STARTED
[04:10:27.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:28:0) after 4m40s
[04:15:07.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:28:0)
[04:15:07.908] Build status: STARTED
[04:15:07.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:29:0) after 1m38s
[04:16:46.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:29:0)
[04:16:46.061] Build status: STARTED
[04:16:46.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:30:0) after 1m29s
[04:18:15.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:30:0)
[04:18:15.113] Build status: STARTED
[04:18:15.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:31:0) after 4m42s
[04:22:57.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:31:0)
[04:22:57.147] Build status: STARTED
[04:22:57.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:32:0) after 2m10s
[04:25:07.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:32:0)
[04:25:07.184] Build status: STARTED
[04:25:07.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:33:0) after 9m38s
[04:34:45.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:33:0)
[04:34:45.234] Build status: STARTED
[04:34:45.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:34:0) after 4m44s
[04:39:29.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:34:0)
[04:39:29.289] Build status: STARTED
[04:39:29.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:35:0) after 2m23s
[04:41:52.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:35:0)
[04:41:52.396] Build status: STARTED
[04:41:52.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:36:0) after 6m36s
[04:48:28.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:36:0)
[04:48:28.448] Build status: STARTED
[04:48:28.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:37:0) after 1m13s
[04:49:41.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:37:0)
[04:49:41.590] Build status: STARTED
[04:49:41.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:38:0) after 3m54s
[04:53:35.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:38:0)
[04:53:35.911] Build status: STARTED
[04:53:35.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:39:0) after 3m24s
[04:56:59.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:39:0)
[04:57:00.017] Build status: STARTED
[04:57:00.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:40:0) after 4m20s
[05:01:20.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:40:0)
[05:01:20.071] Build status: STARTED
[05:01:20.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:41:0) after 7m28s
[05:08:48.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:41:0)
[05:08:48.105] Build status: STARTED
[05:08:48.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:42:0) after 6m24s
[05:15:12.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:42:0)
[05:15:12.505] Build status: STARTED
[05:15:12.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:43:0) after 3m53s
[05:19:05.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:43:0)
[05:19:05.879] Build status: STARTED
[05:19:05.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:44:0) after 4m14s
[05:23:19.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:44:0)
[05:23:19.945] Build status: STARTED
[05:23:19.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:45:0) after 3m8s
[05:26:28.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:45:0)
[05:26:28.519] Build status: STARTED
[05:26:28.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:46:0) after 5m57s
[05:32:25.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:46:0)
[05:32:25.674] Build status: STARTED
[05:32:25.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:47:0) after 5m37s
[05:38:02.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:47:0)
[05:38:02.945] Build status: STARTED
[05:38:02.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:48:0) after 1m40s
[05:39:44.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:48:0)
[05:39:44.288] Build status: STARTED
[05:39:44.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:49:0) after 4m35s
[05:44:20.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:49:0)
[05:44:20.292] Build status: STARTED
[05:44:20.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:50:0) after 5m26s
[05:49:46.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:50:0)
[05:49:46.868] Build status: STARTED
[05:49:46.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:51:0) after 4m36s
[05:54:23.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:51:0)
[05:54:23.445] Build status: STARTED
[05:54:23.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:52:0) after 9m34s
[06:03:57.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:52:0)
[06:03:57.490] Build status: STARTED
[06:03:57.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:53:0) after 5m47s
[06:09:44.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:53:0)
[06:09:44.547] Build status: STARTED
[06:09:44.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:54:0) after 6m30s
[06:16:16.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:54:0)
[06:16:16.770] Build status: STARTED
[06:16:16.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:55:0) after 8m17s
[06:24:33.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:55:0)
[06:24:33.824] Build status: STARTED
[06:24:33.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:56:0) after 7m10s
[06:31:43.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:56:0)
[06:31:43.881] Build status: STARTED
[06:31:43.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:57:0) after 2m35s
[06:34:19.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:57:0)
[06:34:19.403] Build status: STARTED
[06:34:19.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:58:0) after 9m2s
[06:43:21.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:58:0)
[06:43:21.780] Build status: STARTED
[06:43:21.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:59:0) after 4m47s
[06:48:08.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:59:0)
[06:48:08.912] Build status: STARTED
[06:48:08.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:60:0) after 3m33s
[06:51:41.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:60:0)
[06:51:41.964] Build status: STARTED
[06:51:41.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:61:0) after 2m28s
[06:54:09.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:61:0)
[06:54:10.008] Build status: STARTED
[06:54:10.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:62:0) after 3m26s
[06:57:36.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:62:0)
[06:57:37.034] Build status: STARTED
[06:57:37.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:63:0) after 6m39s
[07:04:16.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:63:0)
[07:04:16.294] Build status: STARTED
[07:04:16.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:64:0) after 9m43s
[07:13:59.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:64:0)
[07:13:59.333] Build status: STARTED
[07:13:59.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:65:0) after 9m7s
[07:23:06.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:65:0)
[07:23:06.390] Build status: STARTED
[07:23:06.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:66:0) after 6m22s
[07:29:28.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:66:0)
[07:29:28.428] Build status: STARTED
[07:29:28.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:67:0) after 2m52s
[07:32:22.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:67:0)
[07:32:22.711] Build status: STARTED
[07:32:22.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:68:0) after 6m21s
[07:38:43.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:68:0)
[07:38:43.806] Build status: STARTED
[07:38:43.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:69:0) after 2m57s
[07:41:40.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:69:0)
[07:41:40.947] Build status: STARTED
[07:41:40.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:70:0) after 6m52s
[07:48:32.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:70:0)
[07:48:32.995] Build status: STARTED
[07:48:32.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:71:0) after 7m41s
[07:56:14.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:71:0)
[07:56:14.166] Build status: STARTED
[07:56:14.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:72:0) after 2m2s
[07:58:16.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:72:0)
[07:58:16.202] Build status: STARTED
[07:58:16.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:73:0) after 4m54s
[08:03:10.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:73:0)
[08:03:10.239] Build status: STARTED
[08:03:10.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:74:0) after 5m27s
[08:08:37.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:74:0)
[08:08:37.274] Build status: STARTED
[08:08:37.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:75:0) after 7m33s
[08:16:10.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:75:0)
[08:16:10.716] Build status: STARTED
[08:16:10.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:76:0) after 3m54s
[08:20:04.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:76:0)
[08:20:04.767] Build status: STARTED
[08:20:04.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:77:0) after 2m5s
[08:22:09.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:77:0)
[08:22:09.825] Build status: STARTED
[08:22:09.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:78:0) after 9m42s
[08:31:51.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:78:0)
[08:31:51.958] Build status: STARTED
[08:31:51.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:79:0) after 1m40s
[08:33:31.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:79:0)
[08:33:32.001] Build status: STARTED
[08:33:32.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:80:0) after 7m51s
[08:41:23.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:80:0)
[08:41:23.081] Build status: STARTED
[08:41:23.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:81:0) after 6m46s
[08:48:09.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:81:0)
[08:48:09.121] Build status: STARTED
[08:48:09.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:82:0) after 2m29s
[08:50:38.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:82:0)
[08:50:38.654] Build status: STARTED
[08:50:38.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:83:0) after 2m26s
[08:53:04.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:83:0)
[08:53:04.688] Build status: STARTED
[08:53:04.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:84:0) after 8m32s
[09:01:37.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:84:0)
[09:01:37.028] Build status: STARTED
[09:01:37.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:85:0) after 3m32s
[09:05:09.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:85:0)
[09:05:09.111] Build status: STARTED
[09:05:09.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:86:0) after 1m33s
[09:06:42.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:86:0)
[09:06:42.258] Build status: STARTED
[09:06:42.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:87:0) after 4m38s
[09:11:20.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:87:0)
[09:11:20.413] Build status: STARTED
[09:11:20.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:88:0) after 1m45s
[09:13:05.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:88:0)
[09:13:05.476] Build status: STARTED
[09:13:05.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:89:0) after 4m23s
[09:17:28.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:89:0)
[09:17:28.660] Build status: STARTED
[09:17:28.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:90:0) after 9m55s
[09:27:23.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:90:0)
[09:27:23.787] Build status: STARTED
[09:27:23.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:91:0) after 3m36s
[09:30:59.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:91:0)
[09:30:59.951] Build status: STARTED
[09:30:59.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:92:0) after 9m14s
[09:40:14.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:92:0)
[09:40:14.172] Build status: STARTED
[09:40:14.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:93:0) after 3m22s
[09:43:36.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:93:0)
[09:43:36.405] Build status: STARTED
[09:43:36.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:94:0) after 8m50s
[09:52:26.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:94:0)
[09:52:26.755] Build status: STARTED
[09:52:26.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:95:0) after 8m2s
[10:00:28.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:95:0)
[10:00:28.822] Build status: STARTED
[10:00:28.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:96:0) after 9m44s
[10:10:13.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:96:0)
[10:10:13.524] Build status: STARTED
[10:10:13.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:97:0) after 2m46s
[10:12:59.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:97:0)
[10:12:59.709] Build status: STARTED
[10:12:59.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:98:0) after 9m4s
[10:22:03.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:98:0)
[10:22:03.756] Build status: STARTED
[10:22:03.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:99:0) after 6m22s
[10:28:25.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:99:0)
[10:28:25.806] Build status: STARTED
[10:28:25.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:100:0) after 4m15s
[10:32:40.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:100:0)
[10:32:40.984] Build status: STARTED
[10:32:40.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:101:0) after 5m30s
[10:38:11.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:101:0)
[10:38:11.354] Build status: STARTED
[10:38:11.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:102:0) after 6m51s
[10:45:02.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:102:0)
[10:45:02.557] Build status: STARTED
[10:45:02.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:103:0) after 3m5s
[10:48:07.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:103:0)
[10:48:07.602] Build status: STARTED
[10:48:07.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:104:0) after 3m15s
[10:51:22.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:104:0)
[10:51:22.837] Build status: STARTED
[10:51:22.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:105:0) after 7m56s
[10:59:18.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:105:0)
[10:59:18.954] Build status: STARTED
[10:59:18.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:106:0) after 1m46s
[11:01:06.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:106:0)
[11:01:06.094] Build status: STARTED
[11:01:06.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:107:0) after 6m40s
[11:07:46.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:107:0)
[11:07:46.310] Build status: STARTED
[11:07:46.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:108:0) after 6m59s
[11:14:45.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:108:0)
[11:14:45.449] Build status: STARTED
[11:14:45.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:109:0) after 4m4s
[11:18:49.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:109:0)
[11:18:49.488] Build status: STARTED
[11:18:49.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:110:0) after 1m23s
[11:20:12.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:110:0)
[11:20:12.538] Build status: STARTED
[11:20:12.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:111:0) after 3m3s
[11:23:15.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:111:0)
[11:23:15.590] Build status: STARTED
[11:23:15.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:112:0) after 9m32s
[11:32:47.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:112:0)
[11:32:47.669] Build status: STARTED
[11:32:47.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:113:0) after 5m0s
[11:37:47.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:113:0)
[11:37:47.813] Build status: STARTED
[11:37:47.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:114:0) after 2m25s
[11:40:12.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:114:0)
[11:40:12.979] Build status: STARTED
[11:40:12.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:115:0) after 4m33s
[11:44:46.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:115:0)
[11:44:46.069] Build status: STARTED
[11:44:46.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:116:0) after 8m28s
[11:53:14.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:116:0)
[11:53:14.323] Build status: STARTED
[11:53:14.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:117:0) after 1m7s
[11:54:21.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:117:0)
[11:54:22.055] Build status: STARTED
[11:54:22.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:118:0) after 3m28s
[11:57:50.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:118:0)
[11:57:50.100] Build status: STARTED
[11:57:50.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:119:0) after 3m3s
[12:00:53.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:119:0)
[12:00:53.122] Build status: STARTED
[12:00:53.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:120:0) after 1m10s
[12:02:03.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:120:0)
[12:02:03.168] Build status: STARTED
[12:02:03.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992887764251527744:121:0) after 9m32s
[12:10:37.348] Received PubSub notification, asking Buildbucket for the build status
[12:10:37.384] Build:
{
"id": "8827457702431621041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26366,
"createdBy": "project:chromium",
"createTime": "2021-12-19T01:28:52.236428045Z",
"startTime": "2021-12-19T01:36:07.280428Z",
"endTime": "2021-12-19T12:10:36.504991947Z",
"updateTime": "2021-12-19T12:10:36.504991947Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f66b0dfe03cf5bef9d6e20b7940bb26c420df1a3",
"ref": "refs/heads/main"
}
}
}
[12:10:37.384] Invocation finished in 10h41m46.266862932s with status FAILED