[01:45:20.692] New invocation is queued and will start shortly
[01:45:21.907] Starting the invocation (attempt 1)
[01:45:21.971] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/dab3cc56e1ca83c08bc4233d113d4dbb11bb663c"
[01:45:21.971] Popped gitiles commit info from properties and tags
[01:45:21.971] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:45:21.971] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:45:21.971] Buildbucket request:
{
"requestId": "8966070024565595584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dab3cc56e1ca83c08bc4233d113d4dbb11bb663c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8966070024565595584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:45:22.484] Scheduled build:
{
"id": "8800639962453071729",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28226,
"createdBy": "project:chromium",
"createTime": "2022-10-11T01:45:22.078263119Z",
"updateTime": "2022-10-11T01:45:22.078263119Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dab3cc56e1ca83c08bc4233d113d4dbb11bb663c",
"ref": "refs/heads/main"
}
}
}
[01:45:22.485] Task URL: https://cr-buildbucket.appspot.com/build/8800639962453071729
[01:45:22.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:2:0) after 4m25s
[01:49:47.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:2:0)
[01:49:47.605] Build status: SCHEDULED
[01:49:47.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:3:0) after 6m11s
[01:50:21.727] Received PubSub notification, asking Buildbucket for the build status
[01:50:21.759] Build status: STARTED
[01:55:58.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:3:0)
[01:55:58.802] Build status: STARTED
[01:55:58.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:5:0) after 8m50s
[02:04:49.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:5:0)
[02:04:49.062] Build status: STARTED
[02:04:49.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:6:0) after 2m11s
[02:07:00.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:6:0)
[02:07:00.134] Build status: STARTED
[02:07:00.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:7:0) after 3m33s
[02:10:33.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:7:0)
[02:10:33.355] Build status: STARTED
[02:10:33.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:8:0) after 4m25s
[02:14:58.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:8:0)
[02:14:58.430] Build status: STARTED
[02:14:58.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:9:0) after 7m33s
[02:22:31.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:9:0)
[02:22:31.709] Build status: STARTED
[02:22:31.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:10:0) after 4m49s
[02:27:20.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:10:0)
[02:27:21.065] Build status: STARTED
[02:27:21.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:11:0) after 4m23s
[02:31:44.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:11:0)
[02:31:44.287] Build status: STARTED
[02:31:44.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:12:0) after 4m55s
[02:36:39.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:12:0)
[02:36:39.383] Build status: STARTED
[02:36:39.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:13:0) after 5m13s
[02:41:52.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:13:0)
[02:41:52.508] Build status: STARTED
[02:41:52.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:14:0) after 4m5s
[02:45:57.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:14:0)
[02:45:57.668] Build status: STARTED
[02:45:57.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:15:0) after 8m2s
[02:54:00.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:15:0)
[02:54:00.253] Build status: STARTED
[02:54:00.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:16:0) after 1m43s
[02:55:43.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:16:0)
[02:55:43.442] Build status: STARTED
[02:55:43.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:17:0) after 3m20s
[02:59:03.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:17:0)
[02:59:03.683] Build status: STARTED
[02:59:03.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:18:0) after 8m44s
[03:07:47.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:18:0)
[03:07:47.870] Build status: STARTED
[03:07:47.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:19:0) after 1m45s
[03:09:32.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:19:0)
[03:09:33.023] Build status: STARTED
[03:09:33.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:20:0) after 4m48s
[03:14:21.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:20:0)
[03:14:21.341] Build status: STARTED
[03:14:21.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:21:0) after 2m20s
[03:16:41.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:21:0)
[03:16:41.399] Build status: STARTED
[03:16:41.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:22:0) after 8m49s
[03:25:30.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:22:0)
[03:25:30.457] Build status: STARTED
[03:25:30.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:23:0) after 9m23s
[03:34:53.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:23:0)
[03:34:53.534] Build status: STARTED
[03:34:53.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:24:0) after 9m44s
[03:44:37.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:24:0)
[03:44:37.697] Build status: STARTED
[03:44:37.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:25:0) after 1m17s
[03:45:54.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:25:0)
[03:45:54.832] Build status: STARTED
[03:45:54.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:26:0) after 8m3s
[03:53:58.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:26:0)
[03:53:58.115] Build status: STARTED
[03:53:58.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:27:0) after 8m4s
[04:02:02.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:27:0)
[04:02:02.308] Build status: STARTED
[04:02:02.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:28:0) after 3m7s
[04:05:09.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:28:0)
[04:05:09.505] Build status: STARTED
[04:05:09.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:29:0) after 6m47s
[04:11:56.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:29:0)
[04:11:56.565] Build status: STARTED
[04:11:56.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:30:0) after 9m27s
[04:21:23.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:30:0)
[04:21:23.582] Build status: STARTED
[04:21:23.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:31:0) after 6m11s
[04:27:34.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:31:0)
[04:27:34.793] Build status: STARTED
[04:27:34.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:32:0) after 9m50s
[04:37:24.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:32:0)
[04:37:24.905] Build status: STARTED
[04:37:24.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:33:0) after 4m8s
[04:41:33.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:33:0)
[04:41:33.116] Build status: STARTED
[04:41:33.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:34:0) after 2m55s
[04:44:28.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:34:0)
[04:44:28.184] Build status: STARTED
[04:44:28.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:35:0) after 8m13s
[04:52:41.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:35:0)
[04:52:41.361] Build status: STARTED
[04:52:41.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:36:0) after 3m52s
[04:56:33.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:36:0)
[04:56:33.641] Build status: STARTED
[04:56:33.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:37:0) after 6m36s
[05:03:09.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:37:0)
[05:03:09.867] Build status: STARTED
[05:03:09.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:38:0) after 9m16s
[05:12:25.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:38:0)
[05:12:25.872] Build status: STARTED
[05:12:25.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:39:0) after 6m37s
[05:19:02.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:39:0)
[05:19:02.969] Build status: STARTED
[05:19:02.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:40:0) after 1m40s
[05:20:42.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:40:0)
[05:20:43.021] Build status: STARTED
[05:20:43.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:41:0) after 3m26s
[05:24:09.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:41:0)
[05:24:09.444] Build status: STARTED
[05:24:09.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:42:0) after 9m16s
[05:33:25.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:42:0)
[05:33:25.502] Build status: STARTED
[05:33:25.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:43:0) after 2m3s
[05:35:28.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:43:0)
[05:35:28.579] Build status: STARTED
[05:35:28.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:44:0) after 2m49s
[05:38:17.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:44:0)
[05:38:17.770] Build status: STARTED
[05:38:17.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:45:0) after 7m59s
[05:46:17.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:45:0)
[05:46:17.046] Build status: STARTED
[05:46:17.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:46:0) after 6m21s
[05:52:38.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:46:0)
[05:52:38.110] Build status: STARTED
[05:52:38.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:47:0) after 7m42s
[06:00:20.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:47:0)
[06:00:20.330] Build status: STARTED
[06:00:20.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:48:0) after 9m37s
[06:09:57.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:48:0)
[06:09:57.874] Build status: STARTED
[06:09:57.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:49:0) after 9m9s
[06:19:06.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:49:0)
[06:19:06.992] Build status: STARTED
[06:19:06.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:50:0) after 5m47s
[06:24:54.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:50:0)
[06:24:54.190] Build status: STARTED
[06:24:54.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:51:0) after 8m56s
[06:33:50.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:51:0)
[06:33:50.317] Build status: STARTED
[06:33:50.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:52:0) after 4m32s
[06:38:22.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:52:0)
[06:38:22.435] Build status: STARTED
[06:38:22.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:53:0) after 1m4s
[06:39:26.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:53:0)
[06:39:26.597] Build status: STARTED
[06:39:26.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:54:0) after 8m28s
[06:47:54.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:54:0)
[06:47:54.656] Build status: STARTED
[06:47:54.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:55:0) after 8m36s
[06:56:30.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:55:0)
[06:56:30.733] Build status: STARTED
[06:56:30.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:56:0) after 8m52s
[07:05:22.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:56:0)
[07:05:22.824] Build status: STARTED
[07:05:22.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:57:0) after 3m22s
[07:08:44.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:57:0)
[07:08:45.008] Build status: STARTED
[07:08:45.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:58:0) after 7m18s
[07:16:03.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:58:0)
[07:16:03.081] Build status: STARTED
[07:16:03.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:59:0) after 4m25s
[07:20:28.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:59:0)
[07:20:28.147] Build status: STARTED
[07:20:28.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:60:0) after 8m29s
[07:28:57.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:60:0)
[07:28:57.434] Build status: STARTED
[07:28:57.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:61:0) after 2m27s
[07:31:24.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:61:0)
[07:31:24.879] Build status: STARTED
[07:31:24.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:62:0) after 3m9s
[07:34:33.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:62:0)
[07:34:33.990] Build status: STARTED
[07:34:33.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:63:0) after 2m7s
[07:36:41.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:63:0)
[07:36:41.088] Build status: STARTED
[07:36:41.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:64:0) after 8m19s
[07:45:00.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:64:0)
[07:45:00.278] Build status: STARTED
[07:45:00.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:65:0) after 3m59s
[07:48:59.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:65:0)
[07:48:59.320] Build status: STARTED
[07:48:59.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:66:0) after 3m22s
[07:52:21.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:66:0)
[07:52:21.590] Build status: STARTED
[07:52:21.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:67:0) after 8m31s
[08:00:52.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:67:0)
[08:00:52.806] Build status: STARTED
[08:00:52.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:68:0) after 4m27s
[08:05:19.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:68:0)
[08:05:20.018] Build status: STARTED
[08:05:20.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:69:0) after 9m18s
[08:14:38.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:69:0)
[08:14:38.082] Build status: STARTED
[08:14:38.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:70:0) after 2m33s
[08:17:11.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:70:0)
[08:17:11.166] Build status: STARTED
[08:17:11.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:71:0) after 6m10s
[08:23:21.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:71:0)
[08:23:21.218] Build status: STARTED
[08:23:21.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:72:0) after 5m0s
[08:28:21.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:72:0)
[08:28:21.490] Build status: STARTED
[08:28:21.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:73:0) after 3m12s
[08:31:33.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:73:0)
[08:31:33.613] Build status: STARTED
[08:31:33.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:74:0) after 8m15s
[08:39:48.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:74:0)
[08:39:48.766] Build status: STARTED
[08:39:48.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:75:0) after 7m1s
[08:46:49.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:75:0)
[08:46:49.833] Build status: STARTED
[08:46:49.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:76:0) after 8m29s
[08:55:19.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:76:0)
[08:55:19.144] Build status: STARTED
[08:55:19.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:77:0) after 5m48s
[09:01:07.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:77:0)
[09:01:07.207] Build status: STARTED
[09:01:07.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:78:0) after 5m49s
[09:06:56.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:78:0)
[09:06:56.367] Build status: STARTED
[09:06:56.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:79:0) after 8m33s
[09:15:29.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:79:0)
[09:15:29.679] Build status: STARTED
[09:15:29.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:80:0) after 3m41s
[09:19:10.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:80:0)
[09:19:10.793] Build status: STARTED
[09:19:10.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:81:0) after 1m51s
[09:21:01.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:81:0)
[09:21:01.886] Build status: STARTED
[09:21:01.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:82:0) after 4m17s
[09:25:19.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:82:0)
[09:25:19.046] Build status: STARTED
[09:25:19.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:83:0) after 2m7s
[09:27:26.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:83:0)
[09:27:26.551] Build status: STARTED
[09:27:26.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:84:0) after 4m48s
[09:32:14.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:84:0)
[09:32:14.898] Build status: STARTED
[09:32:14.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:85:0) after 9m16s
[09:41:30.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:85:0)
[09:41:30.994] Build status: STARTED
[09:41:30.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:86:0) after 1m52s
[09:43:23.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:86:0)
[09:43:23.172] Build status: STARTED
[09:43:23.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:87:0) after 3m24s
[09:46:47.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:87:0)
[09:46:47.545] Build status: STARTED
[09:46:47.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:88:0) after 7m58s
[09:54:45.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:88:0)
[09:54:45.719] Build status: STARTED
[09:54:45.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:89:0) after 6m29s
[10:01:14.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:89:0)
[10:01:14.861] Build status: STARTED
[10:01:14.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:90:0) after 9m13s
[10:10:28.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:90:0)
[10:10:28.066] Build status: STARTED
[10:10:28.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:91:0) after 8m2s
[10:18:30.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:91:0)
[10:18:30.350] Build status: STARTED
[10:18:30.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:92:0) after 1m31s
[10:20:01.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:92:0)
[10:20:01.691] Build status: STARTED
[10:20:01.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:93:0) after 7m15s
[10:27:16.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:93:0)
[10:27:16.752] Build status: STARTED
[10:27:16.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:94:0) after 6m11s
[10:33:28.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:94:0)
[10:33:28.087] Build status: STARTED
[10:33:28.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:95:0) after 2m40s
[10:36:08.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:95:0)
[10:36:08.234] Build status: STARTED
[10:36:08.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:96:0) after 2m15s
[10:38:23.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:96:0)
[10:38:23.449] Build status: STARTED
[10:38:23.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:97:0) after 6m45s
[10:45:08.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:97:0)
[10:45:08.564] Build status: STARTED
[10:45:08.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:98:0) after 6m31s
[10:51:39.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:98:0)
[10:51:39.718] Build status: STARTED
[10:51:39.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:99:0) after 3m45s
[10:55:24.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:99:0)
[10:55:24.832] Build status: STARTED
[10:55:24.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:100:0) after 4m46s
[11:00:10.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:100:0)
[11:00:10.897] Build status: STARTED
[11:00:10.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:101:0) after 3m5s
[11:03:15.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:101:0)
[11:03:16.065] Build status: STARTED
[11:03:16.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:102:0) after 1m18s
[11:04:34.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:102:0)
[11:04:34.165] Build status: STARTED
[11:04:34.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:103:0) after 8m51s
[11:13:25.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:103:0)
[11:13:25.247] Build status: STARTED
[11:13:25.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:104:0) after 3m3s
[11:16:28.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:104:0)
[11:16:28.638] Build status: STARTED
[11:16:28.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:105:0) after 2m17s
[11:18:45.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:105:0)
[11:18:45.752] Build status: STARTED
[11:18:45.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:106:0) after 5m32s
[11:24:17.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:106:0)
[11:24:17.992] Build status: STARTED
[11:24:17.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:107:0) after 9m20s
[11:33:38.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:107:0)
[11:33:38.186] Build status: STARTED
[11:33:38.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:108:0) after 4m55s
[11:38:33.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:108:0)
[11:38:33.420] Build status: STARTED
[11:38:33.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:109:0) after 2m15s
[11:40:48.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:109:0)
[11:40:48.513] Build status: STARTED
[11:40:48.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:110:0) after 5m32s
[11:46:20.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:110:0)
[11:46:20.825] Build status: STARTED
[11:46:20.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:111:0) after 1m23s
[11:47:43.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:111:0)
[11:47:43.866] Build status: STARTED
[11:47:43.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:112:0) after 2m6s
[11:49:49.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:112:0)
[11:49:49.979] Build status: STARTED
[11:49:49.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:113:0) after 8m2s
[11:57:52.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:113:0)
[11:57:52.130] Build status: STARTED
[11:57:52.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:114:0) after 2m23s
[12:00:15.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:114:0)
[12:00:15.234] Build status: STARTED
[12:00:15.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:115:0) after 4m8s
[12:04:23.250] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:115:0)
[12:04:23.271] Build status: STARTED
[12:04:23.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:116:0) after 1m40s
[12:06:03.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:116:0)
[12:06:03.326] Build status: STARTED
[12:06:03.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:117:0) after 6m50s
[12:12:53.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:117:0)
[12:12:53.441] Build status: STARTED
[12:12:53.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:118:0) after 1m35s
[12:14:28.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:118:0)
[12:14:28.594] Build status: STARTED
[12:14:28.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:119:0) after 9m49s
[12:24:17.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:119:0)
[12:24:17.666] Build status: STARTED
[12:24:17.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:120:0) after 7m27s
[12:31:45.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:120:0)
[12:31:45.292] Build status: STARTED
[12:31:45.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:121:0) after 6m3s
[12:37:48.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:121:0)
[12:37:48.359] Build status: STARTED
[12:37:48.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:122:0) after 8m48s
[12:46:37.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:122:0)
[12:46:37.122] Build status: STARTED
[12:46:37.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:123:0) after 9m47s
[12:56:24.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:123:0)
[12:56:24.231] Build status: STARTED
[12:56:24.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:124:0) after 4m22s
[13:00:46.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:124:0)
[13:00:46.732] Build status: STARTED
[13:00:46.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:125:0) after 9m30s
[13:10:16.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:125:0)
[13:10:17.008] Build status: STARTED
[13:10:17.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:126:0) after 4m4s
[13:14:21.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:126:0)
[13:14:21.133] Build status: STARTED
[13:14:21.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:127:0) after 5m46s
[13:20:07.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:127:0)
[13:20:07.223] Build status: STARTED
[13:20:07.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:128:0) after 1m46s
[13:21:53.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:128:0)
[13:21:53.385] Build status: STARTED
[13:21:53.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:129:0) after 6m48s
[13:28:41.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:129:0)
[13:28:41.481] Build status: STARTED
[13:28:41.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:130:0) after 1m53s
[13:30:34.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:130:0)
[13:30:34.601] Build status: STARTED
[13:30:34.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:131:0) after 3m56s
[13:34:30.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:131:0)
[13:34:31.012] Build status: STARTED
[13:34:31.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:132:0) after 8m25s
[13:42:56.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:132:0)
[13:42:56.123] Build status: STARTED
[13:42:56.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:133:0) after 9m33s
[13:52:29.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:133:0)
[13:52:29.349] Build status: STARTED
[13:52:29.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:134:0) after 6m32s
[13:59:01.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:134:0)
[13:59:01.545] Build status: STARTED
[13:59:01.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:135:0) after 3m6s
[14:02:07.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:135:0)
[14:02:07.642] Build status: STARTED
[14:02:07.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:136:0) after 5m34s
[14:07:41.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:136:0)
[14:07:41.945] Build status: STARTED
[14:07:41.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:137:0) after 1m54s
[14:09:36.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:137:0)
[14:09:36.359] Build status: STARTED
[14:09:36.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:138:0) after 5m13s
[14:14:49.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:138:0)
[14:14:49.729] Build status: STARTED
[14:14:49.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:139:0) after 4m32s
[14:19:22.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:139:0)
[14:19:22.178] Build status: STARTED
[14:19:22.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:140:0) after 4m4s
[14:23:26.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:140:0)
[14:23:26.246] Build status: STARTED
[14:23:26.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:141:0) after 7m55s
[14:31:21.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:141:0)
[14:31:21.308] Build status: STARTED
[14:31:21.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:142:0) after 9m18s
[14:40:39.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:142:0)
[14:40:39.558] Build status: STARTED
[14:40:39.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:143:0) after 5m32s
[14:46:11.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:143:0)
[14:46:11.625] Build status: STARTED
[14:46:11.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:144:0) after 2m32s
[14:48:43.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:144:0)
[14:48:43.874] Build status: STARTED
[14:48:43.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:145:0) after 6m58s
[14:55:41.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:145:0)
[14:55:42.007] Build status: STARTED
[14:55:42.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:146:0) after 8m27s
[15:04:09.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:146:0)
[15:04:09.421] Build status: STARTED
[15:04:09.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8966070024565595584:147:0) after 7m57s
[15:10:51.038] Received PubSub notification, asking Buildbucket for the build status
[15:10:51.063] Build:
{
"id": "8800639962453071729",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28226,
"createdBy": "project:chromium",
"createTime": "2022-10-11T01:45:22.078263119Z",
"startTime": "2022-10-11T01:50:16.194804Z",
"endTime": "2022-10-11T15:10:50.724163504Z",
"updateTime": "2022-10-11T15:10:50.724163504Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dab3cc56e1ca83c08bc4233d113d4dbb11bb663c",
"ref": "refs/heads/main"
}
}
}
[15:10:51.063] Invocation finished in 13h25m30.384627823s with status FAILED