[09:28:02.613] New invocation is queued and will start shortly
[09:28:04.341] Starting the invocation (attempt 1)
[09:28:04.401] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c69596323bd42e45bd8830d37d701c47d56537c3"
[09:28:04.401] Popped gitiles commit info from properties and tags
[09:28:04.401] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:28:04.401] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:28:04.401] Buildbucket request:
{
"requestId": "8916393776497562592",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c69596323bd42e45bd8830d37d701c47d56537c3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8916393776497562592"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:28:06.438] Scheduled build:
{
"id": "8750963713840482081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31504,
"createdBy": "project:chromium",
"createTime": "2024-04-11T09:28:04.515907814Z",
"updateTime": "2024-04-11T09:28:04.515907814Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c69596323bd42e45bd8830d37d701c47d56537c3",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:28:06.438] Task URL: https://cr-buildbucket.appspot.com/build/8750963713840482081
[09:28:06.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:2:0) after 1m16s
[09:28:06.964] Received PubSub notification, asking Buildbucket for the build status
[09:28:06.985] Build status: SCHEDULED
[09:28:13.192] Received PubSub notification, asking Buildbucket for the build status
[09:28:13.211] Build status: STARTED
[09:29:22.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:2:0)
[09:29:22.658] Build status: STARTED
[09:29:22.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:5:0) after 2m34s
[09:31:56.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:5:0)
[09:31:57.000] Build status: STARTED
[09:31:57.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:6:0) after 6m19s
[09:38:16.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:6:0)
[09:38:16.426] Build status: STARTED
[09:38:16.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:7:0) after 4m54s
[09:43:10.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:7:0)
[09:43:10.504] Build status: STARTED
[09:43:10.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:8:0) after 9m53s
[09:53:03.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:8:0)
[09:53:03.689] Build status: STARTED
[09:53:03.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:9:0) after 5m51s
[09:58:54.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:9:0)
[09:58:54.869] Build status: STARTED
[09:58:54.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:10:0) after 6m34s
[10:05:28.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:10:0)
[10:05:28.993] Build status: STARTED
[10:05:28.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:11:0) after 7m56s
[10:13:25.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:11:0)
[10:13:25.092] Build status: STARTED
[10:13:25.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:12:0) after 9m2s
[10:22:27.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:12:0)
[10:22:27.278] Build status: STARTED
[10:22:27.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:13:0) after 8m32s
[10:30:59.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:13:0)
[10:30:59.375] Build status: STARTED
[10:30:59.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:14:0) after 3m5s
[10:34:04.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:14:0)
[10:34:04.469] Build status: STARTED
[10:34:04.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:15:0) after 3m57s
[10:38:01.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:15:0)
[10:38:01.643] Build status: STARTED
[10:38:01.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:16:0) after 9m24s
[10:47:25.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:16:0)
[10:47:25.893] Build status: STARTED
[10:47:25.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:17:0) after 8m9s
[10:55:35.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:17:0)
[10:55:35.132] Build status: STARTED
[10:55:35.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:18:0) after 9m48s
[11:05:23.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:18:0)
[11:05:23.308] Build status: STARTED
[11:05:23.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:19:0) after 9m16s
[11:14:39.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:19:0)
[11:14:39.540] Build status: STARTED
[11:14:39.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:20:0) after 5m21s
[11:20:00.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:20:0)
[11:20:00.637] Build status: STARTED
[11:20:00.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:21:0) after 8m48s
[11:28:48.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:21:0)
[11:28:48.720] Build status: STARTED
[11:28:48.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:22:0) after 8m15s
[11:37:03.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:22:0)
[11:37:03.949] Build status: STARTED
[11:37:03.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:23:0) after 5m39s
[11:42:43.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:23:0)
[11:42:43.025] Build status: STARTED
[11:42:43.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:24:0) after 7m39s
[11:50:22.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:24:0)
[11:50:22.263] Build status: STARTED
[11:50:22.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:25:0) after 8m28s
[11:58:50.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:25:0)
[11:58:50.858] Build status: STARTED
[11:58:50.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:26:0) after 9m30s
[12:08:20.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:26:0)
[12:08:20.936] Build status: STARTED
[12:08:20.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:27:0) after 7m43s
[12:16:04.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:27:0)
[12:16:04.298] Build status: STARTED
[12:16:04.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:28:0) after 6m55s
[12:22:59.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:28:0)
[12:22:59.670] Build status: STARTED
[12:22:59.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:29:0) after 4m9s
[12:27:08.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:29:0)
[12:27:08.907] Build status: STARTED
[12:27:08.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:30:0) after 4m11s
[12:31:19.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:30:0)
[12:31:20.012] Build status: STARTED
[12:31:20.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:31:0) after 1m46s
[12:33:06.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:31:0)
[12:33:06.076] Build status: STARTED
[12:33:06.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:32:0) after 9m57s
[12:43:03.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:32:0)
[12:43:03.372] Build status: STARTED
[12:43:03.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:33:0) after 6m16s
[12:49:19.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:33:0)
[12:49:19.846] Build status: STARTED
[12:49:19.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:34:0) after 6m58s
[12:56:17.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:34:0)
[12:56:17.895] Build status: STARTED
[12:56:17.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:35:0) after 6m41s
[13:02:58.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:35:0)
[13:02:59.002] Build status: STARTED
[13:02:59.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:36:0) after 8m58s
[13:11:57.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:36:0)
[13:11:57.195] Build status: STARTED
[13:11:57.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:37:0) after 5m10s
[13:17:07.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:37:0)
[13:17:07.446] Build status: STARTED
[13:17:07.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:38:0) after 2m3s
[13:19:10.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:38:0)
[13:19:10.816] Build status: STARTED
[13:19:10.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:39:0) after 4m46s
[13:23:56.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:39:0)
[13:23:56.973] Build status: STARTED
[13:23:56.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:40:0) after 4m20s
[13:28:17.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:40:0)
[13:28:17.263] Build status: STARTED
[13:28:17.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:41:0) after 1m0s
[13:29:17.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:41:0)
[13:29:17.321] Build status: STARTED
[13:29:17.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:42:0) after 9m15s
[13:38:32.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:42:0)
[13:38:32.408] Build status: STARTED
[13:38:32.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:43:0) after 4m13s
[13:42:45.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:43:0)
[13:42:45.862] Build status: STARTED
[13:42:45.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:44:0) after 3m45s
[13:46:30.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:44:0)
[13:46:30.938] Build status: STARTED
[13:46:30.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:45:0) after 3m15s
[13:49:46.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:45:0)
[13:49:46.530] Build status: STARTED
[13:49:46.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:46:0) after 7m6s
[13:56:52.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:46:0)
[13:56:52.711] Build status: STARTED
[13:56:52.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:47:0) after 1m13s
[13:58:06.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:47:0)
[13:58:06.086] Build status: STARTED
[13:58:06.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:48:0) after 1m34s
[13:59:40.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:48:0)
[13:59:40.739] Build status: STARTED
[13:59:40.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:49:0) after 4m33s
[14:04:14.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:49:0)
[14:04:14.078] Build status: STARTED
[14:04:14.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:50:0) after 7m17s
[14:11:31.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:50:0)
[14:11:31.512] Build status: STARTED
[14:11:31.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:51:0) after 7m23s
[14:18:54.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:51:0)
[14:18:54.687] Build status: STARTED
[14:18:54.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:52:0) after 3m45s
[14:22:40.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:52:0)
[14:22:40.072] Build status: STARTED
[14:22:40.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:53:0) after 6m47s
[14:29:27.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:53:0)
[14:29:27.661] Build status: STARTED
[14:29:27.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:54:0) after 8m28s
[14:37:55.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:54:0)
[14:37:55.880] Build status: STARTED
[14:37:55.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:55:0) after 3m57s
[14:41:53.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:55:0)
[14:41:53.258] Build status: STARTED
[14:41:53.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:56:0) after 5m46s
[14:47:39.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:56:0)
[14:47:39.355] Build status: STARTED
[14:47:39.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:57:0) after 5m40s
[14:53:19.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:57:0)
[14:53:19.442] Build status: STARTED
[14:53:19.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:58:0) after 2m31s
[14:55:50.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:58:0)
[14:55:50.917] Build status: STARTED
[14:55:50.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:59:0) after 8m32s
[15:04:23.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:59:0)
[15:04:23.094] Build status: STARTED
[15:04:23.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:60:0) after 2m56s
[15:07:19.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:60:0)
[15:07:19.430] Build status: STARTED
[15:07:19.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:61:0) after 1m28s
[15:08:48.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:61:0)
[15:08:48.126] Build status: STARTED
[15:08:48.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:62:0) after 5m24s
[15:14:12.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:62:0)
[15:14:12.214] Build status: STARTED
[15:14:12.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:63:0) after 2m32s
[15:16:45.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:63:0)
[15:16:45.135] Build status: STARTED
[15:16:45.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:64:0) after 3m41s
[15:20:26.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:64:0)
[15:20:26.267] Build status: STARTED
[15:20:26.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:65:0) after 6m59s
[15:27:25.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:65:0)
[15:27:25.493] Build status: STARTED
[15:27:25.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:66:0) after 3m11s
[15:30:36.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:66:0)
[15:30:36.694] Build status: STARTED
[15:30:36.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:67:0) after 1m30s
[15:32:06.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:67:0)
[15:32:07.023] Build status: STARTED
[15:32:07.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:68:0) after 4m32s
[15:36:39.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:68:0)
[15:36:39.169] Build status: STARTED
[15:36:39.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:69:0) after 3m45s
[15:40:24.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:69:0)
[15:40:24.453] Build status: STARTED
[15:40:24.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:70:0) after 5m49s
[15:46:14.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:70:0)
[15:46:14.294] Build status: STARTED
[15:46:14.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:71:0) after 8m34s
[15:54:48.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:71:0)
[15:54:48.591] Build status: STARTED
[15:54:48.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:72:0) after 9m22s
[16:04:10.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:72:0)
[16:04:10.764] Build status: STARTED
[16:04:10.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:73:0) after 5m10s
[16:09:20.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:73:0)
[16:09:20.910] Build status: STARTED
[16:09:20.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:74:0) after 5m54s
[16:15:15.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:74:0)
[16:15:15.082] Build status: STARTED
[16:15:15.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:75:0) after 8m23s
[16:23:38.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:75:0)
[16:23:38.334] Build status: STARTED
[16:23:38.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:76:0) after 3m54s
[16:27:32.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:76:0)
[16:27:32.392] Build status: STARTED
[16:27:32.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:77:0) after 5m27s
[16:32:59.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:77:0)
[16:32:59.603] Build status: STARTED
[16:32:59.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:78:0) after 6m59s
[16:39:58.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:78:0)
[16:39:58.678] Build status: STARTED
[16:39:58.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:79:0) after 6m5s
[16:46:03.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:79:0)
[16:46:03.951] Build status: STARTED
[16:46:03.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:80:0) after 4m3s
[16:50:06.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:80:0)
[16:50:07.007] Build status: STARTED
[16:50:07.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:81:0) after 9m7s
[16:59:14.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:81:0)
[16:59:14.117] Build status: STARTED
[16:59:14.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:82:0) after 6m48s
[17:06:02.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:82:0)
[17:06:02.432] Build status: STARTED
[17:06:02.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:83:0) after 2m12s
[17:08:14.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:83:0)
[17:08:14.582] Build status: STARTED
[17:08:14.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:84:0) after 7m33s
[17:15:47.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:84:0)
[17:15:47.691] Build status: STARTED
[17:15:47.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:85:0) after 5m35s
[17:21:22.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:85:0)
[17:21:22.794] Build status: STARTED
[17:21:22.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:86:0) after 2m56s
[17:24:19.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:86:0)
[17:24:19.045] Build status: STARTED
[17:24:19.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:87:0) after 7m38s
[17:31:57.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:87:0)
[17:31:57.106] Build status: STARTED
[17:31:57.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:88:0) after 1m43s
[17:33:40.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:88:0)
[17:33:40.232] Build status: STARTED
[17:33:40.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:89:0) after 8m2s
[17:41:42.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:89:0)
[17:41:42.437] Build status: STARTED
[17:41:42.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:90:0) after 6m52s
[17:48:34.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:90:0)
[17:48:34.570] Build status: STARTED
[17:48:34.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:91:0) after 8m36s
[17:57:10.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:91:0)
[17:57:10.803] Build status: STARTED
[17:57:10.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:92:0) after 4m49s
[18:01:59.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:92:0)
[18:01:59.942] Build status: STARTED
[18:01:59.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:93:0) after 5m9s
[18:07:09.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:93:0)
[18:07:09.111] Build status: STARTED
[18:07:09.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:94:0) after 7m42s
[18:14:51.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:94:0)
[18:14:51.296] Build status: STARTED
[18:14:51.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:95:0) after 8m30s
[18:23:21.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:95:0)
[18:23:21.382] Build status: STARTED
[18:23:21.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:96:0) after 3m6s
[18:26:27.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:96:0)
[18:26:27.459] Build status: STARTED
[18:26:27.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:97:0) after 1m3s
[18:27:30.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:97:0)
[18:27:30.602] Build status: STARTED
[18:27:30.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:98:0) after 5m48s
[18:33:18.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:98:0)
[18:33:18.690] Build status: STARTED
[18:33:18.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:99:0) after 6m59s
[18:40:17.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:99:0)
[18:40:17.803] Build status: STARTED
[18:40:17.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:100:0) after 8m4s
[18:48:21.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:100:0)
[18:48:21.866] Build status: STARTED
[18:48:21.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:101:0) after 5m20s
[18:53:41.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:101:0)
[18:53:41.931] Build status: STARTED
[18:53:41.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:102:0) after 1m51s
[18:55:33.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:102:0)
[18:55:33.320] Build status: STARTED
[18:55:33.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:103:0) after 1m4s
[18:56:37.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:103:0)
[18:56:37.522] Build status: STARTED
[18:56:37.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:104:0) after 5m16s
[19:01:53.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:104:0)
[19:01:53.653] Build status: STARTED
[19:01:53.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:105:0) after 3m14s
[19:05:07.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:105:0)
[19:05:07.835] Build status: STARTED
[19:05:07.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:106:0) after 9m7s
[19:14:15.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:106:0)
[19:14:15.194] Build status: STARTED
[19:14:15.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:107:0) after 1m31s
[19:15:46.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:107:0)
[19:15:46.334] Build status: STARTED
[19:15:46.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:108:0) after 6m44s
[19:22:30.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:108:0)
[19:22:30.853] Build status: STARTED
[19:22:30.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:109:0) after 3m43s
[19:26:13.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:109:0)
[19:26:13.938] Build status: STARTED
[19:26:13.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:110:0) after 1m47s
[19:28:00.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:110:0)
[19:28:01.004] Build status: STARTED
[19:28:01.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:111:0) after 3m19s
[19:31:20.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:111:0)
[19:31:20.119] Build status: STARTED
[19:31:20.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:112:0) after 2m4s
[19:33:24.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:112:0)
[19:33:24.225] Build status: STARTED
[19:33:24.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:113:0) after 9m29s
[19:42:53.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:113:0)
[19:42:53.295] Build status: STARTED
[19:42:53.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:114:0) after 9m44s
[19:52:37.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:114:0)
[19:52:37.372] Build status: STARTED
[19:52:37.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:115:0) after 2m15s
[19:54:52.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:115:0)
[19:54:52.776] Build status: STARTED
[19:54:52.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:116:0) after 2m0s
[19:56:52.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:116:0)
[19:56:52.917] Build status: STARTED
[19:56:52.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:117:0) after 3m56s
[20:00:49.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:117:0)
[20:00:49.082] Build status: STARTED
[20:00:49.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:118:0) after 4m41s
[20:05:30.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:118:0)
[20:05:30.855] Build status: STARTED
[20:05:30.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:119:0) after 2m23s
[20:07:54.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:119:0)
[20:07:54.265] Build status: STARTED
[20:07:54.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:120:0) after 6m37s
[20:14:31.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:120:0)
[20:14:31.461] Build status: STARTED
[20:14:31.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:121:0) after 3m17s
[20:17:48.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:121:0)
[20:17:48.590] Build status: STARTED
[20:17:48.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:122:0) after 5m34s
[20:23:22.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:122:0)
[20:23:22.689] Build status: STARTED
[20:23:22.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:123:0) after 2m44s
[20:26:06.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:123:0)
[20:26:06.789] Build status: STARTED
[20:26:06.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:124:0) after 7m43s
[20:33:49.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:124:0)
[20:33:49.898] Build status: STARTED
[20:33:49.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:125:0) after 4m15s
[20:38:04.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:125:0)
[20:38:04.992] Build status: STARTED
[20:38:04.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:126:0) after 5m43s
[20:43:48.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:126:0)
[20:43:48.030] Build status: STARTED
[20:43:48.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:127:0) after 2m57s
[20:46:45.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:127:0)
[20:46:45.086] Build status: STARTED
[20:46:45.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:128:0) after 2m37s
[20:49:22.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:128:0)
[20:49:22.188] Build status: STARTED
[20:49:22.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:129:0) after 6m41s
[20:56:03.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:129:0)
[20:56:03.246] Build status: STARTED
[20:56:03.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:130:0) after 2m41s
[20:58:44.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:130:0)
[20:58:44.319] Build status: STARTED
[20:58:44.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:131:0) after 1m56s
[21:00:40.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:131:0)
[21:00:40.425] Build status: STARTED
[21:00:40.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:132:0) after 2m51s
[21:03:31.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:132:0)
[21:03:31.849] Build status: STARTED
[21:03:31.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:133:0) after 7m25s
[21:10:56.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:133:0)
[21:10:57.010] Build status: STARTED
[21:10:57.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:134:0) after 3m39s
[21:14:36.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:134:0)
[21:14:36.186] Build status: STARTED
[21:14:36.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:135:0) after 3m50s
[21:18:26.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:135:0)
[21:18:26.259] Build status: STARTED
[21:18:26.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:136:0) after 1m35s
[21:20:01.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:136:0)
[21:20:01.366] Build status: STARTED
[21:20:01.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:137:0) after 2m9s
[21:22:10.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:137:0)
[21:22:10.652] Build status: STARTED
[21:22:10.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:138:0) after 8m41s
[21:30:51.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:138:0)
[21:30:51.724] Build status: STARTED
[21:30:51.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:139:0) after 2m31s
[21:33:22.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:139:0)
[21:33:22.787] Build status: STARTED
[21:33:22.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:140:0) after 6m6s
[21:39:28.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:140:0)
[21:39:28.895] Build status: STARTED
[21:39:28.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:141:0) after 7m52s
[21:47:20.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:141:0)
[21:47:20.973] Build status: STARTED
[21:47:20.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:142:0) after 9m51s
[21:57:12.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:142:0)
[21:57:12.326] Build status: STARTED
[21:57:12.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:143:0) after 9m34s
[22:06:46.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:143:0)
[22:06:46.449] Build status: STARTED
[22:06:46.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:144:0) after 7m35s
[22:14:21.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:144:0)
[22:14:21.708] Build status: STARTED
[22:14:21.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:145:0) after 1m32s
[22:15:53.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:145:0)
[22:15:53.775] Build status: STARTED
[22:15:53.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:146:0) after 5m32s
[22:21:25.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:146:0)
[22:21:26.036] Build status: STARTED
[22:21:26.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:147:0) after 8m9s
[22:29:35.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:147:0)
[22:29:35.102] Build status: STARTED
[22:29:35.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:148:0) after 8m26s
[22:38:01.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:148:0)
[22:38:01.294] Build status: STARTED
[22:38:01.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:149:0) after 6m59s
[22:45:00.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:149:0)
[22:45:00.545] Build status: STARTED
[22:45:00.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:150:0) after 2m27s
[22:47:27.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:150:0)
[22:47:27.620] Build status: STARTED
[22:47:27.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916393776497562592:151:0) after 5m22s
[22:51:23.802] Received PubSub notification, asking Buildbucket for the build status
[22:51:23.873] Build:
{
"id": "8750963713840482081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31504,
"createdBy": "project:chromium",
"createTime": "2024-04-11T09:28:04.515907814Z",
"startTime": "2024-04-11T09:28:12.951621259Z",
"endTime": "2024-04-11T22:51:23.210577011Z",
"updateTime": "2024-04-11T22:51:23.210577011Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c69596323bd42e45bd8830d37d701c47d56537c3",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:51:23.873] Invocation finished in 13h23m21.276286724s with status FAILED