[16:00:42.127] New invocation is queued and will start shortly
[16:00:43.204] Starting the invocation (attempt 1)
[16:00:43.231] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fe1880412c1c9343d4d02721c95064d00249e5ea"
[16:00:43.231] Popped gitiles commit info from properties and tags
[16:00:43.231] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:00:43.231] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:00:43.231] Buildbucket request:
{
"requestId": "8833835236154950720",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe1880412c1c9343d4d02721c95064d00249e5ea",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833835236154950720"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:00:43.927] Scheduled build:
{
"id": "8668405174268144417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"number": 14720,
"createdBy": "project:chromium",
"createTime": "2026-10-09T16:00:43.305554829Z",
"updateTime": "2026-10-09T16:00:43.305554829Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe1880412c1c9343d4d02721c95064d00249e5ea",
"ref": "refs/heads/main"
}
}
}
[16:00:43.927] Task URL: https://cr-buildbucket.appspot.com/build/8668405174268144417
[16:00:43.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:2:0) after 6m45s
[16:01:03.930] Received PubSub notification, asking Buildbucket for the build status
[16:01:03.962] Build status: SCHEDULED
[16:02:04.318] Received PubSub notification, asking Buildbucket for the build status
[16:02:04.334] Build status: STARTED
[16:07:28.943] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:2:0)
[16:07:28.974] Build status: STARTED
[16:07:28.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:5:0) after 9m0s
[16:16:29.043] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:5:0)
[16:16:29.062] Build status: STARTED
[16:16:29.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:6:0) after 8m1s
[16:24:30.237] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:6:0)
[16:24:30.254] Build status: STARTED
[16:24:30.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:7:0) after 6m1s
[16:30:31.335] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:7:0)
[16:30:31.355] Build status: STARTED
[16:30:31.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:8:0) after 7m14s
[16:37:45.491] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:8:0)
[16:37:45.510] Build status: STARTED
[16:37:45.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:9:0) after 3m1s
[16:40:46.620] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:9:0)
[16:40:46.899] Build status: STARTED
[16:40:46.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:10:0) after 7m18s
[16:48:05.144] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:10:0)
[16:48:05.175] Build status: STARTED
[16:48:05.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:11:0) after 5m16s
[16:53:21.199] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:11:0)
[16:53:21.283] Build status: STARTED
[16:53:21.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:12:0) after 6m5s
[16:59:26.300] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:12:0)
[16:59:26.321] Build status: STARTED
[16:59:26.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:13:0) after 9m36s
[17:09:02.393] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:13:0)
[17:09:02.416] Build status: STARTED
[17:09:02.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:14:0) after 8m42s
[17:17:44.451] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:14:0)
[17:17:44.473] Build status: STARTED
[17:17:44.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:15:0) after 3m53s
[17:21:37.540] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:15:0)
[17:21:37.563] Build status: STARTED
[17:21:37.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:16:0) after 8m33s
[17:30:10.713] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:16:0)
[17:30:10.752] Build status: STARTED
[17:30:10.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:17:0) after 2m56s
[17:33:06.767] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:17:0)
[17:33:06.792] Build status: STARTED
[17:33:06.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:18:0) after 2m38s
[17:35:44.870] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:18:0)
[17:35:44.894] Build status: STARTED
[17:35:44.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:19:0) after 1m14s
[17:36:58.976] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:19:0)
[17:36:59.004] Build status: STARTED
[17:36:59.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:20:0) after 6m27s
[17:43:26.022] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:20:0)
[17:43:26.048] Build status: STARTED
[17:43:26.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:21:0) after 6m51s
[17:50:17.045] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:21:0)
[17:50:17.066] Build status: STARTED
[17:50:17.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:22:0) after 7m57s
[17:58:14.119] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:22:0)
[17:58:14.154] Build status: STARTED
[17:58:14.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:23:0) after 9m41s
[18:07:55.187] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:23:0)
[18:07:55.206] Build status: STARTED
[18:07:55.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:24:0) after 7m50s
[18:15:45.232] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:24:0)
[18:15:45.250] Build status: STARTED
[18:15:45.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:25:0) after 4m6s
[18:19:51.508] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:25:0)
[18:19:51.530] Build status: STARTED
[18:19:51.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:26:0) after 6m18s
[18:26:09.605] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:26:0)
[18:26:09.627] Build status: STARTED
[18:26:09.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:27:0) after 3m25s
[18:29:34.723] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:27:0)
[18:29:34.756] Build status: STARTED
[18:29:34.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:28:0) after 1m49s
[18:31:23.825] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:28:0)
[18:31:23.909] Build status: STARTED
[18:31:23.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:29:0) after 1m59s
[18:33:22.928] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:29:0)
[18:33:22.956] Build status: STARTED
[18:33:22.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:30:0) after 9m12s
[18:42:34.973] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:30:0)
[18:42:35.006] Build status: STARTED
[18:42:35.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:31:0) after 7m20s
[18:49:55.029] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:31:0)
[18:49:55.096] Build status: STARTED
[18:49:55.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:32:0) after 3m1s
[18:52:56.118] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:32:0)
[18:52:56.145] Build status: STARTED
[18:52:56.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:33:0) after 3m13s
[18:56:09.262] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:33:0)
[18:56:09.366] Build status: STARTED
[18:56:09.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:34:0) after 8m4s
[19:04:13.438] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:34:0)
[19:04:13.455] Build status: STARTED
[19:04:13.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:35:0) after 1m2s
[19:05:15.472] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:35:0)
[19:05:15.493] Build status: STARTED
[19:05:15.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:36:0) after 2m15s
[19:07:30.650] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:36:0)
[19:07:30.672] Build status: STARTED
[19:07:30.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:37:0) after 6m15s
[19:13:45.697] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:37:0)
[19:13:45.798] Build status: STARTED
[19:13:45.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:38:0) after 6m27s
[19:20:12.902] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:38:0)
[19:20:12.928] Build status: STARTED
[19:20:12.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:39:0) after 8m45s
[19:28:57.949] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:39:0)
[19:28:57.972] Build status: STARTED
[19:28:57.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:40:0) after 9m18s
[19:38:16.064] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:40:0)
[19:38:16.090] Build status: STARTED
[19:38:16.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:41:0) after 4m24s
[19:42:40.159] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:41:0)
[19:42:40.179] Build status: STARTED
[19:42:40.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:42:0) after 7m46s
[19:50:26.186] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:42:0)
[19:50:26.266] Build status: STARTED
[19:50:26.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:43:0) after 2m42s
[19:53:08.343] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:43:0)
[19:53:08.411] Build status: STARTED
[19:53:08.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:44:0) after 7m16s
[20:00:24.514] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:44:0)
[20:00:24.875] Build status: STARTED
[20:00:24.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:45:0) after 4m33s
[20:04:57.912] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:45:0)
[20:04:57.931] Build status: STARTED
[20:04:57.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:46:0) after 4m21s
[20:09:19.139] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:46:0)
[20:09:19.163] Build status: STARTED
[20:09:19.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:47:0) after 8m42s
[20:18:01.184] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:47:0)
[20:18:01.211] Build status: STARTED
[20:18:01.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:48:0) after 2m5s
[20:20:06.236] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:48:0)
[20:20:06.265] Build status: STARTED
[20:20:06.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:49:0) after 6m3s
[20:26:09.358] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:49:0)
[20:26:09.375] Build status: STARTED
[20:26:09.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:50:0) after 8m51s
[20:35:00.532] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:50:0)
[20:35:03.222] Build status: STARTED
[20:35:03.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:51:0) after 7m12s
[20:42:15.272] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:51:0)
[20:42:15.305] Build status: STARTED
[20:42:15.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:52:0) after 5m9s
[20:47:24.326] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:52:0)
[20:47:24.356] Build status: STARTED
[20:47:24.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:53:0) after 3m27s
[20:50:51.439] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:53:0)
[20:50:51.465] Build status: STARTED
[20:50:51.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:54:0) after 6m42s
[20:57:33.579] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:54:0)
[20:57:33.598] Build status: STARTED
[20:57:33.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:55:0) after 1m57s
[20:59:30.700] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:55:0)
[20:59:30.726] Build status: STARTED
[20:59:30.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:56:0) after 4m47s
[21:04:17.873] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:56:0)
[21:04:17.896] Build status: STARTED
[21:04:17.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:57:0) after 3m31s
[21:07:49.195] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:57:0)
[21:07:49.256] Build status: STARTED
[21:07:49.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:58:0) after 2m40s
[21:10:29.485] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:58:0)
[21:10:29.512] Build status: STARTED
[21:10:29.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:59:0) after 9m51s
[21:20:20.618] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:59:0)
[21:20:20.649] Build status: STARTED
[21:20:20.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:60:0) after 2m34s
[21:22:54.703] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:60:0)
[21:22:54.892] Build status: STARTED
[21:22:54.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:61:0) after 3m34s
[21:26:28.974] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:61:0)
[21:26:29.076] Build status: STARTED
[21:26:29.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:62:0) after 5m52s
[21:32:21.234] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:62:0)
[21:32:21.276] Build status: STARTED
[21:32:21.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:63:0) after 7m1s
[21:39:22.644] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:63:0)
[21:39:22.731] Build status: STARTED
[21:39:22.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:64:0) after 6m38s
[21:46:00.757] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:64:0)
[21:46:00.776] Build status: STARTED
[21:46:00.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:65:0) after 2m12s
[21:48:12.819] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:65:0)
[21:48:12.836] Build status: STARTED
[21:48:12.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:66:0) after 8m34s
[21:56:46.992] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:66:0)
[21:56:47.013] Build status: STARTED
[21:56:47.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:67:0) after 9m11s
[22:05:58.024] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:67:0)
[22:05:58.043] Build status: STARTED
[22:05:58.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:68:0) after 9m21s
[22:15:19.060] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:68:0)
[22:15:19.086] Build status: STARTED
[22:15:19.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:69:0) after 9m2s
[22:24:21.106] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:69:0)
[22:24:21.127] Build status: STARTED
[22:24:21.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:70:0) after 7m21s
[22:31:42.194] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:70:0)
[22:31:42.223] Build status: STARTED
[22:31:42.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:71:0) after 5m14s
[22:36:56.241] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:71:0)
[22:36:56.265] Build status: STARTED
[22:36:56.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:72:0) after 6m9s
[22:43:05.285] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:72:0)
[22:43:05.305] Build status: STARTED
[22:43:05.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:73:0) after 9m56s
[22:53:01.471] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:73:0)
[22:53:01.491] Build status: STARTED
[22:53:01.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:74:0) after 4m38s
[22:57:39.529] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:74:0)
[22:57:39.587] Build status: STARTED
[22:57:39.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:75:0) after 9m34s
[23:07:13.606] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:75:0)
[23:07:13.629] Build status: STARTED
[23:07:13.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:76:0) after 9m23s
[23:16:36.648] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:76:0)
[23:16:36.668] Build status: STARTED
[23:16:36.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:77:0) after 1m17s
[23:17:53.726] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:77:0)
[23:17:53.755] Build status: STARTED
[23:17:53.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:78:0) after 5m39s
[23:23:32.754] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:78:0)
[23:23:32.772] Build status: STARTED
[23:23:32.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:79:0) after 3m28s
[23:27:00.806] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:79:0)
[23:27:00.827] Build status: STARTED
[23:27:00.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:80:0) after 3m38s
[23:30:39.008] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:80:0)
[23:30:39.026] Build status: STARTED
[23:30:39.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:81:0) after 8m21s
[23:39:00.090] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:81:0)
[23:39:00.223] Build status: STARTED
[23:39:00.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:82:0) after 6m26s
[23:45:26.245] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:82:0)
[23:45:26.270] Build status: STARTED
[23:45:26.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:83:0) after 3m12s
[23:48:38.310] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:83:0)
[23:48:38.349] Build status: STARTED
[23:48:38.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:84:0) after 2m41s
[23:51:19.371] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:84:0)
[23:51:19.398] Build status: STARTED
[23:51:19.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:85:0) after 7m40s
[23:58:59.441] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:85:0)
[23:58:59.463] Build status: STARTED
[23:58:59.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:86:0) after 7m1s
[00:06:00.591] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:86:0)
[00:06:00.609] Build status: STARTED
[00:06:00.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:87:0) after 1m6s
[00:07:06.694] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:87:0)
[00:07:06.773] Build status: STARTED
[00:07:06.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:88:0) after 8m17s
[00:15:23.793] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:88:0)
[00:15:23.807] Build status: STARTED
[00:15:23.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:89:0) after 5m23s
[00:20:46.858] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:89:0)
[00:20:46.879] Build status: STARTED
[00:20:46.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:90:0) after 1m13s
[00:21:59.893] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:90:0)
[00:21:59.943] Build status: STARTED
[00:21:59.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:91:0) after 3m11s
[00:25:10.963] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:91:0)
[00:25:11.016] Build status: STARTED
[00:25:11.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:92:0) after 6m23s
[00:31:34.115] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:92:0)
[00:31:34.134] Build status: STARTED
[00:31:34.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:93:0) after 9m17s
[00:40:51.219] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:93:0)
[00:40:51.259] Build status: STARTED
[00:40:51.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:94:0) after 1m21s
[00:42:12.269] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:94:0)
[00:42:12.289] Build status: STARTED
[00:42:12.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:95:0) after 9m23s
[00:51:35.318] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:95:0)
[00:51:35.338] Build status: STARTED
[00:51:35.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:96:0) after 4m50s
[00:56:25.383] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:96:0)
[00:56:25.409] Build status: STARTED
[00:56:25.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:97:0) after 1m13s
[00:57:38.427] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:97:0)
[00:57:38.460] Build status: STARTED
[00:57:38.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:98:0) after 3m24s
[01:01:02.479] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:98:0)
[01:01:02.504] Build status: STARTED
[01:01:02.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:99:0) after 7m49s
[01:08:51.544] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:99:0)
[01:08:51.569] Build status: STARTED
[01:08:51.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:100:0) after 6m34s
[01:15:25.587] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:100:0)
[01:15:25.612] Build status: STARTED
[01:15:25.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:101:0) after 1m44s
[01:17:09.674] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:101:0)
[01:17:09.701] Build status: STARTED
[01:17:09.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:102:0) after 3m39s
[01:20:48.921] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:102:0)
[01:20:49.221] Build status: STARTED
[01:20:49.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:103:0) after 1m29s
[01:22:18.241] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:103:0)
[01:22:18.278] Build status: STARTED
[01:22:18.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:104:0) after 5m12s
[01:27:30.459] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:104:0)
[01:27:30.478] Build status: STARTED
[01:27:30.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:105:0) after 1m16s
[01:28:46.512] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:105:0)
[01:28:46.590] Build status: STARTED
[01:28:46.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:106:0) after 2m19s
[01:31:05.711] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:106:0)
[01:31:05.731] Build status: STARTED
[01:31:05.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:107:0) after 8m40s
[01:39:45.799] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:107:0)
[01:39:45.821] Build status: STARTED
[01:39:45.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:108:0) after 4m3s
[01:43:48.956] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:108:0)
[01:43:48.976] Build status: STARTED
[01:43:48.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:109:0) after 6m20s
[01:50:08.995] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:109:0)
[01:50:09.019] Build status: STARTED
[01:50:09.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:110:0) after 7m51s
[01:58:00.043] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:110:0)
[01:58:00.060] Build status: STARTED
[01:58:00.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:111:0) after 1m31s
[01:59:31.102] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:111:0)
[01:59:31.127] Build status: STARTED
[01:59:31.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:112:0) after 2m43s
[02:02:14.257] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:112:0)
[02:02:14.316] Build status: STARTED
[02:02:14.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:113:0) after 3m17s
[02:05:31.391] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:113:0)
[02:05:31.416] Build status: STARTED
[02:05:31.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:114:0) after 9m27s
[02:14:58.823] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:114:0)
[02:14:58.853] Build status: STARTED
[02:14:58.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:115:0) after 5m15s
[02:20:13.875] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:115:0)
[02:20:13.894] Build status: STARTED
[02:20:13.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:116:0) after 1m54s
[02:22:08.023] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:116:0)
[02:22:08.039] Build status: STARTED
[02:22:08.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:117:0) after 3m40s
[02:25:48.175] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:117:0)
[02:25:48.195] Build status: STARTED
[02:25:48.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:118:0) after 2m13s
[02:28:01.180] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:118:0)
[02:28:01.199] Build status: STARTED
[02:28:01.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:119:0) after 9m23s
[02:37:24.306] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:119:0)
[02:37:24.363] Build status: STARTED
[02:37:24.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:120:0) after 7m4s
[02:44:28.394] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:120:0)
[02:44:28.480] Build status: STARTED
[02:44:28.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:121:0) after 1m11s
[02:45:39.548] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:121:0)
[02:45:39.582] Build status: STARTED
[02:45:39.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:122:0) after 1m45s
[02:47:24.649] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:122:0)
[02:47:24.674] Build status: STARTED
[02:47:24.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:123:0) after 7m27s
[02:54:51.705] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:123:0)
[02:54:51.726] Build status: STARTED
[02:54:51.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:124:0) after 5m11s
[03:00:02.804] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:124:0)
[03:00:02.939] Build status: STARTED
[03:00:02.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:125:0) after 8m50s
[03:08:52.961] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:125:0)
[03:08:53.058] Build status: STARTED
[03:08:53.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:126:0) after 1m5s
[03:09:58.076] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:126:0)
[03:09:58.118] Build status: STARTED
[03:09:58.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:127:0) after 2m22s
[03:12:20.163] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:127:0)
[03:12:20.215] Build status: STARTED
[03:12:20.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:128:0) after 7m24s
[03:19:44.274] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:128:0)
[03:19:44.298] Build status: STARTED
[03:19:44.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:129:0) after 6m21s
[03:26:05.405] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:129:0)
[03:26:05.424] Build status: STARTED
[03:26:05.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:130:0) after 8m0s
[03:34:05.459] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:130:0)
[03:34:05.477] Build status: STARTED
[03:34:05.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:131:0) after 8m27s
[03:42:32.508] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:131:0)
[03:42:32.531] Build status: STARTED
[03:42:32.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:132:0) after 6m57s
[03:49:29.693] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:132:0)
[03:49:29.728] Build status: STARTED
[03:49:29.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:133:0) after 2m7s
[03:51:36.761] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:133:0)
[03:51:36.787] Build status: STARTED
[03:51:36.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:134:0) after 7m46s
[03:59:22.865] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:134:0)
[03:59:23.045] Build status: STARTED
[03:59:23.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:135:0) after 2m52s
[04:02:15.092] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:135:0)
[04:02:15.110] Build status: STARTED
[04:02:15.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:136:0) after 5m5s
[04:07:20.238] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:136:0)
[04:07:20.263] Build status: STARTED
[04:07:20.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:137:0) after 3m28s
[04:10:48.281] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:137:0)
[04:10:48.375] Build status: STARTED
[04:10:48.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:138:0) after 4m19s
[04:15:07.446] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:138:0)
[04:15:07.477] Build status: STARTED
[04:15:07.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:139:0) after 8m48s
[04:23:55.501] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:139:0)
[04:23:55.539] Build status: STARTED
[04:23:55.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:140:0) after 8m14s
[04:32:09.678] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:140:0)
[04:32:09.697] Build status: STARTED
[04:32:09.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:141:0) after 2m24s
[04:34:33.693] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:141:0)
[04:34:33.716] Build status: STARTED
[04:34:33.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:142:0) after 9m45s
[04:44:18.734] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:142:0)
[04:44:18.752] Build status: STARTED
[04:44:18.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:143:0) after 4m4s
[04:48:22.825] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:143:0)
[04:48:22.888] Build status: STARTED
[04:48:22.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:144:0) after 6m37s
[04:55:00.009] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:144:0)
[04:55:00.060] Build status: STARTED
[04:55:00.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8833835236154950720:145:0) after 9m45s
[05:03:06.358] Received PubSub notification, asking Buildbucket for the build status
[05:03:06.397] Build:
{
"id": "8668405174268144417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"number": 14720,
"createdBy": "project:chromium",
"createTime": "2026-10-09T16:00:43.305554829Z",
"startTime": "2026-10-09T16:02:04.130534589Z",
"endTime": "2026-10-10T05:03:00.126218556Z",
"updateTime": "2026-10-10T05:03:00.126218556Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fe1880412c1c9343d4d02721c95064d00249e5ea",
"ref": "refs/heads/main"
}
}
}
[05:03:06.397] Invocation finished in 13h2m24.275560971s with status FAILED