[18:35:59.425] New invocation is queued and will start shortly
[18:36:00.518] Starting the invocation (attempt 1)
[18:36:00.567] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1434102aea38dee015172af2180b8ded454dc6f2"
[18:36:00.567] Popped gitiles commit info from properties and tags
[18:36:00.567] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:36:00.567] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:36:00.567] Buildbucket request:
{
"requestId": "8851854262573670736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1434102aea38dee015172af2180b8ded454dc6f2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851854262573670736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:36:01.191] Scheduled build:
{
"id": "8686424200659579793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"number": 12620,
"createdBy": "project:chromium",
"createTime": "2026-03-24T18:36:00.629830890Z",
"updateTime": "2026-03-24T18:36:00.629830890Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1434102aea38dee015172af2180b8ded454dc6f2",
"ref": "refs/heads/main"
}
}
}
[18:36:01.191] Task URL: https://cr-buildbucket.appspot.com/build/8686424200659579793
[18:36:01.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:2:0) after 6m40s
[18:36:02.147] Received PubSub notification, asking Buildbucket for the build status
[18:36:02.465] Build status: SCHEDULED
[18:36:06.587] Received PubSub notification, asking Buildbucket for the build status
[18:36:06.608] Build status: STARTED
[18:42:41.170] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:2:0)
[18:42:41.233] Build status: STARTED
[18:42:41.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:5:0) after 3m20s
[18:46:01.359] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:5:0)
[18:46:01.432] Build status: STARTED
[18:46:01.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:6:0) after 1m59s
[18:48:00.570] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:6:0)
[18:48:00.590] Build status: STARTED
[18:48:00.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:7:0) after 8m18s
[18:56:18.615] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:7:0)
[18:56:18.642] Build status: STARTED
[18:56:18.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:8:0) after 4m43s
[19:01:01.702] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:8:0)
[19:01:01.721] Build status: STARTED
[19:01:01.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:9:0) after 7m27s
[19:08:28.813] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:9:0)
[19:08:28.837] Build status: STARTED
[19:08:28.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:10:0) after 1m29s
[19:09:58.024] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:10:0)
[19:09:58.041] Build status: STARTED
[19:09:58.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:11:0) after 3m36s
[19:13:34.118] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:11:0)
[19:13:34.137] Build status: STARTED
[19:13:34.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:12:0) after 7m19s
[19:20:53.273] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:12:0)
[19:20:53.293] Build status: STARTED
[19:20:53.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:13:0) after 3m8s
[19:24:01.460] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:13:0)
[19:24:01.474] Build status: STARTED
[19:24:01.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:14:0) after 4m50s
[19:28:51.485] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:14:0)
[19:28:51.515] Build status: STARTED
[19:28:51.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:15:0) after 3m14s
[19:32:05.655] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:15:0)
[19:32:05.670] Build status: STARTED
[19:32:05.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:16:0) after 7m0s
[19:39:05.898] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:16:0)
[19:39:05.933] Build status: STARTED
[19:39:05.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:17:0) after 1m50s
[19:40:56.010] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:17:0)
[19:40:56.058] Build status: STARTED
[19:40:56.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:18:0) after 6m40s
[19:47:36.133] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:18:0)
[19:47:36.159] Build status: STARTED
[19:47:36.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:19:0) after 2m47s
[19:50:23.189] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:19:0)
[19:50:23.274] Build status: STARTED
[19:50:23.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:20:0) after 7m9s
[19:57:32.296] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:20:0)
[19:57:32.326] Build status: STARTED
[19:57:32.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:21:0) after 8m24s
[20:05:56.406] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:21:0)
[20:05:56.422] Build status: STARTED
[20:05:56.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:22:0) after 3m48s
[20:09:44.583] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:22:0)
[20:09:44.602] Build status: STARTED
[20:09:44.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:23:0) after 4m48s
[20:14:32.626] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:23:0)
[20:14:32.720] Build status: STARTED
[20:14:32.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:24:0) after 2m42s
[20:17:14.742] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:24:0)
[20:17:14.770] Build status: STARTED
[20:17:14.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:25:0) after 9m35s
[20:26:49.806] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:25:0)
[20:26:49.840] Build status: STARTED
[20:26:49.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:26:0) after 6m27s
[20:33:16.908] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:26:0)
[20:33:16.930] Build status: STARTED
[20:33:16.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:27:0) after 9m34s
[20:42:51.018] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:27:0)
[20:42:51.047] Build status: STARTED
[20:42:51.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:28:0) after 2m1s
[20:44:52.169] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:28:0)
[20:44:52.186] Build status: STARTED
[20:44:52.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:29:0) after 8m48s
[20:53:40.173] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:29:0)
[20:53:40.205] Build status: STARTED
[20:53:40.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:30:0) after 3m49s
[20:57:29.252] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:30:0)
[20:57:29.274] Build status: STARTED
[20:57:29.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:31:0) after 2m5s
[20:59:34.498] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:31:0)
[20:59:34.517] Build status: STARTED
[20:59:34.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:32:0) after 6m18s
[21:05:52.548] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:32:0)
[21:05:52.571] Build status: STARTED
[21:05:52.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:33:0) after 7m13s
[21:13:05.699] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:33:0)
[21:13:05.734] Build status: STARTED
[21:13:05.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:34:0) after 8m5s
[21:21:10.789] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:34:0)
[21:21:10.806] Build status: STARTED
[21:21:10.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:35:0) after 5m19s
[21:26:29.828] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:35:0)
[21:26:29.850] Build status: STARTED
[21:26:29.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:36:0) after 9m31s
[21:36:00.925] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:36:0)
[21:36:00.941] Build status: STARTED
[21:36:00.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:37:0) after 1m11s
[21:37:11.975] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:37:0)
[21:37:12.004] Build status: STARTED
[21:37:12.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:38:0) after 7m1s
[21:44:13.218] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:38:0)
[21:44:13.251] Build status: STARTED
[21:44:13.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:39:0) after 4m18s
[21:48:31.311] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:39:0)
[21:48:31.327] Build status: STARTED
[21:48:31.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:40:0) after 9m39s
[21:58:10.370] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:40:0)
[21:58:10.413] Build status: STARTED
[21:58:10.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:41:0) after 7m25s
[22:05:35.450] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:41:0)
[22:05:35.467] Build status: STARTED
[22:05:35.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:42:0) after 6m52s
[22:12:27.540] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:42:0)
[22:12:27.564] Build status: STARTED
[22:12:27.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:43:0) after 8m50s
[22:21:17.611] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:43:0)
[22:21:17.629] Build status: STARTED
[22:21:17.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:44:0) after 9m50s
[22:31:07.730] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:44:0)
[22:31:07.792] Build status: STARTED
[22:31:07.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:45:0) after 3m51s
[22:34:58.933] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:45:0)
[22:34:58.948] Build status: STARTED
[22:34:58.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:46:0) after 4m29s
[22:39:27.980] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:46:0)
[22:39:27.996] Build status: STARTED
[22:39:27.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:47:0) after 9m23s
[22:48:51.076] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:47:0)
[22:48:51.091] Build status: STARTED
[22:48:51.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:48:0) after 8m18s
[22:57:09.113] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:48:0)
[22:57:09.136] Build status: STARTED
[22:57:09.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:49:0) after 8m42s
[23:05:51.132] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:49:0)
[23:05:51.161] Build status: STARTED
[23:05:51.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:50:0) after 8m14s
[23:14:05.191] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:50:0)
[23:14:05.253] Build status: STARTED
[23:14:05.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:51:0) after 4m37s
[23:18:42.333] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:51:0)
[23:18:42.355] Build status: STARTED
[23:18:42.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:52:0) after 6m11s
[23:24:53.383] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:52:0)
[23:24:53.409] Build status: STARTED
[23:24:53.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:53:0) after 9m40s
[23:34:33.431] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:53:0)
[23:34:33.447] Build status: STARTED
[23:34:33.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:54:0) after 7m43s
[23:42:16.529] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:54:0)
[23:42:16.900] Build status: STARTED
[23:42:16.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:55:0) after 4m56s
[23:47:13.010] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:55:0)
[23:47:13.032] Build status: STARTED
[23:47:13.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:56:0) after 1m28s
[23:48:41.053] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:56:0)
[23:48:41.067] Build status: STARTED
[23:48:41.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:57:0) after 5m8s
[23:53:49.090] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:57:0)
[23:53:49.111] Build status: STARTED
[23:53:49.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:58:0) after 4m48s
[23:58:37.138] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:58:0)
[23:58:37.168] Build status: STARTED
[23:58:37.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:59:0) after 5m21s
[00:03:58.288] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:59:0)
[00:03:58.305] Build status: STARTED
[00:03:58.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:60:0) after 4m39s
[00:08:37.375] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:60:0)
[00:08:37.395] Build status: STARTED
[00:08:37.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:61:0) after 7m23s
[00:16:00.462] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:61:0)
[00:16:00.479] Build status: STARTED
[00:16:00.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:62:0) after 6m34s
[00:22:34.532] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:62:0)
[00:22:34.552] Build status: STARTED
[00:22:34.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:63:0) after 8m13s
[00:30:47.649] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:63:0)
[00:30:47.669] Build status: STARTED
[00:30:47.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:64:0) after 2m14s
[00:33:01.778] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:64:0)
[00:33:01.822] Build status: STARTED
[00:33:01.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:65:0) after 8m44s
[00:41:45.851] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:65:0)
[00:41:45.872] Build status: STARTED
[00:41:45.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:66:0) after 7m29s
[00:49:14.894] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:66:0)
[00:49:14.913] Build status: STARTED
[00:49:14.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:67:0) after 4m28s
[00:53:42.995] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:67:0)
[00:53:43.015] Build status: STARTED
[00:53:43.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:68:0) after 7m0s
[01:00:43.044] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:68:0)
[01:00:43.137] Build status: STARTED
[01:00:43.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:69:0) after 7m15s
[01:07:58.158] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:69:0)
[01:07:58.175] Build status: STARTED
[01:07:58.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:70:0) after 5m24s
[01:13:22.553] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:70:0)
[01:13:22.609] Build status: STARTED
[01:13:22.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:71:0) after 8m21s
[01:21:43.646] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:71:0)
[01:21:43.664] Build status: STARTED
[01:21:43.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:72:0) after 8m52s
[01:30:35.784] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:72:0)
[01:30:35.801] Build status: STARTED
[01:30:35.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8851854262573670736:73:0) after 7m43s
[01:30:57.602] Received PubSub notification, asking Buildbucket for the build status
[01:30:57.629] Build:
{
"id": "8686424200659579793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"number": 12620,
"createdBy": "project:chromium",
"createTime": "2026-03-24T18:36:00.629830890Z",
"startTime": "2026-03-24T18:36:06.419724874Z",
"endTime": "2026-03-25T01:30:57.010337643Z",
"updateTime": "2026-03-25T01:30:57.010337643Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1434102aea38dee015172af2180b8ded454dc6f2",
"ref": "refs/heads/main"
}
}
}
[01:30:57.629] Invocation finished in 6h54m58.2093538s with status FAILED