[03:10:08.721] New invocation is queued and will start shortly
[03:10:09.841] Starting the invocation (attempt 1)
[03:10:09.874] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/27a0c304ca1005d2d4085884b2d01707dc91601c"
[03:10:09.874] Popped gitiles commit info from properties and tags
[03:10:09.874] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:10:09.874] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:10:09.874] Buildbucket request:
{
"requestId": "8886611149845913472",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "27a0c304ca1005d2d4085884b2d01707dc91601c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8886611149845913472"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:10:10.500] Scheduled build:
{
"id": "8721181087916409137",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9864,
"createdBy": "project:chromium",
"createTime": "2025-03-06T03:10:09.934999190Z",
"updateTime": "2025-03-06T03:10:09.934999190Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "27a0c304ca1005d2d4085884b2d01707dc91601c",
"ref": "refs/heads/main"
}
}
}
[03:10:10.500] Task URL: https://cr-buildbucket.appspot.com/build/8721181087916409137
[03:10:10.500] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:2:0) after 7m33s
[03:10:11.530] Received PubSub notification, asking Buildbucket for the build status
[03:10:11.548] Build status: SCHEDULED
[03:11:25.496] Received PubSub notification, asking Buildbucket for the build status
[03:11:25.564] Build status: STARTED
[03:17:43.518] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:2:0)
[03:17:43.553] Build status: STARTED
[03:17:43.553] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:5:0) after 1m24s
[03:19:07.572] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:5:0)
[03:19:07.603] Build status: STARTED
[03:19:07.603] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:6:0) after 9m21s
[03:28:28.727] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:6:0)
[03:28:28.747] Build status: STARTED
[03:28:28.747] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:7:0) after 6m41s
[03:35:09.781] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:7:0)
[03:35:11.782] Build status: STARTED
[03:35:11.782] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:8:0) after 8m48s
[03:43:59.803] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:8:0)
[03:43:59.829] Build status: STARTED
[03:43:59.829] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:9:0) after 7m58s
[03:51:57.916] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:9:0)
[03:51:57.970] Build status: STARTED
[03:51:57.971] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:10:0) after 4m19s
[03:56:17.040] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:10:0)
[03:56:17.065] Build status: STARTED
[03:56:17.065] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:11:0) after 2m29s
[03:58:46.192] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:11:0)
[03:58:46.211] Build status: STARTED
[03:58:46.211] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:12:0) after 1m53s
[04:00:39.231] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:12:0)
[04:00:39.257] Build status: STARTED
[04:00:39.257] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:13:0) after 2m0s
[04:02:39.292] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:13:0)
[04:02:39.355] Build status: STARTED
[04:02:39.355] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:14:0) after 6m24s
[04:09:03.375] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:14:0)
[04:09:03.401] Build status: STARTED
[04:09:03.401] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:15:0) after 1m39s
[04:10:42.537] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:15:0)
[04:10:42.562] Build status: STARTED
[04:10:42.562] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:16:0) after 4m29s
[04:15:11.591] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:16:0)
[04:15:11.614] Build status: STARTED
[04:15:11.614] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:17:0) after 6m38s
[04:21:49.769] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:17:0)
[04:21:49.790] Build status: STARTED
[04:21:49.790] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:18:0) after 6m54s
[04:28:43.838] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:18:0)
[04:28:43.861] Build status: STARTED
[04:28:43.861] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:19:0) after 4m33s
[04:33:17.121] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:19:0)
[04:33:17.146] Build status: STARTED
[04:33:17.146] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:20:0) after 1m25s
[04:34:42.816] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:20:0)
[04:34:42.841] Build status: STARTED
[04:34:42.841] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:21:0) after 1m31s
[04:36:13.972] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:21:0)
[04:36:14.005] Build status: STARTED
[04:36:14.005] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:22:0) after 7m1s
[04:43:15.024] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:22:0)
[04:43:15.092] Build status: STARTED
[04:43:15.092] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:23:0) after 5m13s
[04:48:28.116] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:23:0)
[04:48:28.156] Build status: STARTED
[04:48:28.157] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:24:0) after 6m17s
[04:54:45.193] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:24:0)
[04:54:45.212] Build status: STARTED
[04:54:45.213] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:25:0) after 7m53s
[05:02:38.786] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:25:0)
[05:02:38.805] Build status: STARTED
[05:02:38.806] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:26:0) after 2m48s
[05:05:27.110] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:26:0)
[05:05:27.129] Build status: STARTED
[05:05:27.129] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:27:0) after 6m10s
[05:11:37.182] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:27:0)
[05:11:37.226] Build status: STARTED
[05:11:37.226] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:28:0) after 9m18s
[05:20:55.249] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:28:0)
[05:20:55.266] Build status: STARTED
[05:20:55.267] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:29:0) after 4m56s
[05:25:51.298] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:29:0)
[05:25:51.317] Build status: STARTED
[05:25:51.317] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:30:0) after 4m25s
[05:30:16.349] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:30:0)
[05:30:16.827] Build status: STARTED
[05:30:16.827] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:31:0) after 6m40s
[05:36:56.913] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:31:0)
[05:36:56.928] Build status: STARTED
[05:36:56.928] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:32:0) after 8m34s
[05:45:30.919] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:32:0)
[05:45:30.939] Build status: STARTED
[05:45:30.939] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:33:0) after 6m30s
[05:52:00.931] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:33:0)
[05:52:00.999] Build status: STARTED
[05:52:00.999] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:34:0) after 5m39s
[05:57:40.016] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:34:0)
[05:57:40.036] Build status: STARTED
[05:57:40.036] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:35:0) after 7m21s
[06:05:01.066] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:35:0)
[06:05:01.088] Build status: STARTED
[06:05:01.088] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:36:0) after 3m5s
[06:08:06.152] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:36:0)
[06:08:06.167] Build status: STARTED
[06:08:06.167] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:37:0) after 5m37s
[06:13:43.283] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:37:0)
[06:13:43.303] Build status: STARTED
[06:13:43.303] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:38:0) after 8m13s
[06:21:56.453] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:38:0)
[06:21:56.494] Build status: STARTED
[06:21:56.494] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:39:0) after 8m10s
[06:30:06.509] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:39:0)
[06:30:06.533] Build status: STARTED
[06:30:06.533] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:40:0) after 7m36s
[06:37:42.878] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:40:0)
[06:37:42.908] Build status: STARTED
[06:37:42.908] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886611149845913472:41:0) after 8m11s
[06:44:54.593] Received PubSub notification, asking Buildbucket for the build status
[06:44:54.611] Build:
{
"id": "8721181087916409137",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9864,
"createdBy": "project:chromium",
"createTime": "2025-03-06T03:10:09.934999190Z",
"startTime": "2025-03-06T03:11:25.265777268Z",
"endTime": "2025-03-06T06:44:54.227412730Z",
"updateTime": "2025-03-06T06:44:54.227412730Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "27a0c304ca1005d2d4085884b2d01707dc91601c",
"ref": "refs/heads/main"
}
}
}
[06:44:54.611] Invocation finished in 3h34m45.900972756s with status FAILED