[22:36:00.566] New invocation is queued and will start shortly
[22:36:01.927] Starting the invocation (attempt 1)
[22:36:01.956] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c95f9955b82e96f877826e34d0243931548e4540"
[22:36:01.956] Popped gitiles commit info from properties and tags
[22:36:01.956] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:36:01.957] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:36:01.957] Buildbucket request:
{
"requestId": "8889618096881215456",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c95f9955b82e96f877826e34d0243931548e4540",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8889618096881215456"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:36:02.710] Scheduled build:
{
"id": "8724188034703953425",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9278,
"createdBy": "project:chromium",
"createTime": "2025-01-31T22:36:02.012690157Z",
"updateTime": "2025-01-31T22:36:02.012690157Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c95f9955b82e96f877826e34d0243931548e4540",
"ref": "refs/heads/main"
}
}
}
[22:36:02.710] Task URL: https://cr-buildbucket.appspot.com/build/8724188034703953425
[22:36:02.710] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:2:0) after 4m6s
[22:36:03.618] Received PubSub notification, asking Buildbucket for the build status
[22:36:03.642] Build status: SCHEDULED
[22:38:03.749] Received PubSub notification, asking Buildbucket for the build status
[22:38:03.779] Build status: STARTED
[22:40:08.858] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:2:0)
[22:40:08.893] Build status: STARTED
[22:40:08.894] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:5:0) after 2m4s
[22:42:12.914] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:5:0)
[22:42:12.933] Build status: STARTED
[22:42:12.933] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:6:0) after 5m45s
[22:47:57.960] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:6:0)
[22:47:58.005] Build status: STARTED
[22:47:58.005] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:7:0) after 2m9s
[22:50:07.029] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:7:0)
[22:50:07.056] Build status: STARTED
[22:50:07.056] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:8:0) after 7m24s
[22:57:31.082] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:8:0)
[22:57:31.102] Build status: STARTED
[22:57:31.102] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:9:0) after 5m18s
[23:02:49.098] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:9:0)
[23:02:49.121] Build status: STARTED
[23:02:49.121] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:10:0) after 1m21s
[23:04:10.112] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:10:0)
[23:04:10.160] Build status: STARTED
[23:04:10.160] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:11:0) after 5m21s
[23:09:31.220] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:11:0)
[23:09:31.244] Build status: STARTED
[23:09:31.244] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:12:0) after 5m30s
[23:15:01.282] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:12:0)
[23:15:01.316] Build status: STARTED
[23:15:01.316] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:13:0) after 1m7s
[23:16:08.338] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:13:0)
[23:16:08.375] Build status: STARTED
[23:16:08.375] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:14:0) after 8m57s
[23:25:05.405] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:14:0)
[23:25:05.432] Build status: STARTED
[23:25:05.432] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:15:0) after 9m57s
[23:35:02.467] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:15:0)
[23:35:02.486] Build status: STARTED
[23:35:02.486] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:16:0) after 7m11s
[23:42:13.561] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:16:0)
[23:42:13.575] Build status: STARTED
[23:42:13.575] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:17:0) after 8m27s
[23:50:40.629] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:17:0)
[23:50:40.648] Build status: STARTED
[23:50:40.648] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:18:0) after 4m17s
[23:54:57.725] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:18:0)
[23:54:57.747] Build status: STARTED
[23:54:57.747] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:19:0) after 6m56s
[00:01:53.819] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:19:0)
[00:01:53.835] Build status: STARTED
[00:01:53.836] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:20:0) after 1m2s
[00:02:55.859] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:20:0)
[00:02:55.878] Build status: STARTED
[00:02:55.878] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:21:0) after 7m14s
[00:10:09.917] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:21:0)
[00:10:10.018] Build status: STARTED
[00:10:10.018] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:22:0) after 3m1s
[00:13:11.080] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:22:0)
[00:13:11.097] Build status: STARTED
[00:13:11.097] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:23:0) after 4m19s
[00:17:30.131] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:23:0)
[00:17:30.148] Build status: STARTED
[00:17:30.148] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:24:0) after 3m16s
[00:20:46.127] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:24:0)
[00:20:46.161] Build status: STARTED
[00:20:46.161] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:25:0) after 7m51s
[00:28:37.183] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:25:0)
[00:28:37.200] Build status: STARTED
[00:28:37.200] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:26:0) after 4m20s
[00:32:57.339] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:26:0)
[00:32:57.357] Build status: STARTED
[00:32:57.357] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:27:0) after 2m47s
[00:35:44.436] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:27:0)
[00:35:44.454] Build status: STARTED
[00:35:44.454] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:28:0) after 5m44s
[00:41:28.481] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:28:0)
[00:41:28.502] Build status: STARTED
[00:41:28.502] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:29:0) after 7m46s
[00:49:14.535] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:29:0)
[00:49:14.550] Build status: STARTED
[00:49:14.551] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:30:0) after 7m58s
[00:57:12.759] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:30:0)
[00:57:12.775] Build status: STARTED
[00:57:12.775] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:31:0) after 2m32s
[00:59:44.804] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:31:0)
[00:59:44.837] Build status: STARTED
[00:59:44.837] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:32:0) after 1m13s
[01:00:57.930] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:32:0)
[01:00:57.964] Build status: STARTED
[01:00:57.964] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:33:0) after 5m8s
[01:06:05.961] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:33:0)
[01:06:06.011] Build status: STARTED
[01:06:06.011] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:34:0) after 1m38s
[01:07:44.118] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:34:0)
[01:07:44.138] Build status: STARTED
[01:07:44.138] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:35:0) after 5m59s
[01:13:43.240] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:35:0)
[01:13:43.305] Build status: STARTED
[01:13:43.305] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:36:0) after 1m53s
[01:15:36.335] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:36:0)
[01:15:36.358] Build status: STARTED
[01:15:36.358] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:37:0) after 6m41s
[01:22:17.429] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:37:0)
[01:22:17.462] Build status: STARTED
[01:22:17.462] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:38:0) after 6m1s
[01:28:18.492] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:38:0)
[01:28:18.508] Build status: STARTED
[01:28:18.508] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:39:0) after 2m6s
[01:30:24.537] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:39:0)
[01:30:24.554] Build status: STARTED
[01:30:24.554] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:40:0) after 3m15s
[01:33:39.612] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:40:0)
[01:33:39.645] Build status: STARTED
[01:33:39.645] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:41:0) after 4m27s
[01:38:06.650] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:41:0)
[01:38:06.673] Build status: STARTED
[01:38:06.673] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:42:0) after 8m1s
[01:46:07.750] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:42:0)
[01:46:07.769] Build status: STARTED
[01:46:07.769] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:43:0) after 7m15s
[01:53:22.806] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:43:0)
[01:53:22.829] Build status: STARTED
[01:53:22.829] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:44:0) after 5m19s
[01:58:41.894] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:44:0)
[01:58:41.911] Build status: STARTED
[01:58:41.911] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:45:0) after 2m16s
[02:00:58.005] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:45:0)
[02:00:58.037] Build status: STARTED
[02:00:58.037] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:46:0) after 5m30s
[02:06:28.067] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:46:0)
[02:06:28.098] Build status: STARTED
[02:06:28.098] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:47:0) after 8m55s
[02:15:23.120] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:47:0)
[02:15:23.142] Build status: STARTED
[02:15:23.142] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:48:0) after 8m17s
[02:23:40.345] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:48:0)
[02:23:40.413] Build status: STARTED
[02:23:40.413] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:49:0) after 9m58s
[02:33:38.443] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:49:0)
[02:33:38.477] Build status: STARTED
[02:33:38.477] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:50:0) after 9m38s
[02:43:16.548] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:50:0)
[02:43:16.588] Build status: STARTED
[02:43:16.588] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:51:0) after 2m28s
[02:45:44.604] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:51:0)
[02:45:44.629] Build status: STARTED
[02:45:44.629] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:52:0) after 1m54s
[02:47:38.695] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:52:0)
[02:47:38.721] Build status: STARTED
[02:47:38.721] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:53:0) after 6m26s
[02:54:05.062] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:53:0)
[02:54:05.094] Build status: STARTED
[02:54:05.094] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:54:0) after 4m49s
[02:58:54.277] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:54:0)
[02:58:54.295] Build status: STARTED
[02:58:54.295] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:55:0) after 6m20s
[03:05:14.329] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:55:0)
[03:05:14.402] Build status: STARTED
[03:05:14.402] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8889618096881215456:56:0) after 8m31s
[03:06:06.141] Received PubSub notification, asking Buildbucket for the build status
[03:06:06.203] Build:
{
"id": "8724188034703953425",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9278,
"createdBy": "project:chromium",
"createTime": "2025-01-31T22:36:02.012690157Z",
"startTime": "2025-01-31T22:37:48.738700201Z",
"endTime": "2025-02-01T03:06:05.842190948Z",
"updateTime": "2025-02-01T03:06:05.842190948Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c95f9955b82e96f877826e34d0243931548e4540",
"ref": "refs/heads/main"
}
}
}
[03:06:06.203] Invocation finished in 4h30m5.650986975s with status FAILED