[07:52:14.985] New invocation is queued and will start shortly
[07:52:16.056] Starting the invocation (attempt 1)
[07:52:16.086] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9243b15e24d37b5e0286b097c31646e0568636ea"
[07:52:16.086] Popped gitiles commit info from properties and tags
[07:52:16.086] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:52:16.086] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:52:16.086] Buildbucket request:
{
"requestId": "8915040848816462448",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9243b15e24d37b5e0286b097c31646e0568636ea",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8915040848816462448"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:52:16.637] Scheduled build:
{
"id": "8749610786943201089",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 2132,
"createdBy": "project:chromium",
"createTime": "2024-04-26T07:52:16.149167962Z",
"updateTime": "2024-04-26T07:52:16.149167962Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9243b15e24d37b5e0286b097c31646e0568636ea",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:52:16.637] Task URL: https://cr-buildbucket.appspot.com/build/8749610786943201089
[07:52:16.637] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:2:0) after 7m46s
[07:52:17.560] Received PubSub notification, asking Buildbucket for the build status
[07:52:17.585] Build status: SCHEDULED
[08:00:02.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:2:0)
[08:00:02.785] Build status: SCHEDULED
[08:00:02.785] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:4:0) after 7m23s
[08:07:25.813] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:4:0)
[08:07:25.849] Build status: SCHEDULED
[08:07:25.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:5:0) after 7m32s
[08:14:57.873] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:5:0)
[08:14:57.898] Build status: SCHEDULED
[08:14:57.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:6:0) after 2m18s
[08:17:15.918] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:6:0)
[08:17:15.939] Build status: SCHEDULED
[08:17:15.939] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:7:0) after 4m7s
[08:21:23.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:7:0)
[08:21:23.284] Build status: SCHEDULED
[08:21:23.284] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:8:0) after 8m59s
[08:30:22.488] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:8:0)
[08:30:22.529] Build status: SCHEDULED
[08:30:22.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:9:0) after 8m58s
[08:39:20.803] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:9:0)
[08:39:20.825] Build status: STARTED
[08:39:20.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:10:0) after 6m26s
[08:39:58.356] Received PubSub notification, asking Buildbucket for the build status
[08:39:58.390] Build status: STARTED
[08:45:46.900] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:10:0)
[08:45:46.923] Build status: STARTED
[08:45:46.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:12:0) after 6m38s
[08:52:25.003] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:12:0)
[08:52:25.102] Build status: STARTED
[08:52:25.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:13:0) after 4m6s
[08:56:31.502] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:13:0)
[08:56:31.564] Build status: STARTED
[08:56:31.564] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:14:0) after 7m53s
[09:04:24.588] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:14:0)
[09:04:24.625] Build status: STARTED
[09:04:24.625] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:15:0) after 7m10s
[09:11:34.658] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:15:0)
[09:11:34.688] Build status: STARTED
[09:11:34.688] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:16:0) after 6m19s
[09:17:54.045] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:16:0)
[09:17:54.186] Build status: STARTED
[09:17:54.186] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:17:0) after 9m9s
[09:27:03.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:17:0)
[09:27:03.556] Build status: STARTED
[09:27:03.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:18:0) after 9m56s
[09:36:59.586] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:18:0)
[09:36:59.623] Build status: STARTED
[09:36:59.623] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:19:0) after 4m59s
[09:41:59.082] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:19:0)
[09:41:59.112] Build status: STARTED
[09:41:59.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:20:0) after 6m8s
[09:48:07.186] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:20:0)
[09:48:07.203] Build status: STARTED
[09:48:07.203] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:21:0) after 7m51s
[09:55:58.253] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:21:0)
[09:55:58.339] Build status: STARTED
[09:55:58.339] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:22:0) after 7m13s
[10:03:11.468] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:22:0)
[10:03:11.603] Build status: STARTED
[10:03:11.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:23:0) after 6m20s
[10:09:31.630] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:23:0)
[10:09:31.651] Build status: STARTED
[10:09:31.651] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:24:0) after 2m48s
[10:12:20.233] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:24:0)
[10:12:20.282] Build status: STARTED
[10:12:20.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:25:0) after 7m18s
[10:19:38.381] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:25:0)
[10:19:38.427] Build status: STARTED
[10:19:38.427] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:26:0) after 7m0s
[10:26:38.659] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:26:0)
[10:26:38.683] Build status: STARTED
[10:26:38.683] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:27:0) after 3m38s
[10:30:16.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:27:0)
[10:30:16.842] Build status: STARTED
[10:30:16.842] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:28:0) after 1m23s
[10:31:40.236] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:28:0)
[10:31:40.289] Build status: STARTED
[10:31:40.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:29:0) after 3m44s
[10:35:24.529] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:29:0)
[10:35:24.555] Build status: STARTED
[10:35:24.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:30:0) after 6m32s
[10:41:56.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:30:0)
[10:41:56.987] Build status: STARTED
[10:41:56.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:31:0) after 3m17s
[10:45:14.122] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:31:0)
[10:45:14.154] Build status: STARTED
[10:45:14.154] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:32:0) after 3m44s
[10:48:58.612] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:32:0)
[10:48:58.633] Build status: STARTED
[10:48:58.633] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:33:0) after 4m37s
[10:53:35.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:33:0)
[10:53:35.940] Build status: STARTED
[10:53:35.940] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:34:0) after 8m46s
[11:02:21.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:34:0)
[11:02:21.989] Build status: STARTED
[11:02:21.989] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:35:0) after 8m44s
[11:11:06.017] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:35:0)
[11:11:06.049] Build status: STARTED
[11:11:06.049] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:36:0) after 5m10s
[11:16:16.157] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:36:0)
[11:16:16.254] Build status: STARTED
[11:16:16.254] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:37:0) after 6m19s
[11:22:35.404] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:37:0)
[11:22:35.464] Build status: STARTED
[11:22:35.464] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:38:0) after 2m49s
[11:25:24.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:38:0)
[11:25:24.570] Build status: STARTED
[11:25:24.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:39:0) after 8m56s
[11:34:20.896] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:39:0)
[11:34:20.914] Build status: STARTED
[11:34:20.914] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:40:0) after 9m37s
[11:43:57.939] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:40:0)
[11:43:57.972] Build status: STARTED
[11:43:57.972] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:41:0) after 6m19s
[11:50:16.990] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:41:0)
[11:50:17.025] Build status: STARTED
[11:50:17.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:42:0) after 3m1s
[11:53:18.229] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:42:0)
[11:53:18.317] Build status: STARTED
[11:53:18.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:43:0) after 6m4s
[11:59:22.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:43:0)
[11:59:22.381] Build status: STARTED
[11:59:22.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:44:0) after 6m45s
[12:06:07.463] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:44:0)
[12:06:07.488] Build status: STARTED
[12:06:07.488] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:45:0) after 4m24s
[12:10:31.521] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:45:0)
[12:10:31.547] Build status: STARTED
[12:10:31.547] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:46:0) after 2m12s
[12:12:43.605] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:46:0)
[12:12:43.627] Build status: STARTED
[12:12:43.627] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:47:0) after 2m20s
[12:15:03.674] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:47:0)
[12:15:03.701] Build status: STARTED
[12:15:03.701] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:48:0) after 1m49s
[12:16:52.733] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:48:0)
[12:16:52.795] Build status: STARTED
[12:16:52.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8915040848816462448:49:0) after 9m39s
[12:26:14.967] Received PubSub notification, asking Buildbucket for the build status
[12:26:14.991] Build:
{
"id": "8749610786943201089",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 2132,
"createdBy": "project:chromium",
"createTime": "2024-04-26T07:52:16.149167962Z",
"startTime": "2024-04-26T08:38:45.737600014Z",
"endTime": "2024-04-26T12:26:14.290478301Z",
"updateTime": "2024-04-26T12:26:14.290478301Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9243b15e24d37b5e0286b097c31646e0568636ea",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:26:14.991] Invocation finished in 4h34m0.012642135s with status FAILED