[21:14:28.097] New invocation is queued and will start shortly
[21:14:29.250] Starting the invocation (attempt 1)
[21:14:29.298] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1bac1ef4f61b8b7078ffcec4aef28ff16a613514"
[21:14:29.298] Popped gitiles commit info from properties and tags
[21:14:29.298] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:14:29.298] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:14:29.298] Buildbucket request:
{
"requestId": "8984115862966087488",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1bac1ef4f61b8b7078ffcec4aef28ff16a613514",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8984115862966087488"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:14:29.880] Scheduled build:
{
"id": "8818685800944847265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 2275,
"createdBy": "project:chromium",
"createTime": "2022-03-25T21:14:29.390132062Z",
"updateTime": "2022-03-25T21:14:29.390132062Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1bac1ef4f61b8b7078ffcec4aef28ff16a613514",
"ref": "refs/heads/main"
}
}
}
[21:14:29.880] Task URL: https://cr-buildbucket.appspot.com/build/8818685800944847265
[21:14:29.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:2:0) after 2m59s
[21:17:29.021] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:2:0)
[21:17:29.049] Build status: SCHEDULED
[21:17:29.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:3:0) after 7m58s
[21:25:27.130] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:3:0)
[21:25:27.151] Build status: SCHEDULED
[21:25:27.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:4:0) after 1m13s
[21:26:40.169] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:4:0)
[21:26:40.190] Build status: SCHEDULED
[21:26:40.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:5:0) after 1m12s
[21:27:52.213] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:5:0)
[21:27:52.231] Build status: SCHEDULED
[21:27:52.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:6:0) after 8m17s
[21:36:09.553] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:6:0)
[21:36:09.576] Build status: SCHEDULED
[21:36:09.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:7:0) after 9m8s
[21:45:17.785] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:7:0)
[21:45:17.805] Build status: SCHEDULED
[21:45:17.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:8:0) after 2m22s
[21:47:39.860] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:8:0)
[21:47:39.892] Build status: SCHEDULED
[21:47:39.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:9:0) after 5m12s
[21:51:11.743] Received PubSub notification, asking Buildbucket for the build status
[21:51:11.821] Build status: STARTED
[21:52:51.920] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:9:0)
[21:52:51.944] Build status: STARTED
[21:52:51.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:11:0) after 3m26s
[21:56:18.094] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:11:0)
[21:56:18.112] Build status: STARTED
[21:56:18.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:12:0) after 2m39s
[21:58:57.219] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:12:0)
[21:58:57.240] Build status: STARTED
[21:58:57.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:13:0) after 6m23s
[22:05:20.264] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:13:0)
[22:05:20.286] Build status: STARTED
[22:05:20.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:14:0) after 6m15s
[22:11:35.476] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:14:0)
[22:11:35.506] Build status: STARTED
[22:11:35.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:15:0) after 5m3s
[22:16:38.563] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:15:0)
[22:16:38.593] Build status: STARTED
[22:16:38.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:16:0) after 8m10s
[22:24:49.752] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:16:0)
[22:24:49.773] Build status: STARTED
[22:24:49.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:17:0) after 8m26s
[22:33:15.840] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:17:0)
[22:33:15.866] Build status: STARTED
[22:33:15.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:18:0) after 9m35s
[22:42:51.171] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:18:0)
[22:42:51.260] Build status: STARTED
[22:42:51.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:19:0) after 2m13s
[22:45:04.491] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:19:0)
[22:45:04.546] Build status: STARTED
[22:45:04.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:20:0) after 1m13s
[22:46:17.683] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:20:0)
[22:46:17.748] Build status: STARTED
[22:46:17.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:21:0) after 5m31s
[22:51:48.825] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:21:0)
[22:51:48.869] Build status: STARTED
[22:51:48.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:22:0) after 1m30s
[22:53:18.941] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:22:0)
[22:53:18.984] Build status: STARTED
[22:53:18.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:23:0) after 3m4s
[22:56:22.981] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:23:0)
[22:56:23.001] Build status: STARTED
[22:56:23.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:24:0) after 4m36s
[23:00:59.116] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:24:0)
[23:00:59.152] Build status: STARTED
[23:00:59.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:25:0) after 2m59s
[23:03:58.200] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:25:0)
[23:03:58.221] Build status: STARTED
[23:03:58.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:26:0) after 2m5s
[23:06:03.260] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:26:0)
[23:06:03.284] Build status: STARTED
[23:06:03.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:27:0) after 6m7s
[23:12:10.351] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:27:0)
[23:12:10.392] Build status: STARTED
[23:12:10.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:28:0) after 7m18s
[23:19:28.533] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:28:0)
[23:19:28.563] Build status: STARTED
[23:19:28.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:29:0) after 7m41s
[23:27:09.817] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:29:0)
[23:27:09.847] Build status: STARTED
[23:27:09.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:30:0) after 5m33s
[23:32:42.921] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:30:0)
[23:32:42.958] Build status: STARTED
[23:32:42.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:31:0) after 6m27s
[23:39:10.041] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:31:0)
[23:39:10.064] Build status: STARTED
[23:39:10.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:32:0) after 5m7s
[23:44:17.086] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:32:0)
[23:44:17.105] Build status: STARTED
[23:44:17.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:33:0) after 5m59s
[23:50:16.131] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:33:0)
[23:50:16.168] Build status: STARTED
[23:50:16.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:34:0) after 8m3s
[23:58:19.902] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:34:0)
[23:58:19.956] Build status: STARTED
[23:58:19.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:35:0) after 1m51s
[00:00:11.272] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:35:0)
[00:00:11.369] Build status: STARTED
[00:00:11.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:36:0) after 7m29s
[00:07:40.780] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:36:0)
[00:07:40.802] Build status: STARTED
[00:07:40.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:37:0) after 9m32s
[00:17:12.914] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:37:0)
[00:17:12.932] Build status: STARTED
[00:17:12.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:38:0) after 2m5s
[00:19:18.033] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:38:0)
[00:19:18.066] Build status: STARTED
[00:19:18.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:39:0) after 3m27s
[00:22:45.352] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:39:0)
[00:22:45.378] Build status: STARTED
[00:22:45.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:40:0) after 1m18s
[00:24:03.413] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:40:0)
[00:24:03.436] Build status: STARTED
[00:24:03.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:41:0) after 4m11s
[00:28:14.435] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:41:0)
[00:28:14.466] Build status: STARTED
[00:28:14.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:42:0) after 3m12s
[00:31:26.594] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:42:0)
[00:31:26.626] Build status: STARTED
[00:31:26.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:43:0) after 3m6s
[00:34:32.839] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:43:0)
[00:34:32.866] Build status: STARTED
[00:34:32.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:44:0) after 8m29s
[00:43:01.987] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:44:0)
[00:43:02.008] Build status: STARTED
[00:43:02.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:45:0) after 2m33s
[00:45:35.029] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:45:0)
[00:45:35.054] Build status: STARTED
[00:45:35.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:46:0) after 1m36s
[00:47:11.076] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:46:0)
[00:47:11.111] Build status: STARTED
[00:47:11.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:47:0) after 7m3s
[00:54:14.152] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:47:0)
[00:54:14.196] Build status: STARTED
[00:54:14.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:48:0) after 3m2s
[00:57:16.725] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:48:0)
[00:57:16.746] Build status: STARTED
[00:57:16.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:49:0) after 4m4s
[01:01:21.290] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:49:0)
[01:01:21.476] Build status: STARTED
[01:01:21.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:50:0) after 4m4s
[01:05:25.721] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:50:0)
[01:05:25.746] Build status: STARTED
[01:05:25.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:51:0) after 1m44s
[01:07:09.771] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:51:0)
[01:07:09.798] Build status: STARTED
[01:07:09.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:52:0) after 2m8s
[01:09:18.171] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:52:0)
[01:09:18.189] Build status: STARTED
[01:09:18.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:53:0) after 1m35s
[01:10:53.804] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:53:0)
[01:10:53.903] Build status: STARTED
[01:10:53.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8984115862966087488:54:0) after 8m13s
[01:11:37.498] Received PubSub notification, asking Buildbucket for the build status
[01:11:37.518] Build:
{
"id": "8818685800944847265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 2275,
"createdBy": "project:chromium",
"createTime": "2022-03-25T21:14:29.390132062Z",
"startTime": "2022-03-25T21:51:11.088788Z",
"endTime": "2022-03-26T01:11:37.163953492Z",
"updateTime": "2022-03-26T01:11:37.163953492Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1bac1ef4f61b8b7078ffcec4aef28ff16a613514",
"ref": "refs/heads/main"
}
}
}
[01:11:37.518] Invocation finished in 3h57m9.438940218s with status FAILED