[20:52:16.953] New invocation is queued and will start shortly
[20:52:18.084] Starting the invocation (attempt 1)
[20:52:18.120] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/31371895c3e138b20b2b6bb834f4c18025a745c4"
[20:52:18.120] Popped gitiles commit info from properties and tags
[20:52:18.120] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:52:18.120] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:52:18.120] Buildbucket request:
{
"requestId": "8979496813482373024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "31371895c3e138b20b2b6bb834f4c18025a745c4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8979496813482373024"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:52:18.707] Scheduled build:
{
"id": "8814066751510351313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 3883,
"createdBy": "project:chromium",
"createTime": "2022-05-15T20:52:18.202085671Z",
"updateTime": "2022-05-15T20:52:18.202085671Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "31371895c3e138b20b2b6bb834f4c18025a745c4",
"ref": "refs/heads/main"
}
}
}
[20:52:18.707] Task URL: https://cr-buildbucket.appspot.com/build/8814066751510351313
[20:52:18.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:2:0) after 1m12s
[20:53:30.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:2:0)
[20:53:30.742] Build status: SCHEDULED
[20:53:30.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:3:0) after 4m47s
[20:53:34.004] Received PubSub notification, asking Buildbucket for the build status
[20:53:34.054] Build status: STARTED
[20:58:17.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:3:0)
[20:58:17.967] Build status: STARTED
[20:58:17.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:5:0) after 2m54s
[21:01:11.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:5:0)
[21:01:12.022] Build status: STARTED
[21:01:12.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:6:0) after 2m29s
[21:03:41.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:6:0)
[21:03:41.444] Build status: STARTED
[21:03:41.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:7:0) after 7m25s
[21:11:06.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:7:0)
[21:11:06.606] Build status: STARTED
[21:11:06.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:8:0) after 6m28s
[21:17:34.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:8:0)
[21:17:34.731] Build status: STARTED
[21:17:34.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:9:0) after 8m38s
[21:26:12.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:9:0)
[21:26:12.841] Build status: STARTED
[21:26:12.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:10:0) after 2m32s
[21:28:44.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:10:0)
[21:28:44.948] Build status: STARTED
[21:28:44.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:11:0) after 9m34s
[21:38:18.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:11:0)
[21:38:18.998] Build status: STARTED
[21:38:18.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:12:0) after 9m0s
[21:47:19.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:12:0)
[21:47:19.278] Build status: STARTED
[21:47:19.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:13:0) after 9m21s
[21:56:40.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:13:0)
[21:56:40.326] Build status: STARTED
[21:56:40.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:14:0) after 1m57s
[21:58:37.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:14:0)
[21:58:37.459] Build status: STARTED
[21:58:37.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:15:0) after 3m39s
[22:02:16.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:15:0)
[22:02:16.651] Build status: STARTED
[22:02:16.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:16:0) after 7m44s
[22:10:00.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:16:0)
[22:10:00.739] Build status: STARTED
[22:10:00.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:17:0) after 5m28s
[22:15:28.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:17:0)
[22:15:28.802] Build status: STARTED
[22:15:28.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:18:0) after 7m18s
[22:22:46.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:18:0)
[22:22:46.853] Build status: STARTED
[22:22:46.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:19:0) after 4m48s
[22:27:34.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:19:0)
[22:27:35.005] Build status: STARTED
[22:27:35.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:20:0) after 4m37s
[22:32:12.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:20:0)
[22:32:12.039] Build status: STARTED
[22:32:12.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:21:0) after 9m28s
[22:41:40.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:21:0)
[22:41:40.191] Build status: STARTED
[22:41:40.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:22:0) after 7m12s
[22:48:52.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:22:0)
[22:48:52.240] Build status: STARTED
[22:48:52.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:23:0) after 4m22s
[22:53:14.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:23:0)
[22:53:14.485] Build status: STARTED
[22:53:14.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:24:0) after 1m15s
[22:54:29.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:24:0)
[22:54:29.539] Build status: STARTED
[22:54:29.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:25:0) after 5m2s
[22:59:32.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:25:0)
[22:59:32.077] Build status: STARTED
[22:59:32.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:26:0) after 9m35s
[23:09:07.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:26:0)
[23:09:07.116] Build status: STARTED
[23:09:07.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:27:0) after 4m23s
[23:13:30.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:27:0)
[23:13:30.192] Build status: STARTED
[23:13:30.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:28:0) after 1m12s
[23:14:42.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:28:0)
[23:14:42.300] Build status: STARTED
[23:14:42.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:29:0) after 5m49s
[23:20:31.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:29:0)
[23:20:31.370] Build status: STARTED
[23:20:31.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:30:0) after 4m15s
[23:24:46.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:30:0)
[23:24:46.418] Build status: STARTED
[23:24:46.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:31:0) after 3m53s
[23:28:39.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:31:0)
[23:28:39.578] Build status: STARTED
[23:28:39.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:32:0) after 8m56s
[23:37:35.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:32:0)
[23:37:35.733] Build status: STARTED
[23:37:35.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:33:0) after 2m15s
[23:39:50.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:33:0)
[23:39:50.799] Build status: STARTED
[23:39:50.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:34:0) after 5m36s
[23:45:26.939] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:34:0)
[23:45:27.008] Build status: STARTED
[23:45:27.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:35:0) after 7m44s
[23:53:11.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:35:0)
[23:53:11.207] Build status: STARTED
[23:53:11.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:36:0) after 9m32s
[00:02:43.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:36:0)
[00:02:43.366] Build status: STARTED
[00:02:43.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:37:0) after 4m17s
[00:07:00.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:37:0)
[00:07:00.567] Build status: STARTED
[00:07:00.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:38:0) after 6m40s
[00:13:40.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:38:0)
[00:13:40.764] Build status: STARTED
[00:13:40.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:39:0) after 9m25s
[00:23:05.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:39:0)
[00:23:05.825] Build status: STARTED
[00:23:05.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:40:0) after 9m19s
[00:32:25.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:40:0)
[00:32:25.217] Build status: STARTED
[00:32:25.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:41:0) after 7m56s
[00:40:21.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:41:0)
[00:40:21.326] Build status: STARTED
[00:40:21.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:42:0) after 5m17s
[00:45:38.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:42:0)
[00:45:38.390] Build status: STARTED
[00:45:38.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:43:0) after 9m32s
[00:55:10.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:43:0)
[00:55:10.569] Build status: STARTED
[00:55:10.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:44:0) after 9m54s
[01:05:05.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:44:0)
[01:05:05.510] Build status: STARTED
[01:05:05.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:45:0) after 3m18s
[01:08:23.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:45:0)
[01:08:23.562] Build status: STARTED
[01:08:23.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:46:0) after 9m33s
[01:17:56.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:46:0)
[01:17:56.611] Build status: STARTED
[01:17:56.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:47:0) after 5m19s
[01:23:15.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:47:0)
[01:23:15.658] Build status: STARTED
[01:23:15.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:48:0) after 5m33s
[01:28:48.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:48:0)
[01:28:48.894] Build status: STARTED
[01:28:48.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:49:0) after 4m35s
[01:33:24.065] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:49:0)
[01:33:24.093] Build status: STARTED
[01:33:24.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:50:0) after 8m42s
[01:42:06.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:50:0)
[01:42:06.167] Build status: STARTED
[01:42:06.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:51:0) after 9m47s
[01:51:53.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:51:0)
[01:51:53.315] Build status: STARTED
[01:51:53.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:52:0) after 9m48s
[02:01:41.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:52:0)
[02:01:41.367] Build status: STARTED
[02:01:41.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:53:0) after 6m58s
[02:08:39.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:53:0)
[02:08:39.491] Build status: STARTED
[02:08:39.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:54:0) after 3m8s
[02:11:47.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:54:0)
[02:11:47.539] Build status: STARTED
[02:11:47.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:55:0) after 9m38s
[02:21:25.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:55:0)
[02:21:25.629] Build status: STARTED
[02:21:25.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:56:0) after 4m52s
[02:26:17.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:56:0)
[02:26:17.750] Build status: STARTED
[02:26:17.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:57:0) after 3m4s
[02:29:21.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:57:0)
[02:29:21.995] Build status: STARTED
[02:29:21.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:58:0) after 9m0s
[02:38:22.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:58:0)
[02:38:22.038] Build status: STARTED
[02:38:22.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:59:0) after 2m11s
[02:40:33.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:59:0)
[02:40:33.092] Build status: STARTED
[02:40:33.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:60:0) after 7m13s
[02:47:46.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:60:0)
[02:47:46.169] Build status: STARTED
[02:47:46.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8979496813482373024:61:0) after 1m2s
[02:48:03.776] Received PubSub notification, asking Buildbucket for the build status
[02:48:03.793] Build:
{
"id": "8814066751510351313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 3883,
"createdBy": "project:chromium",
"createTime": "2022-05-15T20:52:18.202085671Z",
"startTime": "2022-05-15T20:53:33.473842Z",
"endTime": "2022-05-16T02:47:54.763976109Z",
"updateTime": "2022-05-16T02:47:54.763976109Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "31371895c3e138b20b2b6bb834f4c18025a745c4",
"ref": "refs/heads/main"
}
}
}
[02:48:03.793] Invocation finished in 5h55m46.854592496s with status FAILED