[19:05:34.714] New invocation is queued and will start shortly
[19:05:35.782] Starting the invocation (attempt 1)
[19:05:35.840] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/88ba2ce076d07b060f8e629a9a40f62db2aaee50"
[19:05:35.840] Popped gitiles commit info from properties and tags
[19:05:35.840] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:05:35.841] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:05:35.841] Buildbucket request:
{
"requestId": "8893979990433178992",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "88ba2ce076d07b060f8e629a9a40f62db2aaee50",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8893979990433178992"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:05:36.320] Scheduled build:
{
"id": "8728549928532059137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 14974,
"createdBy": "project:chromium",
"createTime": "2024-12-14T19:05:35.897907367Z",
"updateTime": "2024-12-14T19:05:35.897907367Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "88ba2ce076d07b060f8e629a9a40f62db2aaee50",
"ref": "refs/heads/main"
}
}
}
[19:05:36.320] Task URL: https://cr-buildbucket.appspot.com/build/8728549928532059137
[19:05:36.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:2:0) after 9m54s
[19:05:37.301] Received PubSub notification, asking Buildbucket for the build status
[19:05:37.319] Build status: SCHEDULED
[19:07:15.492] Received PubSub notification, asking Buildbucket for the build status
[19:07:15.557] Build status: STARTED
[19:15:30.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:2:0)
[19:15:30.372] Build status: STARTED
[19:15:30.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:5:0) after 8m37s
[19:24:07.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:5:0)
[19:24:07.703] Build status: STARTED
[19:24:07.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:6:0) after 8m19s
[19:32:27.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:6:0)
[19:32:27.027] Build status: STARTED
[19:32:27.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:7:0) after 1m53s
[19:34:20.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:7:0)
[19:34:20.307] Build status: STARTED
[19:34:20.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:8:0) after 7m49s
[19:42:09.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:8:0)
[19:42:09.489] Build status: STARTED
[19:42:09.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:9:0) after 2m59s
[19:45:08.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:9:0)
[19:45:08.523] Build status: STARTED
[19:45:08.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:10:0) after 4m47s
[19:49:55.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:10:0)
[19:49:55.675] Build status: STARTED
[19:49:55.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:11:0) after 3m4s
[19:53:00.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:11:0)
[19:53:00.105] Build status: STARTED
[19:53:00.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:12:0) after 3m37s
[19:56:37.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:12:0)
[19:56:37.390] Build status: STARTED
[19:56:37.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:13:0) after 6m18s
[20:02:55.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:13:0)
[20:02:55.647] Build status: STARTED
[20:02:55.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:14:0) after 3m26s
[20:06:21.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:14:0)
[20:06:21.757] Build status: STARTED
[20:06:21.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:15:0) after 6m42s
[20:13:03.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:15:0)
[20:13:03.875] Build status: STARTED
[20:13:03.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:16:0) after 9m34s
[20:22:37.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:16:0)
[20:22:37.911] Build status: STARTED
[20:22:37.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:17:0) after 5m49s
[20:28:26.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:17:0)
[20:28:26.942] Build status: STARTED
[20:28:26.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:18:0) after 4m42s
[20:33:08.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:18:0)
[20:33:08.976] Build status: STARTED
[20:33:08.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:19:0) after 9m58s
[20:43:06.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:19:0)
[20:43:07.014] Build status: STARTED
[20:43:07.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:20:0) after 4m58s
[20:48:05.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:20:0)
[20:48:05.264] Build status: STARTED
[20:48:05.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:21:0) after 5m18s
[20:53:23.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:21:0)
[20:53:23.330] Build status: STARTED
[20:53:23.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:22:0) after 3m25s
[20:56:48.486] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:22:0)
[20:56:48.500] Build status: STARTED
[20:56:48.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:23:0) after 8m40s
[21:05:28.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:23:0)
[21:05:28.534] Build status: STARTED
[21:05:28.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:24:0) after 3m7s
[21:08:35.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:24:0)
[21:08:35.569] Build status: STARTED
[21:08:35.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:25:0) after 5m56s
[21:14:31.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:25:0)
[21:14:31.609] Build status: STARTED
[21:14:31.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:26:0) after 2m7s
[21:16:38.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:26:0)
[21:16:38.660] Build status: STARTED
[21:16:38.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:27:0) after 3m56s
[21:20:34.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:27:0)
[21:20:34.763] Build status: STARTED
[21:20:34.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:28:0) after 6m29s
[21:27:03.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:28:0)
[21:27:03.803] Build status: STARTED
[21:27:03.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:29:0) after 8m29s
[21:35:32.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:29:0)
[21:35:32.941] Build status: STARTED
[21:35:32.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:30:0) after 4m47s
[21:40:19.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:30:0)
[21:40:19.983] Build status: STARTED
[21:40:19.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:31:0) after 5m3s
[21:45:23.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:31:0)
[21:45:23.160] Build status: STARTED
[21:45:23.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:32:0) after 7m38s
[21:53:01.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:32:0)
[21:53:01.193] Build status: STARTED
[21:53:01.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:33:0) after 4m20s
[21:57:21.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:33:0)
[21:57:21.226] Build status: STARTED
[21:57:21.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:34:0) after 8m55s
[22:06:16.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:34:0)
[22:06:16.328] Build status: STARTED
[22:06:16.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:35:0) after 3m7s
[22:09:23.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:35:0)
[22:09:23.646] Build status: STARTED
[22:09:23.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:36:0) after 4m11s
[22:13:34.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:36:0)
[22:13:34.690] Build status: STARTED
[22:13:34.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:37:0) after 2m51s
[22:16:25.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:37:0)
[22:16:25.821] Build status: STARTED
[22:16:25.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:38:0) after 6m25s
[22:22:50.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:38:0)
[22:22:51.009] Build status: STARTED
[22:22:51.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:39:0) after 3m10s
[22:26:01.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:39:0)
[22:26:01.083] Build status: STARTED
[22:26:01.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:40:0) after 8m51s
[22:34:52.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:40:0)
[22:34:52.128] Build status: STARTED
[22:34:52.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:41:0) after 2m58s
[22:37:50.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:41:0)
[22:37:50.748] Build status: STARTED
[22:37:50.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:42:0) after 7m34s
[22:45:24.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:42:0)
[22:45:24.852] Build status: STARTED
[22:45:24.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:43:0) after 9m5s
[22:54:29.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:43:0)
[22:54:29.900] Build status: STARTED
[22:54:29.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:44:0) after 5m26s
[22:59:56.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:44:0)
[22:59:56.165] Build status: STARTED
[22:59:56.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:45:0) after 9m22s
[23:09:18.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:45:0)
[23:09:18.218] Build status: STARTED
[23:09:18.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:46:0) after 8m51s
[23:18:09.222] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:46:0)
[23:18:09.235] Build status: STARTED
[23:18:09.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:47:0) after 8m31s
[23:26:40.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:47:0)
[23:26:40.453] Build status: STARTED
[23:26:40.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:48:0) after 4m37s
[23:31:17.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:48:0)
[23:31:17.659] Build status: STARTED
[23:31:17.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:49:0) after 9m7s
[23:40:24.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:49:0)
[23:40:24.694] Build status: STARTED
[23:40:24.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:50:0) after 5m33s
[23:45:57.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:50:0)
[23:45:57.727] Build status: STARTED
[23:45:57.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:51:0) after 7m34s
[23:53:31.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:51:0)
[23:53:31.911] Build status: STARTED
[23:53:31.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:52:0) after 5m32s
[23:59:04.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:52:0)
[23:59:04.223] Build status: STARTED
[23:59:04.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:53:0) after 9m8s
[00:08:12.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:53:0)
[00:08:12.449] Build status: STARTED
[00:08:12.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:54:0) after 3m33s
[00:11:45.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:54:0)
[00:11:45.832] Build status: STARTED
[00:11:45.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:55:0) after 5m46s
[00:17:31.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:55:0)
[00:17:31.866] Build status: STARTED
[00:17:31.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:56:0) after 3m28s
[00:20:59.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:56:0)
[00:20:59.933] Build status: STARTED
[00:20:59.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:57:0) after 5m40s
[00:26:40.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:57:0)
[00:26:40.073] Build status: STARTED
[00:26:40.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:58:0) after 6m26s
[00:33:06.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:58:0)
[00:33:06.122] Build status: STARTED
[00:33:06.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:59:0) after 8m0s
[00:41:06.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:59:0)
[00:41:06.164] Build status: STARTED
[00:41:06.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:60:0) after 2m0s
[00:43:06.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:60:0)
[00:43:06.411] Build status: STARTED
[00:43:06.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:61:0) after 6m31s
[00:49:37.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:61:0)
[00:49:37.480] Build status: STARTED
[00:49:37.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:62:0) after 5m39s
[00:55:16.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:62:0)
[00:55:16.576] Build status: STARTED
[00:55:16.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:63:0) after 5m22s
[01:00:38.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:63:0)
[01:00:38.615] Build status: STARTED
[01:00:38.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8893979990433178992:64:0) after 7m18s
[01:04:04.036] Received PubSub notification, asking Buildbucket for the build status
[01:04:04.060] Build:
{
"id": "8728549928532059137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 14974,
"createdBy": "project:chromium",
"createTime": "2024-12-14T19:05:35.897907367Z",
"startTime": "2024-12-14T19:07:14.844033481Z",
"endTime": "2024-12-15T01:04:03.539779979Z",
"updateTime": "2024-12-15T01:04:03.539779979Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "88ba2ce076d07b060f8e629a9a40f62db2aaee50",
"ref": "refs/heads/main"
}
}
}
[01:04:04.060] Invocation finished in 5h58m29.360129187s with status FAILED