[18:21:56.273] New invocation is queued and will start shortly
[18:21:57.373] Starting the invocation (attempt 1)
[18:21:57.400] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/34851e112626ec958857fa19cc152d54e3dbe0ee"
[18:21:57.400] Popped gitiles commit info from properties and tags
[18:21:57.400] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:21:57.400] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:21:57.401] Buildbucket request:
{
"requestId": "8902498850988215776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "34851e112626ec958857fa19cc152d54e3dbe0ee",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8902498850988215776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:21:58.103] Scheduled build:
{
"id": "8737068788999878481",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 13676,
"createdBy": "project:chromium",
"createTime": "2024-09-11T18:21:57.464175965Z",
"updateTime": "2024-09-11T18:21:57.464175965Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "34851e112626ec958857fa19cc152d54e3dbe0ee",
"ref": "refs/heads/main"
}
}
}
[18:21:58.103] Task URL: https://cr-buildbucket.appspot.com/build/8737068788999878481
[18:21:58.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:2:0) after 6m29s
[18:21:58.372] Received PubSub notification, asking Buildbucket for the build status
[18:21:58.432] Build status: SCHEDULED
[18:22:05.489] Received PubSub notification, asking Buildbucket for the build status
[18:22:05.538] Build status: STARTED
[18:28:27.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:2:0)
[18:28:27.444] Build status: STARTED
[18:28:27.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:5:0) after 1m39s
[18:30:06.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:5:0)
[18:30:06.501] Build status: STARTED
[18:30:06.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:6:0) after 6m20s
[18:36:26.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:6:0)
[18:36:26.648] Build status: STARTED
[18:36:26.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:7:0) after 9m45s
[18:46:11.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:7:0)
[18:46:11.711] Build status: STARTED
[18:46:11.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:8:0) after 8m4s
[18:54:15.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:8:0)
[18:54:15.854] Build status: STARTED
[18:54:15.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:9:0) after 3m15s
[18:57:30.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:9:0)
[18:57:30.904] Build status: STARTED
[18:57:30.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:10:0) after 1m8s
[18:58:38.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:10:0)
[18:58:38.948] Build status: STARTED
[18:58:38.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:11:0) after 1m16s
[18:59:54.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:11:0)
[18:59:54.951] Build status: STARTED
[18:59:54.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:12:0) after 1m48s
[19:01:43.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:12:0)
[19:01:43.129] Build status: STARTED
[19:01:43.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:13:0) after 1m50s
[19:03:33.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:13:0)
[19:03:33.243] Build status: STARTED
[19:03:33.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:14:0) after 5m35s
[19:09:08.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:14:0)
[19:09:08.349] Build status: STARTED
[19:09:08.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:15:0) after 3m42s
[19:12:50.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:15:0)
[19:12:50.402] Build status: STARTED
[19:12:50.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:16:0) after 9m17s
[19:22:07.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:16:0)
[19:22:07.587] Build status: STARTED
[19:22:07.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:17:0) after 8m6s
[19:30:13.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:17:0)
[19:30:13.727] Build status: STARTED
[19:30:13.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:18:0) after 9m43s
[19:39:56.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:18:0)
[19:39:56.821] Build status: STARTED
[19:39:56.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:19:0) after 9m24s
[19:49:20.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:19:0)
[19:49:20.896] Build status: STARTED
[19:49:20.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:20:0) after 6m30s
[19:55:50.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:20:0)
[19:55:51.007] Build status: STARTED
[19:55:51.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:21:0) after 1m46s
[19:57:37.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:21:0)
[19:57:37.069] Build status: STARTED
[19:57:37.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:22:0) after 9m29s
[20:07:06.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:22:0)
[20:07:06.176] Build status: STARTED
[20:07:06.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:23:0) after 7m47s
[20:14:53.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:23:0)
[20:14:53.370] Build status: STARTED
[20:14:53.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:24:0) after 5m28s
[20:20:21.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:24:0)
[20:20:21.414] Build status: STARTED
[20:20:21.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:25:0) after 1m14s
[20:21:35.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:25:0)
[20:21:35.521] Build status: STARTED
[20:21:35.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:26:0) after 2m0s
[20:23:35.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:26:0)
[20:23:35.600] Build status: STARTED
[20:23:35.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:27:0) after 4m24s
[20:27:59.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:27:0)
[20:27:59.706] Build status: STARTED
[20:27:59.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:28:0) after 7m32s
[20:35:31.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:28:0)
[20:35:31.765] Build status: STARTED
[20:35:31.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:29:0) after 3m34s
[20:39:05.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:29:0)
[20:39:05.926] Build status: STARTED
[20:39:05.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:30:0) after 1m0s
[20:40:06.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:30:0)
[20:40:06.080] Build status: STARTED
[20:40:06.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:31:0) after 5m12s
[20:45:18.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:31:0)
[20:45:18.148] Build status: STARTED
[20:45:18.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:32:0) after 5m15s
[20:50:33.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:32:0)
[20:50:33.246] Build status: STARTED
[20:50:33.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:33:0) after 9m40s
[21:00:13.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:33:0)
[21:00:13.375] Build status: STARTED
[21:00:13.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:34:0) after 5m34s
[21:05:47.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:34:0)
[21:05:47.486] Build status: STARTED
[21:05:47.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:35:0) after 6m55s
[21:12:42.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:35:0)
[21:12:42.527] Build status: STARTED
[21:12:42.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:36:0) after 1m52s
[21:14:34.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:36:0)
[21:14:34.623] Build status: STARTED
[21:14:34.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:37:0) after 3m53s
[21:18:27.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:37:0)
[21:18:27.702] Build status: STARTED
[21:18:27.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:38:0) after 1m39s
[21:20:06.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:38:0)
[21:20:06.762] Build status: STARTED
[21:20:06.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:39:0) after 2m29s
[21:22:35.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:39:0)
[21:22:35.873] Build status: STARTED
[21:22:35.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:40:0) after 8m17s
[21:30:52.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:40:0)
[21:30:52.931] Build status: STARTED
[21:30:52.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:41:0) after 2m28s
[21:33:21.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:41:0)
[21:33:21.151] Build status: STARTED
[21:33:21.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:42:0) after 1m41s
[21:35:02.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:42:0)
[21:35:02.267] Build status: STARTED
[21:35:02.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:43:0) after 3m43s
[21:38:45.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:43:0)
[21:38:45.314] Build status: STARTED
[21:38:45.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:44:0) after 1m20s
[21:40:05.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:44:0)
[21:40:05.383] Build status: STARTED
[21:40:05.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:45:0) after 9m16s
[21:49:21.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:45:0)
[21:49:21.455] Build status: STARTED
[21:49:21.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:46:0) after 8m11s
[21:57:32.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:46:0)
[21:57:32.557] Build status: STARTED
[21:57:32.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:47:0) after 2m52s
[22:00:24.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:47:0)
[22:00:24.768] Build status: STARTED
[22:00:24.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:48:0) after 2m33s
[22:02:57.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:48:0)
[22:02:57.876] Build status: STARTED
[22:02:57.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:49:0) after 9m43s
[22:12:40.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:49:0)
[22:12:40.955] Build status: STARTED
[22:12:40.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:50:0) after 5m55s
[22:18:36.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:50:0)
[22:18:36.134] Build status: STARTED
[22:18:36.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:51:0) after 6m44s
[22:25:20.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:51:0)
[22:25:20.320] Build status: STARTED
[22:25:20.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:52:0) after 9m47s
[22:35:07.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:52:0)
[22:35:07.521] Build status: STARTED
[22:35:07.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:53:0) after 9m53s
[22:45:00.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:53:0)
[22:45:00.648] Build status: STARTED
[22:45:00.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:54:0) after 4m47s
[22:49:47.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:54:0)
[22:49:47.759] Build status: STARTED
[22:49:47.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:55:0) after 8m37s
[22:58:24.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:55:0)
[22:58:24.887] Build status: STARTED
[22:58:24.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:56:0) after 4m24s
[23:02:48.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:56:0)
[23:02:48.968] Build status: STARTED
[23:02:48.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:57:0) after 9m7s
[23:11:55.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:57:0)
[23:11:56.018] Build status: STARTED
[23:11:56.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:58:0) after 4m49s
[23:16:45.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:58:0)
[23:16:45.134] Build status: STARTED
[23:16:45.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8902498850988215776:59:0) after 6m58s
[23:21:22.680] Received PubSub notification, asking Buildbucket for the build status
[23:21:22.732] Build:
{
"id": "8737068788999878481",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 13676,
"createdBy": "project:chromium",
"createTime": "2024-09-11T18:21:57.464175965Z",
"startTime": "2024-09-11T18:22:05.182635301Z",
"endTime": "2024-09-11T23:21:22.417812538Z",
"updateTime": "2024-09-11T23:21:22.417812538Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "34851e112626ec958857fa19cc152d54e3dbe0ee",
"ref": "refs/heads/main"
}
}
}
[23:21:22.732] Invocation finished in 4h59m26.547912s with status FAILED