[22:40:34.298] New invocation is queued and will start shortly
[22:40:35.360] Starting the invocation (attempt 1)
[22:40:35.390] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2cd1dff51a5876226987aa6908b18021c2dfd6cd"
[22:40:35.391] Popped gitiles commit info from properties and tags
[22:40:35.391] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:40:35.391] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:40:35.391] Buildbucket request:
{
"requestId": "8855643947442421632",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2cd1dff51a5876226987aa6908b18021c2dfd6cd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8855643947442421632"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:40:35.987] Scheduled build:
{
"id": "8690213885573994145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 19557,
"createdBy": "project:chromium",
"createTime": "2026-02-10T22:40:35.459833296Z",
"updateTime": "2026-02-10T22:40:35.459833296Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2cd1dff51a5876226987aa6908b18021c2dfd6cd",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:40:35.987] Task URL: https://cr-buildbucket.appspot.com/build/8690213885573994145
[22:40:35.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:2:0) after 9m0s
[22:40:36.064] Received PubSub notification, asking Buildbucket for the build status
[22:40:36.090] Build status: SCHEDULED
[22:40:41.582] Received PubSub notification, asking Buildbucket for the build status
[22:40:41.643] Build status: STARTED
[22:49:36.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:2:0)
[22:49:36.022] Build status: STARTED
[22:49:36.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:5:0) after 8m7s
[22:57:43.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:5:0)
[22:57:43.061] Build status: STARTED
[22:57:43.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:6:0) after 9m56s
[23:07:39.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:6:0)
[23:07:39.222] Build status: STARTED
[23:07:39.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:7:0) after 1m59s
[23:09:38.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:7:0)
[23:09:38.269] Build status: STARTED
[23:09:38.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:8:0) after 3m46s
[23:13:24.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:8:0)
[23:13:24.378] Build status: STARTED
[23:13:24.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:9:0) after 2m38s
[23:16:02.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:9:0)
[23:16:02.505] Build status: STARTED
[23:16:02.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:10:0) after 1m13s
[23:17:15.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:10:0)
[23:17:15.676] Build status: STARTED
[23:17:15.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:11:0) after 8m21s
[23:25:36.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:11:0)
[23:25:36.767] Build status: STARTED
[23:25:36.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:12:0) after 5m50s
[23:31:26.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:12:0)
[23:31:26.818] Build status: STARTED
[23:31:26.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:13:0) after 8m28s
[23:39:54.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:13:0)
[23:39:55.016] Build status: STARTED
[23:39:55.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:14:0) after 7m6s
[23:47:01.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:14:0)
[23:47:01.065] Build status: STARTED
[23:47:01.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:15:0) after 9m29s
[23:56:30.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:15:0)
[23:56:30.225] Build status: STARTED
[23:56:30.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:16:0) after 2m43s
[23:59:13.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:16:0)
[23:59:13.294] Build status: STARTED
[23:59:13.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:17:0) after 3m51s
[00:03:04.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:17:0)
[00:03:04.306] Build status: STARTED
[00:03:04.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:18:0) after 5m29s
[00:08:33.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:18:0)
[00:08:33.425] Build status: STARTED
[00:08:33.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:19:0) after 1m36s
[00:10:09.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:19:0)
[00:10:09.565] Build status: STARTED
[00:10:09.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:20:0) after 3m34s
[00:13:43.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:20:0)
[00:13:43.688] Build status: STARTED
[00:13:43.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:21:0) after 2m31s
[00:16:14.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:21:0)
[00:16:14.779] Build status: STARTED
[00:16:14.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:22:0) after 4m36s
[00:20:50.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:22:0)
[00:20:50.870] Build status: STARTED
[00:20:50.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:23:0) after 4m4s
[00:24:54.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:23:0)
[00:24:54.913] Build status: STARTED
[00:24:54.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:24:0) after 7m42s
[00:32:36.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:24:0)
[00:32:36.945] Build status: STARTED
[00:32:36.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:25:0) after 5m30s
[00:38:06.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:25:0)
[00:38:06.989] Build status: STARTED
[00:38:06.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:26:0) after 5m45s
[00:43:52.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:26:0)
[00:43:52.055] Build status: STARTED
[00:43:52.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:27:0) after 5m20s
[00:49:12.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:27:0)
[00:49:12.119] Build status: STARTED
[00:49:12.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:28:0) after 4m33s
[00:53:45.276] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:28:0)
[00:53:45.351] Build status: STARTED
[00:53:45.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:29:0) after 3m14s
[00:56:59.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:29:0)
[00:56:59.444] Build status: STARTED
[00:56:59.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:30:0) after 7m32s
[01:04:31.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:30:0)
[01:04:31.527] Build status: STARTED
[01:04:31.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:31:0) after 9m49s
[01:14:20.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:31:0)
[01:14:20.610] Build status: STARTED
[01:14:20.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:32:0) after 4m56s
[01:19:16.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:32:0)
[01:19:16.735] Build status: STARTED
[01:19:16.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:33:0) after 3m47s
[01:23:03.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:33:0)
[01:23:03.772] Build status: STARTED
[01:23:03.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:34:0) after 3m46s
[01:26:49.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:34:0)
[01:26:49.810] Build status: STARTED
[01:26:49.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:35:0) after 1m3s
[01:27:52.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:35:0)
[01:27:52.892] Build status: STARTED
[01:27:52.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:36:0) after 3m11s
[01:31:03.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:36:0)
[01:31:03.973] Build status: STARTED
[01:31:03.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:37:0) after 1m43s
[01:32:47.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:37:0)
[01:32:47.139] Build status: STARTED
[01:32:47.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:38:0) after 6m26s
[01:39:13.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:38:0)
[01:39:13.186] Build status: STARTED
[01:39:13.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:39:0) after 7m2s
[01:46:15.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:39:0)
[01:46:15.240] Build status: STARTED
[01:46:15.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:40:0) after 8m25s
[01:54:40.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:40:0)
[01:54:40.488] Build status: STARTED
[01:54:40.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:41:0) after 5m40s
[02:00:20.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:41:0)
[02:00:20.534] Build status: STARTED
[02:00:20.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:42:0) after 3m26s
[02:03:46.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:42:0)
[02:03:46.579] Build status: STARTED
[02:03:46.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:43:0) after 2m1s
[02:05:47.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:43:0)
[02:05:47.658] Build status: STARTED
[02:05:47.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:44:0) after 7m45s
[02:13:32.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:44:0)
[02:13:32.701] Build status: STARTED
[02:13:32.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:45:0) after 8m45s
[02:22:17.702] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:45:0)
[02:22:17.716] Build status: STARTED
[02:22:17.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:46:0) after 8m39s
[02:30:56.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:46:0)
[02:30:56.780] Build status: STARTED
[02:30:56.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:47:0) after 1m37s
[02:32:33.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:47:0)
[02:32:33.821] Build status: STARTED
[02:32:33.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:48:0) after 9m22s
[02:41:55.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:48:0)
[02:41:55.859] Build status: STARTED
[02:41:55.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:49:0) after 5m41s
[02:47:36.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:49:0)
[02:47:36.932] Build status: STARTED
[02:47:36.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:50:0) after 5m57s
[02:53:33.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:50:0)
[02:53:33.984] Build status: STARTED
[02:53:33.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:51:0) after 6m19s
[02:59:53.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:51:0)
[02:59:53.029] Build status: STARTED
[02:59:53.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:52:0) after 4m13s
[03:04:06.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:52:0)
[03:04:06.045] Build status: STARTED
[03:04:06.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:53:0) after 9m44s
[03:13:50.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:53:0)
[03:13:50.096] Build status: STARTED
[03:13:50.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:54:0) after 6m37s
[03:20:27.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:54:0)
[03:20:27.247] Build status: STARTED
[03:20:27.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:55:0) after 9m39s
[03:30:06.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:55:0)
[03:30:06.302] Build status: STARTED
[03:30:06.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:56:0) after 6m34s
[03:36:40.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:56:0)
[03:36:40.342] Build status: STARTED
[03:36:40.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:57:0) after 6m58s
[03:43:38.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:57:0)
[03:43:38.455] Build status: STARTED
[03:43:38.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:58:0) after 6m6s
[03:49:44.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:58:0)
[03:49:44.571] Build status: STARTED
[03:49:44.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:59:0) after 2m24s
[03:52:08.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:59:0)
[03:52:08.616] Build status: STARTED
[03:52:08.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:60:0) after 4m1s
[03:56:09.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:60:0)
[03:56:09.765] Build status: STARTED
[03:56:09.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:61:0) after 5m49s
[04:01:58.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:61:0)
[04:01:58.834] Build status: STARTED
[04:01:58.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:62:0) after 5m47s
[04:07:45.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:62:0)
[04:07:45.878] Build status: STARTED
[04:07:45.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:63:0) after 3m30s
[04:11:15.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:63:0)
[04:11:15.904] Build status: STARTED
[04:11:15.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8855643947442421632:64:0) after 1m44s
[04:11:51.805] Received PubSub notification, asking Buildbucket for the build status
[04:11:51.818] Build:
{
"id": "8690213885573994145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 19557,
"createdBy": "project:chromium",
"createTime": "2026-02-10T22:40:35.459833296Z",
"startTime": "2026-02-10T22:40:41.400959922Z",
"endTime": "2026-02-11T04:11:51.445371578Z",
"updateTime": "2026-02-11T04:11:51.445371578Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2cd1dff51a5876226987aa6908b18021c2dfd6cd",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:11:51.818] Invocation finished in 5h31m17.52484056s with status SUCCEEDED