[00:18:40.824] New invocation is queued and will start shortly
[00:18:41.926] Starting the invocation (attempt 1)
[00:18:41.965] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/69ccf1c12c6ce5e5fbd5c6ed4de2c0af3b54233d"
[00:18:41.965] Popped gitiles commit info from properties and tags
[00:18:41.965] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:18:41.965] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:18:41.965] Buildbucket request:
{
"requestId": "8874572540950049920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "69ccf1c12c6ce5e5fbd5c6ed4de2c0af3b54233d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874572540950049920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:18:45.858] Scheduled build:
{
"id": "8709142479025062705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 12167,
"createdBy": "project:chromium",
"createTime": "2025-07-17T00:18:42.039446355Z",
"updateTime": "2025-07-17T00:18:42.039446355Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "69ccf1c12c6ce5e5fbd5c6ed4de2c0af3b54233d",
"ref": "refs/heads/main"
}
}
}
[00:18:45.858] Task URL: https://cr-buildbucket.appspot.com/build/8709142479025062705
[00:18:45.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:2:0) after 3m45s
[00:18:45.992] Received PubSub notification, asking Buildbucket for the build status
[00:18:46.017] Build status: SCHEDULED
[00:22:30.904] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:2:0)
[00:22:30.932] Build status: SCHEDULED
[00:22:30.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:4:0) after 8m34s
[00:31:04.986] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:4:0)
[00:31:05.010] Build status: SCHEDULED
[00:31:05.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:5:0) after 1m35s
[00:32:40.103] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:5:0)
[00:32:40.151] Build status: SCHEDULED
[00:32:40.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:6:0) after 1m19s
[00:33:59.186] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:6:0)
[00:33:59.212] Build status: SCHEDULED
[00:33:59.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:7:0) after 8m26s
[00:42:25.261] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:7:0)
[00:42:25.326] Build status: SCHEDULED
[00:42:25.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:8:0) after 9m3s
[00:51:28.374] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:8:0)
[00:51:28.396] Build status: SCHEDULED
[00:51:28.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:9:0) after 6m59s
[00:58:27.570] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:9:0)
[00:58:27.650] Build status: SCHEDULED
[00:58:27.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:10:0) after 8m10s
[01:06:37.659] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:10:0)
[01:06:37.708] Build status: SCHEDULED
[01:06:37.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:11:0) after 8m37s
[01:15:14.740] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:11:0)
[01:15:14.780] Build status: SCHEDULED
[01:15:14.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:12:0) after 4m39s
[01:19:53.846] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:12:0)
[01:19:53.865] Build status: SCHEDULED
[01:19:53.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:13:0) after 5m24s
[01:25:17.913] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:13:0)
[01:25:17.941] Build status: SCHEDULED
[01:25:17.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:14:0) after 8m52s
[01:34:10.026] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:14:0)
[01:34:10.064] Build status: SCHEDULED
[01:34:10.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:15:0) after 1m11s
[01:34:46.230] Received PubSub notification, asking Buildbucket for the build status
[01:34:46.256] Build status: STARTED
[01:35:21.163] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:15:0)
[01:35:21.188] Build status: STARTED
[01:35:21.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:17:0) after 8m33s
[01:43:54.210] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:17:0)
[01:43:54.244] Build status: STARTED
[01:43:54.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:18:0) after 4m49s
[01:48:43.285] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:18:0)
[01:48:43.307] Build status: STARTED
[01:48:43.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:19:0) after 4m39s
[01:53:22.353] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:19:0)
[01:53:22.373] Build status: STARTED
[01:53:22.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:20:0) after 8m43s
[02:02:05.612] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:20:0)
[02:02:05.627] Build status: STARTED
[02:02:05.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:21:0) after 7m48s
[02:09:53.705] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:21:0)
[02:09:53.740] Build status: STARTED
[02:09:53.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:22:0) after 8m51s
[02:18:44.832] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:22:0)
[02:18:44.866] Build status: STARTED
[02:18:44.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:23:0) after 8m29s
[02:27:13.922] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:23:0)
[02:27:13.943] Build status: STARTED
[02:27:13.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:24:0) after 5m34s
[02:32:47.978] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:24:0)
[02:32:47.994] Build status: STARTED
[02:32:47.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:25:0) after 2m16s
[02:35:04.032] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:25:0)
[02:35:04.049] Build status: STARTED
[02:35:04.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:26:0) after 6m21s
[02:41:25.077] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:26:0)
[02:41:25.102] Build status: STARTED
[02:41:25.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:27:0) after 8m13s
[02:49:38.178] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:27:0)
[02:49:38.200] Build status: STARTED
[02:49:38.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:28:0) after 5m32s
[02:55:10.255] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:28:0)
[02:55:10.292] Build status: STARTED
[02:55:10.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:29:0) after 4m28s
[02:59:38.319] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:29:0)
[02:59:38.336] Build status: STARTED
[02:59:38.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:30:0) after 3m46s
[03:03:24.321] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:30:0)
[03:03:24.353] Build status: STARTED
[03:03:24.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:31:0) after 2m17s
[03:05:41.391] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:31:0)
[03:05:41.416] Build status: STARTED
[03:05:41.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:32:0) after 7m27s
[03:13:08.604] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:32:0)
[03:13:08.696] Build status: STARTED
[03:13:08.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:33:0) after 7m25s
[03:20:33.756] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:33:0)
[03:20:33.776] Build status: STARTED
[03:20:33.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:34:0) after 3m42s
[03:24:15.817] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:34:0)
[03:24:15.880] Build status: STARTED
[03:24:15.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:35:0) after 3m33s
[03:27:49.084] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:35:0)
[03:27:49.190] Build status: STARTED
[03:27:49.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:36:0) after 5m27s
[03:33:16.222] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:36:0)
[03:33:16.243] Build status: STARTED
[03:33:16.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:37:0) after 9m56s
[03:43:12.328] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:37:0)
[03:43:12.395] Build status: STARTED
[03:43:12.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:38:0) after 7m36s
[03:50:48.730] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:38:0)
[03:50:48.750] Build status: STARTED
[03:50:48.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:39:0) after 3m24s
[03:54:12.785] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:39:0)
[03:54:12.802] Build status: STARTED
[03:54:12.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:40:0) after 2m38s
[03:56:50.938] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:40:0)
[03:56:50.954] Build status: STARTED
[03:56:50.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:41:0) after 9m38s
[04:06:28.990] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:41:0)
[04:06:29.006] Build status: STARTED
[04:06:29.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:42:0) after 7m47s
[04:14:16.093] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:42:0)
[04:14:16.139] Build status: STARTED
[04:14:16.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:43:0) after 1m28s
[04:15:44.271] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:43:0)
[04:15:44.296] Build status: STARTED
[04:15:44.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:44:0) after 1m11s
[04:16:55.383] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:44:0)
[04:16:55.461] Build status: STARTED
[04:16:55.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:45:0) after 2m3s
[04:18:58.490] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:45:0)
[04:18:58.544] Build status: STARTED
[04:18:58.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:46:0) after 2m9s
[04:21:08.045] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:46:0)
[04:21:08.064] Build status: STARTED
[04:21:08.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:47:0) after 8m12s
[04:29:20.096] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:47:0)
[04:29:20.131] Build status: STARTED
[04:29:20.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:48:0) after 2m45s
[04:32:05.677] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:48:0)
[04:32:05.758] Build status: STARTED
[04:32:05.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:49:0) after 5m21s
[04:37:26.933] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:49:0)
[04:37:26.949] Build status: STARTED
[04:37:26.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:50:0) after 9m23s
[04:46:49.987] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:50:0)
[04:46:50.003] Build status: STARTED
[04:46:50.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:51:0) after 5m33s
[04:52:23.597] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:51:0)
[04:52:23.620] Build status: STARTED
[04:52:23.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:52:0) after 3m23s
[04:55:46.824] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:52:0)
[04:55:47.103] Build status: STARTED
[04:55:47.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:53:0) after 6m58s
[05:02:45.277] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:53:0)
[05:02:45.294] Build status: STARTED
[05:02:45.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:54:0) after 2m20s
[05:05:05.432] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:54:0)
[05:05:05.529] Build status: STARTED
[05:05:05.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:55:0) after 6m7s
[05:11:12.658] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:55:0)
[05:11:12.675] Build status: STARTED
[05:11:12.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:56:0) after 9m12s
[05:20:24.686] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:56:0)
[05:20:24.707] Build status: STARTED
[05:20:24.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:57:0) after 2m32s
[05:22:56.713] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:57:0)
[05:22:56.728] Build status: STARTED
[05:22:56.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:58:0) after 8m28s
[05:31:24.752] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:58:0)
[05:31:24.774] Build status: STARTED
[05:31:24.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:59:0) after 6m18s
[05:37:43.011] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:59:0)
[05:37:43.117] Build status: STARTED
[05:37:43.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:60:0) after 7m25s
[05:45:08.349] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:60:0)
[05:45:08.368] Build status: STARTED
[05:45:08.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:61:0) after 9m29s
[05:54:37.535] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:61:0)
[05:54:37.576] Build status: STARTED
[05:54:37.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:62:0) after 3m6s
[05:57:43.671] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:62:0)
[05:57:43.699] Build status: STARTED
[05:57:43.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:63:0) after 2m2s
[05:59:45.746] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:63:0)
[05:59:45.788] Build status: STARTED
[05:59:45.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:64:0) after 9m55s
[06:09:41.116] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:64:0)
[06:09:41.163] Build status: STARTED
[06:09:41.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:65:0) after 6m2s
[06:15:43.202] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:65:0)
[06:15:43.288] Build status: STARTED
[06:15:43.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:66:0) after 5m7s
[06:20:50.357] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:66:0)
[06:20:50.373] Build status: STARTED
[06:20:50.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:67:0) after 8m57s
[06:29:47.425] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:67:0)
[06:29:47.443] Build status: STARTED
[06:29:47.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:68:0) after 1m41s
[06:31:28.482] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:68:0)
[06:31:28.500] Build status: STARTED
[06:31:28.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:69:0) after 4m45s
[06:36:13.629] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:69:0)
[06:36:13.660] Build status: STARTED
[06:36:13.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:70:0) after 7m0s
[06:43:14.039] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:70:0)
[06:43:14.058] Build status: STARTED
[06:43:14.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:71:0) after 4m32s
[06:47:46.211] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:71:0)
[06:47:46.233] Build status: STARTED
[06:47:46.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:72:0) after 7m24s
[06:55:10.271] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:72:0)
[06:55:10.295] Build status: STARTED
[06:55:10.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:73:0) after 3m48s
[06:58:58.459] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:73:0)
[06:58:58.476] Build status: STARTED
[06:58:58.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:74:0) after 1m52s
[07:00:50.826] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:74:0)
[07:00:50.862] Build status: STARTED
[07:00:50.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:75:0) after 9m39s
[07:10:29.959] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:75:0)
[07:10:30.028] Build status: STARTED
[07:10:30.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:76:0) after 2m4s
[07:12:34.531] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:76:0)
[07:12:34.553] Build status: STARTED
[07:12:34.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:77:0) after 9m10s
[07:21:45.046] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:77:0)
[07:21:45.067] Build status: STARTED
[07:21:45.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:78:0) after 6m37s
[07:28:22.183] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:78:0)
[07:28:22.201] Build status: STARTED
[07:28:22.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:79:0) after 2m10s
[07:30:32.335] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:79:0)
[07:30:32.353] Build status: STARTED
[07:30:32.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:80:0) after 4m43s
[07:35:15.761] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:80:0)
[07:35:15.793] Build status: STARTED
[07:35:15.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:81:0) after 8m25s
[07:43:40.933] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:81:0)
[07:43:40.956] Build status: STARTED
[07:43:40.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:82:0) after 1m10s
[07:44:51.295] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:82:0)
[07:44:51.316] Build status: STARTED
[07:44:51.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:83:0) after 3m32s
[07:48:23.401] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:83:0)
[07:48:23.423] Build status: STARTED
[07:48:23.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:84:0) after 6m40s
[07:55:03.439] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:84:0)
[07:55:03.497] Build status: STARTED
[07:55:03.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:85:0) after 6m11s
[08:01:14.546] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:85:0)
[08:01:14.577] Build status: STARTED
[08:01:14.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:86:0) after 7m45s
[08:08:59.612] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:86:0)
[08:08:59.639] Build status: STARTED
[08:08:59.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:87:0) after 5m52s
[08:14:51.692] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:87:0)
[08:14:51.712] Build status: STARTED
[08:14:51.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:88:0) after 4m18s
[08:19:09.813] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:88:0)
[08:19:09.833] Build status: STARTED
[08:19:09.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:89:0) after 2m52s
[08:22:01.882] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:89:0)
[08:22:01.901] Build status: STARTED
[08:22:01.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:90:0) after 2m5s
[08:24:06.984] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:90:0)
[08:24:07.002] Build status: STARTED
[08:24:07.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:91:0) after 3m41s
[08:27:48.037] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:91:0)
[08:27:48.057] Build status: STARTED
[08:27:48.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:92:0) after 8m42s
[08:36:30.087] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:92:0)
[08:36:30.107] Build status: STARTED
[08:36:30.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:93:0) after 2m2s
[08:38:32.159] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:93:0)
[08:38:32.184] Build status: STARTED
[08:38:32.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:94:0) after 6m33s
[08:45:05.262] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:94:0)
[08:45:05.282] Build status: STARTED
[08:45:05.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:95:0) after 4m57s
[08:50:02.307] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:95:0)
[08:50:02.357] Build status: STARTED
[08:50:02.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:96:0) after 5m59s
[08:56:01.377] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:96:0)
[08:56:01.437] Build status: STARTED
[08:56:01.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:97:0) after 2m27s
[08:58:28.504] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:97:0)
[08:58:28.569] Build status: STARTED
[08:58:28.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:98:0) after 2m13s
[09:00:41.602] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:98:0)
[09:00:41.634] Build status: STARTED
[09:00:41.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:99:0) after 1m19s
[09:02:00.698] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:99:0)
[09:02:00.718] Build status: STARTED
[09:02:00.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:100:0) after 6m29s
[09:08:29.760] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:100:0)
[09:08:29.803] Build status: STARTED
[09:08:29.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:101:0) after 8m25s
[09:16:54.837] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:101:0)
[09:16:54.860] Build status: STARTED
[09:16:54.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:102:0) after 4m8s
[09:21:02.894] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:102:0)
[09:21:02.912] Build status: STARTED
[09:21:02.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:103:0) after 1m47s
[09:22:50.145] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:103:0)
[09:22:50.180] Build status: STARTED
[09:22:50.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:104:0) after 1m47s
[09:24:37.644] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:104:0)
[09:24:37.661] Build status: STARTED
[09:24:37.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:105:0) after 6m53s
[09:31:30.828] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:105:0)
[09:31:30.862] Build status: STARTED
[09:31:30.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:106:0) after 1m58s
[09:33:29.062] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:106:0)
[09:33:29.090] Build status: STARTED
[09:33:29.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:107:0) after 7m19s
[09:40:48.647] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:107:0)
[09:40:48.671] Build status: STARTED
[09:40:48.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:108:0) after 6m23s
[09:47:11.716] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:108:0)
[09:47:11.733] Build status: STARTED
[09:47:11.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:109:0) after 9m1s
[09:56:12.765] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:109:0)
[09:56:12.832] Build status: STARTED
[09:56:12.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:110:0) after 2m4s
[09:58:17.031] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:110:0)
[09:58:17.128] Build status: STARTED
[09:58:17.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:111:0) after 3m58s
[10:02:15.277] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:111:0)
[10:02:15.297] Build status: STARTED
[10:02:15.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:112:0) after 9m6s
[10:11:21.412] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:112:0)
[10:11:21.428] Build status: STARTED
[10:11:21.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:113:0) after 9m0s
[10:20:21.467] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:113:0)
[10:20:21.486] Build status: STARTED
[10:20:21.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:114:0) after 2m59s
[10:23:20.647] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:114:0)
[10:23:20.669] Build status: STARTED
[10:23:20.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:115:0) after 5m15s
[10:28:35.820] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:115:0)
[10:28:35.837] Build status: STARTED
[10:28:35.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:116:0) after 6m31s
[10:35:06.973] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:116:0)
[10:35:06.993] Build status: STARTED
[10:35:06.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:117:0) after 4m47s
[10:39:54.034] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:117:0)
[10:39:54.052] Build status: STARTED
[10:39:54.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:118:0) after 8m15s
[10:48:09.080] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:118:0)
[10:48:09.097] Build status: STARTED
[10:48:09.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:119:0) after 8m40s
[10:56:49.162] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:119:0)
[10:56:49.197] Build status: STARTED
[10:56:49.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:120:0) after 2m8s
[10:58:57.237] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:120:0)
[10:58:57.254] Build status: STARTED
[10:58:57.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:121:0) after 4m56s
[11:03:53.298] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:121:0)
[11:03:53.313] Build status: STARTED
[11:03:53.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:122:0) after 3m55s
[11:07:48.353] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:122:0)
[11:07:48.403] Build status: STARTED
[11:07:48.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:123:0) after 8m5s
[11:15:53.443] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:123:0)
[11:15:53.472] Build status: STARTED
[11:15:53.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:124:0) after 4m27s
[11:20:20.594] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:124:0)
[11:20:20.612] Build status: STARTED
[11:20:20.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:125:0) after 6m59s
[11:27:19.812] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:125:0)
[11:27:19.830] Build status: STARTED
[11:27:19.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:126:0) after 4m21s
[11:31:40.979] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:126:0)
[11:31:40.997] Build status: STARTED
[11:31:40.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:127:0) after 1m39s
[11:33:20.403] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:127:0)
[11:33:20.422] Build status: STARTED
[11:33:20.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:128:0) after 6m57s
[11:40:17.460] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:128:0)
[11:40:17.482] Build status: STARTED
[11:40:17.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:129:0) after 8m35s
[11:48:52.896] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:129:0)
[11:48:52.914] Build status: STARTED
[11:48:52.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:130:0) after 6m55s
[11:55:47.959] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:130:0)
[11:55:48.032] Build status: STARTED
[11:55:48.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:131:0) after 5m0s
[12:00:48.496] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:131:0)
[12:00:48.517] Build status: STARTED
[12:00:48.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:132:0) after 8m16s
[12:09:04.511] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:132:0)
[12:09:04.534] Build status: STARTED
[12:09:04.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:133:0) after 3m29s
[12:12:33.568] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:133:0)
[12:12:33.619] Build status: STARTED
[12:12:33.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:134:0) after 5m15s
[12:17:48.658] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:134:0)
[12:17:48.680] Build status: STARTED
[12:17:48.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:135:0) after 3m52s
[12:21:40.867] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:135:0)
[12:21:40.891] Build status: STARTED
[12:21:40.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:136:0) after 1m45s
[12:23:26.008] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:136:0)
[12:23:26.030] Build status: STARTED
[12:23:26.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8874572540950049920:137:0) after 9m7s
[12:27:46.600] Received PubSub notification, asking Buildbucket for the build status
[12:27:46.628] Build:
{
"id": "8709142479025062705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 12167,
"createdBy": "project:chromium",
"createTime": "2025-07-17T00:18:42.039446355Z",
"startTime": "2025-07-17T01:34:46.023901408Z",
"endTime": "2025-07-17T12:27:44.471802928Z",
"updateTime": "2025-07-17T12:27:44.471802928Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "69ccf1c12c6ce5e5fbd5c6ed4de2c0af3b54233d",
"ref": "refs/heads/main"
}
}
}
[12:27:46.628] Invocation finished in 12h9m5.80976942s with status FAILED