[21:30:56.704] New invocation is queued and will start shortly
[21:30:57.824] Starting the invocation (attempt 1)
[21:30:57.865] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ae5d08093173315512054c5a4227061a002a7c8a"
[21:30:57.865] Popped gitiles commit info from properties and tags
[21:30:57.865] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:30:57.866] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:30:57.866] Buildbucket request:
{
"requestId": "8870053245631110992",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae5d08093173315512054c5a4227061a002a7c8a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8870053245631110992"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:30:58.701] Scheduled build:
{
"id": "8704623183510912465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 17930,
"createdBy": "project:chromium",
"createTime": "2025-09-04T21:30:58.099491777Z",
"updateTime": "2025-09-04T21:30:58.099491777Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae5d08093173315512054c5a4227061a002a7c8a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:30:58.701] Task URL: https://cr-buildbucket.appspot.com/build/8704623183510912465
[21:30:58.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:2:0) after 7m3s
[21:30:59.714] Received PubSub notification, asking Buildbucket for the build status
[21:30:59.739] Build status: SCHEDULED
[21:31:05.464] Received PubSub notification, asking Buildbucket for the build status
[21:31:05.487] Build status: STARTED
[21:38:01.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:2:0)
[21:38:01.760] Build status: STARTED
[21:38:01.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:5:0) after 9m6s
[21:47:07.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:5:0)
[21:47:08.022] Build status: STARTED
[21:47:08.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:6:0) after 8m29s
[21:55:37.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:6:0)
[21:55:37.165] Build status: STARTED
[21:55:37.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:7:0) after 6m57s
[22:02:34.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:7:0)
[22:02:34.171] Build status: STARTED
[22:02:34.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:8:0) after 1m29s
[22:04:03.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:8:0)
[22:04:03.212] Build status: STARTED
[22:04:03.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:9:0) after 4m34s
[22:08:37.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:9:0)
[22:08:37.315] Build status: STARTED
[22:08:37.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:10:0) after 9m29s
[22:18:06.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:10:0)
[22:18:06.366] Build status: STARTED
[22:18:06.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:11:0) after 1m13s
[22:19:19.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:11:0)
[22:19:19.414] Build status: STARTED
[22:19:19.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:12:0) after 8m38s
[22:27:57.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:12:0)
[22:27:57.584] Build status: STARTED
[22:27:57.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:13:0) after 1m4s
[22:29:01.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:13:0)
[22:29:01.683] Build status: STARTED
[22:29:01.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:14:0) after 1m58s
[22:30:59.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:14:0)
[22:30:59.775] Build status: STARTED
[22:30:59.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:15:0) after 5m7s
[22:36:06.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:15:0)
[22:36:06.869] Build status: STARTED
[22:36:06.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:16:0) after 1m47s
[22:37:53.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:16:0)
[22:37:53.961] Build status: STARTED
[22:37:53.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:17:0) after 6m51s
[22:44:45.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:17:0)
[22:44:45.136] Build status: STARTED
[22:44:45.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:18:0) after 5m12s
[22:49:57.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:18:0)
[22:49:57.263] Build status: STARTED
[22:49:57.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:19:0) after 4m47s
[22:54:44.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:19:0)
[22:54:44.328] Build status: STARTED
[22:54:44.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:20:0) after 2m57s
[22:57:41.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:20:0)
[22:57:41.573] Build status: STARTED
[22:57:41.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:21:0) after 9m23s
[23:07:04.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:21:0)
[23:07:04.637] Build status: STARTED
[23:07:04.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:22:0) after 5m18s
[23:12:22.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:22:0)
[23:12:22.729] Build status: STARTED
[23:12:22.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:23:0) after 5m58s
[23:18:20.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:23:0)
[23:18:20.787] Build status: STARTED
[23:18:20.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:24:0) after 5m0s
[23:23:20.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:24:0)
[23:23:20.843] Build status: STARTED
[23:23:20.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:25:0) after 9m40s
[23:33:00.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:25:0)
[23:33:00.943] Build status: STARTED
[23:33:00.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:26:0) after 3m6s
[23:36:06.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:26:0)
[23:36:06.993] Build status: STARTED
[23:36:06.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:27:0) after 2m28s
[23:38:35.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:27:0)
[23:38:35.097] Build status: STARTED
[23:38:35.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:28:0) after 3m4s
[23:41:39.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:28:0)
[23:41:39.295] Build status: STARTED
[23:41:39.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:29:0) after 7m2s
[23:48:41.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:29:0)
[23:48:41.384] Build status: STARTED
[23:48:41.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:30:0) after 1m29s
[23:50:10.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:30:0)
[23:50:10.537] Build status: STARTED
[23:50:10.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:31:0) after 6m25s
[23:56:35.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:31:0)
[23:56:35.638] Build status: STARTED
[23:56:35.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:32:0) after 9m47s
[00:06:22.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:32:0)
[00:06:22.689] Build status: STARTED
[00:06:22.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:33:0) after 4m44s
[00:11:06.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:33:0)
[00:11:06.803] Build status: STARTED
[00:11:06.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:34:0) after 8m9s
[00:19:15.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:34:0)
[00:19:15.902] Build status: STARTED
[00:19:15.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:35:0) after 3m11s
[00:22:26.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:35:0)
[00:22:26.980] Build status: STARTED
[00:22:26.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:36:0) after 9m5s
[00:31:32.091] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:36:0)
[00:31:32.110] Build status: STARTED
[00:31:32.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:37:0) after 8m52s
[00:40:24.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:37:0)
[00:40:24.273] Build status: STARTED
[00:40:24.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:38:0) after 5m6s
[00:45:30.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:38:0)
[00:45:30.415] Build status: STARTED
[00:45:30.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:39:0) after 1m35s
[00:47:05.408] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:39:0)
[00:47:05.474] Build status: STARTED
[00:47:05.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:40:0) after 4m10s
[00:51:15.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:40:0)
[00:51:15.623] Build status: STARTED
[00:51:15.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:41:0) after 3m56s
[00:55:11.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:41:0)
[00:55:11.786] Build status: STARTED
[00:55:11.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:42:0) after 7m9s
[01:02:20.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:42:0)
[01:02:20.840] Build status: STARTED
[01:02:20.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:43:0) after 3m2s
[01:05:22.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:43:0)
[01:05:22.884] Build status: STARTED
[01:05:22.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:44:0) after 9m41s
[01:15:03.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:44:0)
[01:15:04.000] Build status: STARTED
[01:15:04.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:45:0) after 4m10s
[01:19:14.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:45:0)
[01:19:14.046] Build status: STARTED
[01:19:14.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:46:0) after 4m6s
[01:23:20.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:46:0)
[01:23:20.160] Build status: STARTED
[01:23:20.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:47:0) after 9m39s
[01:32:59.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:47:0)
[01:32:59.215] Build status: STARTED
[01:32:59.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:48:0) after 3m28s
[01:36:27.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:48:0)
[01:36:27.295] Build status: STARTED
[01:36:27.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:49:0) after 4m24s
[01:40:51.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:49:0)
[01:40:51.342] Build status: STARTED
[01:40:51.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:50:0) after 3m12s
[01:44:03.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:50:0)
[01:44:03.454] Build status: STARTED
[01:44:03.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:51:0) after 9m29s
[01:53:32.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:51:0)
[01:53:32.583] Build status: STARTED
[01:53:32.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:52:0) after 8m46s
[02:02:18.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:52:0)
[02:02:18.759] Build status: STARTED
[02:02:18.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:53:0) after 1m47s
[02:04:05.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:53:0)
[02:04:05.814] Build status: STARTED
[02:04:05.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:54:0) after 3m45s
[02:07:50.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:54:0)
[02:07:50.901] Build status: STARTED
[02:07:50.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:55:0) after 3m57s
[02:11:47.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:55:0)
[02:11:47.952] Build status: STARTED
[02:11:47.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:56:0) after 4m2s
[02:15:49.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:56:0)
[02:15:50.010] Build status: STARTED
[02:15:50.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:57:0) after 3m18s
[02:19:08.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:57:0)
[02:19:08.062] Build status: STARTED
[02:19:08.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:58:0) after 6m10s
[02:25:18.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:58:0)
[02:25:18.090] Build status: STARTED
[02:25:18.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:59:0) after 6m32s
[02:31:50.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:59:0)
[02:31:50.148] Build status: STARTED
[02:31:50.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:60:0) after 8m24s
[02:40:14.182] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:60:0)
[02:40:14.200] Build status: STARTED
[02:40:14.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:61:0) after 2m19s
[02:42:33.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:61:0)
[02:42:33.303] Build status: STARTED
[02:42:33.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:62:0) after 9m20s
[02:51:53.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:62:0)
[02:51:53.372] Build status: STARTED
[02:51:53.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:63:0) after 5m14s
[02:57:07.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:63:0)
[02:57:07.490] Build status: STARTED
[02:57:07.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:64:0) after 4m1s
[03:01:08.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:64:0)
[03:01:08.625] Build status: STARTED
[03:01:08.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:65:0) after 7m51s
[03:08:59.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:65:0)
[03:08:59.722] Build status: STARTED
[03:08:59.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:66:0) after 3m6s
[03:12:05.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:66:0)
[03:12:05.776] Build status: STARTED
[03:12:05.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:67:0) after 9m38s
[03:21:43.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:67:0)
[03:21:43.839] Build status: STARTED
[03:21:43.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:68:0) after 3m56s
[03:25:39.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:68:0)
[03:25:39.890] Build status: STARTED
[03:25:39.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:69:0) after 3m43s
[03:29:22.963] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:69:0)
[03:29:22.978] Build status: STARTED
[03:29:22.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:70:0) after 1m13s
[03:30:36.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:70:0)
[03:30:36.063] Build status: STARTED
[03:30:36.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:71:0) after 6m29s
[03:37:05.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:71:0)
[03:37:05.094] Build status: STARTED
[03:37:05.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:72:0) after 8m8s
[03:45:13.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:72:0)
[03:45:13.504] Build status: STARTED
[03:45:13.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:73:0) after 2m50s
[03:48:03.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:73:0)
[03:48:04.006] Build status: STARTED
[03:48:04.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:74:0) after 4m59s
[03:53:03.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:74:0)
[03:53:03.099] Build status: STARTED
[03:53:03.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:75:0) after 4m21s
[03:57:24.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:75:0)
[03:57:24.186] Build status: STARTED
[03:57:24.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:76:0) after 8m48s
[04:06:12.222] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:76:0)
[04:06:12.272] Build status: STARTED
[04:06:12.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:77:0) after 1m33s
[04:07:45.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:77:0)
[04:07:45.343] Build status: STARTED
[04:07:45.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:78:0) after 2m39s
[04:10:24.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:78:0)
[04:10:24.404] Build status: STARTED
[04:10:24.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:79:0) after 3m33s
[04:13:57.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:79:0)
[04:13:57.547] Build status: STARTED
[04:13:57.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:80:0) after 8m32s
[04:22:29.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:80:0)
[04:22:29.619] Build status: STARTED
[04:22:29.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:81:0) after 7m12s
[04:29:41.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:81:0)
[04:29:41.768] Build status: STARTED
[04:29:41.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:82:0) after 3m46s
[04:33:28.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:82:0)
[04:33:28.106] Build status: STARTED
[04:33:28.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:83:0) after 8m50s
[04:42:18.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:83:0)
[04:42:18.162] Build status: STARTED
[04:42:18.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:84:0) after 5m10s
[04:47:28.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:84:0)
[04:47:28.214] Build status: STARTED
[04:47:28.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:85:0) after 1m8s
[04:48:36.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:85:0)
[04:48:36.265] Build status: STARTED
[04:48:36.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:86:0) after 3m50s
[04:52:26.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:86:0)
[04:52:26.307] Build status: STARTED
[04:52:26.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:87:0) after 1m30s
[04:53:56.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:87:0)
[04:53:56.396] Build status: STARTED
[04:53:56.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:88:0) after 4m43s
[04:58:39.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:88:0)
[04:58:39.498] Build status: STARTED
[04:58:39.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:89:0) after 7m26s
[05:06:05.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:89:0)
[05:06:05.673] Build status: STARTED
[05:06:05.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:90:0) after 4m19s
[05:10:24.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:90:0)
[05:10:24.737] Build status: STARTED
[05:10:24.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:91:0) after 1m51s
[05:12:15.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:91:0)
[05:12:15.790] Build status: STARTED
[05:12:15.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:92:0) after 4m39s
[05:16:54.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:92:0)
[05:16:54.900] Build status: STARTED
[05:16:54.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:93:0) after 5m32s
[05:22:26.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:93:0)
[05:22:26.968] Build status: STARTED
[05:22:26.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:94:0) after 1m22s
[05:23:48.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:94:0)
[05:23:49.015] Build status: STARTED
[05:23:49.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:95:0) after 6m1s
[05:29:50.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:95:0)
[05:29:50.056] Build status: STARTED
[05:29:50.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:96:0) after 3m33s
[05:33:23.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:96:0)
[05:33:23.117] Build status: STARTED
[05:33:23.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:97:0) after 3m47s
[05:37:10.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:97:0)
[05:37:10.164] Build status: STARTED
[05:37:10.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:98:0) after 1m30s
[05:38:40.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:98:0)
[05:38:40.250] Build status: STARTED
[05:38:40.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:99:0) after 9m49s
[05:48:29.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:99:0)
[05:48:29.377] Build status: STARTED
[05:48:29.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:100:0) after 2m39s
[05:51:08.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:100:0)
[05:51:08.422] Build status: STARTED
[05:51:08.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:101:0) after 2m50s
[05:53:58.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:101:0)
[05:53:58.474] Build status: STARTED
[05:53:58.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:102:0) after 8m0s
[06:01:58.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:102:0)
[06:01:58.688] Build status: STARTED
[06:01:58.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:103:0) after 8m45s
[06:10:43.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:103:0)
[06:10:43.735] Build status: STARTED
[06:10:43.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:104:0) after 9m28s
[06:20:11.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:104:0)
[06:20:11.779] Build status: STARTED
[06:20:11.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:105:0) after 1m20s
[06:21:31.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:105:0)
[06:21:31.865] Build status: STARTED
[06:21:31.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:106:0) after 3m39s
[06:25:10.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:106:0)
[06:25:10.982] Build status: STARTED
[06:25:10.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:107:0) after 2m56s
[06:28:07.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:107:0)
[06:28:07.050] Build status: STARTED
[06:28:07.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:108:0) after 3m53s
[06:32:00.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:108:0)
[06:32:00.097] Build status: STARTED
[06:32:00.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:109:0) after 6m41s
[06:38:41.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:109:0)
[06:38:41.147] Build status: STARTED
[06:38:41.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:110:0) after 2m30s
[06:41:11.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:110:0)
[06:41:11.198] Build status: STARTED
[06:41:11.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:111:0) after 4m53s
[06:46:04.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:111:0)
[06:46:04.241] Build status: STARTED
[06:46:04.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:112:0) after 2m16s
[06:48:20.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:112:0)
[06:48:20.288] Build status: STARTED
[06:48:20.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:113:0) after 3m23s
[06:51:43.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:113:0)
[06:51:43.475] Build status: STARTED
[06:51:43.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:114:0) after 9m22s
[07:01:05.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:114:0)
[07:01:05.499] Build status: STARTED
[07:01:05.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:115:0) after 2m48s
[07:03:53.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:115:0)
[07:03:53.604] Build status: STARTED
[07:03:53.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:116:0) after 8m19s
[07:12:12.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:116:0)
[07:12:12.660] Build status: STARTED
[07:12:12.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:117:0) after 3m49s
[07:16:01.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:117:0)
[07:16:01.714] Build status: STARTED
[07:16:01.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:118:0) after 1m26s
[07:17:27.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:118:0)
[07:17:27.778] Build status: STARTED
[07:17:27.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:119:0) after 1m8s
[07:18:35.814] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:119:0)
[07:18:35.867] Build status: STARTED
[07:18:35.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:120:0) after 1m0s
[07:19:35.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:120:0)
[07:19:35.915] Build status: STARTED
[07:19:35.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:121:0) after 6m40s
[07:26:15.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:121:0)
[07:26:16.007] Build status: STARTED
[07:26:16.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:122:0) after 2m30s
[07:28:46.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:122:0)
[07:28:46.058] Build status: STARTED
[07:28:46.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:123:0) after 1m0s
[07:29:46.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:123:0)
[07:29:46.202] Build status: STARTED
[07:29:46.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:124:0) after 4m9s
[07:33:55.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:124:0)
[07:33:55.248] Build status: STARTED
[07:33:55.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:125:0) after 1m43s
[07:35:38.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:125:0)
[07:35:38.391] Build status: STARTED
[07:35:38.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:126:0) after 3m45s
[07:39:23.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:126:0)
[07:39:23.524] Build status: STARTED
[07:39:23.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:127:0) after 8m4s
[07:47:27.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:127:0)
[07:47:27.721] Build status: STARTED
[07:47:27.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:128:0) after 1m37s
[07:49:04.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:128:0)
[07:49:04.782] Build status: STARTED
[07:49:04.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:129:0) after 6m26s
[07:55:30.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:129:0)
[07:55:30.870] Build status: STARTED
[07:55:30.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:130:0) after 8m12s
[08:03:42.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:130:0)
[08:03:42.945] Build status: STARTED
[08:03:42.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:131:0) after 4m1s
[08:07:43.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:131:0)
[08:07:44.058] Build status: STARTED
[08:07:44.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:132:0) after 1m19s
[08:09:03.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:132:0)
[08:09:03.106] Build status: STARTED
[08:09:03.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:133:0) after 5m22s
[08:14:25.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:133:0)
[08:14:25.235] Build status: STARTED
[08:14:25.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:134:0) after 1m53s
[08:16:18.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:134:0)
[08:16:18.349] Build status: STARTED
[08:16:18.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:135:0) after 8m2s
[08:24:20.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:135:0)
[08:24:20.463] Build status: STARTED
[08:24:20.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:136:0) after 5m50s
[08:30:10.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:136:0)
[08:30:10.565] Build status: STARTED
[08:30:10.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:137:0) after 7m36s
[08:37:46.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:137:0)
[08:37:46.607] Build status: STARTED
[08:37:46.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:138:0) after 9m30s
[08:47:16.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:138:0)
[08:47:16.660] Build status: STARTED
[08:47:16.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:139:0) after 1m44s
[08:49:00.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:139:0)
[08:49:00.703] Build status: STARTED
[08:49:00.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:140:0) after 8m32s
[08:57:32.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:140:0)
[08:57:32.738] Build status: STARTED
[08:57:32.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:141:0) after 3m7s
[09:00:39.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:141:0)
[09:00:39.839] Build status: STARTED
[09:00:39.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:142:0) after 3m7s
[09:03:46.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:142:0)
[09:03:46.995] Build status: STARTED
[09:03:46.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:143:0) after 5m43s
[09:09:30.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:143:0)
[09:09:30.048] Build status: STARTED
[09:09:30.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:144:0) after 7m50s
[09:17:20.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:144:0)
[09:17:20.117] Build status: STARTED
[09:17:20.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:145:0) after 5m12s
[09:22:32.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:145:0)
[09:22:32.176] Build status: STARTED
[09:22:32.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:146:0) after 3m15s
[09:25:47.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:146:0)
[09:25:47.262] Build status: STARTED
[09:25:47.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:147:0) after 1m29s
[09:27:16.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:147:0)
[09:27:16.315] Build status: STARTED
[09:27:16.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:148:0) after 1m9s
[09:28:25.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:148:0)
[09:28:25.380] Build status: STARTED
[09:28:25.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:149:0) after 2m17s
[09:30:42.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:149:0)
[09:30:42.453] Build status: STARTED
[09:30:42.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:150:0) after 7m33s
[09:38:15.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:150:0)
[09:38:15.536] Build status: STARTED
[09:38:15.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:151:0) after 8m9s
[09:46:24.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:151:0)
[09:46:24.634] Build status: STARTED
[09:46:24.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:152:0) after 8m37s
[09:55:01.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:152:0)
[09:55:01.686] Build status: STARTED
[09:55:01.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:153:0) after 1m6s
[09:56:07.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:153:0)
[09:56:07.738] Build status: STARTED
[09:56:07.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:154:0) after 5m23s
[10:01:30.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:154:0)
[10:01:30.784] Build status: STARTED
[10:01:30.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:155:0) after 4m30s
[10:06:00.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:155:0)
[10:06:00.876] Build status: STARTED
[10:06:00.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:156:0) after 7m28s
[10:13:28.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:156:0)
[10:13:28.909] Build status: STARTED
[10:13:28.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:157:0) after 6m46s
[10:20:14.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:157:0)
[10:20:15.001] Build status: STARTED
[10:20:15.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:158:0) after 4m17s
[10:24:32.046] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:158:0)
[10:24:32.071] Build status: STARTED
[10:24:32.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:159:0) after 7m44s
[10:32:16.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:159:0)
[10:32:16.163] Build status: STARTED
[10:32:16.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:160:0) after 8m19s
[10:40:35.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:160:0)
[10:40:35.216] Build status: STARTED
[10:40:35.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:161:0) after 4m0s
[10:44:35.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:161:0)
[10:44:35.453] Build status: STARTED
[10:44:35.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:162:0) after 8m48s
[10:53:23.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:162:0)
[10:53:23.759] Build status: STARTED
[10:53:23.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:163:0) after 8m39s
[11:02:02.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:163:0)
[11:02:02.805] Build status: STARTED
[11:02:02.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:164:0) after 7m51s
[11:09:53.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:164:0)
[11:09:53.841] Build status: STARTED
[11:09:53.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:165:0) after 2m8s
[11:12:01.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:165:0)
[11:12:01.908] Build status: STARTED
[11:12:01.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:166:0) after 8m59s
[11:21:01.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:166:0)
[11:21:01.043] Build status: STARTED
[11:21:01.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:167:0) after 1m19s
[11:22:20.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:167:0)
[11:22:20.098] Build status: STARTED
[11:22:20.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:168:0) after 8m22s
[11:30:42.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:168:0)
[11:30:42.143] Build status: STARTED
[11:30:42.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:169:0) after 1m27s
[11:32:09.182] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:169:0)
[11:32:09.209] Build status: STARTED
[11:32:09.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:170:0) after 9m48s
[11:41:57.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:170:0)
[11:41:57.258] Build status: STARTED
[11:41:57.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:171:0) after 6m42s
[11:48:39.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:171:0)
[11:48:39.328] Build status: STARTED
[11:48:39.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:172:0) after 9m41s
[11:58:20.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:172:0)
[11:58:20.409] Build status: STARTED
[11:58:20.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:173:0) after 9m11s
[12:07:31.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:173:0)
[12:07:31.502] Build status: STARTED
[12:07:31.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:174:0) after 9m29s
[12:17:00.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:174:0)
[12:17:00.584] Build status: STARTED
[12:17:00.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:175:0) after 1m32s
[12:18:32.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:175:0)
[12:18:32.741] Build status: STARTED
[12:18:32.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:176:0) after 5m0s
[12:23:32.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:176:0)
[12:23:32.750] Build status: STARTED
[12:23:32.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:177:0) after 6m26s
[12:29:58.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:177:0)
[12:29:58.866] Build status: STARTED
[12:29:58.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:178:0) after 5m2s
[12:35:00.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:178:0)
[12:35:00.956] Build status: STARTED
[12:35:00.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:179:0) after 2m31s
[12:37:32.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:179:0)
[12:37:32.102] Build status: STARTED
[12:37:32.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:180:0) after 4m40s
[12:42:12.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:180:0)
[12:42:12.170] Build status: STARTED
[12:42:12.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:181:0) after 6m21s
[12:48:33.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:181:0)
[12:48:33.176] Build status: STARTED
[12:48:33.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:182:0) after 4m43s
[12:53:16.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:182:0)
[12:53:16.245] Build status: STARTED
[12:53:16.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:183:0) after 6m56s
[13:00:12.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:183:0)
[13:00:12.313] Build status: STARTED
[13:00:12.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:184:0) after 3m47s
[13:03:59.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:184:0)
[13:03:59.362] Build status: STARTED
[13:03:59.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:185:0) after 2m20s
[13:06:19.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:185:0)
[13:06:19.544] Build status: STARTED
[13:06:19.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:186:0) after 5m11s
[13:11:30.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:186:0)
[13:11:30.635] Build status: STARTED
[13:11:30.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:187:0) after 6m17s
[13:17:47.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:187:0)
[13:17:47.682] Build status: STARTED
[13:17:47.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:188:0) after 2m32s
[13:20:19.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:188:0)
[13:20:19.801] Build status: STARTED
[13:20:19.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:189:0) after 4m38s
[13:24:57.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:189:0)
[13:24:57.925] Build status: STARTED
[13:24:57.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8870053245631110992:190:0) after 8m8s
[13:31:48.071] Received PubSub notification, asking Buildbucket for the build status
[13:31:48.132] Build:
{
"id": "8704623183510912465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 17930,
"createdBy": "project:chromium",
"createTime": "2025-09-04T21:30:58.099491777Z",
"startTime": "2025-09-04T21:31:05.180105786Z",
"endTime": "2025-09-05T13:31:47.626589701Z",
"updateTime": "2025-09-05T13:31:47.626589701Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae5d08093173315512054c5a4227061a002a7c8a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[13:31:48.133] Invocation finished in 16h0m51.43974899s with status FAILED