[20:19:35.111] New invocation is queued and will start shortly
[20:19:36.321] Starting the invocation (attempt 1)
[20:19:36.360] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f8933e31c0e18c6226f4005f1f7679b4518c968a"
[20:19:36.360] Popped gitiles commit info from properties and tags
[20:19:36.360] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:19:36.360] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:19:36.360] Buildbucket request:
{
"requestId": "8964278580277628000",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f8933e31c0e18c6226f4005f1f7679b4518c968a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8964278580277628000"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:19:36.810] Scheduled build:
{
"id": "8798848518215515857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 3993,
"createdBy": "project:chromium",
"createTime": "2022-10-30T20:19:36.436871907Z",
"updateTime": "2022-10-30T20:19:36.436871907Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f8933e31c0e18c6226f4005f1f7679b4518c968a",
"ref": "refs/heads/main"
}
}
}
[20:19:36.810] Task URL: https://cr-buildbucket.appspot.com/build/8798848518215515857
[20:19:36.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:2:0) after 1m1s
[20:19:40.061] Received PubSub notification, asking Buildbucket for the build status
[20:19:40.085] Build status: STARTED
[20:20:37.832] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:2:0)
[20:20:37.866] Build status: STARTED
[20:20:37.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:4:0) after 6m42s
[20:27:19.960] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:4:0)
[20:27:19.991] Build status: STARTED
[20:27:19.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:5:0) after 2m34s
[20:29:53.993] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:5:0)
[20:29:54.014] Build status: STARTED
[20:29:54.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:6:0) after 1m53s
[20:31:47.102] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:6:0)
[20:31:47.136] Build status: STARTED
[20:31:47.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:7:0) after 1m20s
[20:33:07.318] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:7:0)
[20:33:07.339] Build status: STARTED
[20:33:07.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:8:0) after 4m42s
[20:37:49.364] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:8:0)
[20:37:49.387] Build status: STARTED
[20:37:49.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:9:0) after 2m9s
[20:39:58.541] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:9:0)
[20:39:58.584] Build status: STARTED
[20:39:58.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:10:0) after 6m19s
[20:46:17.614] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:10:0)
[20:46:17.638] Build status: STARTED
[20:46:17.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:11:0) after 3m43s
[20:50:01.258] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:11:0)
[20:50:01.283] Build status: STARTED
[20:50:01.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:12:0) after 5m1s
[20:55:02.316] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:12:0)
[20:55:02.339] Build status: STARTED
[20:55:02.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:13:0) after 4m45s
[20:59:47.378] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:13:0)
[20:59:47.400] Build status: STARTED
[20:59:47.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:14:0) after 6m31s
[21:06:18.393] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:14:0)
[21:06:18.527] Build status: STARTED
[21:06:18.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:15:0) after 6m45s
[21:13:03.594] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:15:0)
[21:13:03.616] Build status: STARTED
[21:13:03.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:16:0) after 6m29s
[21:19:32.636] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:16:0)
[21:19:32.727] Build status: STARTED
[21:19:32.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:17:0) after 8m48s
[21:28:20.885] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:17:0)
[21:28:20.910] Build status: STARTED
[21:28:20.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:18:0) after 1m12s
[21:29:32.995] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:18:0)
[21:29:33.023] Build status: STARTED
[21:29:33.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:19:0) after 2m3s
[21:31:36.003] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:19:0)
[21:31:36.064] Build status: STARTED
[21:31:36.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:20:0) after 9m58s
[21:41:34.366] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:20:0)
[21:41:34.388] Build status: STARTED
[21:41:34.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:21:0) after 5m27s
[21:47:01.749] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:21:0)
[21:47:01.779] Build status: STARTED
[21:47:01.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:22:0) after 4m46s
[21:51:47.811] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:22:0)
[21:51:47.837] Build status: STARTED
[21:51:47.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:23:0) after 4m16s
[21:56:03.938] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:23:0)
[21:56:03.961] Build status: STARTED
[21:56:03.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:24:0) after 8m56s
[22:04:59.981] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:24:0)
[22:05:00.024] Build status: STARTED
[22:05:00.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:25:0) after 7m55s
[22:12:55.392] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:25:0)
[22:12:55.416] Build status: STARTED
[22:12:55.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:26:0) after 1m26s
[22:14:21.687] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:26:0)
[22:14:21.714] Build status: STARTED
[22:14:21.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:27:0) after 2m20s
[22:16:41.842] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:27:0)
[22:16:41.866] Build status: STARTED
[22:16:41.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:28:0) after 6m35s
[22:23:17.141] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:28:0)
[22:23:17.167] Build status: STARTED
[22:23:17.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:29:0) after 4m3s
[22:27:20.271] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:29:0)
[22:27:20.296] Build status: STARTED
[22:27:20.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:30:0) after 1m34s
[22:28:54.420] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:30:0)
[22:28:54.445] Build status: STARTED
[22:28:54.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:31:0) after 1m37s
[22:30:31.474] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:31:0)
[22:30:31.503] Build status: STARTED
[22:30:31.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:32:0) after 1m49s
[22:32:21.218] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:32:0)
[22:32:21.245] Build status: STARTED
[22:32:21.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:33:0) after 1m34s
[22:33:55.461] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:33:0)
[22:33:55.483] Build status: STARTED
[22:33:55.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:34:0) after 5m55s
[22:39:50.695] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:34:0)
[22:39:50.716] Build status: STARTED
[22:39:50.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:35:0) after 5m1s
[22:44:51.755] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:35:0)
[22:44:51.790] Build status: STARTED
[22:44:51.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:36:0) after 7m11s
[22:52:03.295] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:36:0)
[22:52:03.324] Build status: STARTED
[22:52:03.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:37:0) after 5m39s
[22:57:42.350] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:37:0)
[22:57:42.373] Build status: STARTED
[22:57:42.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:38:0) after 8m41s
[23:06:23.613] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:38:0)
[23:06:23.640] Build status: STARTED
[23:06:23.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:39:0) after 6m3s
[23:12:27.001] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:39:0)
[23:12:27.031] Build status: STARTED
[23:12:27.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:40:0) after 4m42s
[23:17:09.123] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:40:0)
[23:17:09.150] Build status: STARTED
[23:17:09.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:41:0) after 2m58s
[23:20:07.178] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:41:0)
[23:20:07.212] Build status: STARTED
[23:20:07.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:42:0) after 1m27s
[23:21:34.331] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:42:0)
[23:21:34.353] Build status: STARTED
[23:21:34.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:43:0) after 3m11s
[23:24:45.426] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:43:0)
[23:24:45.453] Build status: STARTED
[23:24:45.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:44:0) after 9m41s
[23:34:26.579] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:44:0)
[23:34:26.607] Build status: STARTED
[23:34:26.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:45:0) after 1m45s
[23:36:11.631] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:45:0)
[23:36:11.655] Build status: STARTED
[23:36:11.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:46:0) after 2m16s
[23:38:27.979] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:46:0)
[23:38:28.001] Build status: STARTED
[23:38:28.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:47:0) after 6m19s
[23:44:47.032] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:47:0)
[23:44:47.052] Build status: STARTED
[23:44:47.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:48:0) after 8m4s
[23:52:51.075] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:48:0)
[23:52:51.099] Build status: STARTED
[23:52:51.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:49:0) after 8m29s
[00:01:20.224] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:49:0)
[00:01:20.256] Build status: STARTED
[00:01:20.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:50:0) after 2m19s
[00:03:39.402] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:50:0)
[00:03:39.430] Build status: STARTED
[00:03:39.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:51:0) after 3m55s
[00:07:34.453] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:51:0)
[00:07:34.492] Build status: STARTED
[00:07:34.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:52:0) after 5m35s
[00:13:09.519] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:52:0)
[00:13:09.545] Build status: STARTED
[00:13:09.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:53:0) after 2m29s
[00:15:38.578] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:53:0)
[00:15:38.605] Build status: STARTED
[00:15:38.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:54:0) after 1m31s
[00:17:09.635] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:54:0)
[00:17:09.655] Build status: STARTED
[00:17:09.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:55:0) after 8m8s
[00:25:17.785] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:55:0)
[00:25:17.806] Build status: STARTED
[00:25:17.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:56:0) after 2m15s
[00:27:32.902] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:56:0)
[00:27:32.929] Build status: STARTED
[00:27:32.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:57:0) after 1m5s
[00:28:38.042] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:57:0)
[00:28:38.081] Build status: STARTED
[00:28:38.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:58:0) after 2m22s
[00:31:00.108] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:58:0)
[00:31:00.143] Build status: STARTED
[00:31:00.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:59:0) after 8m31s
[00:39:31.167] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:59:0)
[00:39:31.187] Build status: STARTED
[00:39:31.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:60:0) after 7m54s
[00:47:25.226] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:60:0)
[00:47:25.255] Build status: STARTED
[00:47:25.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:61:0) after 2m12s
[00:49:37.298] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:61:0)
[00:49:37.327] Build status: STARTED
[00:49:37.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:62:0) after 1m46s
[00:51:23.465] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:62:0)
[00:51:23.494] Build status: STARTED
[00:51:23.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:63:0) after 1m16s
[00:52:39.831] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:63:0)
[00:52:39.859] Build status: STARTED
[00:52:39.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:64:0) after 5m31s
[00:58:10.906] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:64:0)
[00:58:10.931] Build status: STARTED
[00:58:10.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:65:0) after 1m3s
[00:59:13.953] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:65:0)
[00:59:13.983] Build status: STARTED
[00:59:13.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:66:0) after 9m41s
[01:08:55.026] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:66:0)
[01:08:55.051] Build status: STARTED
[01:08:55.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:67:0) after 4m10s
[01:13:05.140] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:67:0)
[01:13:05.251] Build status: STARTED
[01:13:05.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:68:0) after 9m32s
[01:22:37.276] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:68:0)
[01:22:37.299] Build status: STARTED
[01:22:37.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:69:0) after 3m33s
[01:26:10.542] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:69:0)
[01:26:10.565] Build status: STARTED
[01:26:10.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:70:0) after 9m9s
[01:35:19.590] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:70:0)
[01:35:19.613] Build status: STARTED
[01:35:19.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:71:0) after 4m48s
[01:40:07.684] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:71:0)
[01:40:07.797] Build status: STARTED
[01:40:07.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:72:0) after 6m50s
[01:46:57.920] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:72:0)
[01:46:57.945] Build status: STARTED
[01:46:57.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:73:0) after 4m36s
[01:51:34.144] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:73:0)
[01:51:34.176] Build status: STARTED
[01:51:34.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:74:0) after 6m8s
[01:57:42.240] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:74:0)
[01:57:42.264] Build status: STARTED
[01:57:42.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:75:0) after 2m8s
[01:59:50.298] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:75:0)
[01:59:50.326] Build status: STARTED
[01:59:50.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:76:0) after 3m24s
[02:03:14.487] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:76:0)
[02:03:14.545] Build status: STARTED
[02:03:14.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:77:0) after 9m25s
[02:12:39.671] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:77:0)
[02:12:39.695] Build status: STARTED
[02:12:39.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:78:0) after 5m49s
[02:18:28.724] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:78:0)
[02:18:28.797] Build status: STARTED
[02:18:28.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:79:0) after 6m27s
[02:24:55.833] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:79:0)
[02:24:55.857] Build status: STARTED
[02:24:55.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:80:0) after 2m54s
[02:27:49.888] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:80:0)
[02:27:49.911] Build status: STARTED
[02:27:49.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:81:0) after 6m4s
[02:33:53.945] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:81:0)
[02:33:53.965] Build status: STARTED
[02:33:53.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:82:0) after 1m6s
[02:35:00.140] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:82:0)
[02:35:00.207] Build status: STARTED
[02:35:00.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:83:0) after 9m24s
[02:44:24.290] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:83:0)
[02:44:24.318] Build status: STARTED
[02:44:24.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:84:0) after 1m35s
[02:45:59.344] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:84:0)
[02:45:59.369] Build status: STARTED
[02:45:59.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:85:0) after 5m43s
[02:51:42.413] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:85:0)
[02:51:42.434] Build status: STARTED
[02:51:42.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:86:0) after 1m34s
[02:53:16.555] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:86:0)
[02:53:16.585] Build status: STARTED
[02:53:16.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:87:0) after 4m54s
[02:58:10.610] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:87:0)
[02:58:10.637] Build status: STARTED
[02:58:10.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:88:0) after 1m50s
[03:00:01.347] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:88:0)
[03:00:01.371] Build status: STARTED
[03:00:01.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:89:0) after 6m45s
[03:06:46.410] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:89:0)
[03:06:46.434] Build status: STARTED
[03:06:46.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:90:0) after 1m19s
[03:08:05.457] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:90:0)
[03:08:05.483] Build status: STARTED
[03:08:05.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:91:0) after 2m11s
[03:10:16.579] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:91:0)
[03:10:16.603] Build status: STARTED
[03:10:16.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:92:0) after 9m26s
[03:19:42.740] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:92:0)
[03:19:42.764] Build status: STARTED
[03:19:42.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:93:0) after 7m33s
[03:27:15.929] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:93:0)
[03:27:15.951] Build status: STARTED
[03:27:15.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:94:0) after 5m59s
[03:33:14.992] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:94:0)
[03:33:15.032] Build status: STARTED
[03:33:15.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:95:0) after 8m51s
[03:42:06.061] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:95:0)
[03:42:06.083] Build status: STARTED
[03:42:06.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:96:0) after 5m32s
[03:47:38.109] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:96:0)
[03:47:38.135] Build status: STARTED
[03:47:38.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:97:0) after 1m0s
[03:48:38.376] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:97:0)
[03:48:38.399] Build status: STARTED
[03:48:38.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:98:0) after 3m11s
[03:51:49.471] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:98:0)
[03:51:49.498] Build status: STARTED
[03:51:49.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:99:0) after 2m39s
[03:54:28.639] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:99:0)
[03:54:28.659] Build status: STARTED
[03:54:28.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:100:0) after 9m7s
[04:03:35.711] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:100:0)
[04:03:35.737] Build status: STARTED
[04:03:35.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:101:0) after 7m38s
[04:11:13.764] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:101:0)
[04:11:13.787] Build status: STARTED
[04:11:13.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:102:0) after 1m43s
[04:12:56.911] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:102:0)
[04:12:57.028] Build status: STARTED
[04:12:57.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:103:0) after 2m6s
[04:15:03.133] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:103:0)
[04:15:03.160] Build status: STARTED
[04:15:03.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:104:0) after 7m40s
[04:22:43.228] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:104:0)
[04:22:43.251] Build status: STARTED
[04:22:43.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:105:0) after 7m18s
[04:30:01.812] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:105:0)
[04:30:01.842] Build status: STARTED
[04:30:01.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:106:0) after 2m50s
[04:32:51.972] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:106:0)
[04:32:52.072] Build status: STARTED
[04:32:52.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:107:0) after 4m46s
[04:37:38.205] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:107:0)
[04:37:38.229] Build status: STARTED
[04:37:38.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:108:0) after 8m11s
[04:45:49.308] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:108:0)
[04:45:49.333] Build status: STARTED
[04:45:49.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:109:0) after 6m57s
[04:52:46.355] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:109:0)
[04:52:46.379] Build status: STARTED
[04:52:46.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:110:0) after 1m7s
[04:53:53.403] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:110:0)
[04:53:53.427] Build status: STARTED
[04:53:53.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:111:0) after 8m7s
[05:02:00.462] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:111:0)
[05:02:00.502] Build status: STARTED
[05:02:00.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:112:0) after 6m47s
[05:08:47.609] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:112:0)
[05:08:47.642] Build status: STARTED
[05:08:47.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:113:0) after 3m24s
[05:12:11.670] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:113:0)
[05:12:11.697] Build status: STARTED
[05:12:11.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:114:0) after 4m57s
[05:17:08.731] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:114:0)
[05:17:08.761] Build status: STARTED
[05:17:08.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:115:0) after 8m11s
[05:25:19.789] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:115:0)
[05:25:19.816] Build status: STARTED
[05:25:19.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:116:0) after 5m11s
[05:30:30.937] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:116:0)
[05:30:30.962] Build status: STARTED
[05:30:30.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:117:0) after 8m33s
[05:39:04.090] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:117:0)
[05:39:04.128] Build status: STARTED
[05:39:04.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:118:0) after 2m35s
[05:41:39.230] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:118:0)
[05:41:39.262] Build status: STARTED
[05:41:39.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:119:0) after 2m26s
[05:44:05.288] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:119:0)
[05:44:05.317] Build status: STARTED
[05:44:05.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:120:0) after 2m56s
[05:47:01.476] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:120:0)
[05:47:01.500] Build status: STARTED
[05:47:01.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:121:0) after 3m52s
[05:50:53.559] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:121:0)
[05:50:53.582] Build status: STARTED
[05:50:53.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:122:0) after 3m26s
[05:54:19.625] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:122:0)
[05:54:19.651] Build status: STARTED
[05:54:19.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:123:0) after 4m46s
[05:59:06.007] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:123:0)
[05:59:06.082] Build status: STARTED
[05:59:06.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:124:0) after 1m53s
[06:00:59.108] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:124:0)
[06:00:59.157] Build status: STARTED
[06:00:59.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:125:0) after 5m54s
[06:06:53.201] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:125:0)
[06:06:53.231] Build status: STARTED
[06:06:53.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:126:0) after 1m18s
[06:08:11.253] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:126:0)
[06:08:11.278] Build status: STARTED
[06:08:11.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:127:0) after 9m33s
[06:17:44.356] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:127:0)
[06:17:44.380] Build status: STARTED
[06:17:44.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:128:0) after 7m13s
[06:24:57.640] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:128:0)
[06:24:57.665] Build status: STARTED
[06:24:57.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:129:0) after 7m4s
[06:32:01.745] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:129:0)
[06:32:01.768] Build status: STARTED
[06:32:01.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:130:0) after 3m39s
[06:35:40.928] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:130:0)
[06:35:40.954] Build status: STARTED
[06:35:40.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:131:0) after 9m20s
[06:45:01.800] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:131:0)
[06:45:01.828] Build status: STARTED
[06:45:01.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:132:0) after 2m41s
[06:47:42.851] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:132:0)
[06:47:42.875] Build status: STARTED
[06:47:42.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:133:0) after 1m20s
[06:49:03.008] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:133:0)
[06:49:03.032] Build status: STARTED
[06:49:03.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:134:0) after 3m34s
[06:52:37.089] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:134:0)
[06:52:37.152] Build status: STARTED
[06:52:37.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:135:0) after 4m26s
[06:57:03.200] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:135:0)
[06:57:03.225] Build status: STARTED
[06:57:03.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:136:0) after 5m0s
[07:02:03.550] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:136:0)
[07:02:03.588] Build status: STARTED
[07:02:03.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:137:0) after 8m41s
[07:10:44.874] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:137:0)
[07:10:44.894] Build status: STARTED
[07:10:44.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:138:0) after 2m41s
[07:13:25.922] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:138:0)
[07:13:25.995] Build status: STARTED
[07:13:25.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:139:0) after 5m56s
[07:19:22.021] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:139:0)
[07:19:22.045] Build status: STARTED
[07:19:22.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8964278580277628000:140:0) after 8m38s
[07:26:04.656] Received PubSub notification, asking Buildbucket for the build status
[07:26:04.685] Build:
{
"id": "8798848518215515857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 3993,
"createdBy": "project:chromium",
"createTime": "2022-10-30T20:19:36.436871907Z",
"startTime": "2022-10-30T20:19:39.480671Z",
"endTime": "2022-10-31T07:26:04.276750955Z",
"updateTime": "2022-10-31T07:26:04.276750955Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f8933e31c0e18c6226f4005f1f7679b4518c968a",
"ref": "refs/heads/main"
}
}
}
[07:26:04.685] Invocation finished in 11h6m29.599127536s with status FAILED