[00:15:05.161] New invocation is queued and will start shortly
[00:15:06.517] Starting the invocation (attempt 1)
[00:15:06.579] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4e62a62e09b452347914fe21db01661dbb338aa3"
[00:15:06.579] Popped gitiles commit info from properties and tags
[00:15:06.579] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:15:06.580] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:15:06.580] Buildbucket request:
{
"requestId": "8972417490812405744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4e62a62e09b452347914fe21db01661dbb338aa3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8972417490812405744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:15:07.168] Scheduled build:
{
"id": "8806987428580298033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 3411,
"createdBy": "project:chromium",
"createTime": "2022-08-02T00:15:06.658711667Z",
"updateTime": "2022-08-02T00:15:06.658711667Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4e62a62e09b452347914fe21db01661dbb338aa3",
"ref": "refs/heads/main"
}
}
}
[00:15:07.168] Task URL: https://cr-buildbucket.appspot.com/build/8806987428580298033
[00:15:07.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:2:0) after 8m0s
[00:16:00.691] Received PubSub notification, asking Buildbucket for the build status
[00:16:00.744] Build status: STARTED
[00:23:07.296] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:2:0)
[00:23:07.320] Build status: STARTED
[00:23:07.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:4:0) after 8m55s
[00:32:02.341] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:4:0)
[00:32:02.362] Build status: STARTED
[00:32:02.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:5:0) after 8m52s
[00:40:54.519] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:5:0)
[00:40:54.563] Build status: STARTED
[00:40:54.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:6:0) after 3m32s
[00:44:26.639] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:6:0)
[00:44:26.662] Build status: STARTED
[00:44:26.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:7:0) after 2m50s
[00:47:16.683] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:7:0)
[00:47:16.736] Build status: STARTED
[00:47:16.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:8:0) after 3m46s
[00:51:03.632] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:8:0)
[00:51:03.767] Build status: STARTED
[00:51:03.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:9:0) after 5m6s
[00:56:09.805] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:9:0)
[00:56:09.827] Build status: STARTED
[00:56:09.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:10:0) after 9m36s
[01:05:45.983] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:10:0)
[01:05:46.017] Build status: STARTED
[01:05:46.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:11:0) after 7m40s
[01:13:26.086] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:11:0)
[01:13:26.127] Build status: STARTED
[01:13:26.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:12:0) after 4m37s
[01:18:03.183] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:12:0)
[01:18:03.206] Build status: STARTED
[01:18:03.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:13:0) after 6m15s
[01:24:18.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:13:0)
[01:24:18.241] Build status: STARTED
[01:24:18.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:14:0) after 6m4s
[01:30:22.267] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:14:0)
[01:30:22.298] Build status: STARTED
[01:30:22.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:15:0) after 2m8s
[01:32:30.321] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:15:0)
[01:32:30.357] Build status: STARTED
[01:32:30.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:16:0) after 5m50s
[01:38:20.490] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:16:0)
[01:38:20.513] Build status: STARTED
[01:38:20.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:17:0) after 2m49s
[01:41:09.609] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:17:0)
[01:41:09.632] Build status: STARTED
[01:41:09.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:18:0) after 5m32s
[01:46:41.659] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:18:0)
[01:46:41.686] Build status: STARTED
[01:46:41.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:19:0) after 3m32s
[01:50:13.957] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:19:0)
[01:50:14.009] Build status: STARTED
[01:50:14.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:20:0) after 3m37s
[01:53:51.032] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:20:0)
[01:53:51.060] Build status: STARTED
[01:53:51.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:21:0) after 9m6s
[02:02:57.147] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:21:0)
[02:02:57.166] Build status: STARTED
[02:02:57.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:22:0) after 8m4s
[02:11:01.325] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:22:0)
[02:11:01.366] Build status: STARTED
[02:11:01.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:23:0) after 2m22s
[02:13:23.597] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:23:0)
[02:13:23.655] Build status: STARTED
[02:13:23.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:24:0) after 9m27s
[02:22:50.646] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:24:0)
[02:22:50.682] Build status: STARTED
[02:22:50.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:25:0) after 2m9s
[02:25:00.204] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:25:0)
[02:25:00.243] Build status: STARTED
[02:25:00.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:26:0) after 6m24s
[02:31:24.772] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:26:0)
[02:31:24.832] Build status: STARTED
[02:31:24.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:27:0) after 9m58s
[02:41:22.868] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:27:0)
[02:41:22.945] Build status: STARTED
[02:41:22.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:28:0) after 4m11s
[02:45:34.087] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:28:0)
[02:45:34.123] Build status: STARTED
[02:45:34.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:29:0) after 5m24s
[02:50:58.150] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:29:0)
[02:50:58.172] Build status: STARTED
[02:50:58.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:30:0) after 1m30s
[02:52:28.273] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:30:0)
[02:52:28.306] Build status: STARTED
[02:52:28.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:31:0) after 3m6s
[02:55:34.377] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:31:0)
[02:55:34.401] Build status: STARTED
[02:55:34.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:32:0) after 3m53s
[02:59:27.667] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:32:0)
[02:59:27.700] Build status: STARTED
[02:59:27.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:33:0) after 3m42s
[03:03:09.834] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:33:0)
[03:03:09.873] Build status: STARTED
[03:03:09.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:34:0) after 8m20s
[03:11:29.913] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:34:0)
[03:11:30.004] Build status: STARTED
[03:11:30.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:35:0) after 5m29s
[03:16:59.127] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:35:0)
[03:16:59.160] Build status: STARTED
[03:16:59.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:36:0) after 6m13s
[03:23:12.160] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:36:0)
[03:23:12.181] Build status: STARTED
[03:23:12.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:37:0) after 4m35s
[03:27:47.275] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:37:0)
[03:27:47.306] Build status: STARTED
[03:27:47.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:38:0) after 4m17s
[03:32:04.339] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:38:0)
[03:32:04.372] Build status: STARTED
[03:32:04.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:39:0) after 6m23s
[03:38:27.485] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:39:0)
[03:38:27.508] Build status: STARTED
[03:38:27.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:40:0) after 4m12s
[03:42:39.822] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:40:0)
[03:42:39.844] Build status: STARTED
[03:42:39.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:41:0) after 1m18s
[03:43:57.851] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:41:0)
[03:43:57.886] Build status: STARTED
[03:43:57.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:42:0) after 3m50s
[03:47:47.911] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:42:0)
[03:47:47.942] Build status: STARTED
[03:47:47.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:43:0) after 8m4s
[03:55:52.182] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:43:0)
[03:55:52.213] Build status: STARTED
[03:55:52.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:44:0) after 4m10s
[04:00:02.280] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:44:0)
[04:00:02.311] Build status: STARTED
[04:00:02.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:45:0) after 3m27s
[04:03:29.319] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:45:0)
[04:03:29.339] Build status: STARTED
[04:03:29.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:46:0) after 5m26s
[04:08:55.433] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:46:0)
[04:08:55.456] Build status: STARTED
[04:08:55.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:47:0) after 7m32s
[04:16:27.477] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:47:0)
[04:16:27.498] Build status: STARTED
[04:16:27.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:48:0) after 5m11s
[04:21:38.522] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:48:0)
[04:21:38.555] Build status: STARTED
[04:21:38.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:49:0) after 4m21s
[04:25:59.718] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:49:0)
[04:25:59.761] Build status: STARTED
[04:25:59.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:50:0) after 2m43s
[04:28:42.813] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:50:0)
[04:28:42.835] Build status: STARTED
[04:28:42.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:51:0) after 8m37s
[04:37:19.847] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:51:0)
[04:37:19.897] Build status: STARTED
[04:37:19.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8972417490812405744:52:0) after 7m28s
[04:40:06.734] Received PubSub notification, asking Buildbucket for the build status
[04:40:06.757] Build:
{
"id": "8806987428580298033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 3411,
"createdBy": "project:chromium",
"createTime": "2022-08-02T00:15:06.658711667Z",
"startTime": "2022-08-02T00:16:00.134044Z",
"endTime": "2022-08-02T04:40:06.265158879Z",
"updateTime": "2022-08-02T04:40:06.265158879Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4e62a62e09b452347914fe21db01661dbb338aa3",
"ref": "refs/heads/main"
}
}
}
[04:40:06.757] Invocation finished in 4h25m1.612448175s with status FAILED