[00:31:24.747] New invocation is queued and will start shortly
[00:31:25.851] Starting the invocation (attempt 1)
[00:31:25.880] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c2cbc3d183f1ef18d02dcf478cc93127b7a3a8ed"
[00:31:25.880] Popped gitiles commit info from properties and tags
[00:31:25.880] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:31:25.880] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:31:25.881] Buildbucket request:
{
"requestId": "8925849622909560288",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c2cbc3d183f1ef18d02dcf478cc93127b7a3a8ed",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8925849622909560288"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:31:26.454] Scheduled build:
{
"id": "8760419561003412705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 26796,
"createdBy": "project:chromium",
"createTime": "2023-12-29T00:31:25.936916007Z",
"updateTime": "2023-12-29T00:31:25.936916007Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c2cbc3d183f1ef18d02dcf478cc93127b7a3a8ed",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:31:26.454] Task URL: https://cr-buildbucket.appspot.com/build/8760419561003412705
[00:31:26.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:2:0) after 3m32s
[00:31:27.361] Received PubSub notification, asking Buildbucket for the build status
[00:31:27.377] Build status: SCHEDULED
[00:32:09.587] Received PubSub notification, asking Buildbucket for the build status
[00:32:09.630] Build status: STARTED
[00:34:58.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:2:0)
[00:34:58.639] Build status: STARTED
[00:34:58.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:5:0) after 6m51s
[00:41:49.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:5:0)
[00:41:49.927] Build status: STARTED
[00:41:49.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:6:0) after 9m28s
[00:51:18.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:6:0)
[00:51:18.117] Build status: STARTED
[00:51:18.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:7:0) after 4m12s
[00:55:30.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:7:0)
[00:55:30.194] Build status: STARTED
[00:55:30.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:8:0) after 4m50s
[01:00:20.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:8:0)
[01:00:20.929] Build status: STARTED
[01:00:20.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:9:0) after 2m42s
[01:03:03.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:9:0)
[01:03:03.084] Build status: STARTED
[01:03:03.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:10:0) after 4m11s
[01:07:14.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:10:0)
[01:07:14.272] Build status: STARTED
[01:07:14.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:11:0) after 4m34s
[01:11:48.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:11:0)
[01:11:48.346] Build status: STARTED
[01:11:48.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:12:0) after 6m57s
[01:18:45.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:12:0)
[01:18:45.479] Build status: STARTED
[01:18:45.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:13:0) after 7m37s
[01:26:22.600] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:13:0)
[01:26:22.624] Build status: STARTED
[01:26:22.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:14:0) after 4m28s
[01:30:50.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:14:0)
[01:30:50.698] Build status: STARTED
[01:30:50.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:15:0) after 1m58s
[01:32:48.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:15:0)
[01:32:48.771] Build status: STARTED
[01:32:48.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:16:0) after 1m3s
[01:33:52.285] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:16:0)
[01:33:52.300] Build status: STARTED
[01:33:52.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:17:0) after 1m43s
[01:35:35.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:17:0)
[01:35:35.407] Build status: STARTED
[01:35:35.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:18:0) after 3m7s
[01:38:43.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:18:0)
[01:38:43.196] Build status: STARTED
[01:38:43.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:19:0) after 2m48s
[01:41:31.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:19:0)
[01:41:31.289] Build status: STARTED
[01:41:31.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:20:0) after 2m47s
[01:44:18.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:20:0)
[01:44:18.330] Build status: STARTED
[01:44:18.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:21:0) after 7m20s
[01:51:38.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:21:0)
[01:51:38.442] Build status: STARTED
[01:51:38.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:22:0) after 8m42s
[02:00:20.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:22:0)
[02:00:20.482] Build status: STARTED
[02:00:20.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:23:0) after 4m43s
[02:05:03.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:23:0)
[02:05:03.518] Build status: STARTED
[02:05:03.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:24:0) after 2m18s
[02:07:21.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:24:0)
[02:07:21.597] Build status: STARTED
[02:07:21.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:25:0) after 4m37s
[02:11:58.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:25:0)
[02:11:58.639] Build status: STARTED
[02:11:58.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:26:0) after 2m23s
[02:14:21.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:26:0)
[02:14:21.713] Build status: STARTED
[02:14:21.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:27:0) after 7m33s
[02:21:54.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:27:0)
[02:21:54.757] Build status: STARTED
[02:21:54.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:28:0) after 6m42s
[02:28:37.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:28:0)
[02:28:37.119] Build status: STARTED
[02:28:37.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:29:0) after 8m51s
[02:37:28.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:29:0)
[02:37:28.409] Build status: STARTED
[02:37:28.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:30:0) after 7m38s
[02:45:06.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:30:0)
[02:45:06.454] Build status: STARTED
[02:45:06.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:31:0) after 1m44s
[02:46:50.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:31:0)
[02:46:50.504] Build status: STARTED
[02:46:50.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:32:0) after 3m58s
[02:50:48.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:32:0)
[02:50:48.539] Build status: STARTED
[02:50:48.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:33:0) after 9m56s
[03:00:44.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:33:0)
[03:00:44.720] Build status: STARTED
[03:00:44.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:34:0) after 4m27s
[03:05:11.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:34:0)
[03:05:11.966] Build status: STARTED
[03:05:11.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:35:0) after 7m38s
[03:12:49.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:35:0)
[03:12:50.004] Build status: STARTED
[03:12:50.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:36:0) after 7m56s
[03:20:46.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:36:0)
[03:20:46.042] Build status: STARTED
[03:20:46.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:37:0) after 8m53s
[03:29:39.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:37:0)
[03:29:39.078] Build status: STARTED
[03:29:39.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:38:0) after 8m20s
[03:37:59.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:38:0)
[03:37:59.181] Build status: STARTED
[03:37:59.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:39:0) after 4m14s
[03:42:13.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:39:0)
[03:42:13.389] Build status: STARTED
[03:42:13.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:40:0) after 6m5s
[03:48:18.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:40:0)
[03:48:18.524] Build status: STARTED
[03:48:18.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:41:0) after 6m10s
[03:54:28.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:41:0)
[03:54:28.582] Build status: STARTED
[03:54:28.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:42:0) after 1m20s
[03:55:48.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:42:0)
[03:55:48.864] Build status: STARTED
[03:55:48.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:43:0) after 4m40s
[04:00:29.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:43:0)
[04:00:29.180] Build status: STARTED
[04:00:29.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:44:0) after 9m20s
[04:09:49.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:44:0)
[04:09:49.207] Build status: STARTED
[04:09:49.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:45:0) after 3m18s
[04:13:07.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:45:0)
[04:13:07.369] Build status: STARTED
[04:13:07.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:46:0) after 3m2s
[04:16:09.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:46:0)
[04:16:09.493] Build status: STARTED
[04:16:09.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:47:0) after 8m39s
[04:24:48.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:47:0)
[04:24:48.535] Build status: STARTED
[04:24:48.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:48:0) after 8m29s
[04:33:17.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:48:0)
[04:33:17.658] Build status: STARTED
[04:33:17.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:49:0) after 3m38s
[04:36:55.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:49:0)
[04:36:55.797] Build status: STARTED
[04:36:55.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:50:0) after 4m2s
[04:40:57.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:50:0)
[04:40:57.788] Build status: STARTED
[04:40:57.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:51:0) after 3m55s
[04:44:52.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:51:0)
[04:44:52.859] Build status: STARTED
[04:44:52.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:52:0) after 2m34s
[04:47:26.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:52:0)
[04:47:26.931] Build status: STARTED
[04:47:26.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:53:0) after 2m19s
[04:49:46.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:53:0)
[04:49:46.077] Build status: STARTED
[04:49:46.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:54:0) after 8m4s
[04:57:50.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:54:0)
[04:57:50.172] Build status: STARTED
[04:57:50.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:55:0) after 5m23s
[05:03:13.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:55:0)
[05:03:13.218] Build status: STARTED
[05:03:13.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:56:0) after 8m38s
[05:11:51.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:56:0)
[05:11:51.447] Build status: STARTED
[05:11:51.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:57:0) after 1m58s
[05:13:49.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:57:0)
[05:13:49.778] Build status: STARTED
[05:13:49.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:58:0) after 5m46s
[05:19:36.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:58:0)
[05:19:36.711] Build status: STARTED
[05:19:36.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:59:0) after 8m37s
[05:28:13.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:59:0)
[05:28:13.824] Build status: STARTED
[05:28:13.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:60:0) after 4m13s
[05:32:26.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:60:0)
[05:32:26.891] Build status: STARTED
[05:32:26.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:61:0) after 9m0s
[05:41:27.156] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:61:0)
[05:41:27.177] Build status: STARTED
[05:41:27.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:62:0) after 2m50s
[05:44:17.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:62:0)
[05:44:17.275] Build status: STARTED
[05:44:17.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:63:0) after 9m44s
[05:54:01.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:63:0)
[05:54:01.346] Build status: STARTED
[05:54:01.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:64:0) after 2m47s
[05:56:48.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:64:0)
[05:56:48.381] Build status: STARTED
[05:56:48.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:65:0) after 6m19s
[06:03:07.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:65:0)
[06:03:07.391] Build status: STARTED
[06:03:07.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8925849622909560288:66:0) after 7m41s
[06:08:04.415] Received PubSub notification, asking Buildbucket for the build status
[06:08:04.829] Build:
{
"id": "8760419561003412705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 26796,
"createdBy": "project:chromium",
"createTime": "2023-12-29T00:31:25.936916007Z",
"startTime": "2023-12-29T00:32:08.606819Z",
"endTime": "2023-12-29T06:08:02.966997Z",
"updateTime": "2023-12-29T06:08:02.966997Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c2cbc3d183f1ef18d02dcf478cc93127b7a3a8ed",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:08:04.829] Invocation finished in 5h36m40.095381122s with status FAILED