[22:23:19.233] New invocation is queued and will start shortly
[22:23:20.345] Starting the invocation (attempt 1)
[22:23:20.376] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1ef7edc3bf1ea5752c6f76ea0c518e6c7533afbd"
[22:23:20.376] Popped gitiles commit info from properties and tags
[22:23:20.376] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:23:20.376] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:23:20.376] Buildbucket request:
{
"requestId": "8929934545239368864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ef7edc3bf1ea5752c6f76ea0c518e6c7533afbd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8929934545239368864"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:23:21.159] Scheduled build:
{
"id": "8764504483221312417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30906,
"createdBy": "project:chromium",
"createTime": "2023-11-13T22:23:20.532662965Z",
"updateTime": "2023-11-13T22:23:20.532662965Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ef7edc3bf1ea5752c6f76ea0c518e6c7533afbd",
"ref": "refs/heads/main"
}
}
}
[22:23:21.159] Task URL: https://cr-buildbucket.appspot.com/build/8764504483221312417
[22:23:21.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:2:0) after 9m1s
[22:23:21.228] Received PubSub notification, asking Buildbucket for the build status
[22:23:21.253] Build status: SCHEDULED
[22:24:19.484] Received PubSub notification, asking Buildbucket for the build status
[22:24:19.505] Build status: STARTED
[22:32:22.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:2:0)
[22:32:22.233] Build status: STARTED
[22:32:22.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:5:0) after 4m37s
[22:36:59.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:5:0)
[22:36:59.361] Build status: STARTED
[22:36:59.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:6:0) after 8m7s
[22:45:06.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:6:0)
[22:45:06.417] Build status: STARTED
[22:45:06.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:7:0) after 9m43s
[22:54:49.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:7:0)
[22:54:49.506] Build status: STARTED
[22:54:49.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:8:0) after 5m27s
[23:00:16.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:8:0)
[23:00:16.655] Build status: STARTED
[23:00:16.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:9:0) after 4m54s
[23:05:10.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:9:0)
[23:05:10.767] Build status: STARTED
[23:05:10.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:10:0) after 2m25s
[23:07:35.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:10:0)
[23:07:35.812] Build status: STARTED
[23:07:35.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:11:0) after 1m28s
[23:09:03.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:11:0)
[23:09:03.861] Build status: STARTED
[23:09:03.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:12:0) after 9m32s
[23:18:36.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:12:0)
[23:18:36.312] Build status: STARTED
[23:18:36.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:13:0) after 2m3s
[23:20:39.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:13:0)
[23:20:39.410] Build status: STARTED
[23:20:39.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:14:0) after 7m2s
[23:27:41.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:14:0)
[23:27:41.526] Build status: STARTED
[23:27:41.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:15:0) after 2m9s
[23:29:50.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:15:0)
[23:29:50.658] Build status: STARTED
[23:29:50.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:16:0) after 8m58s
[23:38:48.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:16:0)
[23:38:48.701] Build status: STARTED
[23:38:48.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:17:0) after 6m46s
[23:45:34.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:17:0)
[23:45:34.912] Build status: STARTED
[23:45:34.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:18:0) after 3m56s
[23:49:31.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:18:0)
[23:49:31.281] Build status: STARTED
[23:49:31.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:19:0) after 7m31s
[23:57:02.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:19:0)
[23:57:02.339] Build status: STARTED
[23:57:02.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:20:0) after 7m38s
[00:04:40.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:20:0)
[00:04:40.412] Build status: STARTED
[00:04:40.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:21:0) after 1m26s
[00:06:06.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:21:0)
[00:06:06.562] Build status: STARTED
[00:06:06.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:22:0) after 9m20s
[00:15:27.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:22:0)
[00:15:27.099] Build status: STARTED
[00:15:27.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:23:0) after 6m49s
[00:22:16.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:23:0)
[00:22:16.236] Build status: STARTED
[00:22:16.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:24:0) after 2m48s
[00:25:04.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:24:0)
[00:25:04.310] Build status: STARTED
[00:25:04.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:25:0) after 8m14s
[00:33:18.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:25:0)
[00:33:18.355] Build status: STARTED
[00:33:18.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:26:0) after 2m19s
[00:35:37.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:26:0)
[00:35:37.458] Build status: STARTED
[00:35:37.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:27:0) after 4m33s
[00:40:10.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:27:0)
[00:40:10.639] Build status: STARTED
[00:40:10.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:28:0) after 7m10s
[00:47:20.663] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:28:0)
[00:47:20.700] Build status: STARTED
[00:47:20.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:29:0) after 2m22s
[00:49:42.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:29:0)
[00:49:43.015] Build status: STARTED
[00:49:43.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:30:0) after 5m6s
[00:54:49.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:30:0)
[00:54:49.258] Build status: STARTED
[00:54:49.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:31:0) after 4m56s
[00:59:45.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:31:0)
[00:59:45.319] Build status: STARTED
[00:59:45.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:32:0) after 9m58s
[01:09:43.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:32:0)
[01:09:43.378] Build status: STARTED
[01:09:43.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:33:0) after 8m40s
[01:18:23.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:33:0)
[01:18:23.695] Build status: STARTED
[01:18:23.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:34:0) after 8m17s
[01:26:40.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:34:0)
[01:26:40.742] Build status: STARTED
[01:26:40.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:35:0) after 3m16s
[01:29:56.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:35:0)
[01:29:56.904] Build status: STARTED
[01:29:56.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:36:0) after 3m29s
[01:33:26.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:36:0)
[01:33:26.086] Build status: STARTED
[01:33:26.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:37:0) after 8m57s
[01:42:23.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:37:0)
[01:42:23.183] Build status: STARTED
[01:42:23.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:38:0) after 3m20s
[01:45:43.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:38:0)
[01:45:43.239] Build status: STARTED
[01:45:43.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:39:0) after 6m37s
[01:52:20.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:39:0)
[01:52:20.313] Build status: STARTED
[01:52:20.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:40:0) after 4m17s
[01:56:37.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:40:0)
[01:56:37.372] Build status: STARTED
[01:56:37.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:41:0) after 5m17s
[02:01:54.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:41:0)
[02:01:54.437] Build status: STARTED
[02:01:54.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:42:0) after 2m43s
[02:04:37.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:42:0)
[02:04:37.455] Build status: STARTED
[02:04:37.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:43:0) after 4m50s
[02:09:27.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:43:0)
[02:09:27.528] Build status: STARTED
[02:09:27.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:44:0) after 6m58s
[02:16:25.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:44:0)
[02:16:25.526] Build status: STARTED
[02:16:25.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:45:0) after 3m20s
[02:19:45.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:45:0)
[02:19:45.604] Build status: STARTED
[02:19:45.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:46:0) after 8m0s
[02:27:45.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:46:0)
[02:27:45.664] Build status: STARTED
[02:27:45.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:47:0) after 8m51s
[02:36:36.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:47:0)
[02:36:36.721] Build status: STARTED
[02:36:36.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:48:0) after 1m31s
[02:38:07.764] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:48:0)
[02:38:07.790] Build status: STARTED
[02:38:07.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:49:0) after 8m15s
[02:46:22.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:49:0)
[02:46:22.866] Build status: STARTED
[02:46:22.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:50:0) after 7m31s
[02:53:53.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:50:0)
[02:53:53.905] Build status: STARTED
[02:53:53.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:51:0) after 7m21s
[03:01:14.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:51:0)
[03:01:15.060] Build status: STARTED
[03:01:15.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:52:0) after 1m55s
[03:03:10.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:52:0)
[03:03:10.155] Build status: STARTED
[03:03:10.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:53:0) after 8m46s
[03:11:56.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:53:0)
[03:11:56.423] Build status: STARTED
[03:11:56.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:54:0) after 9m40s
[03:21:36.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:54:0)
[03:21:36.499] Build status: STARTED
[03:21:36.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:55:0) after 2m0s
[03:23:36.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:55:0)
[03:23:36.551] Build status: STARTED
[03:23:36.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:56:0) after 9m16s
[03:32:52.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:56:0)
[03:32:52.645] Build status: STARTED
[03:32:52.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:57:0) after 2m26s
[03:35:18.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:57:0)
[03:35:18.834] Build status: STARTED
[03:35:18.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:58:0) after 5m0s
[03:40:19.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:58:0)
[03:40:19.398] Build status: STARTED
[03:40:19.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:59:0) after 9m25s
[03:49:44.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:59:0)
[03:49:44.471] Build status: STARTED
[03:49:44.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:60:0) after 9m37s
[03:59:21.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:60:0)
[03:59:21.805] Build status: STARTED
[03:59:21.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:61:0) after 5m13s
[04:04:34.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:61:0)
[04:04:34.950] Build status: STARTED
[04:04:34.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:62:0) after 3m41s
[04:08:16.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:62:0)
[04:08:16.185] Build status: STARTED
[04:08:16.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:63:0) after 9m56s
[04:18:12.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:63:0)
[04:18:12.211] Build status: STARTED
[04:18:12.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:64:0) after 8m34s
[04:26:47.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:64:0)
[04:26:47.081] Build status: STARTED
[04:26:47.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:65:0) after 2m22s
[04:29:09.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:65:0)
[04:29:09.444] Build status: STARTED
[04:29:09.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:66:0) after 3m53s
[04:33:02.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:66:0)
[04:33:02.738] Build status: STARTED
[04:33:02.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8929934545239368864:67:0) after 4m48s
[04:35:35.503] Received PubSub notification, asking Buildbucket for the build status
[04:35:35.535] Build:
{
"id": "8764504483221312417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30906,
"createdBy": "project:chromium",
"createTime": "2023-11-13T22:23:20.532662965Z",
"startTime": "2023-11-13T22:24:18.935428Z",
"endTime": "2023-11-14T04:35:34.833747Z",
"updateTime": "2023-11-14T04:35:34.833747Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1ef7edc3bf1ea5752c6f76ea0c518e6c7533afbd",
"ref": "refs/heads/main"
}
}
}
[04:35:35.535] Invocation finished in 6h12m16.311631845s with status FAILED