[23:06:27.006] New invocation is queued and will start shortly
[23:06:28.143] Starting the invocation (attempt 1)
[23:06:28.178] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b7ecf35c136375c38b611c4e676e97af638de43a"
[23:06:28.178] Popped gitiles commit info from properties and tags
[23:06:28.178] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:06:28.178] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:06:28.178] Buildbucket request:
{
"requestId": "8925220789520370400",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7ecf35c136375c38b611c4e676e97af638de43a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8925220789520370400"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:06:28.826] Scheduled build:
{
"id": "8759790727541764193",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 31223,
"createdBy": "project:chromium",
"createTime": "2024-01-04T23:06:28.257902225Z",
"updateTime": "2024-01-04T23:06:28.257902225Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7ecf35c136375c38b611c4e676e97af638de43a",
"ref": "refs/heads/main"
}
}
}
[23:06:28.826] Task URL: https://cr-buildbucket.appspot.com/build/8759790727541764193
[23:06:28.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:2:0) after 9m10s
[23:06:28.936] Received PubSub notification, asking Buildbucket for the build status
[23:06:28.966] Build status: SCHEDULED
[23:07:15.514] Received PubSub notification, asking Buildbucket for the build status
[23:07:15.533] Build status: STARTED
[23:15:39.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:2:0)
[23:15:39.276] Build status: STARTED
[23:15:39.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:5:0) after 6m53s
[23:22:32.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:5:0)
[23:22:32.490] Build status: STARTED
[23:22:32.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:6:0) after 8m45s
[23:31:17.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:6:0)
[23:31:17.559] Build status: STARTED
[23:31:17.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:7:0) after 5m59s
[23:37:16.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:7:0)
[23:37:16.679] Build status: STARTED
[23:37:16.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:8:0) after 8m41s
[23:45:57.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:8:0)
[23:45:58.002] Build status: STARTED
[23:45:58.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:9:0) after 4m15s
[23:50:13.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:9:0)
[23:50:13.040] Build status: STARTED
[23:50:13.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:10:0) after 8m28s
[23:58:41.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:10:0)
[23:58:41.085] Build status: STARTED
[23:58:41.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:11:0) after 1m31s
[00:00:12.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:11:0)
[00:00:12.248] Build status: STARTED
[00:00:12.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:12:0) after 7m33s
[00:07:45.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:12:0)
[00:07:45.315] Build status: STARTED
[00:07:45.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:13:0) after 3m57s
[00:11:42.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:13:0)
[00:11:42.327] Build status: STARTED
[00:11:42.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:14:0) after 2m55s
[00:14:37.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:14:0)
[00:14:37.464] Build status: STARTED
[00:14:37.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:15:0) after 8m6s
[00:22:43.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:15:0)
[00:22:43.551] Build status: STARTED
[00:22:43.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:16:0) after 8m55s
[00:31:38.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:16:0)
[00:31:38.685] Build status: STARTED
[00:31:38.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:17:0) after 6m41s
[00:38:19.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:17:0)
[00:38:19.765] Build status: STARTED
[00:38:19.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:18:0) after 2m32s
[00:40:51.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:18:0)
[00:40:51.870] Build status: STARTED
[00:40:51.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:19:0) after 7m54s
[00:48:45.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:19:0)
[00:48:46.001] Build status: STARTED
[00:48:46.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:20:0) after 6m29s
[00:55:15.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:20:0)
[00:55:15.087] Build status: STARTED
[00:55:15.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:21:0) after 2m10s
[00:57:25.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:21:0)
[00:57:25.098] Build status: STARTED
[00:57:25.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:22:0) after 5m15s
[01:02:40.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:22:0)
[01:02:40.090] Build status: STARTED
[01:02:40.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:23:0) after 6m25s
[01:09:05.172] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:23:0)
[01:09:05.206] Build status: STARTED
[01:09:05.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:24:0) after 1m29s
[01:10:34.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:24:0)
[01:10:34.286] Build status: STARTED
[01:10:34.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:25:0) after 3m43s
[01:14:17.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:25:0)
[01:14:17.329] Build status: STARTED
[01:14:17.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:26:0) after 6m20s
[01:20:37.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:26:0)
[01:20:37.389] Build status: STARTED
[01:20:37.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:27:0) after 6m53s
[01:27:30.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:27:0)
[01:27:30.432] Build status: STARTED
[01:27:30.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:28:0) after 9m37s
[01:37:07.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:28:0)
[01:37:07.533] Build status: STARTED
[01:37:07.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:29:0) after 9m16s
[01:46:23.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:29:0)
[01:46:23.588] Build status: STARTED
[01:46:23.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:30:0) after 4m8s
[01:50:31.639] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:30:0)
[01:50:31.665] Build status: STARTED
[01:50:31.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:31:0) after 7m25s
[01:57:56.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:31:0)
[01:57:56.706] Build status: STARTED
[01:57:56.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:32:0) after 3m14s
[02:01:10.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:32:0)
[02:01:10.756] Build status: STARTED
[02:01:10.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:33:0) after 8m19s
[02:09:29.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:33:0)
[02:09:29.815] Build status: STARTED
[02:09:29.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:34:0) after 9m45s
[02:19:14.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:34:0)
[02:19:14.871] Build status: STARTED
[02:19:14.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:35:0) after 6m27s
[02:25:41.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:35:0)
[02:25:41.905] Build status: STARTED
[02:25:41.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:36:0) after 8m15s
[02:33:56.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:36:0)
[02:33:56.952] Build status: STARTED
[02:33:56.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:37:0) after 7m29s
[02:41:26.014] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:37:0)
[02:41:26.032] Build status: STARTED
[02:41:26.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:38:0) after 6m4s
[02:47:30.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:38:0)
[02:47:30.096] Build status: STARTED
[02:47:30.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:39:0) after 8m19s
[02:55:49.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:39:0)
[02:55:49.147] Build status: STARTED
[02:55:49.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:40:0) after 8m7s
[03:03:56.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:40:0)
[03:03:56.305] Build status: STARTED
[03:03:56.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:41:0) after 6m9s
[03:10:05.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:41:0)
[03:10:05.351] Build status: STARTED
[03:10:05.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:42:0) after 6m35s
[03:16:40.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:42:0)
[03:16:40.458] Build status: STARTED
[03:16:40.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:43:0) after 4m40s
[03:21:20.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:43:0)
[03:21:20.982] Build status: STARTED
[03:21:20.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:44:0) after 9m14s
[03:30:35.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:44:0)
[03:30:35.605] Build status: STARTED
[03:30:35.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:45:0) after 3m27s
[03:34:02.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:45:0)
[03:34:02.670] Build status: STARTED
[03:34:02.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:46:0) after 1m50s
[03:35:52.690] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:46:0)
[03:35:52.708] Build status: STARTED
[03:35:52.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:47:0) after 3m28s
[03:39:20.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:47:0)
[03:39:20.789] Build status: STARTED
[03:39:20.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:48:0) after 6m26s
[03:45:46.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:48:0)
[03:45:46.888] Build status: STARTED
[03:45:46.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:49:0) after 8m18s
[03:54:04.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:49:0)
[03:54:05.032] Build status: STARTED
[03:54:05.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:50:0) after 6m22s
[04:00:27.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:50:0)
[04:00:27.230] Build status: STARTED
[04:00:27.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:51:0) after 3m29s
[04:03:56.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:51:0)
[04:03:56.501] Build status: STARTED
[04:03:56.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:52:0) after 4m56s
[04:08:52.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:52:0)
[04:08:52.549] Build status: STARTED
[04:08:52.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:53:0) after 7m18s
[04:16:10.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:53:0)
[04:16:10.703] Build status: STARTED
[04:16:10.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:54:0) after 9m32s
[04:25:42.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:54:0)
[04:25:42.798] Build status: STARTED
[04:25:42.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:55:0) after 3m14s
[04:28:56.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:55:0)
[04:28:56.879] Build status: STARTED
[04:28:56.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:56:0) after 5m20s
[04:34:16.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:56:0)
[04:34:16.910] Build status: STARTED
[04:34:16.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:57:0) after 2m3s
[04:36:20.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:57:0)
[04:36:20.263] Build status: STARTED
[04:36:20.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:58:0) after 8m36s
[04:44:56.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:58:0)
[04:44:56.856] Build status: STARTED
[04:44:56.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:59:0) after 7m45s
[04:52:42.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:59:0)
[04:52:42.091] Build status: STARTED
[04:52:42.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:60:0) after 5m43s
[04:58:25.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:60:0)
[04:58:25.534] Build status: STARTED
[04:58:25.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:61:0) after 7m38s
[05:06:03.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:61:0)
[05:06:03.620] Build status: STARTED
[05:06:03.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:62:0) after 1m13s
[05:07:16.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:62:0)
[05:07:16.659] Build status: STARTED
[05:07:16.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:63:0) after 6m30s
[05:13:46.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:63:0)
[05:13:46.720] Build status: STARTED
[05:13:46.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:64:0) after 7m37s
[05:21:23.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:64:0)
[05:21:23.937] Build status: STARTED
[05:21:23.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:65:0) after 8m47s
[05:30:11.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:65:0)
[05:30:11.395] Build status: STARTED
[05:30:11.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8925220789520370400:66:0) after 2m18s
[05:31:18.531] Received PubSub notification, asking Buildbucket for the build status
[05:31:18.549] Build:
{
"id": "8759790727541764193",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 31223,
"createdBy": "project:chromium",
"createTime": "2024-01-04T23:06:28.257902225Z",
"startTime": "2024-01-04T23:07:14.508656Z",
"endTime": "2024-01-05T05:31:17.805398Z",
"updateTime": "2024-01-05T05:31:17.805398Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7ecf35c136375c38b611c4e676e97af638de43a",
"ref": "refs/heads/main"
}
}
}
[05:31:18.549] Invocation finished in 6h24m51.561800054s with status FAILED