[06:56:59.572] New invocation is queued and will start shortly
[06:57:00.614] Starting the invocation (attempt 1)
[06:57:00.645] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b510b08641137b5c0a3893a814a870d99bbdff38"
[06:57:00.645] Popped gitiles commit info from properties and tags
[06:57:00.645] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:57:00.645] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:57:00.645] Buildbucket request:
{
"requestId": "8994950849651291792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b510b08641137b5c0a3893a814a870d99bbdff38",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8994950849651291792"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:57:01.143] Scheduled build:
{
"id": "8829520787806886737",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23608,
"createdBy": "project:chromium",
"createTime": "2021-11-26T06:57:00.701384549Z",
"updateTime": "2021-11-26T06:57:00.701384549Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b510b08641137b5c0a3893a814a870d99bbdff38",
"ref": "refs/heads/main"
}
}
}
[06:57:01.144] Task URL: https://cr-buildbucket.appspot.com/build/8829520787806886737
[06:57:01.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:2:0) after 6m27s
[06:59:31.198] Received PubSub notification, asking Buildbucket for the build status
[06:59:31.850] Build status: STARTED
[07:03:28.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:2:0)
[07:03:28.201] Build status: STARTED
[07:03:28.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:4:0) after 8m39s
[07:12:07.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:4:0)
[07:12:07.369] Build status: STARTED
[07:12:07.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:5:0) after 9m44s
[07:21:51.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:5:0)
[07:21:51.481] Build status: STARTED
[07:21:51.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:6:0) after 9m1s
[07:30:52.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:6:0)
[07:30:52.528] Build status: STARTED
[07:30:52.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:7:0) after 2m54s
[07:33:46.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:7:0)
[07:33:46.784] Build status: STARTED
[07:33:46.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:8:0) after 1m19s
[07:35:05.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:8:0)
[07:35:05.850] Build status: STARTED
[07:35:05.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:9:0) after 3m49s
[07:38:54.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:9:0)
[07:38:54.984] Build status: STARTED
[07:38:54.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:10:0) after 2m38s
[07:41:33.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:10:0)
[07:41:33.036] Build status: STARTED
[07:41:33.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:11:0) after 1m28s
[07:43:01.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:11:0)
[07:43:01.645] Build status: STARTED
[07:43:01.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:12:0) after 3m14s
[07:46:15.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:12:0)
[07:46:15.707] Build status: STARTED
[07:46:15.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:13:0) after 8m12s
[07:54:27.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:13:0)
[07:54:27.755] Build status: STARTED
[07:54:27.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:14:0) after 6m26s
[08:00:54.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:14:0)
[08:00:54.110] Build status: STARTED
[08:00:54.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:15:0) after 5m2s
[08:05:56.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:15:0)
[08:05:56.163] Build status: STARTED
[08:05:56.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:16:0) after 2m50s
[08:08:46.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:16:0)
[08:08:46.239] Build status: STARTED
[08:08:46.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:17:0) after 4m28s
[08:13:14.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:17:0)
[08:13:14.455] Build status: STARTED
[08:13:14.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:18:0) after 6m35s
[08:19:49.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:18:0)
[08:19:49.525] Build status: STARTED
[08:19:49.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:19:0) after 8m33s
[08:28:22.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:19:0)
[08:28:22.619] Build status: STARTED
[08:28:22.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:20:0) after 5m52s
[08:34:15.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:20:0)
[08:34:15.048] Build status: STARTED
[08:34:15.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:21:0) after 5m1s
[08:39:16.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:21:0)
[08:39:16.104] Build status: STARTED
[08:39:16.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:22:0) after 3m18s
[08:42:34.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:22:0)
[08:42:34.187] Build status: STARTED
[08:42:34.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:23:0) after 6m29s
[08:49:03.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:23:0)
[08:49:03.247] Build status: STARTED
[08:49:03.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:24:0) after 4m39s
[08:53:42.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:24:0)
[08:53:42.322] Build status: STARTED
[08:53:42.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:25:0) after 2m6s
[08:55:48.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:25:0)
[08:55:48.409] Build status: STARTED
[08:55:48.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:26:0) after 5m25s
[09:01:13.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:26:0)
[09:01:13.496] Build status: STARTED
[09:01:13.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:27:0) after 2m36s
[09:03:49.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:27:0)
[09:03:49.770] Build status: STARTED
[09:03:49.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:28:0) after 5m29s
[09:09:18.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:28:0)
[09:09:18.826] Build status: STARTED
[09:09:18.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:29:0) after 2m19s
[09:11:37.947] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:29:0)
[09:11:37.987] Build status: STARTED
[09:11:37.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:30:0) after 8m41s
[09:20:18.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:30:0)
[09:20:19.093] Build status: STARTED
[09:20:19.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:31:0) after 8m32s
[09:28:51.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:31:0)
[09:28:51.280] Build status: STARTED
[09:28:51.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:32:0) after 8m40s
[09:37:31.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:32:0)
[09:37:31.488] Build status: STARTED
[09:37:31.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:33:0) after 1m0s
[09:38:31.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:33:0)
[09:38:31.743] Build status: STARTED
[09:38:31.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:34:0) after 3m17s
[09:41:48.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:34:0)
[09:41:48.925] Build status: STARTED
[09:41:48.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:35:0) after 5m56s
[09:47:44.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:35:0)
[09:47:44.995] Build status: STARTED
[09:47:44.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:36:0) after 5m59s
[09:53:44.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:36:0)
[09:53:44.152] Build status: STARTED
[09:53:44.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:37:0) after 6m17s
[10:00:01.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:37:0)
[10:00:01.239] Build status: STARTED
[10:00:01.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:38:0) after 5m36s
[10:05:37.285] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:38:0)
[10:05:37.315] Build status: STARTED
[10:05:37.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:39:0) after 4m41s
[10:10:18.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:39:0)
[10:10:18.469] Build status: STARTED
[10:10:18.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:40:0) after 3m40s
[10:13:59.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:40:0)
[10:13:59.050] Build status: STARTED
[10:13:59.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:41:0) after 3m7s
[10:17:06.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:41:0)
[10:17:06.116] Build status: STARTED
[10:17:06.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:42:0) after 1m30s
[10:18:36.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:42:0)
[10:18:36.176] Build status: STARTED
[10:18:36.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:43:0) after 3m25s
[10:22:01.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:43:0)
[10:22:01.294] Build status: STARTED
[10:22:01.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:44:0) after 2m52s
[10:24:53.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:44:0)
[10:24:53.413] Build status: STARTED
[10:24:53.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:45:0) after 6m6s
[10:30:59.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:45:0)
[10:30:59.587] Build status: STARTED
[10:30:59.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:46:0) after 8m56s
[10:39:55.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:46:0)
[10:39:55.632] Build status: STARTED
[10:39:55.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:47:0) after 5m5s
[10:45:00.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:47:0)
[10:45:00.913] Build status: STARTED
[10:45:00.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:48:0) after 1m57s
[10:46:57.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:48:0)
[10:46:57.929] Build status: STARTED
[10:46:57.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:49:0) after 6m36s
[10:53:33.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:49:0)
[10:53:33.982] Build status: STARTED
[10:53:33.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:50:0) after 4m2s
[10:57:36.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:50:0)
[10:57:36.088] Build status: STARTED
[10:57:36.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:51:0) after 4m57s
[11:02:33.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:51:0)
[11:02:33.160] Build status: STARTED
[11:02:33.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:52:0) after 7m57s
[11:10:30.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:52:0)
[11:10:30.355] Build status: STARTED
[11:10:30.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:53:0) after 1m39s
[11:12:09.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:53:0)
[11:12:09.443] Build status: STARTED
[11:12:09.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:54:0) after 9m56s
[11:22:05.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:54:0)
[11:22:05.500] Build status: STARTED
[11:22:05.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:55:0) after 8m57s
[11:31:02.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:55:0)
[11:31:02.632] Build status: STARTED
[11:31:02.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:56:0) after 7m7s
[11:38:09.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:56:0)
[11:38:09.699] Build status: STARTED
[11:38:09.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:57:0) after 7m7s
[11:45:16.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:57:0)
[11:45:16.804] Build status: STARTED
[11:45:16.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:58:0) after 2m29s
[11:47:45.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:58:0)
[11:47:45.870] Build status: STARTED
[11:47:45.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:59:0) after 8m50s
[11:56:35.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:59:0)
[11:56:35.919] Build status: STARTED
[11:56:35.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:60:0) after 9m56s
[12:06:32.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:60:0)
[12:06:32.052] Build status: STARTED
[12:06:32.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:61:0) after 8m53s
[12:15:25.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:61:0)
[12:15:25.121] Build status: STARTED
[12:15:25.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:62:0) after 7m26s
[12:22:51.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:62:0)
[12:22:51.281] Build status: STARTED
[12:22:51.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:63:0) after 5m24s
[12:28:15.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:63:0)
[12:28:15.434] Build status: STARTED
[12:28:15.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8994950849651291792:64:0) after 8m14s
[12:30:44.493] Received PubSub notification, asking Buildbucket for the build status
[12:30:44.697] Build:
{
"id": "8829520787806886737",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23608,
"createdBy": "project:chromium",
"createTime": "2021-11-26T06:57:00.701384549Z",
"startTime": "2021-11-26T06:59:28.593805Z",
"endTime": "2021-11-26T12:30:44.109063321Z",
"updateTime": "2021-11-26T12:30:44.109063321Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b510b08641137b5c0a3893a814a870d99bbdff38",
"ref": "refs/heads/main"
}
}
}
[12:30:44.697] Invocation finished in 5h33m45.139307862s with status FAILED