[12:26:01.416] New invocation is queued and will start shortly
[12:26:02.482] Starting the invocation (attempt 1)
[12:26:02.518] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1c8a1e0be22da094e0384ab85388e0212cd0f0f8"
[12:26:02.518] Popped gitiles commit info from properties and tags
[12:26:02.518] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:26:02.518] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:26:02.519] Buildbucket request:
{
"requestId": "8995745521526756112",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1c8a1e0be22da094e0384ab85388e0212cd0f0f8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8995745521526756112"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:26:03.769] Scheduled build:
{
"id": "8830315459640743841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23569,
"createdBy": "project:chromium",
"createTime": "2021-11-17T12:26:02.583946038Z",
"updateTime": "2021-11-17T12:26:02.583946038Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1c8a1e0be22da094e0384ab85388e0212cd0f0f8",
"ref": "refs/heads/main"
}
}
}
[12:26:03.769] Task URL: https://cr-buildbucket.appspot.com/build/8830315459640743841
[12:26:03.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:2:0) after 4m57s
[12:28:32.766] Received PubSub notification, asking Buildbucket for the build status
[12:28:32.794] Build status: STARTED
[12:31:00.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:2:0)
[12:31:00.929] Build status: STARTED
[12:31:00.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:4:0) after 6m51s
[12:37:52.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:4:0)
[12:37:52.190] Build status: STARTED
[12:37:52.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:5:0) after 1m33s
[12:39:25.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:5:0)
[12:39:25.364] Build status: STARTED
[12:39:25.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:6:0) after 1m36s
[12:41:01.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:6:0)
[12:41:01.421] Build status: STARTED
[12:41:01.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:7:0) after 8m50s
[12:49:51.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:7:0)
[12:49:51.548] Build status: STARTED
[12:49:51.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:8:0) after 2m41s
[12:52:32.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:8:0)
[12:52:32.737] Build status: STARTED
[12:52:32.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:9:0) after 2m39s
[12:55:11.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:9:0)
[12:55:11.875] Build status: STARTED
[12:55:11.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:10:0) after 5m48s
[13:00:59.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:10:0)
[13:00:59.933] Build status: STARTED
[13:00:59.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:11:0) after 6m31s
[13:07:30.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:11:0)
[13:07:31.055] Build status: STARTED
[13:07:31.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:12:0) after 9m27s
[13:16:58.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:12:0)
[13:16:58.352] Build status: STARTED
[13:16:58.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:13:0) after 8m52s
[13:25:50.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:13:0)
[13:25:50.405] Build status: STARTED
[13:25:50.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:14:0) after 6m31s
[13:32:21.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:14:0)
[13:32:21.605] Build status: STARTED
[13:32:21.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:15:0) after 8m2s
[13:40:23.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:15:0)
[13:40:23.699] Build status: STARTED
[13:40:23.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:16:0) after 4m53s
[13:45:16.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:16:0)
[13:45:16.840] Build status: STARTED
[13:45:16.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:17:0) after 1m10s
[13:46:26.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:17:0)
[13:46:26.908] Build status: STARTED
[13:46:26.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:18:0) after 3m40s
[13:50:06.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:18:0)
[13:50:06.961] Build status: STARTED
[13:50:06.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:19:0) after 7m16s
[13:57:23.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:19:0)
[13:57:23.475] Build status: STARTED
[13:57:23.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:20:0) after 3m50s
[14:01:13.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:20:0)
[14:01:13.652] Build status: STARTED
[14:01:13.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:21:0) after 8m13s
[14:09:26.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:21:0)
[14:09:26.869] Build status: STARTED
[14:09:26.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:22:0) after 8m54s
[14:18:21.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:22:0)
[14:18:21.437] Build status: STARTED
[14:18:21.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:23:0) after 4m14s
[14:22:35.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:23:0)
[14:22:35.576] Build status: STARTED
[14:22:35.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:24:0) after 1m46s
[14:24:21.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:24:0)
[14:24:21.733] Build status: STARTED
[14:24:21.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:25:0) after 1m56s
[14:26:17.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:25:0)
[14:26:17.868] Build status: STARTED
[14:26:17.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:26:0) after 9m56s
[14:36:14.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:26:0)
[14:36:14.182] Build status: STARTED
[14:36:14.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:27:0) after 7m8s
[14:43:22.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:27:0)
[14:43:22.341] Build status: STARTED
[14:43:22.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:28:0) after 6m38s
[14:50:00.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:28:0)
[14:50:00.397] Build status: STARTED
[14:50:00.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:29:0) after 1m24s
[14:51:24.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:29:0)
[14:51:24.449] Build status: STARTED
[14:51:24.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:30:0) after 9m2s
[15:00:26.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:30:0)
[15:00:26.609] Build status: STARTED
[15:00:26.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:31:0) after 1m13s
[15:01:39.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:31:0)
[15:01:39.667] Build status: STARTED
[15:01:39.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:32:0) after 3m50s
[15:05:29.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:32:0)
[15:05:29.719] Build status: STARTED
[15:05:29.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:33:0) after 1m17s
[15:06:46.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:33:0)
[15:06:46.855] Build status: STARTED
[15:06:46.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:34:0) after 6m5s
[15:12:52.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:34:0)
[15:12:52.072] Build status: STARTED
[15:12:52.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:35:0) after 2m12s
[15:15:04.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:35:0)
[15:15:04.225] Build status: STARTED
[15:15:04.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:36:0) after 5m14s
[15:20:18.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:36:0)
[15:20:18.469] Build status: STARTED
[15:20:18.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:37:0) after 3m28s
[15:23:46.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:37:0)
[15:23:46.683] Build status: STARTED
[15:23:46.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:38:0) after 3m32s
[15:27:19.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:38:0)
[15:27:19.074] Build status: STARTED
[15:27:19.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:39:0) after 9m39s
[15:36:58.292] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:39:0)
[15:36:58.323] Build status: STARTED
[15:36:58.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:40:0) after 6m55s
[15:43:53.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:40:0)
[15:43:53.633] Build status: STARTED
[15:43:53.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:41:0) after 8m3s
[15:51:56.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:41:0)
[15:51:56.841] Build status: STARTED
[15:51:56.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:42:0) after 6m23s
[15:58:20.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:42:0)
[15:58:20.309] Build status: STARTED
[15:58:20.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:43:0) after 6m44s
[16:05:04.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:43:0)
[16:05:04.380] Build status: STARTED
[16:05:04.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:44:0) after 6m17s
[16:11:21.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:44:0)
[16:11:21.489] Build status: STARTED
[16:11:21.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:45:0) after 4m37s
[16:15:58.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:45:0)
[16:15:58.544] Build status: STARTED
[16:15:58.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:46:0) after 1m47s
[16:17:45.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:46:0)
[16:17:45.599] Build status: STARTED
[16:17:45.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:47:0) after 3m1s
[16:20:46.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:47:0)
[16:20:46.761] Build status: STARTED
[16:20:46.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:48:0) after 2m46s
[16:23:32.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:48:0)
[16:23:32.888] Build status: STARTED
[16:23:32.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:49:0) after 9m26s
[16:32:58.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:49:0)
[16:32:58.938] Build status: STARTED
[16:32:58.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:50:0) after 8m4s
[16:41:03.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:50:0)
[16:41:03.047] Build status: STARTED
[16:41:03.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:51:0) after 6m36s
[16:47:39.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:51:0)
[16:47:39.616] Build status: STARTED
[16:47:39.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:52:0) after 7m42s
[16:55:21.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:52:0)
[16:55:21.680] Build status: STARTED
[16:55:21.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:53:0) after 3m53s
[16:59:14.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:53:0)
[16:59:14.750] Build status: STARTED
[16:59:14.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:54:0) after 3m11s
[17:02:26.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:54:0)
[17:02:26.444] Build status: STARTED
[17:02:26.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:55:0) after 1m24s
[17:03:50.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:55:0)
[17:03:50.762] Build status: STARTED
[17:03:50.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:56:0) after 6m38s
[17:10:28.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:56:0)
[17:10:28.802] Build status: STARTED
[17:10:28.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:57:0) after 2m57s
[17:13:25.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:57:0)
[17:13:25.958] Build status: STARTED
[17:13:25.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:58:0) after 3m54s
[17:17:19.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:58:0)
[17:17:20.020] Build status: STARTED
[17:17:20.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:59:0) after 6m23s
[17:23:43.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:59:0)
[17:23:43.071] Build status: STARTED
[17:23:43.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:60:0) after 4m35s
[17:28:18.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:60:0)
[17:28:18.146] Build status: STARTED
[17:28:18.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:61:0) after 8m10s
[17:36:28.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:61:0)
[17:36:28.200] Build status: STARTED
[17:36:28.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:62:0) after 1m7s
[17:37:35.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:62:0)
[17:37:35.381] Build status: STARTED
[17:37:35.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:63:0) after 7m9s
[17:44:44.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:63:0)
[17:44:44.455] Build status: STARTED
[17:44:44.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:64:0) after 1m41s
[17:46:25.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:64:0)
[17:46:25.915] Build status: STARTED
[17:46:25.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:65:0) after 4m24s
[17:50:50.212] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:65:0)
[17:50:50.252] Build status: STARTED
[17:50:50.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995745521526756112:66:0) after 7m12s
[17:54:48.990] Received PubSub notification, asking Buildbucket for the build status
[17:54:49.027] Build:
{
"id": "8830315459640743841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23569,
"createdBy": "project:chromium",
"createTime": "2021-11-17T12:26:02.583946038Z",
"startTime": "2021-11-17T12:28:30.552139Z",
"endTime": "2021-11-17T17:54:48.574063476Z",
"updateTime": "2021-11-17T17:54:48.574063476Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1c8a1e0be22da094e0384ab85388e0212cd0f0f8",
"ref": "refs/heads/main"
}
}
}
[17:54:49.027] Invocation finished in 5h28m47.626138625s with status FAILED