[16:00:47.895] New invocation is queued and will start shortly
[16:00:50.379] Starting the invocation (attempt 1)
[16:00:50.408] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fb9e671f4fcdf4680eba1207005ae03786c1a6bb"
[16:00:50.408] Popped gitiles commit info from properties and tags
[16:00:50.408] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:00:50.408] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:00:50.408] Buildbucket request:
{
"requestId": "8938837114180197840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb9e671f4fcdf4680eba1207005ae03786c1a6bb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8938837114180197840"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:00:51.702] Scheduled build:
{
"id": "8773407050704593937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30116,
"createdBy": "project:chromium",
"createTime": "2023-08-07T16:00:50.573448263Z",
"updateTime": "2023-08-07T16:00:50.573448263Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb9e671f4fcdf4680eba1207005ae03786c1a6bb",
"ref": "refs/heads/main"
}
}
}
[16:00:51.702] Task URL: https://cr-buildbucket.appspot.com/build/8773407050704593937
[16:00:51.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:2:0) after 3m19s
[16:00:52.515] Received PubSub notification, asking Buildbucket for the build status
[16:00:52.546] Build status: SCHEDULED
[16:04:10.287] Received PubSub notification, asking Buildbucket for the build status
[16:04:10.313] Build status: STARTED
[16:04:10.750] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:2:0)
[16:04:10.771] Build status: STARTED
[16:04:10.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:5:0) after 6m30s
[16:10:40.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:5:0)
[16:10:40.901] Build status: STARTED
[16:10:40.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:6:0) after 2m28s
[16:13:09.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:6:0)
[16:13:09.160] Build status: STARTED
[16:13:09.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:7:0) after 7m18s
[16:20:27.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:7:0)
[16:20:27.332] Build status: STARTED
[16:20:27.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:8:0) after 5m39s
[16:26:06.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:8:0)
[16:26:06.525] Build status: STARTED
[16:26:06.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:9:0) after 8m8s
[16:34:14.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:9:0)
[16:34:14.684] Build status: STARTED
[16:34:14.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:10:0) after 5m54s
[16:40:08.742] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:10:0)
[16:40:08.771] Build status: STARTED
[16:40:08.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:11:0) after 6m44s
[16:46:52.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:11:0)
[16:46:52.834] Build status: STARTED
[16:46:52.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:12:0) after 6m31s
[16:53:23.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:12:0)
[16:53:23.903] Build status: STARTED
[16:53:23.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:13:0) after 6m17s
[16:59:41.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:13:0)
[16:59:41.069] Build status: STARTED
[16:59:41.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:14:0) after 4m22s
[17:04:03.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:14:0)
[17:04:03.569] Build status: STARTED
[17:04:03.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:15:0) after 8m54s
[17:12:57.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:15:0)
[17:12:57.635] Build status: STARTED
[17:12:57.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:16:0) after 9m32s
[17:22:29.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:16:0)
[17:22:29.712] Build status: STARTED
[17:22:29.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:17:0) after 6m37s
[17:29:07.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:17:0)
[17:29:07.170] Build status: STARTED
[17:29:07.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:18:0) after 3m53s
[17:33:00.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:18:0)
[17:33:00.211] Build status: STARTED
[17:33:00.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:19:0) after 8m18s
[17:41:18.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:19:0)
[17:41:18.278] Build status: STARTED
[17:41:18.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:20:0) after 4m33s
[17:45:51.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:20:0)
[17:45:51.464] Build status: STARTED
[17:45:51.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:21:0) after 1m45s
[17:47:36.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:21:0)
[17:47:36.507] Build status: STARTED
[17:47:36.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:22:0) after 8m44s
[17:56:20.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:22:0)
[17:56:20.744] Build status: STARTED
[17:56:20.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:23:0) after 3m6s
[17:59:26.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:23:0)
[17:59:26.851] Build status: STARTED
[17:59:26.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:24:0) after 8m34s
[18:08:00.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:24:0)
[18:08:00.951] Build status: STARTED
[18:08:00.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:25:0) after 6m4s
[18:14:04.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:25:0)
[18:14:05.007] Build status: STARTED
[18:14:05.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:26:0) after 4m3s
[18:18:08.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:26:0)
[18:18:08.204] Build status: STARTED
[18:18:08.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:27:0) after 2m2s
[18:20:10.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:27:0)
[18:20:10.540] Build status: STARTED
[18:20:10.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:28:0) after 4m7s
[18:24:17.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:28:0)
[18:24:17.621] Build status: STARTED
[18:24:17.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:29:0) after 3m39s
[18:27:56.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:29:0)
[18:27:56.735] Build status: STARTED
[18:27:56.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:30:0) after 9m36s
[18:37:33.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:30:0)
[18:37:33.061] Build status: STARTED
[18:37:33.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:31:0) after 2m42s
[18:40:15.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:31:0)
[18:40:15.227] Build status: STARTED
[18:40:15.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:32:0) after 6m13s
[18:46:28.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:32:0)
[18:46:28.313] Build status: STARTED
[18:46:28.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:33:0) after 7m30s
[18:53:58.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:33:0)
[18:53:58.365] Build status: STARTED
[18:53:58.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:34:0) after 2m0s
[18:55:58.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:34:0)
[18:55:58.376] Build status: STARTED
[18:55:58.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:35:0) after 9m34s
[19:05:32.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:35:0)
[19:05:32.467] Build status: STARTED
[19:05:32.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:36:0) after 4m40s
[19:10:12.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:36:0)
[19:10:12.526] Build status: STARTED
[19:10:12.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:37:0) after 8m49s
[19:19:01.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:37:0)
[19:19:01.679] Build status: STARTED
[19:19:01.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:38:0) after 7m38s
[19:26:39.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:38:0)
[19:26:39.870] Build status: STARTED
[19:26:39.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:39:0) after 8m35s
[19:35:15.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:39:0)
[19:35:15.183] Build status: STARTED
[19:35:15.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:40:0) after 1m17s
[19:36:32.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:40:0)
[19:36:32.715] Build status: STARTED
[19:36:32.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:41:0) after 2m59s
[19:39:31.781] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:41:0)
[19:39:31.800] Build status: STARTED
[19:39:31.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:42:0) after 3m22s
[19:42:54.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:42:0)
[19:42:54.560] Build status: STARTED
[19:42:54.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:43:0) after 1m24s
[19:44:18.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:43:0)
[19:44:18.606] Build status: STARTED
[19:44:18.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:44:0) after 6m29s
[19:50:47.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:44:0)
[19:50:47.751] Build status: STARTED
[19:50:47.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:45:0) after 8m38s
[19:59:25.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:45:0)
[19:59:25.814] Build status: STARTED
[19:59:25.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:46:0) after 9m27s
[20:08:53.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:46:0)
[20:08:53.449] Build status: STARTED
[20:08:53.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:47:0) after 9m20s
[20:18:13.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:47:0)
[20:18:13.815] Build status: STARTED
[20:18:13.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:48:0) after 7m4s
[20:25:18.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:48:0)
[20:25:18.223] Build status: STARTED
[20:25:18.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:49:0) after 6m0s
[20:31:18.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:49:0)
[20:31:18.603] Build status: STARTED
[20:31:18.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:50:0) after 4m41s
[20:35:59.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:50:0)
[20:35:59.655] Build status: STARTED
[20:35:59.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:51:0) after 1m22s
[20:37:21.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:51:0)
[20:37:21.677] Build status: STARTED
[20:37:21.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:52:0) after 9m47s
[20:47:08.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:52:0)
[20:47:08.762] Build status: STARTED
[20:47:08.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:53:0) after 5m4s
[20:52:12.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:53:0)
[20:52:12.939] Build status: STARTED
[20:52:12.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:54:0) after 2m27s
[20:54:40.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:54:0)
[20:54:40.557] Build status: STARTED
[20:54:40.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:55:0) after 3m35s
[20:58:15.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:55:0)
[20:58:15.614] Build status: STARTED
[20:58:15.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:56:0) after 8m6s
[21:06:21.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:56:0)
[21:06:21.903] Build status: STARTED
[21:06:21.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:57:0) after 1m47s
[21:08:09.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:57:0)
[21:08:09.046] Build status: STARTED
[21:08:09.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:58:0) after 3m16s
[21:11:25.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:58:0)
[21:11:25.371] Build status: STARTED
[21:11:25.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:59:0) after 2m54s
[21:14:19.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:59:0)
[21:14:19.660] Build status: STARTED
[21:14:19.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:60:0) after 1m2s
[21:15:21.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:60:0)
[21:15:21.704] Build status: STARTED
[21:15:21.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:61:0) after 3m45s
[21:19:07.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:61:0)
[21:19:07.024] Build status: STARTED
[21:19:07.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:62:0) after 7m8s
[21:26:15.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:62:0)
[21:26:15.257] Build status: STARTED
[21:26:15.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:63:0) after 3m54s
[21:30:09.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:63:0)
[21:30:09.397] Build status: STARTED
[21:30:09.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:64:0) after 1m38s
[21:31:47.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:64:0)
[21:31:47.706] Build status: STARTED
[21:31:47.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:65:0) after 6m36s
[21:38:24.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:65:0)
[21:38:24.077] Build status: STARTED
[21:38:24.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:66:0) after 1m12s
[21:39:36.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:66:0)
[21:39:36.425] Build status: STARTED
[21:39:36.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:67:0) after 6m55s
[21:46:31.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:67:0)
[21:46:31.462] Build status: STARTED
[21:46:31.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938837114180197840:68:0) after 5m1s
[21:46:40.296] Received PubSub notification, asking Buildbucket for the build status
[21:46:40.320] Build:
{
"id": "8773407050704593937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30116,
"createdBy": "project:chromium",
"createTime": "2023-08-07T16:00:50.573448263Z",
"startTime": "2023-08-07T16:04:08.200687Z",
"endTime": "2023-08-07T21:46:40.102974224Z",
"updateTime": "2023-08-07T21:46:40.102974224Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb9e671f4fcdf4680eba1207005ae03786c1a6bb",
"ref": "refs/heads/main"
}
}
}
[21:46:40.320] Invocation finished in 5h45m52.44554233s with status FAILED