[21:14:38.268] New invocation is queued and will start shortly
[21:14:39.363] Starting the invocation (attempt 1)
[21:14:39.416] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/529eb9e7978c0ec3152d80efe1b25c52123828b2"
[21:14:39.416] Popped gitiles commit info from properties and tags
[21:14:39.416] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:14:39.416] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:14:39.416] Buildbucket request:
{
"requestId": "9006493303001936864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "529eb9e7978c0ec3152d80efe1b25c52123828b2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9006493303001936864"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:14:40.142] Scheduled build:
{
"id": "8841063241016703616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22579,
"createdBy": "project:chromium",
"createTime": "2021-07-21T21:14:39.526232Z",
"updateTime": "2021-07-21T21:14:40.006521Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "529eb9e7978c0ec3152d80efe1b25c52123828b2",
"ref": "refs/heads/main"
}
}
}
[21:14:40.142] Task URL: https://cr-buildbucket.appspot.com/build/8841063241016703616
[21:14:40.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:2:0) after 3m28s
[21:17:50.096] Received PubSub notification, asking Buildbucket for the build status
[21:17:50.127] Build status: STARTED
[21:18:08.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:2:0)
[21:18:08.394] Build status: STARTED
[21:18:08.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:4:0) after 7m26s
[21:25:34.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:4:0)
[21:25:34.447] Build status: STARTED
[21:25:34.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:5:0) after 7m2s
[21:32:36.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:5:0)
[21:32:36.774] Build status: STARTED
[21:32:36.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:6:0) after 7m57s
[21:40:33.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:6:0)
[21:40:33.945] Build status: STARTED
[21:40:33.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:7:0) after 4m22s
[21:44:56.285] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:7:0)
[21:44:56.313] Build status: STARTED
[21:44:56.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:8:0) after 7m51s
[21:52:48.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:8:0)
[21:52:48.545] Build status: STARTED
[21:52:48.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:9:0) after 1m28s
[21:54:16.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:9:0)
[21:54:16.557] Build status: STARTED
[21:54:16.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:10:0) after 5m12s
[21:59:28.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:10:0)
[21:59:28.616] Build status: STARTED
[21:59:28.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:11:0) after 5m16s
[22:04:44.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:11:0)
[22:04:44.786] Build status: STARTED
[22:04:44.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:12:0) after 7m54s
[22:12:38.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:12:0)
[22:12:39.022] Build status: STARTED
[22:12:39.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:13:0) after 1m40s
[22:14:19.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:13:0)
[22:14:19.340] Build status: STARTED
[22:14:19.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:14:0) after 4m58s
[22:19:17.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:14:0)
[22:19:17.417] Build status: STARTED
[22:19:17.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:15:0) after 6m2s
[22:25:19.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:15:0)
[22:25:19.661] Build status: STARTED
[22:25:19.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:16:0) after 5m19s
[22:30:38.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:16:0)
[22:30:38.809] Build status: STARTED
[22:30:38.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:17:0) after 4m35s
[22:35:13.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:17:0)
[22:35:13.948] Build status: STARTED
[22:35:13.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:18:0) after 9m48s
[22:45:01.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:18:0)
[22:45:02.037] Build status: STARTED
[22:45:02.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:19:0) after 3m9s
[22:48:11.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:19:0)
[22:48:11.210] Build status: STARTED
[22:48:11.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:20:0) after 2m6s
[22:50:17.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:20:0)
[22:50:17.356] Build status: STARTED
[22:50:17.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:21:0) after 9m1s
[22:59:18.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:21:0)
[22:59:18.541] Build status: STARTED
[22:59:18.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:22:0) after 4m30s
[23:03:48.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:22:0)
[23:03:48.652] Build status: STARTED
[23:03:48.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:23:0) after 9m15s
[23:13:03.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:23:0)
[23:13:03.834] Build status: STARTED
[23:13:03.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:24:0) after 4m14s
[23:17:17.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:24:0)
[23:17:18.012] Build status: STARTED
[23:17:18.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:25:0) after 1m33s
[23:18:51.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:25:0)
[23:18:51.242] Build status: STARTED
[23:18:51.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:26:0) after 1m33s
[23:20:24.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:26:0)
[23:20:24.654] Build status: STARTED
[23:20:24.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:27:0) after 8m44s
[23:29:08.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:27:0)
[23:29:09.072] Build status: STARTED
[23:29:09.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:28:0) after 8m22s
[23:37:31.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:28:0)
[23:37:31.386] Build status: STARTED
[23:37:31.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:29:0) after 5m16s
[23:42:47.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:29:0)
[23:42:47.612] Build status: STARTED
[23:42:47.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:30:0) after 4m15s
[23:47:02.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:30:0)
[23:47:02.684] Build status: STARTED
[23:47:02.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:31:0) after 2m32s
[23:49:34.994] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:31:0)
[23:49:35.024] Build status: STARTED
[23:49:35.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:32:0) after 9m26s
[23:59:02.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:32:0)
[23:59:02.214] Build status: STARTED
[23:59:02.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:33:0) after 8m37s
[00:07:39.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:33:0)
[00:07:39.277] Build status: STARTED
[00:07:39.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:34:0) after 3m21s
[00:11:00.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:34:0)
[00:11:00.806] Build status: STARTED
[00:11:00.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:35:0) after 2m14s
[00:13:14.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:35:0)
[00:13:14.833] Build status: STARTED
[00:13:14.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:36:0) after 9m20s
[00:22:34.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:36:0)
[00:22:34.891] Build status: STARTED
[00:22:34.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:37:0) after 4m36s
[00:27:11.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:37:0)
[00:27:11.104] Build status: STARTED
[00:27:11.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:38:0) after 1m14s
[00:28:25.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:38:0)
[00:28:25.316] Build status: STARTED
[00:28:25.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:39:0) after 7m38s
[00:36:03.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:39:0)
[00:36:03.442] Build status: STARTED
[00:36:03.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:40:0) after 4m14s
[00:40:17.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:40:0)
[00:40:17.588] Build status: STARTED
[00:40:17.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:41:0) after 3m33s
[00:43:50.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:41:0)
[00:43:50.651] Build status: STARTED
[00:43:50.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:42:0) after 3m20s
[00:47:10.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:42:0)
[00:47:10.858] Build status: STARTED
[00:47:10.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:43:0) after 9m44s
[00:56:54.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:43:0)
[00:56:54.920] Build status: STARTED
[00:56:54.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:44:0) after 6m44s
[01:03:39.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:44:0)
[01:03:39.088] Build status: STARTED
[01:03:39.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:45:0) after 4m1s
[01:07:40.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:45:0)
[01:07:40.212] Build status: STARTED
[01:07:40.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:46:0) after 4m27s
[01:12:07.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:46:0)
[01:12:07.592] Build status: STARTED
[01:12:07.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:47:0) after 2m56s
[01:15:03.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:47:0)
[01:15:03.699] Build status: STARTED
[01:15:03.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:48:0) after 9m36s
[01:24:39.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:48:0)
[01:24:39.781] Build status: STARTED
[01:24:39.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:49:0) after 2m31s
[01:27:10.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:49:0)
[01:27:10.844] Build status: STARTED
[01:27:10.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:50:0) after 8m37s
[01:35:47.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:50:0)
[01:35:48.006] Build status: STARTED
[01:35:48.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:51:0) after 9m0s
[01:44:48.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:51:0)
[01:44:48.057] Build status: STARTED
[01:44:48.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:52:0) after 5m57s
[01:50:45.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:52:0)
[01:50:45.109] Build status: STARTED
[01:50:45.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:53:0) after 2m37s
[01:53:22.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:53:0)
[01:53:22.174] Build status: STARTED
[01:53:22.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:54:0) after 3m46s
[01:57:08.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:54:0)
[01:57:08.255] Build status: STARTED
[01:57:08.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:55:0) after 6m20s
[02:03:28.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:55:0)
[02:03:28.370] Build status: STARTED
[02:03:28.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:56:0) after 2m23s
[02:05:51.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:56:0)
[02:05:51.508] Build status: STARTED
[02:05:51.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:57:0) after 8m27s
[02:14:18.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:57:0)
[02:14:19.462] Build status: STARTED
[02:14:19.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:58:0) after 1m33s
[02:15:52.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:58:0)
[02:15:52.613] Build status: STARTED
[02:15:52.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:59:0) after 5m32s
[02:21:24.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:59:0)
[02:21:24.649] Build status: STARTED
[02:21:24.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:60:0) after 8m18s
[02:29:42.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:60:0)
[02:29:42.710] Build status: STARTED
[02:29:42.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:61:0) after 3m31s
[02:33:13.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:61:0)
[02:33:13.863] Build status: STARTED
[02:33:13.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:62:0) after 3m34s
[02:36:47.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:62:0)
[02:36:47.911] Build status: STARTED
[02:36:47.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:63:0) after 1m38s
[02:38:26.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:63:0)
[02:38:26.136] Build status: STARTED
[02:38:26.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:64:0) after 4m41s
[02:43:07.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:64:0)
[02:43:07.326] Build status: STARTED
[02:43:07.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:65:0) after 1m45s
[02:44:52.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:65:0)
[02:44:52.671] Build status: STARTED
[02:44:52.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:66:0) after 2m35s
[02:47:27.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:66:0)
[02:47:27.901] Build status: STARTED
[02:47:27.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:67:0) after 4m35s
[02:52:02.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:67:0)
[02:52:02.969] Build status: STARTED
[02:52:02.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006493303001936864:68:0) after 6m15s
[02:54:17.882] Received PubSub notification, asking Buildbucket for the build status
[02:54:17.918] Build:
{
"id": "8841063241016703616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22579,
"createdBy": "project:chromium",
"createTime": "2021-07-21T21:14:39.526232Z",
"startTime": "2021-07-21T21:17:49.326819Z",
"endTime": "2021-07-22T02:54:17.514800290Z",
"updateTime": "2021-07-22T02:54:17.515200770Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "529eb9e7978c0ec3152d80efe1b25c52123828b2",
"ref": "refs/heads/main"
}
}
}
[02:54:17.918] Invocation finished in 5h39m39.668675296s with status FAILED