[00:24:36.736] New invocation is queued and will start shortly
[00:24:37.838] Starting the invocation (attempt 1)
[00:24:37.875] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7cca6647d6dd8fc80a64c03b951824c66cfb39c3"
[00:24:37.875] Popped gitiles commit info from properties and tags
[00:24:37.875] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:24:37.875] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:24:37.875] Buildbucket request:
{
"requestId": "8995156730038252176",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7cca6647d6dd8fc80a64c03b951824c66cfb39c3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8995156730038252176"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:24:38.523] Scheduled build:
{
"id": "8829726668046168225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23598,
"createdBy": "project:chromium",
"createTime": "2021-11-24T00:24:38.005039275Z",
"updateTime": "2021-11-24T00:24:38.005039275Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7cca6647d6dd8fc80a64c03b951824c66cfb39c3",
"ref": "refs/heads/main"
}
}
}
[00:24:38.523] Task URL: https://cr-buildbucket.appspot.com/build/8829726668046168225
[00:24:38.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:2:0) after 2m50s
[00:27:06.477] Received PubSub notification, asking Buildbucket for the build status
[00:27:06.513] Build status: STARTED
[00:27:28.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:2:0)
[00:27:28.609] Build status: STARTED
[00:27:28.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:4:0) after 4m8s
[00:31:36.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:4:0)
[00:31:36.751] Build status: STARTED
[00:31:36.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:5:0) after 7m23s
[00:38:59.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:5:0)
[00:38:59.870] Build status: STARTED
[00:38:59.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:6:0) after 3m43s
[00:42:42.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:6:0)
[00:42:42.957] Build status: STARTED
[00:42:42.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:7:0) after 7m54s
[00:50:36.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:7:0)
[00:50:37.051] Build status: STARTED
[00:50:37.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:8:0) after 1m3s
[00:51:40.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:8:0)
[00:51:40.775] Build status: STARTED
[00:51:40.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:9:0) after 7m19s
[00:58:59.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:9:0)
[00:59:00.022] Build status: STARTED
[00:59:00.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:10:0) after 2m43s
[01:01:43.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:10:0)
[01:01:43.096] Build status: STARTED
[01:01:43.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:11:0) after 1m19s
[01:03:02.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:11:0)
[01:03:02.738] Build status: STARTED
[01:03:02.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:12:0) after 6m3s
[01:09:06.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:12:0)
[01:09:06.119] Build status: STARTED
[01:09:06.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:13:0) after 8m56s
[01:18:02.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:13:0)
[01:18:02.678] Build status: STARTED
[01:18:02.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:14:0) after 5m10s
[01:23:12.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:14:0)
[01:23:12.767] Build status: STARTED
[01:23:12.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:15:0) after 8m18s
[01:31:30.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:15:0)
[01:31:30.841] Build status: STARTED
[01:31:30.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:16:0) after 2m47s
[01:34:17.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:16:0)
[01:34:18.004] Build status: STARTED
[01:34:18.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:17:0) after 2m41s
[01:36:59.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:17:0)
[01:36:59.075] Build status: STARTED
[01:36:59.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:18:0) after 5m7s
[01:42:06.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:18:0)
[01:42:06.554] Build status: STARTED
[01:42:06.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:19:0) after 3m55s
[01:46:02.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:19:0)
[01:46:02.166] Build status: STARTED
[01:46:02.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:20:0) after 2m2s
[01:48:04.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:20:0)
[01:48:04.273] Build status: STARTED
[01:48:04.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:21:0) after 9m18s
[01:57:22.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:21:0)
[01:57:22.424] Build status: STARTED
[01:57:22.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:22:0) after 4m18s
[02:01:40.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:22:0)
[02:01:40.559] Build status: STARTED
[02:01:40.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:23:0) after 8m34s
[02:10:14.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:23:0)
[02:10:14.603] Build status: STARTED
[02:10:14.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:24:0) after 6m6s
[02:16:20.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:24:0)
[02:16:20.674] Build status: STARTED
[02:16:20.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:25:0) after 8m57s
[02:25:17.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:25:0)
[02:25:17.910] Build status: STARTED
[02:25:17.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:26:0) after 8m24s
[02:33:42.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:26:0)
[02:33:42.389] Build status: STARTED
[02:33:42.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:27:0) after 5m33s
[02:39:15.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:27:0)
[02:39:15.647] Build status: STARTED
[02:39:15.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:28:0) after 5m54s
[02:45:09.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:28:0)
[02:45:09.847] Build status: STARTED
[02:45:09.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:29:0) after 3m10s
[02:48:20.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:29:0)
[02:48:20.124] Build status: STARTED
[02:48:20.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:30:0) after 3m43s
[02:52:03.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:30:0)
[02:52:03.399] Build status: STARTED
[02:52:03.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:31:0) after 8m36s
[03:00:39.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:31:0)
[03:00:39.604] Build status: STARTED
[03:00:39.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:32:0) after 3m14s
[03:03:53.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:32:0)
[03:03:53.814] Build status: STARTED
[03:03:53.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:33:0) after 7m57s
[03:11:51.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:33:0)
[03:11:51.223] Build status: STARTED
[03:11:51.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:34:0) after 4m57s
[03:16:48.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:34:0)
[03:16:48.379] Build status: STARTED
[03:16:48.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:35:0) after 8m33s
[03:25:21.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:35:0)
[03:25:21.662] Build status: STARTED
[03:25:21.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:36:0) after 1m42s
[03:27:03.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:36:0)
[03:27:03.980] Build status: STARTED
[03:27:03.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:37:0) after 4m13s
[03:31:17.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:37:0)
[03:31:17.112] Build status: STARTED
[03:31:17.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:38:0) after 3m41s
[03:34:58.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:38:0)
[03:34:58.178] Build status: STARTED
[03:34:58.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:39:0) after 9m42s
[03:44:40.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:39:0)
[03:44:40.658] Build status: STARTED
[03:44:40.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:40:0) after 2m8s
[03:46:48.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:40:0)
[03:46:48.860] Build status: STARTED
[03:46:48.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:41:0) after 9m50s
[03:56:39.089] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:41:0)
[03:56:39.124] Build status: STARTED
[03:56:39.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:42:0) after 3m2s
[03:59:41.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:42:0)
[03:59:41.219] Build status: STARTED
[03:59:41.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:43:0) after 1m4s
[04:00:45.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:43:0)
[04:00:45.423] Build status: STARTED
[04:00:45.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:44:0) after 7m49s
[04:08:34.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:44:0)
[04:08:34.575] Build status: STARTED
[04:08:34.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:45:0) after 7m1s
[04:15:35.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:45:0)
[04:15:35.732] Build status: STARTED
[04:15:35.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:46:0) after 9m27s
[04:25:02.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:46:0)
[04:25:02.855] Build status: STARTED
[04:25:02.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:47:0) after 5m39s
[04:30:42.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:47:0)
[04:30:42.165] Build status: STARTED
[04:30:42.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:48:0) after 6m15s
[04:36:57.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:48:0)
[04:36:57.267] Build status: STARTED
[04:36:57.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:49:0) after 1m40s
[04:38:37.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:49:0)
[04:38:37.422] Build status: STARTED
[04:38:37.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:50:0) after 3m52s
[04:42:29.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:50:0)
[04:42:29.645] Build status: STARTED
[04:42:29.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:51:0) after 4m5s
[04:46:34.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:51:0)
[04:46:34.717] Build status: STARTED
[04:46:34.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:52:0) after 8m34s
[04:55:08.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:52:0)
[04:55:08.786] Build status: STARTED
[04:55:08.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:53:0) after 3m54s
[04:59:02.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:53:0)
[04:59:02.952] Build status: STARTED
[04:59:02.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:54:0) after 2m2s
[05:01:05.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:54:0)
[05:01:05.130] Build status: STARTED
[05:01:05.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:55:0) after 7m49s
[05:08:54.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:55:0)
[05:08:54.259] Build status: STARTED
[05:08:54.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:56:0) after 5m56s
[05:14:50.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:56:0)
[05:14:50.319] Build status: STARTED
[05:14:50.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:57:0) after 8m5s
[05:22:55.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:57:0)
[05:22:55.441] Build status: STARTED
[05:22:55.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:58:0) after 3m9s
[05:26:04.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:58:0)
[05:26:04.803] Build status: STARTED
[05:26:04.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:59:0) after 9m30s
[05:35:34.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:59:0)
[05:35:34.933] Build status: STARTED
[05:35:34.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:60:0) after 7m18s
[05:42:53.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:60:0)
[05:42:53.350] Build status: STARTED
[05:42:53.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:61:0) after 9m28s
[05:52:21.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:61:0)
[05:52:21.465] Build status: STARTED
[05:52:21.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995156730038252176:62:0) after 1m18s
[05:52:55.589] Received PubSub notification, asking Buildbucket for the build status
[05:52:55.624] Build:
{
"id": "8829726668046168225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23598,
"createdBy": "project:chromium",
"createTime": "2021-11-24T00:24:38.005039275Z",
"startTime": "2021-11-24T00:27:05.650676Z",
"endTime": "2021-11-24T05:52:55.336722877Z",
"updateTime": "2021-11-24T05:52:55.336722877Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7cca6647d6dd8fc80a64c03b951824c66cfb39c3",
"ref": "refs/heads/main"
}
}
}
[05:52:55.624] Invocation finished in 5h28m18.902585573s with status FAILED