[01:16:38.456] New invocation is queued and will start shortly
[01:16:39.554] Starting the invocation (attempt 1)
[01:16:39.586] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/211f583fefa6ea140c0d64b01683057998341f22"
[01:16:39.586] Popped gitiles commit info from properties and tags
[01:16:39.586] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:16:39.588] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:16:39.588] Buildbucket request:
{
"requestId": "9010464344001453184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "211f583fefa6ea140c0d64b01683057998341f22",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9010464344001453184"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:16:40.222] Scheduled build:
{
"id": "8845034281974518736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22269,
"createdBy": "project:chromium",
"createTime": "2021-06-08T01:16:39.756308Z",
"updateTime": "2021-06-08T01:16:40.144362Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "211f583fefa6ea140c0d64b01683057998341f22",
"ref": "refs/heads/master"
}
},
"canary": true
}
[01:16:40.222] Task URL: https://cr-buildbucket.appspot.com/build/8845034281974518736
[01:16:40.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:2:0) after 1m7s
[01:17:47.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:2:0)
[01:17:47.273] Build status: SCHEDULED
[01:17:47.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:3:0) after 9m26s
[01:20:34.514] Received PubSub notification, asking Buildbucket for the build status
[01:20:34.600] Build status: STARTED
[01:27:13.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:3:0)
[01:27:13.328] Build status: STARTED
[01:27:13.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:5:0) after 6m20s
[01:33:33.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:5:0)
[01:33:33.450] Build status: STARTED
[01:33:33.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:6:0) after 9m40s
[01:43:13.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:6:0)
[01:43:13.511] Build status: STARTED
[01:43:13.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:7:0) after 5m19s
[01:48:32.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:7:0)
[01:48:32.792] Build status: STARTED
[01:48:32.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:8:0) after 1m41s
[01:50:13.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:8:0)
[01:50:13.942] Build status: STARTED
[01:50:13.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:9:0) after 4m47s
[01:55:01.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:9:0)
[01:55:01.215] Build status: STARTED
[01:55:01.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:10:0) after 9m35s
[02:04:36.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:10:0)
[02:04:36.448] Build status: STARTED
[02:04:36.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:11:0) after 9m43s
[02:14:19.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:11:0)
[02:14:19.525] Build status: STARTED
[02:14:19.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:12:0) after 3m1s
[02:17:20.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:12:0)
[02:17:20.583] Build status: STARTED
[02:17:20.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:13:0) after 9m18s
[02:26:38.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:13:0)
[02:26:38.683] Build status: STARTED
[02:26:38.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:14:0) after 4m36s
[02:31:15.220] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:14:0)
[02:31:15.246] Build status: STARTED
[02:31:15.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:15:0) after 9m0s
[02:40:15.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:15:0)
[02:40:15.406] Build status: STARTED
[02:40:15.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:16:0) after 1m39s
[02:41:54.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:16:0)
[02:41:54.634] Build status: STARTED
[02:41:54.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:17:0) after 4m51s
[02:46:45.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:17:0)
[02:46:45.682] Build status: STARTED
[02:46:45.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:18:0) after 9m10s
[02:55:55.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:18:0)
[02:55:55.741] Build status: STARTED
[02:55:55.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:19:0) after 4m9s
[03:00:04.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:19:0)
[03:00:04.762] Build status: STARTED
[03:00:04.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:20:0) after 4m36s
[03:04:40.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:20:0)
[03:04:40.932] Build status: STARTED
[03:04:40.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:21:0) after 4m40s
[03:09:21.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:21:0)
[03:09:21.104] Build status: STARTED
[03:09:21.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:22:0) after 1m17s
[03:10:38.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:22:0)
[03:10:38.161] Build status: STARTED
[03:10:38.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:23:0) after 8m31s
[03:19:09.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:23:0)
[03:19:09.704] Build status: STARTED
[03:19:09.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:24:0) after 5m20s
[03:24:29.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:24:0)
[03:24:29.827] Build status: STARTED
[03:24:29.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:25:0) after 5m8s
[03:29:37.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:25:0)
[03:29:37.946] Build status: STARTED
[03:29:37.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:26:0) after 1m29s
[03:31:07.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:26:0)
[03:31:07.097] Build status: STARTED
[03:31:07.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:27:0) after 8m25s
[03:39:32.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:27:0)
[03:39:32.266] Build status: STARTED
[03:39:32.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:28:0) after 3m30s
[03:43:02.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:28:0)
[03:43:02.497] Build status: STARTED
[03:43:02.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:29:0) after 2m43s
[03:45:45.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:29:0)
[03:45:45.509] Build status: STARTED
[03:45:45.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:30:0) after 3m12s
[03:48:57.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:30:0)
[03:48:57.564] Build status: STARTED
[03:48:57.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:31:0) after 4m53s
[03:53:50.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:31:0)
[03:53:50.669] Build status: STARTED
[03:53:50.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:32:0) after 8m7s
[04:01:57.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:32:0)
[04:01:57.867] Build status: STARTED
[04:01:57.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:33:0) after 4m20s
[04:06:18.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:33:0)
[04:06:18.041] Build status: STARTED
[04:06:18.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:34:0) after 9m4s
[04:15:22.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:34:0)
[04:15:22.174] Build status: STARTED
[04:15:22.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:35:0) after 8m39s
[04:24:01.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:35:0)
[04:24:01.744] Build status: STARTED
[04:24:01.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:36:0) after 8m50s
[04:32:51.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:36:0)
[04:32:51.806] Build status: STARTED
[04:32:51.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010464344001453184:37:0) after 9m11s
[04:41:53.902] Received PubSub notification, asking Buildbucket for the build status
[04:41:53.945] Build:
{
"id": "8845034281974518736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22269,
"createdBy": "project:chromium",
"createTime": "2021-06-08T01:16:39.756308Z",
"startTime": "2021-06-08T01:20:33.960213Z",
"endTime": "2021-06-08T04:41:53.675898526Z",
"updateTime": "2021-06-08T04:41:53.676266289Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "211f583fefa6ea140c0d64b01683057998341f22",
"ref": "refs/heads/master"
}
},
"canary": true
}
[04:41:53.945] Invocation finished in 3h25m15.505775197s with status FAILED