[04:56:13.519] New invocation is queued and will start shortly
[04:56:14.643] Starting the invocation (attempt 1)
[04:56:14.681] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fc33847bc50c0cee9b891c558794a67ecbe56c72"
[04:56:14.681] Popped gitiles commit info from properties and tags
[04:56:14.681] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:56:14.681] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:56:14.681] Buildbucket request:
{
"requestId": "9016429928727469920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc33847bc50c0cee9b891c558794a67ecbe56c72",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9016429928727469920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:56:15.269] Scheduled build:
{
"id": "8850999866735862032",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21869,
"createdBy": "project:chromium",
"createTime": "2021-04-03T04:56:14.786395Z",
"updateTime": "2021-04-03T04:56:15.188099Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc33847bc50c0cee9b891c558794a67ecbe56c72",
"ref": "refs/heads/master"
}
},
"canary": true
}
[04:56:15.270] Task URL: https://cr-buildbucket.appspot.com/build/8850999866735862032
[04:56:15.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:2:0) after 5m45s
[04:56:20.059] Received PubSub notification, asking Buildbucket for the build status
[04:56:20.119] Build status: STARTED
[05:02:00.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:2:0)
[05:02:00.352] Build status: STARTED
[05:02:00.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:4:0) after 7m9s
[05:09:09.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:4:0)
[05:09:09.406] Build status: STARTED
[05:09:09.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:5:0) after 1m35s
[05:10:44.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:5:0)
[05:10:44.450] Build status: STARTED
[05:10:44.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:6:0) after 1m1s
[05:11:45.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:6:0)
[05:11:45.500] Build status: STARTED
[05:11:45.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:7:0) after 3m44s
[05:15:29.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:7:0)
[05:15:29.558] Build status: STARTED
[05:15:29.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:8:0) after 2m43s
[05:18:12.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:8:0)
[05:18:12.605] Build status: STARTED
[05:18:12.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:9:0) after 4m10s
[05:22:22.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:9:0)
[05:22:22.648] Build status: STARTED
[05:22:22.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:10:0) after 3m11s
[05:25:33.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:10:0)
[05:25:33.707] Build status: STARTED
[05:25:33.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:11:0) after 4m39s
[05:30:12.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:11:0)
[05:30:12.767] Build status: STARTED
[05:30:12.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:12:0) after 4m5s
[05:34:17.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:12:0)
[05:34:17.823] Build status: STARTED
[05:34:17.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:13:0) after 6m52s
[05:41:09.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:13:0)
[05:41:09.879] Build status: STARTED
[05:41:09.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:14:0) after 1m34s
[05:42:43.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:14:0)
[05:42:43.929] Build status: STARTED
[05:42:43.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:15:0) after 7m0s
[05:49:43.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:15:0)
[05:49:43.974] Build status: STARTED
[05:49:43.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:16:0) after 3m19s
[05:53:03.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:16:0)
[05:53:03.287] Build status: STARTED
[05:53:03.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:17:0) after 4m0s
[05:57:03.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:17:0)
[05:57:03.338] Build status: STARTED
[05:57:03.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:18:0) after 5m25s
[06:02:28.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:18:0)
[06:02:28.539] Build status: STARTED
[06:02:28.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:19:0) after 4m42s
[06:07:10.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:19:0)
[06:07:10.920] Build status: STARTED
[06:07:10.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:20:0) after 8m39s
[06:15:49.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:20:0)
[06:15:49.982] Build status: STARTED
[06:15:49.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:21:0) after 7m56s
[06:23:46.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:21:0)
[06:23:46.152] Build status: STARTED
[06:23:46.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:22:0) after 2m56s
[06:26:42.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:22:0)
[06:26:42.200] Build status: STARTED
[06:26:42.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:23:0) after 1m8s
[06:27:51.014] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:23:0)
[06:27:51.038] Build status: STARTED
[06:27:51.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:24:0) after 7m17s
[06:35:08.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:24:0)
[06:35:08.084] Build status: STARTED
[06:35:08.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:25:0) after 7m42s
[06:42:50.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:25:0)
[06:42:50.666] Build status: STARTED
[06:42:50.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:26:0) after 6m10s
[06:49:00.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:26:0)
[06:49:00.739] Build status: STARTED
[06:49:00.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:27:0) after 9m23s
[06:58:23.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:27:0)
[06:58:23.784] Build status: STARTED
[06:58:23.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:28:0) after 5m19s
[07:03:42.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:28:0)
[07:03:42.856] Build status: STARTED
[07:03:42.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:29:0) after 8m56s
[07:12:38.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:29:0)
[07:12:38.925] Build status: STARTED
[07:12:38.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:30:0) after 7m28s
[07:20:06.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:30:0)
[07:20:07.006] Build status: STARTED
[07:20:07.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:31:0) after 9m14s
[07:29:21.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:31:0)
[07:29:21.423] Build status: STARTED
[07:29:21.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:32:0) after 5m15s
[07:34:36.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:32:0)
[07:34:36.506] Build status: STARTED
[07:34:36.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:33:0) after 2m54s
[07:37:30.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:33:0)
[07:37:30.575] Build status: STARTED
[07:37:30.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:34:0) after 5m24s
[07:42:54.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:34:0)
[07:42:54.625] Build status: STARTED
[07:42:54.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:35:0) after 5m4s
[07:47:58.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:35:0)
[07:47:58.915] Build status: STARTED
[07:47:58.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:36:0) after 5m53s
[07:53:51.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:36:0)
[07:53:51.972] Build status: STARTED
[07:53:51.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:37:0) after 6m19s
[08:00:11.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:37:0)
[08:00:11.131] Build status: STARTED
[08:00:11.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:38:0) after 7m57s
[08:08:08.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:38:0)
[08:08:08.186] Build status: STARTED
[08:08:08.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:39:0) after 3m8s
[08:11:16.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:39:0)
[08:11:16.236] Build status: STARTED
[08:11:16.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:40:0) after 6m25s
[08:17:41.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:40:0)
[08:17:41.655] Build status: STARTED
[08:17:41.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:41:0) after 3m18s
[08:20:59.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:41:0)
[08:20:59.846] Build status: STARTED
[08:20:59.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:42:0) after 9m14s
[08:30:13.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:42:0)
[08:30:13.905] Build status: STARTED
[08:30:13.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:43:0) after 4m23s
[08:34:36.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:43:0)
[08:34:36.954] Build status: STARTED
[08:34:36.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:44:0) after 4m6s
[08:38:43.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:44:0)
[08:38:43.200] Build status: STARTED
[08:38:43.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:45:0) after 8m30s
[08:47:13.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:45:0)
[08:47:13.276] Build status: STARTED
[08:47:13.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:46:0) after 8m35s
[08:55:48.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:46:0)
[08:55:48.325] Build status: STARTED
[08:55:48.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:47:0) after 8m58s
[09:04:46.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:47:0)
[09:04:46.375] Build status: STARTED
[09:04:46.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:48:0) after 5m19s
[09:10:05.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:48:0)
[09:10:05.631] Build status: STARTED
[09:10:05.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:49:0) after 3m42s
[09:13:47.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:49:0)
[09:13:47.685] Build status: STARTED
[09:13:47.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:50:0) after 2m14s
[09:16:01.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:50:0)
[09:16:01.766] Build status: STARTED
[09:16:01.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:51:0) after 6m12s
[09:22:13.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:51:0)
[09:22:13.816] Build status: STARTED
[09:22:13.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:52:0) after 6m5s
[09:28:18.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:52:0)
[09:28:18.869] Build status: STARTED
[09:28:18.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:53:0) after 4m57s
[09:33:15.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:53:0)
[09:33:15.949] Build status: STARTED
[09:33:15.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016429928727469920:54:0) after 7m30s
[09:36:32.287] Received PubSub notification, asking Buildbucket for the build status
[09:36:32.314] Build:
{
"id": "8850999866735862032",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21869,
"createdBy": "project:chromium",
"createTime": "2021-04-03T04:56:14.786395Z",
"startTime": "2021-04-03T04:56:18.885104Z",
"endTime": "2021-04-03T09:36:31.668659988Z",
"updateTime": "2021-04-03T09:36:31.669157838Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc33847bc50c0cee9b891c558794a67ecbe56c72",
"ref": "refs/heads/master"
}
},
"canary": true
}
[09:36:32.314] Invocation finished in 4h40m18.811835487s with status FAILED