[06:05:10.471] New invocation is queued and will start shortly
[06:05:11.698] Starting the invocation (attempt 1)
[06:05:11.738] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d501b9ca3049de1cd1972e07b1482d883b9bc448"
[06:05:11.738] Popped gitiles commit info from properties and tags
[06:05:11.738] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:05:11.738] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:05:11.738] Buildbucket request:
{
"requestId": "8999121570239878000",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d501b9ca3049de1cd1972e07b1482d883b9bc448",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8999121570239878000"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:05:12.365] Scheduled build:
{
"id": "8833691508174944977",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23331,
"createdBy": "project:chromium",
"createTime": "2021-10-11T06:05:11.805338517Z",
"updateTime": "2021-10-11T06:05:12.165746692Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d501b9ca3049de1cd1972e07b1482d883b9bc448",
"ref": "refs/heads/main"
}
}
}
[06:05:12.365] Task URL: https://cr-buildbucket.appspot.com/build/8833691508174944977
[06:05:12.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:2:0) after 5m39s
[06:07:40.055] Received PubSub notification, asking Buildbucket for the build status
[06:07:40.080] Build status: STARTED
[06:10:51.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:2:0)
[06:10:51.534] Build status: STARTED
[06:10:51.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:4:0) after 5m45s
[06:16:36.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:4:0)
[06:16:36.678] Build status: STARTED
[06:16:36.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:5:0) after 4m55s
[06:21:31.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:5:0)
[06:21:31.727] Build status: STARTED
[06:21:31.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:6:0) after 9m8s
[06:30:39.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:6:0)
[06:30:39.757] Build status: STARTED
[06:30:39.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:7:0) after 9m56s
[06:40:35.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:7:0)
[06:40:35.860] Build status: STARTED
[06:40:35.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:8:0) after 4m6s
[06:44:41.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:8:0)
[06:44:41.930] Build status: STARTED
[06:44:41.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:9:0) after 3m46s
[06:48:27.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:9:0)
[06:48:28.015] Build status: STARTED
[06:48:28.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:10:0) after 6m37s
[06:55:05.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:10:0)
[06:55:05.056] Build status: STARTED
[06:55:05.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:11:0) after 8m41s
[07:03:46.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:11:0)
[07:03:46.588] Build status: STARTED
[07:03:46.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:12:0) after 9m51s
[07:13:37.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:12:0)
[07:13:37.681] Build status: STARTED
[07:13:37.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:13:0) after 5m11s
[07:18:48.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:13:0)
[07:18:48.754] Build status: STARTED
[07:18:48.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:14:0) after 8m17s
[07:27:05.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:14:0)
[07:27:05.815] Build status: STARTED
[07:27:05.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:15:0) after 5m42s
[07:32:47.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:15:0)
[07:32:47.949] Build status: STARTED
[07:32:47.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:16:0) after 2m27s
[07:35:15.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:16:0)
[07:35:15.119] Build status: STARTED
[07:35:15.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:17:0) after 7m2s
[07:42:17.141] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:17:0)
[07:42:17.171] Build status: STARTED
[07:42:17.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:18:0) after 9m2s
[07:51:19.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:18:0)
[07:51:19.234] Build status: STARTED
[07:51:19.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:19:0) after 4m15s
[07:55:34.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:19:0)
[07:55:34.394] Build status: STARTED
[07:55:34.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:20:0) after 7m55s
[08:03:29.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:20:0)
[08:03:29.524] Build status: STARTED
[08:03:29.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:21:0) after 3m36s
[08:07:05.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:21:0)
[08:07:05.582] Build status: STARTED
[08:07:05.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:22:0) after 2m49s
[08:09:54.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:22:0)
[08:09:54.636] Build status: STARTED
[08:09:54.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:23:0) after 5m36s
[08:15:30.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:23:0)
[08:15:30.720] Build status: STARTED
[08:15:30.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:24:0) after 7m48s
[08:23:18.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:24:0)
[08:23:18.781] Build status: STARTED
[08:23:18.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:25:0) after 5m0s
[08:28:18.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:25:0)
[08:28:18.949] Build status: STARTED
[08:28:18.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:26:0) after 2m39s
[08:30:58.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:26:0)
[08:30:58.144] Build status: STARTED
[08:30:58.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:27:0) after 3m48s
[08:34:46.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:27:0)
[08:34:46.293] Build status: STARTED
[08:34:46.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:28:0) after 8m40s
[08:43:26.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:28:0)
[08:43:26.581] Build status: STARTED
[08:43:26.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:29:0) after 7m39s
[08:51:05.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:29:0)
[08:51:05.694] Build status: STARTED
[08:51:05.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:30:0) after 9m59s
[09:01:04.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:30:0)
[09:01:04.766] Build status: STARTED
[09:01:04.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:31:0) after 5m34s
[09:06:38.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:31:0)
[09:06:38.808] Build status: STARTED
[09:06:38.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:32:0) after 8m26s
[09:15:04.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:32:0)
[09:15:04.878] Build status: STARTED
[09:15:04.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:33:0) after 7m54s
[09:22:58.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:33:0)
[09:22:58.921] Build status: STARTED
[09:22:58.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:34:0) after 4m36s
[09:27:34.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:34:0)
[09:27:34.992] Build status: STARTED
[09:27:34.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:35:0) after 9m21s
[09:36:56.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:35:0)
[09:36:56.191] Build status: STARTED
[09:36:56.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:36:0) after 8m17s
[09:45:13.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:36:0)
[09:45:13.309] Build status: STARTED
[09:45:13.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:37:0) after 3m52s
[09:49:05.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:37:0)
[09:49:05.652] Build status: STARTED
[09:49:05.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:38:0) after 4m13s
[09:53:18.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:38:0)
[09:53:18.760] Build status: STARTED
[09:53:18.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:39:0) after 6m55s
[10:00:13.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:39:0)
[10:00:13.913] Build status: STARTED
[10:00:13.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:40:0) after 6m27s
[10:06:40.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:40:0)
[10:06:40.943] Build status: STARTED
[10:06:40.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:41:0) after 3m33s
[10:10:13.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:41:0)
[10:10:13.994] Build status: STARTED
[10:10:13.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:42:0) after 1m24s
[10:11:38.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:42:0)
[10:11:38.310] Build status: STARTED
[10:11:38.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:43:0) after 2m23s
[10:14:01.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:43:0)
[10:14:01.518] Build status: STARTED
[10:14:01.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:44:0) after 2m6s
[10:16:07.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:44:0)
[10:16:07.576] Build status: STARTED
[10:16:07.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:45:0) after 3m13s
[10:19:20.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:45:0)
[10:19:20.831] Build status: STARTED
[10:19:20.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:46:0) after 9m4s
[10:28:24.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:46:0)
[10:28:25.045] Build status: STARTED
[10:28:25.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:47:0) after 4m58s
[10:33:23.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:47:0)
[10:33:23.293] Build status: STARTED
[10:33:23.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:48:0) after 7m25s
[10:40:48.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:48:0)
[10:40:48.369] Build status: STARTED
[10:40:48.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:49:0) after 8m23s
[10:49:11.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:49:0)
[10:49:11.470] Build status: STARTED
[10:49:11.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:50:0) after 7m7s
[10:56:18.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:50:0)
[10:56:18.528] Build status: STARTED
[10:56:18.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:51:0) after 5m34s
[11:01:52.650] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:51:0)
[11:01:52.789] Build status: STARTED
[11:01:52.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:52:0) after 6m29s
[11:08:21.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:52:0)
[11:08:21.905] Build status: STARTED
[11:08:21.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:53:0) after 2m26s
[11:10:48.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:53:0)
[11:10:48.041] Build status: STARTED
[11:10:48.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:54:0) after 9m6s
[11:19:54.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:54:0)
[11:19:54.094] Build status: STARTED
[11:19:54.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:55:0) after 1m13s
[11:21:07.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:55:0)
[11:21:07.318] Build status: STARTED
[11:21:07.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:56:0) after 5m52s
[11:26:59.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:56:0)
[11:26:59.407] Build status: STARTED
[11:26:59.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999121570239878000:57:0) after 6m55s
[11:29:51.223] Received PubSub notification, asking Buildbucket for the build status
[11:29:51.249] Build:
{
"id": "8833691508174944977",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23331,
"createdBy": "project:chromium",
"createTime": "2021-10-11T06:05:11.805338517Z",
"startTime": "2021-10-11T06:07:39.307748Z",
"endTime": "2021-10-11T11:29:49.720512745Z",
"updateTime": "2021-10-11T11:29:49.720921724Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d501b9ca3049de1cd1972e07b1482d883b9bc448",
"ref": "refs/heads/main"
}
}
}
[11:29:51.249] Invocation finished in 5h24m40.796183691s with status FAILED