[01:07:09.012] New invocation is queued and will start shortly
[01:07:10.269] Starting the invocation (attempt 1)
[01:07:10.303] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/079949e0e91994512ec2030ce646b4f84d8e4266"
[01:07:10.303] Popped gitiles commit info from properties and tags
[01:07:10.303] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:07:10.304] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:07:10.304] Buildbucket request:
{
"requestId": "8945506916197187040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "079949e0e91994512ec2030ce646b4f84d8e4266",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945506916197187040"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:07:10.730] Scheduled build:
{
"id": "8780076854114640257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29478,
"createdBy": "project:chromium",
"createTime": "2023-05-26T01:07:10.365975556Z",
"updateTime": "2023-05-26T01:07:10.365975556Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "079949e0e91994512ec2030ce646b4f84d8e4266",
"ref": "refs/heads/main"
}
}
}
[01:07:10.730] Task URL: https://cr-buildbucket.appspot.com/build/8780076854114640257
[01:07:10.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:2:0) after 9m28s
[01:10:04.964] Received PubSub notification, asking Buildbucket for the build status
[01:10:04.996] Build status: STARTED
[01:16:38.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:2:0)
[01:16:38.889] Build status: STARTED
[01:16:38.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:4:0) after 4m59s
[01:21:37.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:4:0)
[01:21:38.040] Build status: STARTED
[01:21:38.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:5:0) after 8m3s
[01:29:41.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:5:0)
[01:29:41.102] Build status: STARTED
[01:29:41.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:6:0) after 9m6s
[01:38:47.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:6:0)
[01:38:47.141] Build status: STARTED
[01:38:47.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:7:0) after 4m42s
[01:43:29.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:7:0)
[01:43:29.195] Build status: STARTED
[01:43:29.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:8:0) after 2m44s
[01:46:13.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:8:0)
[01:46:13.582] Build status: STARTED
[01:46:13.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:9:0) after 3m27s
[01:49:40.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:9:0)
[01:49:40.886] Build status: STARTED
[01:49:40.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:10:0) after 7m32s
[01:57:12.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:10:0)
[01:57:12.947] Build status: STARTED
[01:57:12.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:11:0) after 2m11s
[01:59:23.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:11:0)
[01:59:24.003] Build status: STARTED
[01:59:24.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:12:0) after 2m3s
[02:01:27.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:12:0)
[02:01:27.340] Build status: STARTED
[02:01:27.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:13:0) after 8m42s
[02:10:09.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:13:0)
[02:10:09.617] Build status: STARTED
[02:10:09.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:14:0) after 6m58s
[02:17:07.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:14:0)
[02:17:07.645] Build status: STARTED
[02:17:07.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:15:0) after 4m7s
[02:21:14.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:15:0)
[02:21:14.768] Build status: STARTED
[02:21:14.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:16:0) after 9m10s
[02:30:24.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:16:0)
[02:30:24.882] Build status: STARTED
[02:30:24.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:17:0) after 3m51s
[02:34:15.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:17:0)
[02:34:15.926] Build status: STARTED
[02:34:15.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:18:0) after 8m51s
[02:43:06.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:18:0)
[02:43:07.020] Build status: STARTED
[02:43:07.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:19:0) after 7m2s
[02:50:09.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:19:0)
[02:50:09.139] Build status: STARTED
[02:50:09.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:20:0) after 8m27s
[02:58:36.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:20:0)
[02:58:36.175] Build status: STARTED
[02:58:36.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:21:0) after 4m0s
[03:02:36.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:21:0)
[03:02:36.213] Build status: STARTED
[03:02:36.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:22:0) after 6m3s
[03:08:39.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:22:0)
[03:08:39.253] Build status: STARTED
[03:08:39.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:23:0) after 6m54s
[03:15:33.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:23:0)
[03:15:33.349] Build status: STARTED
[03:15:33.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:24:0) after 6m56s
[03:22:29.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:24:0)
[03:22:29.461] Build status: STARTED
[03:22:29.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:25:0) after 2m21s
[03:24:50.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:25:0)
[03:24:50.666] Build status: STARTED
[03:24:50.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:26:0) after 4m52s
[03:29:42.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:26:0)
[03:29:42.930] Build status: STARTED
[03:29:42.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:27:0) after 2m35s
[03:32:18.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:27:0)
[03:32:18.201] Build status: STARTED
[03:32:18.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:28:0) after 9m26s
[03:41:44.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:28:0)
[03:41:44.336] Build status: STARTED
[03:41:44.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:29:0) after 7m55s
[03:49:39.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:29:0)
[03:49:39.518] Build status: STARTED
[03:49:39.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:30:0) after 2m38s
[03:52:17.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:30:0)
[03:52:17.671] Build status: STARTED
[03:52:17.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:31:0) after 2m54s
[03:55:11.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:31:0)
[03:55:11.874] Build status: STARTED
[03:55:11.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:32:0) after 1m40s
[03:56:51.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:32:0)
[03:56:51.985] Build status: STARTED
[03:56:51.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:33:0) after 4m9s
[04:01:01.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:33:0)
[04:01:01.139] Build status: STARTED
[04:01:01.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:34:0) after 7m13s
[04:08:14.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:34:0)
[04:08:14.263] Build status: STARTED
[04:08:14.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:35:0) after 3m23s
[04:11:37.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:35:0)
[04:11:37.302] Build status: STARTED
[04:11:37.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:36:0) after 7m37s
[04:19:14.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:36:0)
[04:19:14.491] Build status: STARTED
[04:19:14.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:37:0) after 1m27s
[04:20:41.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:37:0)
[04:20:41.743] Build status: STARTED
[04:20:41.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:38:0) after 2m8s
[04:22:49.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:38:0)
[04:22:49.771] Build status: STARTED
[04:22:49.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:39:0) after 5m52s
[04:28:41.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:39:0)
[04:28:41.839] Build status: STARTED
[04:28:41.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:40:0) after 4m42s
[04:33:24.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:40:0)
[04:33:24.090] Build status: STARTED
[04:33:24.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:41:0) after 4m33s
[04:37:57.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:41:0)
[04:37:57.328] Build status: STARTED
[04:37:57.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:42:0) after 5m34s
[04:43:31.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:42:0)
[04:43:31.408] Build status: STARTED
[04:43:31.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:43:0) after 9m50s
[04:53:21.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:43:0)
[04:53:21.524] Build status: STARTED
[04:53:21.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:44:0) after 1m13s
[04:54:34.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:44:0)
[04:54:34.605] Build status: STARTED
[04:54:34.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:45:0) after 5m45s
[05:00:19.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:45:0)
[05:00:19.672] Build status: STARTED
[05:00:19.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:46:0) after 6m55s
[05:07:14.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:46:0)
[05:07:14.856] Build status: STARTED
[05:07:14.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:47:0) after 2m24s
[05:09:39.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:47:0)
[05:09:39.214] Build status: STARTED
[05:09:39.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:48:0) after 2m25s
[05:12:04.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:48:0)
[05:12:04.341] Build status: STARTED
[05:12:04.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:49:0) after 6m22s
[05:18:26.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:49:0)
[05:18:26.460] Build status: STARTED
[05:18:26.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:50:0) after 6m18s
[05:24:44.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:50:0)
[05:24:44.517] Build status: STARTED
[05:24:44.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:51:0) after 9m27s
[05:34:11.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:51:0)
[05:34:11.584] Build status: STARTED
[05:34:11.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:52:0) after 3m27s
[05:37:38.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:52:0)
[05:37:38.741] Build status: STARTED
[05:37:38.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:53:0) after 5m23s
[05:43:01.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:53:0)
[05:43:01.861] Build status: STARTED
[05:43:01.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:54:0) after 1m54s
[05:44:55.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:54:0)
[05:44:55.906] Build status: STARTED
[05:44:55.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:55:0) after 7m54s
[05:52:49.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:55:0)
[05:52:50.005] Build status: STARTED
[05:52:50.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:56:0) after 2m45s
[05:55:35.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:56:0)
[05:55:35.065] Build status: STARTED
[05:55:35.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:57:0) after 1m27s
[05:57:02.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:57:0)
[05:57:02.109] Build status: STARTED
[05:57:02.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:58:0) after 5m11s
[06:02:13.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:58:0)
[06:02:13.149] Build status: STARTED
[06:02:13.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:59:0) after 5m49s
[06:08:02.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:59:0)
[06:08:02.237] Build status: STARTED
[06:08:02.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:60:0) after 3m13s
[06:11:15.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:60:0)
[06:11:15.340] Build status: STARTED
[06:11:15.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:61:0) after 1m26s
[06:12:41.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:61:0)
[06:12:41.380] Build status: STARTED
[06:12:41.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:62:0) after 1m53s
[06:14:34.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:62:0)
[06:14:34.428] Build status: STARTED
[06:14:34.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945506916197187040:63:0) after 8m16s
[06:20:18.833] Received PubSub notification, asking Buildbucket for the build status
[06:20:18.863] Build:
{
"id": "8780076854114640257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29478,
"createdBy": "project:chromium",
"createTime": "2023-05-26T01:07:10.365975556Z",
"startTime": "2023-05-26T01:10:04.100551Z",
"endTime": "2023-05-26T06:20:18.588756603Z",
"updateTime": "2023-05-26T06:20:18.588756603Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "079949e0e91994512ec2030ce646b4f84d8e4266",
"ref": "refs/heads/main"
}
}
}
[06:20:18.863] Invocation finished in 5h13m9.8670633s with status FAILED