[06:11:52.100] New invocation is queued and will start shortly
[06:11:53.222] Starting the invocation (attempt 1)
[06:11:53.247] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/674cc6b43552b93bfd7598c6b9b157a8f207f199"
[06:11:53.247] Popped gitiles commit info from properties and tags
[06:11:53.247] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:11:53.248] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:11:53.248] Buildbucket request:
{
"requestId": "8941501478461415824",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "674cc6b43552b93bfd7598c6b9b157a8f207f199",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941501478461415824"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:11:53.679] Scheduled build:
{
"id": "8776071416541441505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29881,
"createdBy": "project:chromium",
"createTime": "2023-07-09T06:11:53.305569957Z",
"updateTime": "2023-07-09T06:11:53.305569957Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "674cc6b43552b93bfd7598c6b9b157a8f207f199",
"ref": "refs/heads/main"
}
}
}
[06:11:53.679] Task URL: https://cr-buildbucket.appspot.com/build/8776071416541441505
[06:11:53.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:2:0) after 4m35s
[06:15:27.171] Received PubSub notification, asking Buildbucket for the build status
[06:15:27.198] Build status: STARTED
[06:16:28.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:2:0)
[06:16:28.765] Build status: STARTED
[06:16:28.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:4:0) after 1m35s
[06:18:03.857] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:4:0)
[06:18:03.893] Build status: STARTED
[06:18:03.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:5:0) after 8m49s
[06:26:53.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:5:0)
[06:26:53.133] Build status: STARTED
[06:26:53.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:6:0) after 8m15s
[06:35:08.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:6:0)
[06:35:08.191] Build status: STARTED
[06:35:08.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:7:0) after 3m3s
[06:38:11.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:7:0)
[06:38:11.227] Build status: STARTED
[06:38:11.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:8:0) after 5m48s
[06:43:59.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:8:0)
[06:43:59.300] Build status: STARTED
[06:43:59.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:9:0) after 4m19s
[06:48:18.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:9:0)
[06:48:18.375] Build status: STARTED
[06:48:18.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:10:0) after 7m20s
[06:55:38.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:10:0)
[06:55:38.418] Build status: STARTED
[06:55:38.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:11:0) after 4m23s
[07:00:01.477] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:11:0)
[07:00:01.525] Build status: STARTED
[07:00:01.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:12:0) after 9m7s
[07:09:08.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:12:0)
[07:09:08.610] Build status: STARTED
[07:09:08.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:13:0) after 7m46s
[07:16:55.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:13:0)
[07:16:55.431] Build status: STARTED
[07:16:55.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:14:0) after 3m43s
[07:20:38.449] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:14:0)
[07:20:38.467] Build status: STARTED
[07:20:38.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:15:0) after 2m27s
[07:23:05.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:15:0)
[07:23:05.498] Build status: STARTED
[07:23:05.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:16:0) after 7m33s
[07:30:38.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:16:0)
[07:30:38.525] Build status: STARTED
[07:30:38.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:17:0) after 6m24s
[07:37:02.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:17:0)
[07:37:02.940] Build status: STARTED
[07:37:02.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:18:0) after 5m26s
[07:42:29.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:18:0)
[07:42:29.954] Build status: STARTED
[07:42:29.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:19:0) after 8m1s
[07:50:30.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:19:0)
[07:50:30.994] Build status: STARTED
[07:50:30.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:20:0) after 9m5s
[07:59:36.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:20:0)
[07:59:36.221] Build status: STARTED
[07:59:36.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:21:0) after 5m24s
[08:05:00.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:21:0)
[08:05:00.529] Build status: STARTED
[08:05:00.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:22:0) after 2m5s
[08:07:06.698] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:22:0)
[08:07:06.719] Build status: STARTED
[08:07:06.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:23:0) after 5m1s
[08:12:07.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:23:0)
[08:12:07.774] Build status: STARTED
[08:12:07.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:24:0) after 9m32s
[08:21:39.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:24:0)
[08:21:39.815] Build status: STARTED
[08:21:39.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:25:0) after 2m16s
[08:23:55.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:25:0)
[08:23:55.874] Build status: STARTED
[08:23:55.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:26:0) after 7m5s
[08:31:01.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:26:0)
[08:31:01.055] Build status: STARTED
[08:31:01.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:27:0) after 1m24s
[08:32:25.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:27:0)
[08:32:25.163] Build status: STARTED
[08:32:25.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:28:0) after 5m49s
[08:38:14.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:28:0)
[08:38:14.405] Build status: STARTED
[08:38:14.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:29:0) after 3m46s
[08:42:00.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:29:0)
[08:42:00.709] Build status: STARTED
[08:42:00.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:30:0) after 3m52s
[08:45:52.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:30:0)
[08:45:52.746] Build status: STARTED
[08:45:52.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:31:0) after 3m35s
[08:49:27.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:31:0)
[08:49:27.862] Build status: STARTED
[08:49:27.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:32:0) after 7m14s
[08:56:42.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:32:0)
[08:56:42.116] Build status: STARTED
[08:56:42.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:33:0) after 4m7s
[09:00:49.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:33:0)
[09:00:49.166] Build status: STARTED
[09:00:49.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:34:0) after 2m21s
[09:03:10.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:34:0)
[09:03:10.289] Build status: STARTED
[09:03:10.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:35:0) after 6m42s
[09:09:52.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:35:0)
[09:09:52.389] Build status: STARTED
[09:09:52.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:36:0) after 9m28s
[09:19:20.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:36:0)
[09:19:20.417] Build status: STARTED
[09:19:20.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:37:0) after 3m49s
[09:23:09.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:37:0)
[09:23:09.553] Build status: STARTED
[09:23:09.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:38:0) after 8m20s
[09:31:29.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:38:0)
[09:31:29.608] Build status: STARTED
[09:31:29.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:39:0) after 5m32s
[09:37:01.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:39:0)
[09:37:01.643] Build status: STARTED
[09:37:01.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:40:0) after 6m41s
[09:43:42.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:40:0)
[09:43:42.899] Build status: STARTED
[09:43:42.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:41:0) after 9m8s
[09:52:51.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:41:0)
[09:52:51.102] Build status: STARTED
[09:52:51.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:42:0) after 3m53s
[09:56:44.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:42:0)
[09:56:44.424] Build status: STARTED
[09:56:44.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:43:0) after 5m36s
[10:02:20.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:43:0)
[10:02:20.713] Build status: STARTED
[10:02:20.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:44:0) after 8m30s
[10:10:50.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:44:0)
[10:10:50.810] Build status: STARTED
[10:10:50.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:45:0) after 8m49s
[10:19:40.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:45:0)
[10:19:40.171] Build status: STARTED
[10:19:40.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:46:0) after 9m58s
[10:29:38.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:46:0)
[10:29:38.381] Build status: STARTED
[10:29:38.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:47:0) after 3m0s
[10:32:38.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:47:0)
[10:32:38.722] Build status: STARTED
[10:32:38.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:48:0) after 4m1s
[10:36:39.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:48:0)
[10:36:39.852] Build status: STARTED
[10:36:39.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:49:0) after 6m4s
[10:42:43.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:49:0)
[10:42:43.888] Build status: STARTED
[10:42:43.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:50:0) after 2m59s
[10:45:42.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:50:0)
[10:45:42.928] Build status: STARTED
[10:45:42.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:51:0) after 2m38s
[10:48:20.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:51:0)
[10:48:20.919] Build status: STARTED
[10:48:20.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:52:0) after 5m48s
[10:54:09.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:52:0)
[10:54:09.026] Build status: STARTED
[10:54:09.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:53:0) after 5m49s
[10:59:58.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:53:0)
[10:59:58.068] Build status: STARTED
[10:59:58.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:54:0) after 9m3s
[11:09:01.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:54:0)
[11:09:01.259] Build status: STARTED
[11:09:01.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:55:0) after 6m52s
[11:15:53.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:55:0)
[11:15:53.290] Build status: STARTED
[11:15:53.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:56:0) after 2m52s
[11:18:45.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:56:0)
[11:18:45.532] Build status: STARTED
[11:18:45.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:57:0) after 4m32s
[11:23:17.548] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:57:0)
[11:23:17.564] Build status: STARTED
[11:23:17.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:58:0) after 7m8s
[11:30:25.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:58:0)
[11:30:25.702] Build status: STARTED
[11:30:25.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:59:0) after 3m29s
[11:33:54.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:59:0)
[11:33:54.749] Build status: STARTED
[11:33:54.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:60:0) after 9m35s
[11:43:30.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:60:0)
[11:43:30.443] Build status: STARTED
[11:43:30.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:61:0) after 7m17s
[11:50:47.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:61:0)
[11:50:47.478] Build status: STARTED
[11:50:47.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941501478461415824:62:0) after 5m39s
[11:50:49.098] Received PubSub notification, asking Buildbucket for the build status
[11:50:49.117] Build:
{
"id": "8776071416541441505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29881,
"createdBy": "project:chromium",
"createTime": "2023-07-09T06:11:53.305569957Z",
"startTime": "2023-07-09T06:15:23.059572Z",
"endTime": "2023-07-09T11:50:48.902284517Z",
"updateTime": "2023-07-09T11:50:48.902284517Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "674cc6b43552b93bfd7598c6b9b157a8f207f199",
"ref": "refs/heads/main"
}
}
}
[11:50:49.117] Invocation finished in 5h38m57.026665835s with status FAILED