[00:43:24.119] New invocation is queued and will start shortly
[00:43:25.185] Starting the invocation (attempt 1)
[00:43:25.213] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aae8e28a83b75b216b01eda293cf6e6811fe9a0a"
[00:43:25.213] Popped gitiles commit info from properties and tags
[00:43:25.213] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:43:25.213] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:43:25.213] Buildbucket request:
{
"requestId": "8957467209859547984",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aae8e28a83b75b216b01eda293cf6e6811fe9a0a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8957467209859547984"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:43:25.748] Scheduled build:
{
"id": "8792037147954390305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28767,
"createdBy": "project:chromium",
"createTime": "2023-01-14T00:43:25.314932110Z",
"updateTime": "2023-01-14T00:43:25.314932110Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aae8e28a83b75b216b01eda293cf6e6811fe9a0a",
"ref": "refs/heads/main"
}
}
}
[00:43:25.748] Task URL: https://cr-buildbucket.appspot.com/build/8792037147954390305
[00:43:25.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:2:0) after 7m16s
[00:45:43.458] Received PubSub notification, asking Buildbucket for the build status
[00:45:43.489] Build status: STARTED
[00:50:41.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:2:0)
[00:50:42.127] Build status: STARTED
[00:50:42.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:4:0) after 1m16s
[00:51:58.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:4:0)
[00:51:58.215] Build status: STARTED
[00:51:58.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:5:0) after 3m6s
[00:55:04.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:5:0)
[00:55:04.379] Build status: STARTED
[00:55:04.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:6:0) after 9m11s
[01:04:15.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:6:0)
[01:04:15.706] Build status: STARTED
[01:04:15.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:7:0) after 3m12s
[01:07:27.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:7:0)
[01:07:27.881] Build status: STARTED
[01:07:27.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:8:0) after 9m44s
[01:17:11.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:8:0)
[01:17:11.944] Build status: STARTED
[01:17:11.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:9:0) after 7m30s
[01:24:42.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:9:0)
[01:24:42.187] Build status: STARTED
[01:24:42.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:10:0) after 7m27s
[01:32:09.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:10:0)
[01:32:09.305] Build status: STARTED
[01:32:09.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:11:0) after 4m45s
[01:36:54.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:11:0)
[01:36:54.350] Build status: STARTED
[01:36:54.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:12:0) after 6m26s
[01:43:20.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:12:0)
[01:43:20.401] Build status: STARTED
[01:43:20.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:13:0) after 4m3s
[01:47:23.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:13:0)
[01:47:23.447] Build status: STARTED
[01:47:23.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:14:0) after 5m5s
[01:52:28.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:14:0)
[01:52:28.610] Build status: STARTED
[01:52:28.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:15:0) after 8m37s
[02:01:05.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:15:0)
[02:01:05.860] Build status: STARTED
[02:01:05.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:16:0) after 2m39s
[02:03:45.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:16:0)
[02:03:45.068] Build status: STARTED
[02:03:45.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:17:0) after 5m15s
[02:09:00.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:17:0)
[02:09:00.117] Build status: STARTED
[02:09:00.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:18:0) after 9m4s
[02:18:04.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:18:0)
[02:18:04.156] Build status: STARTED
[02:18:04.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:19:0) after 5m5s
[02:23:09.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:19:0)
[02:23:09.304] Build status: STARTED
[02:23:09.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:20:0) after 3m57s
[02:27:06.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:20:0)
[02:27:06.456] Build status: STARTED
[02:27:06.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:21:0) after 6m11s
[02:33:17.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:21:0)
[02:33:17.523] Build status: STARTED
[02:33:17.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:22:0) after 7m59s
[02:41:16.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:22:0)
[02:41:16.753] Build status: STARTED
[02:41:16.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:23:0) after 3m55s
[02:45:11.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:23:0)
[02:45:11.854] Build status: STARTED
[02:45:11.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:24:0) after 4m50s
[02:50:01.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:24:0)
[02:50:01.920] Build status: STARTED
[02:50:01.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:25:0) after 7m7s
[02:57:08.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:25:0)
[02:57:08.990] Build status: STARTED
[02:57:08.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:26:0) after 4m53s
[03:02:02.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:26:0)
[03:02:02.048] Build status: STARTED
[03:02:02.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:27:0) after 9m41s
[03:11:43.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:27:0)
[03:11:43.615] Build status: STARTED
[03:11:43.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:28:0) after 3m18s
[03:15:01.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:28:0)
[03:15:01.821] Build status: STARTED
[03:15:01.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:29:0) after 8m18s
[03:23:20.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:29:0)
[03:23:20.069] Build status: STARTED
[03:23:20.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:30:0) after 7m26s
[03:30:46.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:30:0)
[03:30:46.236] Build status: STARTED
[03:30:46.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:31:0) after 3m39s
[03:34:25.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:31:0)
[03:34:25.352] Build status: STARTED
[03:34:25.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:32:0) after 1m17s
[03:35:42.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:32:0)
[03:35:42.494] Build status: STARTED
[03:35:42.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:33:0) after 9m32s
[03:45:14.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:33:0)
[03:45:14.786] Build status: STARTED
[03:45:14.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:34:0) after 8m12s
[03:53:26.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:34:0)
[03:53:26.850] Build status: STARTED
[03:53:26.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:35:0) after 9m15s
[04:02:41.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:35:0)
[04:02:41.992] Build status: STARTED
[04:02:41.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:36:0) after 1m10s
[04:03:52.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:36:0)
[04:03:52.031] Build status: STARTED
[04:03:52.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:37:0) after 3m15s
[04:07:07.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:37:0)
[04:07:07.282] Build status: STARTED
[04:07:07.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:38:0) after 8m20s
[04:15:27.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:38:0)
[04:15:27.368] Build status: STARTED
[04:15:27.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:39:0) after 3m56s
[04:19:23.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:39:0)
[04:19:23.630] Build status: STARTED
[04:19:23.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:40:0) after 9m23s
[04:28:46.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:40:0)
[04:28:46.712] Build status: STARTED
[04:28:46.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:41:0) after 7m9s
[04:35:55.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:41:0)
[04:35:55.810] Build status: STARTED
[04:35:55.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:42:0) after 5m8s
[04:41:03.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:42:0)
[04:41:03.969] Build status: STARTED
[04:41:03.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:43:0) after 4m25s
[04:45:29.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:43:0)
[04:45:29.095] Build status: STARTED
[04:45:29.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:44:0) after 1m35s
[04:47:04.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:44:0)
[04:47:04.151] Build status: STARTED
[04:47:04.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:45:0) after 9m1s
[04:56:05.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:45:0)
[04:56:05.186] Build status: STARTED
[04:56:05.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:46:0) after 5m25s
[05:01:30.218] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:46:0)
[05:01:30.239] Build status: STARTED
[05:01:30.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:47:0) after 6m17s
[05:07:47.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:47:0)
[05:07:47.355] Build status: STARTED
[05:07:47.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:48:0) after 5m24s
[05:13:11.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:48:0)
[05:13:11.479] Build status: STARTED
[05:13:11.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:49:0) after 2m33s
[05:15:44.502] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:49:0)
[05:15:44.526] Build status: STARTED
[05:15:44.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:50:0) after 3m17s
[05:19:01.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:50:0)
[05:19:01.611] Build status: STARTED
[05:19:01.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:51:0) after 3m49s
[05:22:50.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:51:0)
[05:22:50.760] Build status: STARTED
[05:22:50.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:52:0) after 2m2s
[05:24:52.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:52:0)
[05:24:52.802] Build status: STARTED
[05:24:52.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:53:0) after 6m32s
[05:31:25.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:53:0)
[05:31:25.234] Build status: STARTED
[05:31:25.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:54:0) after 6m57s
[05:38:22.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:54:0)
[05:38:22.411] Build status: STARTED
[05:38:22.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:55:0) after 8m27s
[05:46:49.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:55:0)
[05:46:49.489] Build status: STARTED
[05:46:49.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:56:0) after 6m29s
[05:53:18.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:56:0)
[05:53:18.720] Build status: STARTED
[05:53:18.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:57:0) after 1m7s
[05:54:26.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:57:0)
[05:54:26.065] Build status: STARTED
[05:54:26.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:58:0) after 7m36s
[06:02:02.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:58:0)
[06:02:02.174] Build status: STARTED
[06:02:02.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:59:0) after 3m47s
[06:05:49.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:59:0)
[06:05:49.224] Build status: STARTED
[06:05:49.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:60:0) after 7m25s
[06:13:14.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:60:0)
[06:13:14.497] Build status: STARTED
[06:13:14.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:61:0) after 2m5s
[06:15:19.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:61:0)
[06:15:19.552] Build status: STARTED
[06:15:19.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:62:0) after 6m48s
[06:22:07.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:62:0)
[06:22:07.576] Build status: STARTED
[06:22:07.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:63:0) after 4m5s
[06:26:12.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:63:0)
[06:26:12.617] Build status: STARTED
[06:26:12.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:64:0) after 3m24s
[06:29:36.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:64:0)
[06:29:36.662] Build status: STARTED
[06:29:36.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:65:0) after 3m22s
[06:32:58.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:65:0)
[06:32:58.699] Build status: STARTED
[06:32:58.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8957467209859547984:66:0) after 7m54s
[06:37:40.970] Received PubSub notification, asking Buildbucket for the build status
[06:37:41.102] Build:
{
"id": "8792037147954390305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28767,
"createdBy": "project:chromium",
"createTime": "2023-01-14T00:43:25.314932110Z",
"startTime": "2023-01-14T00:45:42.971143Z",
"endTime": "2023-01-14T06:37:40.350364841Z",
"updateTime": "2023-01-14T06:37:40.350364841Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aae8e28a83b75b216b01eda293cf6e6811fe9a0a",
"ref": "refs/heads/main"
}
}
}
[06:37:41.102] Invocation finished in 5h54m16.989730409s with status FAILED