[08:07:42.847] New invocation is queued and will start shortly
[08:07:43.920] Starting the invocation (attempt 1)
[08:07:43.953] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e1a053dddd92cd61254ed3702fe4cc1e1025c9a8"
[08:07:43.953] Popped gitiles commit info from properties and tags
[08:07:43.953] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:07:43.954] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:07:43.954] Buildbucket request:
{
"requestId": "9002194157568792144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1a053dddd92cd61254ed3702fe4cc1e1025c9a8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9002194157568792144"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:07:44.717] Scheduled build:
{
"id": "8836764095609586561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23058,
"createdBy": "project:chromium",
"createTime": "2021-09-07T08:07:44.084901859Z",
"updateTime": "2021-09-07T08:07:44.514110589Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1a053dddd92cd61254ed3702fe4cc1e1025c9a8",
"ref": "refs/heads/main"
}
}
}
[08:07:44.717] Task URL: https://cr-buildbucket.appspot.com/build/8836764095609586561
[08:07:44.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:2:0) after 4m10s
[08:10:13.787] Received PubSub notification, asking Buildbucket for the build status
[08:10:13.815] Build status: STARTED
[08:11:54.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:2:0)
[08:11:54.882] Build status: STARTED
[08:11:54.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:4:0) after 1m37s
[08:13:31.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:4:0)
[08:13:32.013] Build status: STARTED
[08:13:32.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:5:0) after 8m14s
[08:21:46.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:5:0)
[08:21:46.091] Build status: STARTED
[08:21:46.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:6:0) after 2m6s
[08:23:52.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:6:0)
[08:23:52.268] Build status: STARTED
[08:23:52.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:7:0) after 8m4s
[08:31:56.285] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:7:0)
[08:31:56.317] Build status: STARTED
[08:31:56.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:8:0) after 7m13s
[08:39:09.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:8:0)
[08:39:09.533] Build status: STARTED
[08:39:09.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:9:0) after 6m24s
[08:45:33.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:9:0)
[08:45:34.006] Build status: STARTED
[08:45:34.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:10:0) after 6m52s
[08:52:26.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:10:0)
[08:52:26.145] Build status: STARTED
[08:52:26.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:11:0) after 9m20s
[09:01:46.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:11:0)
[09:01:46.210] Build status: STARTED
[09:01:46.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:12:0) after 6m19s
[09:08:05.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:12:0)
[09:08:05.257] Build status: STARTED
[09:08:05.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:13:0) after 4m34s
[09:12:39.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:13:0)
[09:12:39.391] Build status: STARTED
[09:12:39.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:14:0) after 4m41s
[09:17:20.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:14:0)
[09:17:20.444] Build status: STARTED
[09:17:20.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:15:0) after 2m49s
[09:20:09.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:15:0)
[09:20:09.563] Build status: STARTED
[09:20:09.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:16:0) after 2m31s
[09:22:40.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:16:0)
[09:22:40.630] Build status: STARTED
[09:22:40.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:17:0) after 8m19s
[09:30:59.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:17:0)
[09:30:59.686] Build status: STARTED
[09:30:59.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:18:0) after 6m41s
[09:37:40.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:18:0)
[09:37:40.791] Build status: STARTED
[09:37:40.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:19:0) after 9m22s
[09:47:02.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:19:0)
[09:47:02.822] Build status: STARTED
[09:47:02.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:20:0) after 6m43s
[09:53:45.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:20:0)
[09:53:45.873] Build status: STARTED
[09:53:45.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:21:0) after 7m8s
[10:00:53.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:21:0)
[10:00:53.933] Build status: STARTED
[10:00:53.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:22:0) after 1m19s
[10:02:13.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:22:0)
[10:02:13.064] Build status: STARTED
[10:02:13.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:23:0) after 5m53s
[10:08:06.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:23:0)
[10:08:06.199] Build status: STARTED
[10:08:06.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:24:0) after 1m0s
[10:09:06.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:24:0)
[10:09:06.265] Build status: STARTED
[10:09:06.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:25:0) after 7m17s
[10:16:23.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:25:0)
[10:16:23.365] Build status: STARTED
[10:16:23.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:26:0) after 8m43s
[10:25:06.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:26:0)
[10:25:06.455] Build status: STARTED
[10:25:06.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:27:0) after 6m50s
[10:31:56.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:27:0)
[10:31:56.514] Build status: STARTED
[10:31:56.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:28:0) after 2m57s
[10:34:53.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:28:0)
[10:34:53.580] Build status: STARTED
[10:34:53.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:29:0) after 5m8s
[10:40:01.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:29:0)
[10:40:01.712] Build status: STARTED
[10:40:01.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:30:0) after 5m10s
[10:45:11.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:30:0)
[10:45:11.814] Build status: STARTED
[10:45:11.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:31:0) after 8m46s
[10:53:57.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:31:0)
[10:53:57.968] Build status: STARTED
[10:53:57.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:32:0) after 3m41s
[10:57:39.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:32:0)
[10:57:39.134] Build status: STARTED
[10:57:39.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:33:0) after 6m18s
[11:03:57.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:33:0)
[11:03:57.189] Build status: STARTED
[11:03:57.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:34:0) after 5m16s
[11:09:13.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:34:0)
[11:09:13.284] Build status: STARTED
[11:09:13.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:35:0) after 8m8s
[11:17:21.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:35:0)
[11:17:21.347] Build status: STARTED
[11:17:21.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:36:0) after 7m31s
[11:24:52.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:36:0)
[11:24:52.485] Build status: STARTED
[11:24:52.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:37:0) after 6m47s
[11:31:39.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:37:0)
[11:31:39.536] Build status: STARTED
[11:31:39.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:38:0) after 3m42s
[11:35:21.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:38:0)
[11:35:21.630] Build status: STARTED
[11:35:21.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:39:0) after 6m9s
[11:41:30.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:39:0)
[11:41:30.681] Build status: STARTED
[11:41:30.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:40:0) after 1m15s
[11:42:45.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:40:0)
[11:42:45.757] Build status: STARTED
[11:42:45.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:41:0) after 2m14s
[11:44:59.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:41:0)
[11:44:59.872] Build status: STARTED
[11:44:59.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:42:0) after 7m58s
[11:52:57.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:42:0)
[11:52:57.986] Build status: STARTED
[11:52:57.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:43:0) after 2m40s
[11:55:38.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:43:0)
[11:55:38.426] Build status: STARTED
[11:55:38.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:44:0) after 5m11s
[12:00:49.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:44:0)
[12:00:49.486] Build status: STARTED
[12:00:49.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:45:0) after 3m36s
[12:04:25.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:45:0)
[12:04:25.604] Build status: STARTED
[12:04:25.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:46:0) after 5m27s
[12:09:52.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:46:0)
[12:09:52.696] Build status: STARTED
[12:09:52.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:47:0) after 1m9s
[12:11:01.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:47:0)
[12:11:01.750] Build status: STARTED
[12:11:01.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:48:0) after 4m59s
[12:16:00.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:48:0)
[12:16:00.856] Build status: STARTED
[12:16:00.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:49:0) after 1m31s
[12:17:31.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:49:0)
[12:17:31.909] Build status: STARTED
[12:17:31.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:50:0) after 6m27s
[12:23:59.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:50:0)
[12:23:59.085] Build status: STARTED
[12:23:59.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:51:0) after 6m53s
[12:30:52.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:51:0)
[12:30:52.228] Build status: STARTED
[12:30:52.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:52:0) after 3m13s
[12:34:05.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:52:0)
[12:34:05.363] Build status: STARTED
[12:34:05.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:53:0) after 6m46s
[12:40:51.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:53:0)
[12:40:51.422] Build status: STARTED
[12:40:51.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:54:0) after 7m54s
[12:48:45.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:54:0)
[12:48:45.483] Build status: STARTED
[12:48:45.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:55:0) after 5m19s
[12:54:04.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:55:0)
[12:54:04.535] Build status: STARTED
[12:54:04.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:56:0) after 7m8s
[13:01:12.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:56:0)
[13:01:12.683] Build status: STARTED
[13:01:12.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:57:0) after 1m41s
[13:02:53.847] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:57:0)
[13:02:53.876] Build status: STARTED
[13:02:53.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:58:0) after 3m26s
[13:06:19.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:58:0)
[13:06:19.940] Build status: STARTED
[13:06:19.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:59:0) after 2m14s
[13:08:34.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:59:0)
[13:08:34.114] Build status: STARTED
[13:08:34.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:60:0) after 3m46s
[13:12:20.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:60:0)
[13:12:20.200] Build status: STARTED
[13:12:20.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:61:0) after 6m29s
[13:18:49.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:61:0)
[13:18:49.474] Build status: STARTED
[13:18:49.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:62:0) after 4m0s
[13:22:49.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:62:0)
[13:22:49.747] Build status: STARTED
[13:22:49.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:63:0) after 1m6s
[13:23:55.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:63:0)
[13:23:55.985] Build status: STARTED
[13:23:55.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:64:0) after 3m50s
[13:27:46.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:64:0)
[13:27:46.047] Build status: STARTED
[13:27:46.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9002194157568792144:65:0) after 4m9s
[13:28:03.835] Received PubSub notification, asking Buildbucket for the build status
[13:28:03.866] Build:
{
"id": "8836764095609586561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23058,
"createdBy": "project:chromium",
"createTime": "2021-09-07T08:07:44.084901859Z",
"startTime": "2021-09-07T08:10:12.845737Z",
"endTime": "2021-09-07T13:28:03.541425918Z",
"updateTime": "2021-09-07T13:28:03.541801840Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1a053dddd92cd61254ed3702fe4cc1e1025c9a8",
"ref": "refs/heads/main"
}
}
}
[13:28:03.866] Invocation finished in 5h20m21.034002813s with status FAILED