[03:42:02.798] New invocation is queued and will start shortly
[03:42:03.908] Starting the invocation (attempt 1)
[03:42:03.946] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bd586cf252788c1d9e780db974d093ecebfc22a9"
[03:42:03.946] Popped gitiles commit info from properties and tags
[03:42:03.946] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:42:03.946] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:42:03.947] Buildbucket request:
{
"requestId": "9009639823169100560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd586cf252788c1d9e780db974d093ecebfc22a9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9009639823169100560"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:42:05.953] Scheduled build:
{
"id": "8844209761121293120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22350,
"createdBy": "project:chromium",
"createTime": "2021-06-17T03:42:04.117678Z",
"updateTime": "2021-06-17T03:42:05.539681Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd586cf252788c1d9e780db974d093ecebfc22a9",
"ref": "refs/heads/main"
}
}
}
[03:42:05.953] Task URL: https://cr-buildbucket.appspot.com/build/8844209761121293120
[03:42:05.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:2:0) after 8m43s
[03:44:56.838] Received PubSub notification, asking Buildbucket for the build status
[03:44:56.868] Build status: STARTED
[03:50:49.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:2:0)
[03:50:49.074] Build status: STARTED
[03:50:49.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:4:0) after 8m22s
[03:59:11.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:4:0)
[03:59:11.127] Build status: STARTED
[03:59:11.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:5:0) after 3m2s
[04:02:13.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:5:0)
[04:02:13.195] Build status: STARTED
[04:02:13.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:6:0) after 4m40s
[04:06:53.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:6:0)
[04:06:53.403] Build status: STARTED
[04:06:53.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:7:0) after 5m47s
[04:12:40.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:7:0)
[04:12:40.470] Build status: STARTED
[04:12:40.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:8:0) after 5m56s
[04:18:36.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:8:0)
[04:18:36.525] Build status: STARTED
[04:18:36.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:9:0) after 2m34s
[04:21:10.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:9:0)
[04:21:10.926] Build status: STARTED
[04:21:10.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:10:0) after 2m55s
[04:24:06.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:10:0)
[04:24:06.101] Build status: STARTED
[04:24:06.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:11:0) after 2m36s
[04:26:42.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:11:0)
[04:26:42.327] Build status: STARTED
[04:26:42.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:12:0) after 9m6s
[04:35:48.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:12:0)
[04:35:48.413] Build status: STARTED
[04:35:48.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:13:0) after 4m25s
[04:40:13.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:13:0)
[04:40:13.579] Build status: STARTED
[04:40:13.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:14:0) after 2m13s
[04:42:26.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:14:0)
[04:42:26.643] Build status: STARTED
[04:42:26.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:15:0) after 8m50s
[04:51:16.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:15:0)
[04:51:16.705] Build status: STARTED
[04:51:16.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:16:0) after 6m15s
[04:57:31.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:16:0)
[04:57:31.766] Build status: STARTED
[04:57:31.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:17:0) after 2m5s
[04:59:36.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:17:0)
[04:59:36.915] Build status: STARTED
[04:59:36.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:18:0) after 3m15s
[05:02:52.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:18:0)
[05:02:52.180] Build status: STARTED
[05:02:52.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:19:0) after 9m16s
[05:12:08.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:19:0)
[05:12:08.225] Build status: STARTED
[05:12:08.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:20:0) after 2m6s
[05:14:14.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:20:0)
[05:14:14.354] Build status: STARTED
[05:14:14.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:21:0) after 4m44s
[05:18:58.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:21:0)
[05:18:58.496] Build status: STARTED
[05:18:58.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:22:0) after 9m13s
[05:28:11.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:22:0)
[05:28:11.880] Build status: STARTED
[05:28:11.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:23:0) after 7m29s
[05:35:40.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:23:0)
[05:35:40.954] Build status: STARTED
[05:35:40.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:24:0) after 4m19s
[05:40:00.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:24:0)
[05:40:00.234] Build status: STARTED
[05:40:00.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:25:0) after 6m48s
[05:46:48.285] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:25:0)
[05:46:48.316] Build status: STARTED
[05:46:48.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:26:0) after 1m20s
[05:48:08.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:26:0)
[05:48:08.409] Build status: STARTED
[05:48:08.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:27:0) after 2m59s
[05:51:07.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:27:0)
[05:51:07.511] Build status: STARTED
[05:51:07.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:28:0) after 3m24s
[05:54:31.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:28:0)
[05:54:31.779] Build status: STARTED
[05:54:31.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:29:0) after 6m18s
[06:00:49.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:29:0)
[06:00:49.846] Build status: STARTED
[06:00:49.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:30:0) after 1m28s
[06:02:17.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:30:0)
[06:02:17.904] Build status: STARTED
[06:02:17.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:31:0) after 3m52s
[06:06:10.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:31:0)
[06:06:10.066] Build status: STARTED
[06:06:10.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:32:0) after 7m27s
[06:13:37.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:32:0)
[06:13:37.116] Build status: STARTED
[06:13:37.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:33:0) after 9m54s
[06:23:31.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:33:0)
[06:23:31.345] Build status: STARTED
[06:23:31.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:34:0) after 1m24s
[06:24:55.369] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:34:0)
[06:24:55.416] Build status: STARTED
[06:24:55.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:35:0) after 3m15s
[06:28:10.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:35:0)
[06:28:10.648] Build status: STARTED
[06:28:10.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:36:0) after 6m42s
[06:34:52.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:36:0)
[06:34:52.734] Build status: STARTED
[06:34:52.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:37:0) after 9m56s
[06:44:48.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:37:0)
[06:44:48.862] Build status: STARTED
[06:44:48.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:38:0) after 1m11s
[06:45:59.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:38:0)
[06:46:00.004] Build status: STARTED
[06:46:00.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:39:0) after 7m16s
[06:53:16.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:39:0)
[06:53:16.495] Build status: STARTED
[06:53:16.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:40:0) after 8m39s
[07:01:55.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:40:0)
[07:01:55.654] Build status: STARTED
[07:01:55.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:41:0) after 5m24s
[07:07:19.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:41:0)
[07:07:19.758] Build status: STARTED
[07:07:19.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:42:0) after 3m28s
[07:10:47.974] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:42:0)
[07:10:48.006] Build status: STARTED
[07:10:48.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:43:0) after 6m25s
[07:17:13.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:43:0)
[07:17:13.059] Build status: STARTED
[07:17:13.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:44:0) after 5m14s
[07:22:27.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:44:0)
[07:22:27.229] Build status: STARTED
[07:22:27.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:45:0) after 4m35s
[07:27:02.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:45:0)
[07:27:02.290] Build status: STARTED
[07:27:02.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:46:0) after 8m32s
[07:35:34.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:46:0)
[07:35:34.448] Build status: STARTED
[07:35:34.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:47:0) after 7m38s
[07:43:12.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:47:0)
[07:43:12.551] Build status: STARTED
[07:43:12.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:48:0) after 1m5s
[07:44:17.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:48:0)
[07:44:17.610] Build status: STARTED
[07:44:17.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:49:0) after 3m16s
[07:47:33.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:49:0)
[07:47:34.004] Build status: STARTED
[07:47:34.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:50:0) after 3m23s
[07:50:57.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:50:0)
[07:50:57.124] Build status: STARTED
[07:50:57.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:51:0) after 8m43s
[07:59:40.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:51:0)
[07:59:40.211] Build status: STARTED
[07:59:40.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:52:0) after 7m43s
[08:07:23.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:52:0)
[08:07:23.314] Build status: STARTED
[08:07:23.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:53:0) after 4m1s
[08:11:24.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:53:0)
[08:11:24.369] Build status: STARTED
[08:11:24.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:54:0) after 7m12s
[08:18:36.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:54:0)
[08:18:36.462] Build status: STARTED
[08:18:36.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:55:0) after 3m7s
[08:21:43.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:55:0)
[08:21:43.557] Build status: STARTED
[08:21:43.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:56:0) after 4m24s
[08:26:07.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:56:0)
[08:26:07.822] Build status: STARTED
[08:26:07.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:57:0) after 2m23s
[08:28:30.847] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:57:0)
[08:28:30.906] Build status: STARTED
[08:28:30.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:58:0) after 3m40s
[08:32:30.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:58:0)
[08:32:30.825] Build status: STARTED
[08:32:30.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:59:0) after 3m12s
[08:35:42.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:59:0)
[08:35:42.919] Build status: STARTED
[08:35:42.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:60:0) after 5m12s
[08:40:54.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:60:0)
[08:40:54.967] Build status: STARTED
[08:40:54.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:61:0) after 6m8s
[08:47:02.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:61:0)
[08:47:03.026] Build status: STARTED
[08:47:03.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:62:0) after 5m11s
[08:52:14.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:62:0)
[08:52:14.098] Build status: STARTED
[08:52:14.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:63:0) after 1m19s
[08:53:33.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:63:0)
[08:53:33.167] Build status: STARTED
[08:53:33.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009639823169100560:64:0) after 7m19s
[08:57:54.735] Received PubSub notification, asking Buildbucket for the build status
[08:57:54.862] Build:
{
"id": "8844209761121293120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22350,
"createdBy": "project:chromium",
"createTime": "2021-06-17T03:42:04.117678Z",
"startTime": "2021-06-17T03:44:55.860329Z",
"endTime": "2021-06-17T08:57:54.408580710Z",
"updateTime": "2021-06-17T08:57:54.409057323Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd586cf252788c1d9e780db974d093ecebfc22a9",
"ref": "refs/heads/main"
}
}
}
[08:57:54.862] Invocation finished in 5h15m52.081170851s with status FAILED