[01:23:10.257] New invocation is queued and will start shortly
[01:23:11.472] Starting the invocation (attempt 1)
[01:23:11.501] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/42b5468a85bf42228205a790c2c5ba59f09a6868"
[01:23:11.501] Popped gitiles commit info from properties and tags
[01:23:11.501] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:23:11.501] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:23:11.501] Buildbucket request:
{
"requestId": "8936627405547819072",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "42b5468a85bf42228205a790c2c5ba59f09a6868",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8936627405547819072"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:23:12.080] Scheduled build:
{
"id": "8771197343470640385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30244,
"createdBy": "project:chromium",
"createTime": "2023-09-01T01:23:11.609471787Z",
"updateTime": "2023-09-01T01:23:11.609471787Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "42b5468a85bf42228205a790c2c5ba59f09a6868",
"ref": "refs/heads/main"
}
}
}
[01:23:12.080] Task URL: https://cr-buildbucket.appspot.com/build/8771197343470640385
[01:23:12.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:2:0) after 7m54s
[01:23:12.164] Received PubSub notification, asking Buildbucket for the build status
[01:23:12.322] Build status: SCHEDULED
[01:26:36.489] Received PubSub notification, asking Buildbucket for the build status
[01:26:36.509] Build status: STARTED
[01:31:06.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:2:0)
[01:31:06.153] Build status: STARTED
[01:31:06.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:5:0) after 8m51s
[01:39:57.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:5:0)
[01:39:57.198] Build status: STARTED
[01:39:57.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:6:0) after 9m14s
[01:49:11.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:6:0)
[01:49:11.249] Build status: STARTED
[01:49:11.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:7:0) after 8m34s
[01:57:45.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:7:0)
[01:57:45.297] Build status: STARTED
[01:57:45.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:8:0) after 8m26s
[02:06:11.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:8:0)
[02:06:11.615] Build status: STARTED
[02:06:11.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:9:0) after 3m35s
[02:09:46.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:9:0)
[02:09:46.677] Build status: STARTED
[02:09:46.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:10:0) after 1m31s
[02:11:17.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:10:0)
[02:11:17.737] Build status: STARTED
[02:11:17.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:11:0) after 4m22s
[02:15:39.764] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:11:0)
[02:15:39.893] Build status: STARTED
[02:15:39.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:12:0) after 4m42s
[02:20:22.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:12:0)
[02:20:22.051] Build status: STARTED
[02:20:22.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:13:0) after 4m52s
[02:25:14.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:13:0)
[02:25:14.209] Build status: STARTED
[02:25:14.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:14:0) after 4m5s
[02:29:19.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:14:0)
[02:29:19.528] Build status: STARTED
[02:29:19.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:15:0) after 5m44s
[02:35:03.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:15:0)
[02:35:03.563] Build status: STARTED
[02:35:03.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:16:0) after 7m6s
[02:42:09.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:16:0)
[02:42:09.808] Build status: STARTED
[02:42:09.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:17:0) after 9m22s
[02:51:31.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:17:0)
[02:51:31.867] Build status: STARTED
[02:51:31.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:18:0) after 3m39s
[02:55:11.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:18:0)
[02:55:11.097] Build status: STARTED
[02:55:11.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:19:0) after 1m20s
[02:56:31.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:19:0)
[02:56:31.237] Build status: STARTED
[02:56:31.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:20:0) after 6m21s
[03:02:52.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:20:0)
[03:02:52.366] Build status: STARTED
[03:02:52.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:21:0) after 5m0s
[03:07:52.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:21:0)
[03:07:52.542] Build status: STARTED
[03:07:52.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:22:0) after 2m27s
[03:10:19.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:22:0)
[03:10:19.585] Build status: STARTED
[03:10:19.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:23:0) after 8m29s
[03:18:48.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:23:0)
[03:18:49.006] Build status: STARTED
[03:18:49.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:24:0) after 6m32s
[03:25:21.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:24:0)
[03:25:21.182] Build status: STARTED
[03:25:21.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:25:0) after 7m15s
[03:32:36.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:25:0)
[03:32:36.316] Build status: STARTED
[03:32:36.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:26:0) after 2m2s
[03:34:38.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:26:0)
[03:34:38.820] Build status: STARTED
[03:34:38.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:27:0) after 7m50s
[03:42:28.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:27:0)
[03:42:29.067] Build status: STARTED
[03:42:29.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:28:0) after 2m27s
[03:44:56.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:28:0)
[03:44:56.136] Build status: STARTED
[03:44:56.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:29:0) after 2m57s
[03:47:53.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:29:0)
[03:47:53.217] Build status: STARTED
[03:47:53.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:30:0) after 3m47s
[03:51:40.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:30:0)
[03:51:40.499] Build status: STARTED
[03:51:40.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:31:0) after 9m4s
[04:00:44.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:31:0)
[04:00:44.573] Build status: STARTED
[04:00:44.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:32:0) after 4m48s
[04:05:32.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:32:0)
[04:05:32.770] Build status: STARTED
[04:05:32.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:33:0) after 7m29s
[04:13:01.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:33:0)
[04:13:01.827] Build status: STARTED
[04:13:01.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:34:0) after 2m27s
[04:15:28.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:34:0)
[04:15:28.992] Build status: STARTED
[04:15:28.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:35:0) after 1m29s
[04:16:58.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:35:0)
[04:16:58.332] Build status: STARTED
[04:16:58.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:36:0) after 7m39s
[04:24:37.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:36:0)
[04:24:37.420] Build status: STARTED
[04:24:37.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:37:0) after 9m54s
[04:34:31.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:37:0)
[04:34:31.416] Build status: STARTED
[04:34:31.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:38:0) after 6m19s
[04:40:50.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:38:0)
[04:40:50.451] Build status: STARTED
[04:40:50.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:39:0) after 3m56s
[04:44:46.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:39:0)
[04:44:46.680] Build status: STARTED
[04:44:46.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:40:0) after 8m23s
[04:53:09.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:40:0)
[04:53:09.729] Build status: STARTED
[04:53:09.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:41:0) after 1m27s
[04:54:36.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:41:0)
[04:54:36.988] Build status: STARTED
[04:54:36.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:42:0) after 6m14s
[05:00:51.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:42:0)
[05:00:51.373] Build status: STARTED
[05:00:51.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:43:0) after 5m51s
[05:06:42.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:43:0)
[05:06:42.553] Build status: STARTED
[05:06:42.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:44:0) after 9m19s
[05:16:01.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:44:0)
[05:16:01.619] Build status: STARTED
[05:16:01.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:45:0) after 7m10s
[05:23:11.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:45:0)
[05:23:11.673] Build status: STARTED
[05:23:11.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:46:0) after 5m23s
[05:28:34.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:46:0)
[05:28:34.721] Build status: STARTED
[05:28:34.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:47:0) after 5m27s
[05:34:01.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:47:0)
[05:34:01.846] Build status: STARTED
[05:34:01.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:48:0) after 9m36s
[05:43:37.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:48:0)
[05:43:37.992] Build status: STARTED
[05:43:37.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:49:0) after 6m3s
[05:49:41.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:49:0)
[05:49:41.081] Build status: STARTED
[05:49:41.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:50:0) after 1m25s
[05:51:06.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:50:0)
[05:51:06.097] Build status: STARTED
[05:51:06.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:51:0) after 8m44s
[05:59:50.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:51:0)
[05:59:50.185] Build status: STARTED
[05:59:50.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:52:0) after 5m45s
[06:05:35.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:52:0)
[06:05:35.229] Build status: STARTED
[06:05:35.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:53:0) after 3m11s
[06:08:46.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:53:0)
[06:08:46.735] Build status: STARTED
[06:08:46.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:54:0) after 3m16s
[06:12:02.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:54:0)
[06:12:02.812] Build status: STARTED
[06:12:02.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:55:0) after 8m4s
[06:20:06.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:55:0)
[06:20:06.918] Build status: STARTED
[06:20:06.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:56:0) after 4m57s
[06:25:03.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:56:0)
[06:25:03.974] Build status: STARTED
[06:25:03.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:57:0) after 1m16s
[06:26:20.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:57:0)
[06:26:20.081] Build status: STARTED
[06:26:20.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:58:0) after 4m57s
[06:31:17.369] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:58:0)
[06:31:17.395] Build status: STARTED
[06:31:17.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:59:0) after 8m45s
[06:40:02.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:59:0)
[06:40:02.494] Build status: STARTED
[06:40:02.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:60:0) after 5m44s
[06:45:46.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:60:0)
[06:45:46.634] Build status: STARTED
[06:45:46.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:61:0) after 3m40s
[06:49:26.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:61:0)
[06:49:26.723] Build status: STARTED
[06:49:26.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:62:0) after 5m23s
[06:54:49.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:62:0)
[06:54:49.733] Build status: STARTED
[06:54:49.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:63:0) after 9m43s
[07:04:32.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:63:0)
[07:04:33.074] Build status: STARTED
[07:04:33.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:64:0) after 4m26s
[07:08:59.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:64:0)
[07:08:59.236] Build status: STARTED
[07:08:59.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8936627405547819072:65:0) after 7m29s
[07:13:52.229] Received PubSub notification, asking Buildbucket for the build status
[07:13:52.249] Build:
{
"id": "8771197343470640385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30244,
"createdBy": "project:chromium",
"createTime": "2023-09-01T01:23:11.609471787Z",
"startTime": "2023-09-01T01:26:35.977152Z",
"endTime": "2023-09-01T07:13:51.602638492Z",
"updateTime": "2023-09-01T07:13:51.602638492Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "42b5468a85bf42228205a790c2c5ba59f09a6868",
"ref": "refs/heads/main"
}
}
}
[07:13:52.249] Invocation finished in 5h50m42.004229909s with status FAILED