[08:47:16.920] New invocation is queued and will start shortly
[08:47:18.147] Starting the invocation (attempt 1)
[08:47:18.184] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/27850e292b1616d5190f6d875496726d33e652d3"
[08:47:18.185] Popped gitiles commit info from properties and tags
[08:47:18.185] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:47:18.185] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:47:18.185] Buildbucket request:
{
"requestId": "8948648861024972192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "27850e292b1616d5190f6d875496726d33e652d3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8948648861024972192"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:47:18.639] Scheduled build:
{
"id": "8783218798923981553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29293,
"createdBy": "project:chromium",
"createTime": "2023-04-21T08:47:18.297243875Z",
"updateTime": "2023-04-21T08:47:18.297243875Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "27850e292b1616d5190f6d875496726d33e652d3",
"ref": "refs/heads/main"
}
}
}
[08:47:18.639] Task URL: https://cr-buildbucket.appspot.com/build/8783218798923981553
[08:47:18.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:2:0) after 4m15s
[08:50:08.725] Received PubSub notification, asking Buildbucket for the build status
[08:50:08.835] Build status: STARTED
[08:51:33.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:2:0)
[08:51:33.830] Build status: STARTED
[08:51:33.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:4:0) after 4m56s
[08:56:29.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:4:0)
[08:56:29.874] Build status: STARTED
[08:56:29.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:5:0) after 9m13s
[09:05:42.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:5:0)
[09:05:42.936] Build status: STARTED
[09:05:42.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:6:0) after 2m4s
[09:07:47.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:6:0)
[09:07:47.260] Build status: STARTED
[09:07:47.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:7:0) after 2m43s
[09:10:30.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:7:0)
[09:10:30.449] Build status: STARTED
[09:10:30.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:8:0) after 7m23s
[09:17:53.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:8:0)
[09:17:53.477] Build status: STARTED
[09:17:53.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:9:0) after 7m23s
[09:25:16.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:9:0)
[09:25:16.527] Build status: STARTED
[09:25:16.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:10:0) after 3m50s
[09:29:06.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:10:0)
[09:29:06.690] Build status: STARTED
[09:29:06.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:11:0) after 6m50s
[09:35:56.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:11:0)
[09:35:56.755] Build status: STARTED
[09:35:56.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:12:0) after 2m51s
[09:38:47.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:12:0)
[09:38:47.806] Build status: STARTED
[09:38:47.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:13:0) after 1m24s
[09:40:11.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:13:0)
[09:40:11.825] Build status: STARTED
[09:40:11.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:14:0) after 3m40s
[09:43:52.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:14:0)
[09:43:52.194] Build status: STARTED
[09:43:52.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:15:0) after 6m7s
[09:49:59.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:15:0)
[09:49:59.265] Build status: STARTED
[09:49:59.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:16:0) after 8m29s
[09:58:28.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:16:0)
[09:58:28.309] Build status: STARTED
[09:58:28.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:17:0) after 5m50s
[10:04:18.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:17:0)
[10:04:18.357] Build status: STARTED
[10:04:18.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:18:0) after 6m13s
[10:10:31.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:18:0)
[10:10:31.579] Build status: STARTED
[10:10:31.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:19:0) after 1m44s
[10:12:15.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:19:0)
[10:12:15.597] Build status: STARTED
[10:12:15.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:20:0) after 4m22s
[10:16:37.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:20:0)
[10:16:37.864] Build status: STARTED
[10:16:37.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:21:0) after 7m22s
[10:23:59.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:21:0)
[10:23:59.951] Build status: STARTED
[10:23:59.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:22:0) after 7m7s
[10:31:07.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:22:0)
[10:31:07.058] Build status: STARTED
[10:31:07.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:23:0) after 2m23s
[10:33:30.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:23:0)
[10:33:30.237] Build status: STARTED
[10:33:30.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:24:0) after 8m56s
[10:42:26.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:24:0)
[10:42:26.314] Build status: STARTED
[10:42:26.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:25:0) after 6m42s
[10:49:08.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:25:0)
[10:49:08.369] Build status: STARTED
[10:49:08.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:26:0) after 4m51s
[10:53:59.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:26:0)
[10:53:59.731] Build status: STARTED
[10:53:59.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:27:0) after 5m51s
[10:59:51.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:27:0)
[10:59:51.343] Build status: STARTED
[10:59:51.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:28:0) after 8m4s
[11:07:55.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:28:0)
[11:07:55.717] Build status: STARTED
[11:07:55.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:29:0) after 7m22s
[11:15:17.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:29:0)
[11:15:18.040] Build status: STARTED
[11:15:18.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:30:0) after 4m42s
[11:20:00.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:30:0)
[11:20:00.172] Build status: STARTED
[11:20:00.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:31:0) after 4m6s
[11:24:06.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:31:0)
[11:24:06.283] Build status: STARTED
[11:24:06.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:32:0) after 6m57s
[11:31:03.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:32:0)
[11:31:03.475] Build status: STARTED
[11:31:03.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:33:0) after 1m20s
[11:32:23.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:33:0)
[11:32:23.654] Build status: STARTED
[11:32:23.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:34:0) after 9m15s
[11:41:38.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:34:0)
[11:41:38.735] Build status: STARTED
[11:41:38.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:35:0) after 2m50s
[11:44:29.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:35:0)
[11:44:29.568] Build status: STARTED
[11:44:29.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:36:0) after 2m5s
[11:46:34.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:36:0)
[11:46:34.620] Build status: STARTED
[11:46:34.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:37:0) after 2m39s
[11:49:14.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:37:0)
[11:49:14.189] Build status: STARTED
[11:49:14.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:38:0) after 2m21s
[11:51:35.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:38:0)
[11:51:35.247] Build status: STARTED
[11:51:35.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:39:0) after 6m32s
[11:58:08.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:39:0)
[11:58:08.300] Build status: STARTED
[11:58:08.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:40:0) after 9m26s
[12:07:34.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:40:0)
[12:07:34.509] Build status: STARTED
[12:07:34.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:41:0) after 8m16s
[12:15:50.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:41:0)
[12:15:50.905] Build status: STARTED
[12:15:50.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:42:0) after 6m25s
[12:22:15.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:42:0)
[12:22:15.992] Build status: STARTED
[12:22:15.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:43:0) after 2m52s
[12:25:08.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:43:0)
[12:25:08.155] Build status: STARTED
[12:25:08.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:44:0) after 9m10s
[12:34:18.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:44:0)
[12:34:18.277] Build status: STARTED
[12:34:18.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:45:0) after 7m51s
[12:42:09.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:45:0)
[12:42:09.442] Build status: STARTED
[12:42:09.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:46:0) after 8m19s
[12:50:28.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:46:0)
[12:50:28.509] Build status: STARTED
[12:50:28.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:47:0) after 9m30s
[12:59:58.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:47:0)
[12:59:58.780] Build status: STARTED
[12:59:58.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:48:0) after 7m39s
[13:07:37.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:48:0)
[13:07:37.827] Build status: STARTED
[13:07:37.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:49:0) after 1m7s
[13:08:44.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:49:0)
[13:08:44.931] Build status: STARTED
[13:08:44.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:50:0) after 4m17s
[13:13:02.585] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:50:0)
[13:13:02.608] Build status: STARTED
[13:13:02.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:51:0) after 1m10s
[13:14:12.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:51:0)
[13:14:12.713] Build status: STARTED
[13:14:12.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:52:0) after 7m17s
[13:21:29.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:52:0)
[13:21:29.872] Build status: STARTED
[13:21:29.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:53:0) after 6m58s
[13:28:28.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:53:0)
[13:28:28.331] Build status: STARTED
[13:28:28.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:54:0) after 4m4s
[13:32:32.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:54:0)
[13:32:32.399] Build status: STARTED
[13:32:32.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:55:0) after 1m52s
[13:34:24.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:55:0)
[13:34:24.479] Build status: STARTED
[13:34:24.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:56:0) after 7m5s
[13:41:29.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:56:0)
[13:41:29.521] Build status: STARTED
[13:41:29.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:57:0) after 7m10s
[13:48:39.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:57:0)
[13:48:39.666] Build status: STARTED
[13:48:39.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:58:0) after 2m26s
[13:51:05.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:58:0)
[13:51:05.983] Build status: STARTED
[13:51:05.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:59:0) after 5m57s
[13:57:03.005] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:59:0)
[13:57:03.030] Build status: STARTED
[13:57:03.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:60:0) after 2m16s
[13:59:19.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:60:0)
[13:59:19.827] Build status: STARTED
[13:59:19.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:61:0) after 1m47s
[14:01:06.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:61:0)
[14:01:06.920] Build status: STARTED
[14:01:06.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:62:0) after 5m36s
[14:06:43.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:62:0)
[14:06:43.253] Build status: STARTED
[14:06:43.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948648861024972192:63:0) after 4m24s
[14:09:26.964] Received PubSub notification, asking Buildbucket for the build status
[14:09:27.023] Build:
{
"id": "8783218798923981553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29293,
"createdBy": "project:chromium",
"createTime": "2023-04-21T08:47:18.297243875Z",
"startTime": "2023-04-21T08:50:07.921487Z",
"endTime": "2023-04-21T14:09:26.732206988Z",
"updateTime": "2023-04-21T14:09:26.732206988Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "27850e292b1616d5190f6d875496726d33e652d3",
"ref": "refs/heads/main"
}
}
}
[14:09:27.023] Invocation finished in 5h22m10.113578964s with status FAILED