[18:30:19.667] New invocation is queued and will start shortly
[18:30:20.863] Starting the invocation (attempt 1)
[18:30:20.905] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ed6cfb88f978dcb09ff88fc3cac4b1cbaa343c62"
[18:30:20.905] Popped gitiles commit info from properties and tags
[18:30:20.905] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:30:20.907] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:30:20.907] Buildbucket request:
{
"requestId": "8951511281878286032",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ed6cfb88f978dcb09ff88fc3cac4b1cbaa343c62",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8951511281878286032"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:30:21.504] Scheduled build:
{
"id": "8786081219742909985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29102,
"createdBy": "project:chromium",
"createTime": "2023-03-20T18:30:21.079631969Z",
"updateTime": "2023-03-20T18:30:21.079631969Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ed6cfb88f978dcb09ff88fc3cac4b1cbaa343c62",
"ref": "refs/heads/main"
}
}
}
[18:30:21.504] Task URL: https://cr-buildbucket.appspot.com/build/8786081219742909985
[18:30:21.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:2:0) after 7m52s
[18:32:50.605] Received PubSub notification, asking Buildbucket for the build status
[18:32:50.645] Build status: STARTED
[18:38:13.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:2:0)
[18:38:13.569] Build status: STARTED
[18:38:13.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:4:0) after 9m30s
[18:47:43.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:4:0)
[18:47:43.620] Build status: STARTED
[18:47:43.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:5:0) after 8m18s
[18:56:01.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:5:0)
[18:56:01.868] Build status: STARTED
[18:56:01.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:6:0) after 5m18s
[19:01:19.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:6:0)
[19:01:19.914] Build status: STARTED
[19:01:19.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:7:0) after 8m46s
[19:10:05.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:7:0)
[19:10:05.976] Build status: STARTED
[19:10:05.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:8:0) after 4m12s
[19:14:18.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:8:0)
[19:14:18.145] Build status: STARTED
[19:14:18.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:9:0) after 8m16s
[19:22:34.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:9:0)
[19:22:34.192] Build status: STARTED
[19:22:34.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:10:0) after 6m54s
[19:29:28.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:10:0)
[19:29:28.252] Build status: STARTED
[19:29:28.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:11:0) after 2m42s
[19:32:10.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:11:0)
[19:32:10.301] Build status: STARTED
[19:32:10.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:12:0) after 6m36s
[19:38:46.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:12:0)
[19:38:46.348] Build status: STARTED
[19:38:46.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:13:0) after 7m33s
[19:46:19.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:13:0)
[19:46:19.421] Build status: STARTED
[19:46:19.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:14:0) after 2m2s
[19:48:21.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:14:0)
[19:48:21.610] Build status: STARTED
[19:48:21.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:15:0) after 4m39s
[19:53:00.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:15:0)
[19:53:00.624] Build status: STARTED
[19:53:00.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:16:0) after 8m14s
[20:01:14.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:16:0)
[20:01:14.930] Build status: STARTED
[20:01:14.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:17:0) after 9m10s
[20:10:24.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:17:0)
[20:10:25.001] Build status: STARTED
[20:10:25.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:18:0) after 7m47s
[20:18:12.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:18:0)
[20:18:12.131] Build status: STARTED
[20:18:12.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:19:0) after 2m57s
[20:21:09.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:19:0)
[20:21:09.226] Build status: STARTED
[20:21:09.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:20:0) after 9m32s
[20:30:41.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:20:0)
[20:30:41.493] Build status: STARTED
[20:30:41.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:21:0) after 3m41s
[20:34:23.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:21:0)
[20:34:23.031] Build status: STARTED
[20:34:23.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:22:0) after 6m30s
[20:40:53.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:22:0)
[20:40:53.214] Build status: STARTED
[20:40:53.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:23:0) after 2m30s
[20:43:24.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:23:0)
[20:43:24.216] Build status: STARTED
[20:43:24.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:24:0) after 9m57s
[20:53:21.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:24:0)
[20:53:21.365] Build status: STARTED
[20:53:21.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:25:0) after 6m24s
[20:59:45.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:25:0)
[20:59:45.487] Build status: STARTED
[20:59:45.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:26:0) after 2m33s
[21:02:18.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:26:0)
[21:02:18.533] Build status: STARTED
[21:02:18.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:27:0) after 3m23s
[21:05:41.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:27:0)
[21:05:41.580] Build status: STARTED
[21:05:41.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:28:0) after 1m43s
[21:07:24.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:28:0)
[21:07:24.662] Build status: STARTED
[21:07:24.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:29:0) after 3m7s
[21:10:31.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:29:0)
[21:10:31.766] Build status: STARTED
[21:10:31.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:30:0) after 7m16s
[21:17:48.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:30:0)
[21:17:48.461] Build status: STARTED
[21:17:48.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:31:0) after 4m13s
[21:22:01.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:31:0)
[21:22:01.534] Build status: STARTED
[21:22:01.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:32:0) after 2m44s
[21:24:45.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:32:0)
[21:24:45.584] Build status: STARTED
[21:24:45.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:33:0) after 5m47s
[21:30:32.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:33:0)
[21:30:32.750] Build status: STARTED
[21:30:32.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:34:0) after 7m52s
[21:38:24.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:34:0)
[21:38:24.985] Build status: STARTED
[21:38:24.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:35:0) after 7m37s
[21:46:02.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:35:0)
[21:46:02.025] Build status: STARTED
[21:46:02.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:36:0) after 5m20s
[21:51:22.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:36:0)
[21:51:22.468] Build status: STARTED
[21:51:22.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:37:0) after 6m20s
[21:57:42.603] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:37:0)
[21:57:42.624] Build status: STARTED
[21:57:42.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:38:0) after 5m34s
[22:03:16.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:38:0)
[22:03:16.992] Build status: STARTED
[22:03:16.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:39:0) after 2m28s
[22:05:45.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:39:0)
[22:05:45.169] Build status: STARTED
[22:05:45.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:40:0) after 4m36s
[22:10:21.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:40:0)
[22:10:21.511] Build status: STARTED
[22:10:21.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:41:0) after 2m19s
[22:12:40.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:41:0)
[22:12:40.679] Build status: STARTED
[22:12:40.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:42:0) after 1m4s
[22:13:44.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:42:0)
[22:13:44.727] Build status: STARTED
[22:13:44.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:43:0) after 5m51s
[22:19:35.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:43:0)
[22:19:35.926] Build status: STARTED
[22:19:35.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:44:0) after 3m53s
[22:23:29.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:44:0)
[22:23:29.051] Build status: STARTED
[22:23:29.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:45:0) after 7m17s
[22:30:46.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:45:0)
[22:30:46.621] Build status: STARTED
[22:30:46.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:46:0) after 4m31s
[22:35:17.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:46:0)
[22:35:17.635] Build status: STARTED
[22:35:17.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:47:0) after 6m16s
[22:41:33.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:47:0)
[22:41:33.768] Build status: STARTED
[22:41:33.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:48:0) after 5m25s
[22:46:58.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:48:0)
[22:46:58.818] Build status: STARTED
[22:46:58.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:49:0) after 4m50s
[22:51:48.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:49:0)
[22:51:48.912] Build status: STARTED
[22:51:48.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:50:0) after 7m57s
[22:59:45.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:50:0)
[22:59:45.962] Build status: STARTED
[22:59:45.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:51:0) after 3m5s
[23:04:16.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:51:0)
[23:04:16.911] Build status: STARTED
[23:04:16.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:52:0) after 6m14s
[23:10:30.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:52:0)
[23:10:30.959] Build status: STARTED
[23:10:30.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:53:0) after 1m57s
[23:12:27.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:53:0)
[23:12:27.963] Build status: STARTED
[23:12:27.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:54:0) after 8m53s
[23:21:20.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:54:0)
[23:21:21.009] Build status: STARTED
[23:21:21.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:55:0) after 5m5s
[23:26:26.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:55:0)
[23:26:26.433] Build status: STARTED
[23:26:26.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:56:0) after 3m22s
[23:29:48.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:56:0)
[23:29:48.724] Build status: STARTED
[23:29:48.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:57:0) after 5m43s
[23:35:31.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:57:0)
[23:35:31.888] Build status: STARTED
[23:35:31.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:58:0) after 4m3s
[23:39:35.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:58:0)
[23:39:35.159] Build status: STARTED
[23:39:35.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:59:0) after 2m5s
[23:41:40.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:59:0)
[23:41:40.205] Build status: STARTED
[23:41:40.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:60:0) after 1m18s
[23:42:58.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:60:0)
[23:42:58.242] Build status: STARTED
[23:42:58.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:61:0) after 6m45s
[23:49:43.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:61:0)
[23:49:43.369] Build status: STARTED
[23:49:43.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951511281878286032:62:0) after 8m54s
[23:50:10.924] Received PubSub notification, asking Buildbucket for the build status
[23:50:10.944] Build:
{
"id": "8786081219742909985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29102,
"createdBy": "project:chromium",
"createTime": "2023-03-20T18:30:21.079631969Z",
"startTime": "2023-03-20T18:32:49.894120Z",
"endTime": "2023-03-20T23:50:10.320233802Z",
"updateTime": "2023-03-20T23:50:10.320233802Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ed6cfb88f978dcb09ff88fc3cac4b1cbaa343c62",
"ref": "refs/heads/main"
}
}
}
[23:50:10.944] Invocation finished in 5h19m51.284978304s with status FAILED