[14:25:15.286] New invocation is queued and will start shortly
[14:25:17.855] Starting the invocation (attempt 1)
[14:25:17.959] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c148b069df53f28eea2cc12ef11e6e250fc35e17"
[14:25:17.959] Popped gitiles commit info from properties and tags
[14:25:17.959] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:25:17.959] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:25:17.959] Buildbucket request:
{
"requestId": "8948989985487300016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c148b069df53f28eea2cc12ef11e6e250fc35e17",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8948989985487300016"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:25:18.490] Scheduled build:
{
"id": "8783559921954889233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29261,
"createdBy": "project:chromium",
"createTime": "2023-04-17T14:25:18.024963620Z",
"updateTime": "2023-04-17T14:25:18.024963620Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c148b069df53f28eea2cc12ef11e6e250fc35e17",
"ref": "refs/heads/main"
}
}
}
[14:25:18.490] Task URL: https://cr-buildbucket.appspot.com/build/8783559921954889233
[14:25:18.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:2:0) after 8m31s
[14:28:11.745] Received PubSub notification, asking Buildbucket for the build status
[14:28:11.771] Build status: STARTED
[14:33:50.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:2:0)
[14:33:50.321] Build status: STARTED
[14:33:50.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:4:0) after 4m48s
[14:38:38.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:4:0)
[14:38:38.387] Build status: STARTED
[14:38:38.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:5:0) after 4m27s
[14:43:05.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:5:0)
[14:43:05.674] Build status: STARTED
[14:43:05.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:6:0) after 5m8s
[14:48:13.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:6:0)
[14:48:13.731] Build status: STARTED
[14:48:13.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:7:0) after 1m49s
[14:50:02.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:7:0)
[14:50:02.988] Build status: STARTED
[14:50:02.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:8:0) after 1m0s
[14:51:03.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:8:0)
[14:51:03.280] Build status: STARTED
[14:51:03.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:9:0) after 2m29s
[14:53:32.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:9:0)
[14:53:32.327] Build status: STARTED
[14:53:32.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:10:0) after 5m10s
[14:58:42.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:10:0)
[14:58:42.368] Build status: STARTED
[14:58:42.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:11:0) after 7m13s
[15:05:56.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:11:0)
[15:05:56.289] Build status: STARTED
[15:05:56.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:12:0) after 7m47s
[15:13:43.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:12:0)
[15:13:43.396] Build status: STARTED
[15:13:43.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:13:0) after 9m9s
[15:22:53.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:13:0)
[15:22:53.481] Build status: STARTED
[15:22:53.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:14:0) after 4m36s
[15:27:29.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:14:0)
[15:27:29.745] Build status: STARTED
[15:27:29.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:15:0) after 7m27s
[15:34:56.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:15:0)
[15:34:56.838] Build status: STARTED
[15:34:56.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:16:0) after 2m18s
[15:37:14.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:16:0)
[15:37:14.894] Build status: STARTED
[15:37:14.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:17:0) after 5m53s
[15:43:08.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:17:0)
[15:43:08.040] Build status: STARTED
[15:43:08.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:18:0) after 1m6s
[15:44:14.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:18:0)
[15:44:14.207] Build status: STARTED
[15:44:14.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:19:0) after 8m22s
[15:52:36.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:19:0)
[15:52:36.380] Build status: STARTED
[15:52:36.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:20:0) after 2m22s
[15:54:58.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:20:0)
[15:54:58.919] Build status: STARTED
[15:54:58.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:21:0) after 9m20s
[16:04:18.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:21:0)
[16:04:18.963] Build status: STARTED
[16:04:18.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:22:0) after 1m46s
[16:06:04.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:22:0)
[16:06:05.005] Build status: STARTED
[16:06:05.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:23:0) after 2m56s
[16:09:01.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:23:0)
[16:09:01.029] Build status: STARTED
[16:09:01.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:24:0) after 5m53s
[16:14:54.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:24:0)
[16:14:54.077] Build status: STARTED
[16:14:54.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:25:0) after 9m48s
[16:24:42.690] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:25:0)
[16:24:42.711] Build status: STARTED
[16:24:42.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:26:0) after 1m54s
[16:26:36.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:26:0)
[16:26:36.911] Build status: STARTED
[16:26:36.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:27:0) after 4m14s
[16:30:50.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:27:0)
[16:30:50.994] Build status: STARTED
[16:30:50.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:28:0) after 5m15s
[16:36:06.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:28:0)
[16:36:06.123] Build status: STARTED
[16:36:06.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:29:0) after 8m14s
[16:44:20.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:29:0)
[16:44:20.231] Build status: STARTED
[16:44:20.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:30:0) after 9m23s
[16:53:43.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:30:0)
[16:53:43.399] Build status: STARTED
[16:53:43.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:31:0) after 6m28s
[17:00:11.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:31:0)
[17:00:11.569] Build status: STARTED
[17:00:11.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:32:0) after 9m57s
[17:10:08.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:32:0)
[17:10:08.761] Build status: STARTED
[17:10:08.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:33:0) after 7m52s
[17:18:00.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:33:0)
[17:18:00.844] Build status: STARTED
[17:18:00.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:34:0) after 2m49s
[17:20:49.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:34:0)
[17:20:49.899] Build status: STARTED
[17:20:49.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:35:0) after 4m43s
[17:25:33.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:35:0)
[17:25:33.093] Build status: STARTED
[17:25:33.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:36:0) after 3m31s
[17:29:04.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:36:0)
[17:29:04.480] Build status: STARTED
[17:29:04.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:37:0) after 3m56s
[17:33:00.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:37:0)
[17:33:00.617] Build status: STARTED
[17:33:00.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:38:0) after 3m18s
[17:36:18.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:38:0)
[17:36:18.674] Build status: STARTED
[17:36:18.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:39:0) after 5m30s
[17:41:48.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:39:0)
[17:41:48.745] Build status: STARTED
[17:41:48.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:40:0) after 1m15s
[17:43:03.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:40:0)
[17:43:03.816] Build status: STARTED
[17:43:03.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:41:0) after 9m6s
[17:52:09.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:41:0)
[17:52:09.884] Build status: STARTED
[17:52:09.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:42:0) after 1m49s
[17:53:59.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:42:0)
[17:53:59.259] Build status: STARTED
[17:53:59.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:43:0) after 5m53s
[17:59:52.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:43:0)
[17:59:52.417] Build status: STARTED
[17:59:52.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:44:0) after 6m49s
[18:06:41.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:44:0)
[18:06:41.475] Build status: STARTED
[18:06:41.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:45:0) after 1m34s
[18:08:15.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:45:0)
[18:08:15.762] Build status: STARTED
[18:08:15.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:46:0) after 2m55s
[18:11:11.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:46:0)
[18:11:11.214] Build status: STARTED
[18:11:11.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:47:0) after 7m48s
[18:18:59.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:47:0)
[18:18:59.511] Build status: STARTED
[18:18:59.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:48:0) after 1m18s
[18:20:17.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:48:0)
[18:20:17.735] Build status: STARTED
[18:20:17.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:49:0) after 8m26s
[18:28:43.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:49:0)
[18:28:44.005] Build status: STARTED
[18:28:44.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:50:0) after 2m50s
[18:31:34.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:50:0)
[18:31:34.060] Build status: STARTED
[18:31:34.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:51:0) after 4m7s
[18:35:41.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:51:0)
[18:35:41.205] Build status: STARTED
[18:35:41.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:52:0) after 9m20s
[18:45:01.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:52:0)
[18:45:01.451] Build status: STARTED
[18:45:01.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:53:0) after 5m0s
[18:50:01.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:53:0)
[18:50:01.607] Build status: STARTED
[18:50:01.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:54:0) after 4m18s
[18:54:19.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:54:0)
[18:54:19.654] Build status: STARTED
[18:54:19.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:55:0) after 5m19s
[18:59:38.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:55:0)
[18:59:38.701] Build status: STARTED
[18:59:38.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:56:0) after 1m45s
[19:01:23.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:56:0)
[19:01:23.769] Build status: STARTED
[19:01:23.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:57:0) after 9m35s
[19:10:58.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:57:0)
[19:10:58.849] Build status: STARTED
[19:10:58.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:58:0) after 5m7s
[19:16:05.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:58:0)
[19:16:05.949] Build status: STARTED
[19:16:05.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:59:0) after 3m3s
[19:19:08.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:59:0)
[19:19:09.107] Build status: STARTED
[19:19:09.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:60:0) after 1m50s
[19:20:59.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:60:0)
[19:20:59.196] Build status: STARTED
[19:20:59.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:61:0) after 1m55s
[19:22:54.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:61:0)
[19:22:54.321] Build status: STARTED
[19:22:54.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:62:0) after 8m6s
[19:31:00.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:62:0)
[19:31:00.364] Build status: STARTED
[19:31:00.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:63:0) after 6m23s
[19:37:23.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:63:0)
[19:37:23.975] Build status: STARTED
[19:37:23.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:64:0) after 1m8s
[19:38:32.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:64:0)
[19:38:32.170] Build status: STARTED
[19:38:32.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948989985487300016:65:0) after 1m15s
[19:39:34.338] Received PubSub notification, asking Buildbucket for the build status
[19:39:34.365] Build:
{
"id": "8783559921954889233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29261,
"createdBy": "project:chromium",
"createTime": "2023-04-17T14:25:18.024963620Z",
"startTime": "2023-04-17T14:28:11.081832172Z",
"endTime": "2023-04-17T19:39:34.130266261Z",
"updateTime": "2023-04-17T19:39:34.130266261Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c148b069df53f28eea2cc12ef11e6e250fc35e17",
"ref": "refs/heads/main"
}
}
}
[19:39:34.365] Invocation finished in 5h14m19.093605379s with status FAILED