[19:39:05.215] New invocation is queued and will start shortly
[19:39:06.677] Starting the invocation (attempt 1)
[19:39:06.714] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/05a39c624b23fedc6b86ce6ff85bbe3c28484231"
[19:39:06.714] Popped gitiles commit info from properties and tags
[19:39:06.714] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:39:06.714] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:39:06.714] Buildbucket request:
{
"requestId": "8946705316708626864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "05a39c624b23fedc6b86ce6ff85bbe3c28484231",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946705316708626864"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:39:07.240] Scheduled build:
{
"id": "8781275254394465537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29391,
"createdBy": "project:chromium",
"createTime": "2023-05-12T19:39:06.798176485Z",
"updateTime": "2023-05-12T19:39:06.798176485Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "05a39c624b23fedc6b86ce6ff85bbe3c28484231",
"ref": "refs/heads/main"
}
}
}
[19:39:07.240] Task URL: https://cr-buildbucket.appspot.com/build/8781275254394465537
[19:39:07.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:2:0) after 6m28s
[19:41:58.734] Received PubSub notification, asking Buildbucket for the build status
[19:41:58.757] Build status: STARTED
[19:45:35.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:2:0)
[19:45:35.264] Build status: STARTED
[19:45:35.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:4:0) after 6m1s
[19:51:36.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:4:0)
[19:51:36.451] Build status: STARTED
[19:51:36.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:5:0) after 3m1s
[19:54:37.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:5:0)
[19:54:37.883] Build status: STARTED
[19:54:37.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:6:0) after 9m10s
[20:03:47.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:6:0)
[20:03:47.964] Build status: STARTED
[20:03:47.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:7:0) after 6m50s
[20:10:38.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:7:0)
[20:10:38.062] Build status: STARTED
[20:10:38.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:8:0) after 2m29s
[20:13:07.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:8:0)
[20:13:07.101] Build status: STARTED
[20:13:07.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:9:0) after 7m47s
[20:20:54.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:9:0)
[20:20:54.368] Build status: STARTED
[20:20:54.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:10:0) after 2m41s
[20:23:35.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:10:0)
[20:23:35.835] Build status: STARTED
[20:23:35.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:11:0) after 3m47s
[20:27:22.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:11:0)
[20:27:22.925] Build status: STARTED
[20:27:22.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:12:0) after 6m28s
[20:33:51.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:12:0)
[20:33:51.186] Build status: STARTED
[20:33:51.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:13:0) after 3m25s
[20:37:16.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:13:0)
[20:37:16.502] Build status: STARTED
[20:37:16.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:14:0) after 5m17s
[20:42:33.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:14:0)
[20:42:33.555] Build status: STARTED
[20:42:33.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:15:0) after 3m30s
[20:46:03.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:15:0)
[20:46:03.879] Build status: STARTED
[20:46:03.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:16:0) after 1m9s
[20:47:13.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:16:0)
[20:47:13.107] Build status: STARTED
[20:47:13.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:17:0) after 8m13s
[20:55:26.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:17:0)
[20:55:26.169] Build status: STARTED
[20:55:26.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:18:0) after 6m16s
[21:01:42.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:18:0)
[21:01:42.213] Build status: STARTED
[21:01:42.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:19:0) after 2m10s
[21:03:52.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:19:0)
[21:03:52.256] Build status: STARTED
[21:03:52.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:20:0) after 4m11s
[21:08:03.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:20:0)
[21:08:03.304] Build status: STARTED
[21:08:03.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:21:0) after 6m17s
[21:14:20.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:21:0)
[21:14:20.637] Build status: STARTED
[21:14:20.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:22:0) after 1m2s
[21:15:22.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:22:0)
[21:15:22.767] Build status: STARTED
[21:15:22.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:23:0) after 1m18s
[21:16:40.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:23:0)
[21:16:40.811] Build status: STARTED
[21:16:40.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:24:0) after 8m3s
[21:24:43.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:24:0)
[21:24:43.817] Build status: STARTED
[21:24:43.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:25:0) after 6m17s
[21:31:00.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:25:0)
[21:31:01.015] Build status: STARTED
[21:31:01.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:26:0) after 3m34s
[21:34:35.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:26:0)
[21:34:35.069] Build status: STARTED
[21:34:35.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:27:0) after 4m16s
[21:38:51.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:27:0)
[21:38:51.185] Build status: STARTED
[21:38:51.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:28:0) after 7m28s
[21:46:19.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:28:0)
[21:46:19.279] Build status: STARTED
[21:46:19.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:29:0) after 1m27s
[21:47:46.603] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:29:0)
[21:47:46.619] Build status: STARTED
[21:47:46.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:30:0) after 1m3s
[21:48:49.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:30:0)
[21:48:49.872] Build status: STARTED
[21:48:49.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:31:0) after 8m1s
[21:56:50.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:31:0)
[21:56:51.001] Build status: STARTED
[21:56:51.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:32:0) after 1m5s
[21:57:56.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:32:0)
[21:57:56.048] Build status: STARTED
[21:57:56.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:33:0) after 8m27s
[22:06:23.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:33:0)
[22:06:23.113] Build status: STARTED
[22:06:23.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:34:0) after 8m43s
[22:15:06.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:34:0)
[22:15:06.460] Build status: STARTED
[22:15:06.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:35:0) after 9m25s
[22:24:31.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:35:0)
[22:24:31.917] Build status: STARTED
[22:24:31.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:36:0) after 5m15s
[22:29:47.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:36:0)
[22:29:47.150] Build status: STARTED
[22:29:47.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:37:0) after 7m2s
[22:36:49.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:37:0)
[22:36:49.440] Build status: STARTED
[22:36:49.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:38:0) after 3m56s
[22:40:45.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:38:0)
[22:40:45.538] Build status: STARTED
[22:40:45.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:39:0) after 3m3s
[22:43:49.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:39:0)
[22:43:49.260] Build status: STARTED
[22:43:49.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:40:0) after 9m56s
[22:53:45.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:40:0)
[22:53:45.280] Build status: STARTED
[22:53:45.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:41:0) after 5m36s
[22:59:21.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:41:0)
[22:59:21.468] Build status: STARTED
[22:59:21.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:42:0) after 3m4s
[23:02:26.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:42:0)
[23:02:26.023] Build status: STARTED
[23:02:26.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:43:0) after 9m54s
[23:12:20.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:43:0)
[23:12:20.300] Build status: STARTED
[23:12:20.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:44:0) after 7m23s
[23:19:43.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:44:0)
[23:19:43.373] Build status: STARTED
[23:19:43.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:45:0) after 2m45s
[23:22:28.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:45:0)
[23:22:28.419] Build status: STARTED
[23:22:28.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:46:0) after 5m8s
[23:27:36.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:46:0)
[23:27:36.460] Build status: STARTED
[23:27:36.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:47:0) after 4m58s
[23:32:34.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:47:0)
[23:32:34.849] Build status: STARTED
[23:32:34.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:48:0) after 6m25s
[23:39:00.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:48:0)
[23:39:00.746] Build status: STARTED
[23:39:00.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:49:0) after 3m24s
[23:42:24.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:49:0)
[23:42:25.017] Build status: STARTED
[23:42:25.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:50:0) after 1m58s
[23:44:23.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:50:0)
[23:44:23.108] Build status: STARTED
[23:44:23.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:51:0) after 2m35s
[23:46:58.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:51:0)
[23:46:58.243] Build status: STARTED
[23:46:58.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:52:0) after 1m52s
[23:48:50.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:52:0)
[23:48:50.516] Build status: STARTED
[23:48:50.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:53:0) after 5m24s
[23:54:14.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:53:0)
[23:54:14.814] Build status: STARTED
[23:54:14.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:54:0) after 8m54s
[00:03:08.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:54:0)
[00:03:08.975] Build status: STARTED
[00:03:08.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:55:0) after 5m34s
[00:08:42.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:55:0)
[00:08:43.014] Build status: STARTED
[00:08:43.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:56:0) after 3m34s
[00:12:17.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:56:0)
[00:12:17.109] Build status: STARTED
[00:12:17.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:57:0) after 4m37s
[00:16:54.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:57:0)
[00:16:54.290] Build status: STARTED
[00:16:54.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:58:0) after 6m16s
[00:23:10.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:58:0)
[00:23:10.415] Build status: STARTED
[00:23:10.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:59:0) after 1m37s
[00:24:48.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:59:0)
[00:24:48.051] Build status: STARTED
[00:24:48.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:60:0) after 3m10s
[00:27:58.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:60:0)
[00:27:58.207] Build status: STARTED
[00:27:58.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:61:0) after 1m37s
[00:29:35.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:61:0)
[00:29:35.335] Build status: STARTED
[00:29:35.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:62:0) after 2m39s
[00:32:14.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:62:0)
[00:32:14.437] Build status: STARTED
[00:32:14.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:63:0) after 7m3s
[00:39:17.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:63:0)
[00:39:17.584] Build status: STARTED
[00:39:17.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:64:0) after 3m3s
[00:42:21.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:64:0)
[00:42:21.086] Build status: STARTED
[00:42:21.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946705316708626864:65:0) after 8m55s
[00:50:37.891] Received PubSub notification, asking Buildbucket for the build status
[00:50:37.907] Build:
{
"id": "8781275254394465537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29391,
"createdBy": "project:chromium",
"createTime": "2023-05-12T19:39:06.798176485Z",
"startTime": "2023-05-12T19:41:57.035904Z",
"endTime": "2023-05-13T00:50:37.389842117Z",
"updateTime": "2023-05-13T00:50:37.389842117Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "05a39c624b23fedc6b86ce6ff85bbe3c28484231",
"ref": "refs/heads/main"
}
}
}
[00:50:37.907] Invocation finished in 5h11m32.69984246s with status FAILED