[18:16:36.162] New invocation is queued and will start shortly
[18:16:37.257] Starting the invocation (attempt 1)
[18:16:37.392] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/99148d89d3e364e6beecb47aadc2ea75486bfe21"
[18:16:37.392] Popped gitiles commit info from properties and tags
[18:16:37.392] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:16:37.392] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:16:37.392] Buildbucket request:
{
"requestId": "9015473603671946336",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "99148d89d3e364e6beecb47aadc2ea75486bfe21",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015473603671946336"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:16:39.697] Scheduled build:
{
"id": "8850043539869036704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21925,
"createdBy": "project:chromium",
"createTime": "2021-04-13T18:16:39.157050Z",
"updateTime": "2021-04-13T18:16:39.621211Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "99148d89d3e364e6beecb47aadc2ea75486bfe21",
"ref": "refs/heads/master"
}
}
}
[18:16:39.697] Task URL: https://cr-buildbucket.appspot.com/build/8850043539869036704
[18:16:39.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:2:0) after 6m31s
[18:19:47.417] Received PubSub notification, asking Buildbucket for the build status
[18:19:47.447] Build status: STARTED
[18:23:10.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:2:0)
[18:23:10.827] Build status: STARTED
[18:23:10.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:4:0) after 5m37s
[18:28:48.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:4:0)
[18:28:48.151] Build status: STARTED
[18:28:48.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:5:0) after 7m40s
[18:36:28.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:5:0)
[18:36:28.266] Build status: STARTED
[18:36:28.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:6:0) after 2m19s
[18:38:47.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:6:0)
[18:38:47.521] Build status: STARTED
[18:38:47.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:7:0) after 9m14s
[18:48:01.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:7:0)
[18:48:01.616] Build status: STARTED
[18:48:01.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:8:0) after 2m27s
[18:50:28.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:8:0)
[18:50:28.696] Build status: STARTED
[18:50:28.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:9:0) after 4m9s
[18:54:37.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:9:0)
[18:54:37.742] Build status: STARTED
[18:54:37.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:10:0) after 4m56s
[18:59:34.021] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:10:0)
[18:59:34.053] Build status: STARTED
[18:59:34.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:11:0) after 7m11s
[19:06:45.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:11:0)
[19:06:45.173] Build status: STARTED
[19:06:45.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:12:0) after 3m38s
[19:10:23.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:12:0)
[19:10:23.697] Build status: STARTED
[19:10:23.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:13:0) after 1m19s
[19:11:42.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:13:0)
[19:11:42.777] Build status: STARTED
[19:11:42.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:14:0) after 3m19s
[19:15:02.021] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:14:0)
[19:15:02.052] Build status: STARTED
[19:15:02.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:15:0) after 1m41s
[19:16:43.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:15:0)
[19:16:43.187] Build status: STARTED
[19:16:43.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:16:0) after 5m14s
[19:21:57.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:16:0)
[19:21:57.275] Build status: STARTED
[19:21:57.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:17:0) after 2m32s
[19:24:29.381] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:17:0)
[19:24:29.417] Build status: STARTED
[19:24:29.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:18:0) after 2m52s
[19:27:21.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:18:0)
[19:27:21.975] Build status: STARTED
[19:27:21.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:19:0) after 6m29s
[19:33:51.005] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:19:0)
[19:33:51.034] Build status: STARTED
[19:33:51.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:20:0) after 5m17s
[19:39:08.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:20:0)
[19:39:08.602] Build status: STARTED
[19:39:08.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:21:0) after 6m32s
[19:45:40.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:21:0)
[19:45:40.653] Build status: STARTED
[19:45:40.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:22:0) after 8m30s
[19:54:10.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:22:0)
[19:54:10.860] Build status: STARTED
[19:54:10.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:23:0) after 8m6s
[20:02:16.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:23:0)
[20:02:16.959] Build status: STARTED
[20:02:16.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:24:0) after 6m50s
[20:09:06.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:24:0)
[20:09:06.998] Build status: STARTED
[20:09:06.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:25:0) after 8m53s
[20:18:00.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:25:0)
[20:18:00.092] Build status: STARTED
[20:18:00.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:26:0) after 7m48s
[20:25:48.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:26:0)
[20:25:48.281] Build status: STARTED
[20:25:48.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:27:0) after 3m6s
[20:28:54.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:27:0)
[20:28:54.365] Build status: STARTED
[20:28:54.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:28:0) after 8m17s
[20:37:11.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:28:0)
[20:37:11.476] Build status: STARTED
[20:37:11.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:29:0) after 5m16s
[20:42:27.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:29:0)
[20:42:27.612] Build status: STARTED
[20:42:27.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:30:0) after 2m47s
[20:45:14.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:30:0)
[20:45:14.703] Build status: STARTED
[20:45:14.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:31:0) after 8m59s
[20:54:13.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:31:0)
[20:54:13.857] Build status: STARTED
[20:54:13.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:32:0) after 4m41s
[20:58:54.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:32:0)
[20:58:54.906] Build status: STARTED
[20:58:54.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:33:0) after 6m3s
[21:04:58.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:33:0)
[21:04:58.203] Build status: STARTED
[21:04:58.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:34:0) after 5m21s
[21:10:19.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:34:0)
[21:10:19.385] Build status: STARTED
[21:10:19.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:35:0) after 4m17s
[21:14:36.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:35:0)
[21:14:36.439] Build status: STARTED
[21:14:36.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:36:0) after 1m34s
[21:16:10.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:36:0)
[21:16:10.457] Build status: STARTED
[21:16:10.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:37:0) after 7m44s
[21:23:54.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:37:0)
[21:23:54.643] Build status: STARTED
[21:23:54.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:38:0) after 3m44s
[21:27:38.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:38:0)
[21:27:38.706] Build status: STARTED
[21:27:38.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:39:0) after 7m34s
[21:35:12.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:39:0)
[21:35:13.073] Build status: STARTED
[21:35:13.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:40:0) after 5m17s
[21:40:30.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:40:0)
[21:40:30.736] Build status: STARTED
[21:40:30.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:41:0) after 6m59s
[21:47:29.766] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:41:0)
[21:47:29.797] Build status: STARTED
[21:47:29.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:42:0) after 5m28s
[21:52:58.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:42:0)
[21:52:58.097] Build status: STARTED
[21:52:58.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:43:0) after 1m13s
[21:54:11.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:43:0)
[21:54:11.153] Build status: STARTED
[21:54:11.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:44:0) after 8m33s
[22:02:44.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:44:0)
[22:02:44.309] Build status: STARTED
[22:02:44.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:45:0) after 7m55s
[22:10:39.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:45:0)
[22:10:39.476] Build status: STARTED
[22:10:39.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:46:0) after 6m39s
[22:17:18.550] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:46:0)
[22:17:18.581] Build status: STARTED
[22:17:18.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:47:0) after 9m53s
[22:27:11.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:47:0)
[22:27:11.699] Build status: STARTED
[22:27:11.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:48:0) after 5m8s
[22:32:19.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:48:0)
[22:32:19.756] Build status: STARTED
[22:32:19.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:49:0) after 2m4s
[22:34:23.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:49:0)
[22:34:23.910] Build status: STARTED
[22:34:23.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:50:0) after 8m26s
[22:42:50.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:50:0)
[22:42:50.084] Build status: STARTED
[22:42:50.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:51:0) after 1m33s
[22:44:23.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:51:0)
[22:44:23.137] Build status: STARTED
[22:44:23.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:52:0) after 4m8s
[22:48:31.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:52:0)
[22:48:31.310] Build status: STARTED
[22:48:31.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:53:0) after 1m31s
[22:50:02.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:53:0)
[22:50:02.696] Build status: STARTED
[22:50:02.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:54:0) after 7m54s
[22:57:56.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:54:0)
[22:57:56.923] Build status: STARTED
[22:57:56.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:55:0) after 4m56s
[23:02:52.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:55:0)
[23:02:53.029] Build status: STARTED
[23:02:53.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:56:0) after 8m33s
[23:11:26.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:56:0)
[23:11:26.035] Build status: STARTED
[23:11:26.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:57:0) after 1m45s
[23:13:11.369] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:57:0)
[23:13:11.398] Build status: STARTED
[23:13:11.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:58:0) after 2m1s
[23:15:12.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:58:0)
[23:15:12.946] Build status: STARTED
[23:15:12.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:59:0) after 6m9s
[23:21:21.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:59:0)
[23:21:22.018] Build status: STARTED
[23:21:22.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:60:0) after 7m19s
[23:28:41.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:60:0)
[23:28:41.460] Build status: STARTED
[23:28:41.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:61:0) after 1m25s
[23:30:06.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:61:0)
[23:30:06.785] Build status: STARTED
[23:30:06.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:62:0) after 4m4s
[23:34:10.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:62:0)
[23:34:11.048] Build status: STARTED
[23:34:11.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015473603671946336:63:0) after 5m31s
[23:34:21.132] Received PubSub notification, asking Buildbucket for the build status
[23:34:21.169] Build:
{
"id": "8850043539869036704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21925,
"createdBy": "project:chromium",
"createTime": "2021-04-13T18:16:39.157050Z",
"startTime": "2021-04-13T18:19:46.532784Z",
"endTime": "2021-04-13T23:34:20.877905291Z",
"updateTime": "2021-04-13T23:34:20.878268073Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "99148d89d3e364e6beecb47aadc2ea75486bfe21",
"ref": "refs/heads/master"
}
}
}
[23:34:21.169] Invocation finished in 5h17m45.022276813s with status FAILED