[01:43:59.955] New invocation is queued and will start shortly
[01:44:01.037] Starting the invocation (attempt 1)
[01:44:01.077] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/20ac97de462a687c637686f7c1d828fdde3527a2"
[01:44:01.077] Popped gitiles commit info from properties and tags
[01:44:01.077] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:44:01.077] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:44:01.077] Buildbucket request:
{
"requestId": "8995785914207482160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "20ac97de462a687c637686f7c1d828fdde3527a2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8995785914207482160"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:44:03.748] Scheduled build:
{
"id": "8830355852303750145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23567,
"createdBy": "project:chromium",
"createTime": "2021-11-17T01:44:01.138953297Z",
"updateTime": "2021-11-17T01:44:01.138953297Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "20ac97de462a687c637686f7c1d828fdde3527a2",
"ref": "refs/heads/main"
}
}
}
[01:44:03.748] Task URL: https://cr-buildbucket.appspot.com/build/8830355852303750145
[01:44:03.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:2:0) after 4m44s
[01:46:26.059] Received PubSub notification, asking Buildbucket for the build status
[01:46:26.086] Build status: STARTED
[01:48:47.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:2:0)
[01:48:47.788] Build status: STARTED
[01:48:47.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:4:0) after 5m34s
[01:54:21.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:4:0)
[01:54:21.961] Build status: STARTED
[01:54:21.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:5:0) after 5m28s
[01:59:49.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:5:0)
[01:59:50.054] Build status: STARTED
[01:59:50.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:6:0) after 3m11s
[02:03:01.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:6:0)
[02:03:01.697] Build status: STARTED
[02:03:01.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:7:0) after 1m55s
[02:04:56.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:7:0)
[02:04:56.753] Build status: STARTED
[02:04:56.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:8:0) after 2m15s
[02:07:11.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:8:0)
[02:07:11.869] Build status: STARTED
[02:07:11.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:9:0) after 8m1s
[02:15:12.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:9:0)
[02:15:12.947] Build status: STARTED
[02:15:12.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:10:0) after 2m15s
[02:17:28.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:10:0)
[02:17:28.155] Build status: STARTED
[02:17:28.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:11:0) after 6m28s
[02:23:56.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:11:0)
[02:23:56.499] Build status: STARTED
[02:23:56.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:12:0) after 5m47s
[02:29:43.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:12:0)
[02:29:43.564] Build status: STARTED
[02:29:43.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:13:0) after 7m4s
[02:36:47.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:13:0)
[02:36:47.704] Build status: STARTED
[02:36:47.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:14:0) after 4m11s
[02:40:58.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:14:0)
[02:40:58.741] Build status: STARTED
[02:40:58.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:15:0) after 4m9s
[02:45:07.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:15:0)
[02:45:07.904] Build status: STARTED
[02:45:07.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:16:0) after 6m37s
[02:51:44.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:16:0)
[02:51:44.960] Build status: STARTED
[02:51:44.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:17:0) after 9m8s
[03:00:52.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:17:0)
[03:00:53.030] Build status: STARTED
[03:00:53.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:18:0) after 1m20s
[03:02:13.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:18:0)
[03:02:13.116] Build status: STARTED
[03:02:13.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:19:0) after 5m41s
[03:07:54.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:19:0)
[03:07:54.564] Build status: STARTED
[03:07:54.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:20:0) after 7m5s
[03:14:59.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:20:0)
[03:14:59.729] Build status: STARTED
[03:14:59.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:21:0) after 5m47s
[03:20:46.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:21:0)
[03:20:46.931] Build status: STARTED
[03:20:46.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:22:0) after 8m56s
[03:29:43.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:22:0)
[03:29:43.063] Build status: STARTED
[03:29:43.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:23:0) after 9m36s
[03:39:19.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:23:0)
[03:39:19.131] Build status: STARTED
[03:39:19.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:24:0) after 2m20s
[03:41:39.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:24:0)
[03:41:39.192] Build status: STARTED
[03:41:39.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:25:0) after 3m23s
[03:45:02.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:25:0)
[03:45:02.707] Build status: STARTED
[03:45:02.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:26:0) after 2m24s
[03:47:26.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:26:0)
[03:47:26.782] Build status: STARTED
[03:47:26.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:27:0) after 8m35s
[03:56:01.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:27:0)
[03:56:01.834] Build status: STARTED
[03:56:01.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:28:0) after 5m54s
[04:01:56.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:28:0)
[04:01:56.183] Build status: STARTED
[04:01:56.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:29:0) after 6m22s
[04:08:18.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:29:0)
[04:08:18.400] Build status: STARTED
[04:08:18.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:30:0) after 8m36s
[04:16:54.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:30:0)
[04:16:54.454] Build status: STARTED
[04:16:54.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:31:0) after 4m59s
[04:21:53.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:31:0)
[04:21:53.524] Build status: STARTED
[04:21:53.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:32:0) after 3m36s
[04:25:29.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:32:0)
[04:25:29.746] Build status: STARTED
[04:25:29.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:33:0) after 3m3s
[04:28:32.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:33:0)
[04:28:32.936] Build status: STARTED
[04:28:32.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:34:0) after 3m17s
[04:31:49.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:34:0)
[04:31:50.015] Build status: STARTED
[04:31:50.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:35:0) after 7m45s
[04:39:35.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:35:0)
[04:39:35.108] Build status: STARTED
[04:39:35.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:36:0) after 7m57s
[04:47:32.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:36:0)
[04:47:32.273] Build status: STARTED
[04:47:32.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:37:0) after 7m34s
[04:55:06.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:37:0)
[04:55:06.330] Build status: STARTED
[04:55:06.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:38:0) after 2m51s
[04:57:57.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:38:0)
[04:57:57.359] Build status: STARTED
[04:57:57.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:39:0) after 8m34s
[05:06:31.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:39:0)
[05:06:31.411] Build status: STARTED
[05:06:31.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:40:0) after 4m6s
[05:10:37.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:40:0)
[05:10:37.573] Build status: STARTED
[05:10:37.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:41:0) after 3m58s
[05:14:35.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:41:0)
[05:14:35.640] Build status: STARTED
[05:14:35.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:42:0) after 6m57s
[05:21:32.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:42:0)
[05:21:32.706] Build status: STARTED
[05:21:32.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:43:0) after 6m28s
[05:28:00.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:43:0)
[05:28:00.781] Build status: STARTED
[05:28:00.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:44:0) after 3m31s
[05:31:31.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:44:0)
[05:31:31.868] Build status: STARTED
[05:31:31.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:45:0) after 9m55s
[05:41:26.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:45:0)
[05:41:26.922] Build status: STARTED
[05:41:26.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:46:0) after 1m47s
[05:43:14.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:46:0)
[05:43:14.097] Build status: STARTED
[05:43:14.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:47:0) after 4m32s
[05:47:46.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:47:0)
[05:47:46.177] Build status: STARTED
[05:47:46.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:48:0) after 3m28s
[05:51:14.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:48:0)
[05:51:14.214] Build status: STARTED
[05:51:14.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:49:0) after 6m11s
[05:57:25.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:49:0)
[05:57:25.291] Build status: STARTED
[05:57:25.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:50:0) after 4m20s
[06:01:45.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:50:0)
[06:01:45.354] Build status: STARTED
[06:01:45.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:51:0) after 8m36s
[06:10:21.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:51:0)
[06:10:21.596] Build status: STARTED
[06:10:21.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:52:0) after 6m46s
[06:17:07.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:52:0)
[06:17:07.786] Build status: STARTED
[06:17:07.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:53:0) after 4m28s
[06:21:35.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:53:0)
[06:21:35.975] Build status: STARTED
[06:21:35.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:54:0) after 9m25s
[06:31:01.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:54:0)
[06:31:01.035] Build status: STARTED
[06:31:01.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:55:0) after 1m46s
[06:32:47.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:55:0)
[06:32:47.235] Build status: STARTED
[06:32:47.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:56:0) after 5m35s
[06:38:22.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:56:0)
[06:38:22.371] Build status: STARTED
[06:38:22.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:57:0) after 5m44s
[06:44:06.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:57:0)
[06:44:06.423] Build status: STARTED
[06:44:06.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:58:0) after 2m20s
[06:46:26.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:58:0)
[06:46:26.493] Build status: STARTED
[06:46:26.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:59:0) after 5m53s
[06:52:19.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:59:0)
[06:52:19.550] Build status: STARTED
[06:52:19.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:60:0) after 2m4s
[06:54:23.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:60:0)
[06:54:23.744] Build status: STARTED
[06:54:23.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:61:0) after 3m4s
[06:57:27.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:61:0)
[06:57:27.800] Build status: STARTED
[06:57:27.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:62:0) after 1m31s
[06:58:58.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:62:0)
[06:58:58.882] Build status: STARTED
[06:58:58.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:63:0) after 2m52s
[07:01:51.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:63:0)
[07:01:51.383] Build status: STARTED
[07:01:51.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:64:0) after 4m24s
[07:06:15.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:64:0)
[07:06:15.437] Build status: STARTED
[07:06:15.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995785914207482160:65:0) after 4m39s
[07:06:58.292] Received PubSub notification, asking Buildbucket for the build status
[07:06:58.343] Build:
{
"id": "8830355852303750145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23567,
"createdBy": "project:chromium",
"createTime": "2021-11-17T01:44:01.138953297Z",
"startTime": "2021-11-17T01:46:25.183598Z",
"endTime": "2021-11-17T07:06:58.037217506Z",
"updateTime": "2021-11-17T07:06:58.037217506Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "20ac97de462a687c637686f7c1d828fdde3527a2",
"ref": "refs/heads/main"
}
}
}
[07:06:58.343] Invocation finished in 5h22m58.404121056s with status FAILED