[03:39:12.738] New invocation is queued and will start shortly
[03:39:13.844] Starting the invocation (attempt 1)
[03:39:13.877] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1e783d543ffcdf9d2e21d0a6aeb265b888647bbb"
[03:39:13.877] Popped gitiles commit info from properties and tags
[03:39:13.877] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:39:13.877] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:39:13.878] Buildbucket request:
{
"requestId": "9014169849827402160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e783d543ffcdf9d2e21d0a6aeb265b888647bbb",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9014169849827402160"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:39:14.845] Scheduled build:
{
"id": "8848739787819162560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22032,
"createdBy": "project:chromium",
"createTime": "2021-04-28T03:39:14.002254Z",
"updateTime": "2021-04-28T03:39:14.725783Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e783d543ffcdf9d2e21d0a6aeb265b888647bbb",
"ref": "refs/heads/master"
}
}
}
[03:39:14.845] Task URL: https://cr-buildbucket.appspot.com/build/8848739787819162560
[03:39:14.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:2:0) after 1m25s
[03:40:39.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:2:0)
[03:40:39.994] Build status: SCHEDULED
[03:40:39.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:3:0) after 4m46s
[03:42:29.627] Received PubSub notification, asking Buildbucket for the build status
[03:42:29.654] Build status: STARTED
[03:45:26.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:3:0)
[03:45:26.048] Build status: STARTED
[03:45:26.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:5:0) after 5m44s
[03:51:10.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:5:0)
[03:51:10.328] Build status: STARTED
[03:51:10.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:6:0) after 1m4s
[03:52:14.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:6:0)
[03:52:14.374] Build status: STARTED
[03:52:14.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:7:0) after 5m16s
[03:57:30.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:7:0)
[03:57:30.556] Build status: STARTED
[03:57:30.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:8:0) after 4m39s
[04:02:09.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:8:0)
[04:02:09.832] Build status: STARTED
[04:02:09.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:9:0) after 4m25s
[04:06:34.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:9:0)
[04:06:34.961] Build status: STARTED
[04:06:34.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:10:0) after 2m22s
[04:08:56.982] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:10:0)
[04:08:57.095] Build status: STARTED
[04:08:57.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:11:0) after 3m38s
[04:12:35.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:11:0)
[04:12:35.178] Build status: STARTED
[04:12:35.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:12:0) after 1m57s
[04:14:32.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:12:0)
[04:14:32.257] Build status: STARTED
[04:14:32.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:13:0) after 5m18s
[04:19:50.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:13:0)
[04:19:50.309] Build status: STARTED
[04:19:50.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:14:0) after 6m7s
[04:25:57.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:14:0)
[04:25:57.436] Build status: STARTED
[04:25:57.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:15:0) after 5m59s
[04:31:57.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:15:0)
[04:31:57.237] Build status: STARTED
[04:31:57.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:16:0) after 7m5s
[04:39:02.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:16:0)
[04:39:02.302] Build status: STARTED
[04:39:02.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:17:0) after 4m18s
[04:43:20.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:17:0)
[04:43:20.355] Build status: STARTED
[04:43:20.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:18:0) after 8m43s
[04:52:03.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:18:0)
[04:52:03.413] Build status: STARTED
[04:52:03.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:19:0) after 8m46s
[05:00:49.453] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:19:0)
[05:00:49.516] Build status: STARTED
[05:00:49.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:20:0) after 4m45s
[05:05:34.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:20:0)
[05:05:34.576] Build status: STARTED
[05:05:34.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:21:0) after 8m57s
[05:14:31.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:21:0)
[05:14:31.622] Build status: STARTED
[05:14:31.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:22:0) after 9m55s
[05:24:26.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:22:0)
[05:24:26.796] Build status: STARTED
[05:24:26.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:23:0) after 4m54s
[05:29:20.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:23:0)
[05:29:20.973] Build status: STARTED
[05:29:20.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:24:0) after 6m52s
[05:36:12.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:24:0)
[05:36:13.023] Build status: STARTED
[05:36:13.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:25:0) after 8m0s
[05:44:13.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:25:0)
[05:44:13.131] Build status: STARTED
[05:44:13.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:26:0) after 5m5s
[05:49:18.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:26:0)
[05:49:18.281] Build status: STARTED
[05:49:18.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:27:0) after 4m29s
[05:53:47.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:27:0)
[05:53:47.336] Build status: STARTED
[05:53:47.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:28:0) after 8m53s
[06:02:40.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:28:0)
[06:02:40.389] Build status: STARTED
[06:02:40.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:29:0) after 7m49s
[06:10:29.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:29:0)
[06:10:29.495] Build status: STARTED
[06:10:29.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:30:0) after 2m5s
[06:12:34.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:30:0)
[06:12:34.839] Build status: STARTED
[06:12:34.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:31:0) after 2m46s
[06:15:20.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:31:0)
[06:15:20.891] Build status: STARTED
[06:15:20.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:32:0) after 7m38s
[06:22:58.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:32:0)
[06:22:58.943] Build status: STARTED
[06:22:58.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:33:0) after 9m54s
[06:32:53.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:33:0)
[06:32:53.289] Build status: STARTED
[06:32:53.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:34:0) after 7m19s
[06:40:12.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:34:0)
[06:40:12.425] Build status: STARTED
[06:40:12.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:35:0) after 8m50s
[06:49:02.449] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:35:0)
[06:49:02.474] Build status: STARTED
[06:49:02.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:36:0) after 6m47s
[06:55:49.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:36:0)
[06:55:49.519] Build status: STARTED
[06:55:49.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:37:0) after 3m45s
[06:59:34.540] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:37:0)
[06:59:34.593] Build status: STARTED
[06:59:34.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:38:0) after 8m53s
[07:08:27.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:38:0)
[07:08:27.680] Build status: STARTED
[07:08:27.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:39:0) after 1m48s
[07:10:15.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:39:0)
[07:10:15.779] Build status: STARTED
[07:10:15.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:40:0) after 6m39s
[07:16:54.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:40:0)
[07:16:54.875] Build status: STARTED
[07:16:54.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:41:0) after 8m55s
[07:25:49.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:41:0)
[07:25:49.928] Build status: STARTED
[07:25:49.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:42:0) after 8m34s
[07:34:23.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:42:0)
[07:34:23.999] Build status: STARTED
[07:34:23.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:43:0) after 7m33s
[07:41:57.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:43:0)
[07:41:57.077] Build status: STARTED
[07:41:57.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:44:0) after 6m10s
[07:48:07.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:44:0)
[07:48:07.132] Build status: STARTED
[07:48:07.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:45:0) after 1m18s
[07:49:25.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:45:0)
[07:49:25.229] Build status: STARTED
[07:49:25.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:46:0) after 9m56s
[07:59:21.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:46:0)
[07:59:21.576] Build status: STARTED
[07:59:21.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:47:0) after 7m19s
[08:06:40.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:47:0)
[08:06:40.632] Build status: STARTED
[08:06:40.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:48:0) after 1m17s
[08:07:57.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:48:0)
[08:07:57.992] Build status: STARTED
[08:07:57.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:49:0) after 2m46s
[08:10:44.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:49:0)
[08:10:44.090] Build status: STARTED
[08:10:44.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:50:0) after 1m3s
[08:11:47.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:50:0)
[08:11:47.179] Build status: STARTED
[08:11:47.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:51:0) after 7m44s
[08:19:31.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:51:0)
[08:19:31.256] Build status: STARTED
[08:19:31.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:52:0) after 3m45s
[08:23:16.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:52:0)
[08:23:16.447] Build status: STARTED
[08:23:16.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:53:0) after 1m16s
[08:24:32.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:53:0)
[08:24:32.596] Build status: STARTED
[08:24:32.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:54:0) after 9m14s
[08:33:46.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:54:0)
[08:33:46.715] Build status: STARTED
[08:33:46.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014169849827402160:55:0) after 9m37s
[08:41:02.721] Received PubSub notification, asking Buildbucket for the build status
[08:41:02.748] Build:
{
"id": "8848739787819162560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22032,
"createdBy": "project:chromium",
"createTime": "2021-04-28T03:39:14.002254Z",
"startTime": "2021-04-28T03:42:27.833450Z",
"endTime": "2021-04-28T08:41:02.388141029Z",
"updateTime": "2021-04-28T08:41:02.388538425Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1e783d543ffcdf9d2e21d0a6aeb265b888647bbb",
"ref": "refs/heads/master"
}
}
}
[08:41:02.748] Invocation finished in 5h1m50.043876117s with status FAILED