[23:26:51.890] New invocation is queued and will start shortly
[23:26:53.133] Starting the invocation (attempt 1)
[23:26:53.211] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2f3f36aa19c925f6912047cad27a86d07e466d1b"
[23:26:53.211] Popped gitiles commit info from properties and tags
[23:26:53.211] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:26:53.211] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:26:53.211] Buildbucket request:
{
"requestId": "9016722441196449568",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f3f36aa19c925f6912047cad27a86d07e466d1b",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9016722441196449568"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:26:53.919] Scheduled build:
{
"id": "8851292378994055056",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21853,
"createdBy": "project:chromium",
"createTime": "2021-03-30T23:26:53.358051Z",
"updateTime": "2021-03-30T23:26:53.826399Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f3f36aa19c925f6912047cad27a86d07e466d1b",
"ref": "refs/heads/master"
}
}
}
[23:26:53.919] Task URL: https://cr-buildbucket.appspot.com/build/8851292378994055056
[23:26:53.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:2:0) after 7m53s
[23:30:00.927] Received PubSub notification, asking Buildbucket for the build status
[23:30:00.954] Build status: STARTED
[23:34:46.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:2:0)
[23:34:46.992] Build status: STARTED
[23:34:46.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:4:0) after 1m39s
[23:36:26.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:4:0)
[23:36:26.056] Build status: STARTED
[23:36:26.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:5:0) after 8m35s
[23:45:01.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:5:0)
[23:45:01.133] Build status: STARTED
[23:45:01.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:6:0) after 2m7s
[23:47:08.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:6:0)
[23:47:08.254] Build status: STARTED
[23:47:08.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:7:0) after 1m18s
[23:48:26.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:7:0)
[23:48:26.383] Build status: STARTED
[23:48:26.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:8:0) after 2m32s
[23:50:58.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:8:0)
[23:50:58.831] Build status: STARTED
[23:50:58.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:9:0) after 7m11s
[23:58:09.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:9:0)
[23:58:09.888] Build status: STARTED
[23:58:09.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:10:0) after 2m33s
[00:00:43.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:10:0)
[00:00:43.193] Build status: STARTED
[00:00:43.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:11:0) after 4m48s
[00:05:31.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:11:0)
[00:05:31.272] Build status: STARTED
[00:05:31.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:12:0) after 6m54s
[00:12:25.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:12:0)
[00:12:25.441] Build status: STARTED
[00:12:25.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:13:0) after 9m57s
[00:22:22.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:13:0)
[00:22:22.629] Build status: STARTED
[00:22:22.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:14:0) after 9m35s
[00:31:57.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:14:0)
[00:31:58.026] Build status: STARTED
[00:31:58.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:15:0) after 8m7s
[00:40:05.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:15:0)
[00:40:05.087] Build status: STARTED
[00:40:05.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:16:0) after 7m57s
[00:48:02.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:16:0)
[00:48:02.282] Build status: STARTED
[00:48:02.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:17:0) after 5m43s
[00:53:45.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:17:0)
[00:53:45.687] Build status: STARTED
[00:53:45.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:18:0) after 7m55s
[01:01:40.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:18:0)
[01:01:40.827] Build status: STARTED
[01:01:40.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:19:0) after 1m2s
[01:02:43.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:19:0)
[01:02:43.179] Build status: STARTED
[01:02:43.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:20:0) after 2m12s
[01:04:55.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:20:0)
[01:04:55.244] Build status: STARTED
[01:04:55.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:21:0) after 5m48s
[01:10:43.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:21:0)
[01:10:43.518] Build status: STARTED
[01:10:43.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:22:0) after 1m25s
[01:12:08.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:22:0)
[01:12:08.645] Build status: STARTED
[01:12:08.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:23:0) after 2m51s
[01:14:59.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:23:0)
[01:14:59.808] Build status: STARTED
[01:14:59.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:24:0) after 8m18s
[01:23:17.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:24:0)
[01:23:17.984] Build status: STARTED
[01:23:17.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:25:0) after 6m33s
[01:29:51.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:25:0)
[01:29:51.068] Build status: STARTED
[01:29:51.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:26:0) after 9m53s
[01:39:44.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:26:0)
[01:39:44.121] Build status: STARTED
[01:39:44.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:27:0) after 4m27s
[01:44:11.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:27:0)
[01:44:11.387] Build status: STARTED
[01:44:11.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:28:0) after 3m16s
[01:47:27.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:28:0)
[01:47:27.435] Build status: STARTED
[01:47:27.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:29:0) after 9m36s
[01:57:03.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:29:0)
[01:57:03.606] Build status: STARTED
[01:57:03.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:30:0) after 5m30s
[02:02:33.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:30:0)
[02:02:33.676] Build status: STARTED
[02:02:33.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:31:0) after 7m22s
[02:09:55.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:31:0)
[02:09:56.030] Build status: STARTED
[02:09:56.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:32:0) after 5m10s
[02:15:06.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:32:0)
[02:15:06.508] Build status: STARTED
[02:15:06.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:33:0) after 6m35s
[02:21:41.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:33:0)
[02:21:41.835] Build status: STARTED
[02:21:41.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:34:0) after 3m12s
[02:24:54.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:34:0)
[02:24:54.244] Build status: STARTED
[02:24:54.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:35:0) after 4m34s
[02:29:28.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:35:0)
[02:29:28.355] Build status: STARTED
[02:29:28.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:36:0) after 2m18s
[02:31:46.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:36:0)
[02:31:46.412] Build status: STARTED
[02:31:46.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:37:0) after 7m25s
[02:39:11.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:37:0)
[02:39:11.480] Build status: STARTED
[02:39:11.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:38:0) after 6m12s
[02:45:23.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:38:0)
[02:45:23.649] Build status: STARTED
[02:45:23.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:39:0) after 1m4s
[02:46:27.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:39:0)
[02:46:27.706] Build status: STARTED
[02:46:27.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:40:0) after 3m13s
[02:49:40.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:40:0)
[02:49:40.886] Build status: STARTED
[02:49:40.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:41:0) after 5m34s
[02:55:15.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:41:0)
[02:55:15.075] Build status: STARTED
[02:55:15.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:42:0) after 2m23s
[02:57:38.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:42:0)
[02:57:38.288] Build status: STARTED
[02:57:38.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:43:0) after 3m33s
[03:01:11.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:43:0)
[03:01:11.422] Build status: STARTED
[03:01:11.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:44:0) after 6m21s
[03:07:32.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:44:0)
[03:07:32.598] Build status: STARTED
[03:07:32.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:45:0) after 4m48s
[03:12:20.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:45:0)
[03:12:20.872] Build status: STARTED
[03:12:20.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:46:0) after 7m0s
[03:19:20.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:46:0)
[03:19:20.922] Build status: STARTED
[03:19:20.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:47:0) after 5m4s
[03:24:25.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:47:0)
[03:24:25.073] Build status: STARTED
[03:24:25.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:48:0) after 9m56s
[03:34:21.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:48:0)
[03:34:21.228] Build status: STARTED
[03:34:21.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:49:0) after 5m22s
[03:39:43.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:49:0)
[03:39:43.379] Build status: STARTED
[03:39:43.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:50:0) after 7m52s
[03:47:35.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:50:0)
[03:47:35.632] Build status: STARTED
[03:47:35.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:51:0) after 3m30s
[03:51:05.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:51:0)
[03:51:05.703] Build status: STARTED
[03:51:05.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:52:0) after 1m30s
[03:52:35.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:52:0)
[03:52:35.930] Build status: STARTED
[03:52:35.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:53:0) after 9m52s
[04:02:27.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:53:0)
[04:02:28.054] Build status: STARTED
[04:02:28.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:54:0) after 8m34s
[04:11:02.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:54:0)
[04:11:02.111] Build status: STARTED
[04:11:02.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:55:0) after 6m55s
[04:17:57.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:55:0)
[04:17:57.187] Build status: STARTED
[04:17:57.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:56:0) after 6m43s
[04:24:40.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:56:0)
[04:24:40.486] Build status: STARTED
[04:24:40.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016722441196449568:57:0) after 3m22s
[04:27:58.101] Received PubSub notification, asking Buildbucket for the build status
[04:27:58.128] Build:
{
"id": "8851292378994055056",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21853,
"createdBy": "project:chromium",
"createTime": "2021-03-30T23:26:53.358051Z",
"startTime": "2021-03-30T23:29:59.973382Z",
"endTime": "2021-03-31T04:27:57.683783088Z",
"updateTime": "2021-03-31T04:27:57.684389788Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f3f36aa19c925f6912047cad27a86d07e466d1b",
"ref": "refs/heads/master"
}
}
}
[04:27:58.128] Invocation finished in 5h1m6.253392407s with status FAILED