[22:36:18.520] New invocation is queued and will start shortly
[22:36:19.566] Starting the invocation (attempt 1)
[22:36:19.601] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b325a29b79ccaa7af6203dd47efe580a793aa33e"
[22:36:19.601] Popped gitiles commit info from properties and tags
[22:36:19.601] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:36:19.601] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:36:19.601] Buildbucket request:
{
"requestId": "9011380400903996448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b325a29b79ccaa7af6203dd47efe580a793aa33e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9011380400903996448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:36:20.149] Scheduled build:
{
"id": "8845950339008300256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22195,
"createdBy": "project:chromium",
"createTime": "2021-05-28T22:36:19.690121Z",
"updateTime": "2021-05-28T22:36:20.069693Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b325a29b79ccaa7af6203dd47efe580a793aa33e",
"ref": "refs/heads/main"
}
}
}
[22:36:20.149] Task URL: https://cr-buildbucket.appspot.com/build/8845950339008300256
[22:36:20.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:2:0) after 1m57s
[22:38:17.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:2:0)
[22:38:17.219] Build status: SCHEDULED
[22:38:17.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:3:0) after 3m9s
[22:39:20.148] Received PubSub notification, asking Buildbucket for the build status
[22:39:20.172] Build status: STARTED
[22:41:26.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:3:0)
[22:41:26.556] Build status: STARTED
[22:41:26.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:5:0) after 1m7s
[22:42:33.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:5:0)
[22:42:33.628] Build status: STARTED
[22:42:33.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:6:0) after 6m37s
[22:49:11.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:6:0)
[22:49:11.258] Build status: STARTED
[22:49:11.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:7:0) after 2m15s
[22:51:26.274] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:7:0)
[22:51:26.305] Build status: STARTED
[22:51:26.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:8:0) after 6m40s
[22:58:06.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:8:0)
[22:58:06.514] Build status: STARTED
[22:58:06.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:9:0) after 8m44s
[23:06:50.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:9:0)
[23:06:50.616] Build status: STARTED
[23:06:50.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:10:0) after 5m16s
[23:12:06.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:10:0)
[23:12:06.660] Build status: STARTED
[23:12:06.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:11:0) after 6m1s
[23:18:07.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:11:0)
[23:18:07.776] Build status: STARTED
[23:18:07.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:12:0) after 1m41s
[23:19:48.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:12:0)
[23:19:48.816] Build status: STARTED
[23:19:48.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:13:0) after 7m51s
[23:27:39.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:13:0)
[23:27:40.014] Build status: STARTED
[23:27:40.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:14:0) after 3m11s
[23:30:51.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:14:0)
[23:30:51.059] Build status: STARTED
[23:30:51.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:15:0) after 2m21s
[23:33:12.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:15:0)
[23:33:12.109] Build status: STARTED
[23:33:12.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:16:0) after 4m44s
[23:37:56.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:16:0)
[23:37:56.955] Build status: STARTED
[23:37:56.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:17:0) after 5m26s
[23:43:22.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:17:0)
[23:43:23.028] Build status: STARTED
[23:43:23.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:18:0) after 3m35s
[23:46:58.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:18:0)
[23:46:58.084] Build status: STARTED
[23:46:58.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:19:0) after 1m17s
[23:48:15.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:19:0)
[23:48:15.135] Build status: STARTED
[23:48:15.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:20:0) after 3m51s
[23:52:06.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:20:0)
[23:52:06.327] Build status: STARTED
[23:52:06.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:21:0) after 2m43s
[23:54:49.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:21:0)
[23:54:49.398] Build status: STARTED
[23:54:49.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:22:0) after 7m38s
[00:02:27.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:22:0)
[00:02:27.633] Build status: STARTED
[00:02:27.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:23:0) after 5m10s
[00:07:39.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:23:0)
[00:07:39.049] Build status: STARTED
[00:07:39.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:24:0) after 1m56s
[00:09:35.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:24:0)
[00:09:35.073] Build status: STARTED
[00:09:35.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:25:0) after 8m23s
[00:17:58.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:25:0)
[00:17:58.162] Build status: STARTED
[00:17:58.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:26:0) after 7m32s
[00:25:30.172] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:26:0)
[00:25:30.203] Build status: STARTED
[00:25:30.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:27:0) after 7m18s
[00:32:48.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:27:0)
[00:32:48.491] Build status: STARTED
[00:32:48.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:28:0) after 3m15s
[00:36:03.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:28:0)
[00:36:03.651] Build status: STARTED
[00:36:03.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:29:0) after 7m23s
[00:43:26.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:29:0)
[00:43:26.697] Build status: STARTED
[00:43:26.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:30:0) after 7m1s
[00:50:27.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:30:0)
[00:50:27.787] Build status: STARTED
[00:50:27.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:31:0) after 2m33s
[00:53:00.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:31:0)
[00:53:00.974] Build status: STARTED
[00:53:00.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:32:0) after 3m43s
[00:56:43.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:32:0)
[00:56:44.025] Build status: STARTED
[00:56:44.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:33:0) after 4m47s
[01:01:31.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:33:0)
[01:01:31.074] Build status: STARTED
[01:01:31.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:34:0) after 6m22s
[01:07:53.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:34:0)
[01:07:53.127] Build status: STARTED
[01:07:53.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:35:0) after 1m47s
[01:09:40.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:35:0)
[01:09:40.303] Build status: STARTED
[01:09:40.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:36:0) after 6m16s
[01:15:56.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:36:0)
[01:15:56.742] Build status: STARTED
[01:15:56.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:37:0) after 5m54s
[01:21:51.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:37:0)
[01:21:51.122] Build status: STARTED
[01:21:51.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:38:0) after 6m47s
[01:28:38.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:38:0)
[01:28:38.130] Build status: STARTED
[01:28:38.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:39:0) after 9m23s
[01:38:01.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:39:0)
[01:38:01.253] Build status: STARTED
[01:38:01.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:40:0) after 6m57s
[01:44:58.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:40:0)
[01:44:58.303] Build status: STARTED
[01:44:58.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:41:0) after 3m58s
[01:48:56.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:41:0)
[01:48:56.493] Build status: STARTED
[01:48:56.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:42:0) after 6m24s
[01:55:20.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:42:0)
[01:55:20.949] Build status: STARTED
[01:55:20.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:43:0) after 1m38s
[01:56:59.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:43:0)
[01:56:59.122] Build status: STARTED
[01:56:59.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:44:0) after 1m37s
[01:58:36.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:44:0)
[01:58:36.287] Build status: STARTED
[01:58:36.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:45:0) after 7m17s
[02:05:53.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:45:0)
[02:05:53.679] Build status: STARTED
[02:05:53.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:46:0) after 8m54s
[02:14:47.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:46:0)
[02:14:47.812] Build status: STARTED
[02:14:47.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:47:0) after 9m7s
[02:23:54.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:47:0)
[02:23:54.859] Build status: STARTED
[02:23:54.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:48:0) after 3m41s
[02:27:36.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:48:0)
[02:27:36.175] Build status: STARTED
[02:27:36.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:49:0) after 6m49s
[02:34:25.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:49:0)
[02:34:25.229] Build status: STARTED
[02:34:25.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:50:0) after 8m35s
[02:43:00.602] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:50:0)
[02:43:00.751] Build status: STARTED
[02:43:00.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:51:0) after 9m44s
[02:52:44.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:51:0)
[02:52:44.898] Build status: STARTED
[02:52:44.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:52:0) after 5m24s
[02:58:09.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:52:0)
[02:58:09.303] Build status: STARTED
[02:58:09.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:53:0) after 8m6s
[03:06:15.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:53:0)
[03:06:15.489] Build status: STARTED
[03:06:15.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:54:0) after 7m32s
[03:13:47.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:54:0)
[03:13:47.600] Build status: STARTED
[03:13:47.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:55:0) after 2m59s
[03:16:46.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:55:0)
[03:16:46.654] Build status: STARTED
[03:16:46.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011380400903996448:56:0) after 2m45s
[03:19:09.212] Received PubSub notification, asking Buildbucket for the build status
[03:19:09.238] Build:
{
"id": "8845950339008300256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22195,
"createdBy": "project:chromium",
"createTime": "2021-05-28T22:36:19.690121Z",
"startTime": "2021-05-28T22:39:19.646925Z",
"endTime": "2021-05-29T03:19:08.637353242Z",
"updateTime": "2021-05-29T03:19:08.637873869Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b325a29b79ccaa7af6203dd47efe580a793aa33e",
"ref": "refs/heads/main"
}
}
}
[03:19:09.238] Invocation finished in 4h42m50.738090426s with status FAILED