[22:26:49.197] New invocation is queued and will start shortly
[22:26:51.348] Starting the invocation (attempt 1)
[22:26:51.395] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/263704d4cde4738257d184bf2c25a67b5297901a"
[22:26:51.395] Popped gitiles commit info from properties and tags
[22:26:51.395] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:26:51.395] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:26:51.395] Buildbucket request:
{
"requestId": "8993714589428225664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "263704d4cde4738257d184bf2c25a67b5297901a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8993714589428225664"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:26:51.929] Scheduled build:
{
"id": "8828284526348255441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 19977,
"createdBy": "project:chromium",
"createTime": "2021-12-09T22:26:51.502486558Z",
"updateTime": "2021-12-09T22:26:51.502486558Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "263704d4cde4738257d184bf2c25a67b5297901a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:26:51.929] Task URL: https://cr-buildbucket.appspot.com/build/8828284526348255441
[22:26:51.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:2:0) after 2m37s
[22:28:31.114] Received PubSub notification, asking Buildbucket for the build status
[22:28:31.144] Build status: STARTED
[22:29:29.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:2:0)
[22:29:29.143] Build status: STARTED
[22:29:29.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:4:0) after 7m7s
[22:36:36.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:4:0)
[22:36:36.458] Build status: STARTED
[22:36:36.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:5:0) after 3m37s
[22:40:13.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:5:0)
[22:40:13.544] Build status: STARTED
[22:40:13.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:6:0) after 8m12s
[22:48:25.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:6:0)
[22:48:25.869] Build status: STARTED
[22:48:25.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:7:0) after 5m22s
[22:53:48.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:7:0)
[22:53:48.056] Build status: STARTED
[22:53:48.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:8:0) after 2m55s
[22:56:43.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:8:0)
[22:56:43.199] Build status: STARTED
[22:56:43.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:9:0) after 5m43s
[23:02:26.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:9:0)
[23:02:26.298] Build status: STARTED
[23:02:26.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:10:0) after 2m59s
[23:05:25.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:10:0)
[23:05:25.350] Build status: STARTED
[23:05:25.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:11:0) after 6m32s
[23:11:57.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:11:0)
[23:11:57.584] Build status: STARTED
[23:11:57.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:12:0) after 4m45s
[23:16:42.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:12:0)
[23:16:42.706] Build status: STARTED
[23:16:42.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:13:0) after 4m45s
[23:21:27.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:13:0)
[23:21:27.751] Build status: STARTED
[23:21:27.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:14:0) after 6m37s
[23:28:04.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:14:0)
[23:28:04.826] Build status: STARTED
[23:28:04.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:15:0) after 9m20s
[23:37:24.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:15:0)
[23:37:24.860] Build status: STARTED
[23:37:24.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:16:0) after 6m20s
[23:43:44.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:16:0)
[23:43:44.994] Build status: STARTED
[23:43:44.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:17:0) after 6m20s
[23:50:05.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:17:0)
[23:50:05.160] Build status: STARTED
[23:50:05.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:18:0) after 2m44s
[23:52:49.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:18:0)
[23:52:49.208] Build status: STARTED
[23:52:49.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:19:0) after 2m4s
[23:54:53.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:19:0)
[23:54:53.354] Build status: STARTED
[23:54:53.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:20:0) after 5m0s
[23:59:53.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:20:0)
[23:59:53.593] Build status: STARTED
[23:59:53.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:21:0) after 7m5s
[00:06:58.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:21:0)
[00:06:58.729] Build status: STARTED
[00:06:58.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:22:0) after 2m25s
[00:09:23.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:22:0)
[00:09:23.787] Build status: STARTED
[00:09:23.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:23:0) after 6m4s
[00:15:27.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:23:0)
[00:15:27.856] Build status: STARTED
[00:15:27.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:24:0) after 5m12s
[00:20:39.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:24:0)
[00:20:40.027] Build status: STARTED
[00:20:40.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:25:0) after 9m29s
[00:30:09.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:25:0)
[00:30:09.081] Build status: STARTED
[00:30:09.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:26:0) after 9m50s
[00:39:59.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:26:0)
[00:39:59.158] Build status: STARTED
[00:39:59.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:27:0) after 8m22s
[00:48:21.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:27:0)
[00:48:21.328] Build status: STARTED
[00:48:21.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:28:0) after 5m29s
[00:53:50.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:28:0)
[00:53:50.488] Build status: STARTED
[00:53:50.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:29:0) after 9m6s
[01:02:56.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:29:0)
[01:02:56.675] Build status: STARTED
[01:02:56.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:30:0) after 8m17s
[01:11:13.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:30:0)
[01:11:13.738] Build status: STARTED
[01:11:13.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:31:0) after 1m12s
[01:12:26.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:31:0)
[01:12:26.117] Build status: STARTED
[01:12:26.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:32:0) after 6m11s
[01:18:37.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:32:0)
[01:18:37.237] Build status: STARTED
[01:18:37.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:33:0) after 1m2s
[01:19:39.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:33:0)
[01:19:39.501] Build status: STARTED
[01:19:39.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:34:0) after 2m5s
[01:21:44.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:34:0)
[01:21:44.652] Build status: STARTED
[01:21:44.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:35:0) after 7m26s
[01:29:10.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:35:0)
[01:29:10.818] Build status: STARTED
[01:29:10.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:36:0) after 9m39s
[01:38:50.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:36:0)
[01:38:50.199] Build status: STARTED
[01:38:50.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:37:0) after 2m40s
[01:41:30.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:37:0)
[01:41:30.286] Build status: STARTED
[01:41:30.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:38:0) after 6m37s
[01:48:07.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:38:0)
[01:48:07.613] Build status: STARTED
[01:48:07.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:39:0) after 2m37s
[01:50:44.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:39:0)
[01:50:44.756] Build status: STARTED
[01:50:44.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:40:0) after 8m58s
[01:59:42.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:40:0)
[01:59:42.874] Build status: STARTED
[01:59:42.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:41:0) after 8m37s
[02:08:19.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:41:0)
[02:08:19.934] Build status: STARTED
[02:08:19.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:42:0) after 4m50s
[02:13:10.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:42:0)
[02:13:10.262] Build status: STARTED
[02:13:10.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:43:0) after 1m55s
[02:15:05.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:43:0)
[02:15:05.463] Build status: STARTED
[02:15:05.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:44:0) after 7m21s
[02:22:26.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:44:0)
[02:22:26.542] Build status: STARTED
[02:22:26.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:45:0) after 7m25s
[02:29:51.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:45:0)
[02:29:51.765] Build status: STARTED
[02:29:51.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:46:0) after 9m59s
[02:39:50.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:46:0)
[02:39:50.860] Build status: STARTED
[02:39:50.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:47:0) after 3m30s
[02:43:20.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:47:0)
[02:43:20.970] Build status: STARTED
[02:43:20.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:48:0) after 4m3s
[02:47:23.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:48:0)
[02:47:24.034] Build status: STARTED
[02:47:24.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:49:0) after 7m23s
[02:54:47.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:49:0)
[02:54:47.111] Build status: STARTED
[02:54:47.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:50:0) after 1m57s
[02:56:44.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:50:0)
[02:56:44.114] Build status: STARTED
[02:56:44.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:51:0) after 3m56s
[03:00:40.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:51:0)
[03:00:40.178] Build status: STARTED
[03:00:40.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:52:0) after 4m14s
[03:04:54.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:52:0)
[03:04:54.555] Build status: STARTED
[03:04:54.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8993714589428225664:53:0) after 5m33s
[03:09:37.888] Received PubSub notification, asking Buildbucket for the build status
[03:09:37.918] Build:
{
"id": "8828284526348255441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 19977,
"createdBy": "project:chromium",
"createTime": "2021-12-09T22:26:51.502486558Z",
"startTime": "2021-12-09T22:28:30.610685Z",
"endTime": "2021-12-10T03:09:37.623436057Z",
"updateTime": "2021-12-10T03:09:37.623436057Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "263704d4cde4738257d184bf2c25a67b5297901a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:09:37.918] Invocation finished in 4h42m48.736864308s with status FAILED