[15:29:43.344] New invocation is queued and will start shortly
[15:29:44.391] Starting the invocation (attempt 1)
[15:29:44.425] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/322d483f81a3fdb7c003bc7bad84b12aec85fe73"
[15:29:44.425] Popped gitiles commit info from properties and tags
[15:29:44.425] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:29:44.425] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:29:44.425] Buildbucket request:
{
"requestId": "8997364709592806080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "322d483f81a3fdb7c003bc7bad84b12aec85fe73",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8997364709592806080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:29:44.989] Scheduled build:
{
"id": "8831934647724828881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23485,
"createdBy": "project:chromium",
"createTime": "2021-10-30T15:29:44.494691283Z",
"updateTime": "2021-10-30T15:29:44.494691283Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "322d483f81a3fdb7c003bc7bad84b12aec85fe73",
"ref": "refs/heads/main"
}
}
}
[15:29:44.989] Task URL: https://cr-buildbucket.appspot.com/build/8831934647724828881
[15:29:44.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:2:0) after 5m0s
[15:32:13.691] Received PubSub notification, asking Buildbucket for the build status
[15:32:13.725] Build status: STARTED
[15:34:45.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:2:0)
[15:34:45.248] Build status: STARTED
[15:34:45.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:4:0) after 5m51s
[15:40:36.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:4:0)
[15:40:36.297] Build status: STARTED
[15:40:36.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:5:0) after 8m24s
[15:49:00.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:5:0)
[15:49:00.724] Build status: STARTED
[15:49:00.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:6:0) after 7m38s
[15:56:38.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:6:0)
[15:56:38.766] Build status: STARTED
[15:56:38.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:7:0) after 8m1s
[16:04:39.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:7:0)
[16:04:39.867] Build status: STARTED
[16:04:39.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:8:0) after 7m5s
[16:11:44.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:8:0)
[16:11:44.913] Build status: STARTED
[16:11:44.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:9:0) after 7m59s
[16:19:44.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:9:0)
[16:19:44.102] Build status: STARTED
[16:19:44.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:10:0) after 7m41s
[16:27:25.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:10:0)
[16:27:25.242] Build status: STARTED
[16:27:25.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:11:0) after 9m50s
[16:37:15.292] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:11:0)
[16:37:15.338] Build status: STARTED
[16:37:15.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:12:0) after 9m33s
[16:46:48.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:12:0)
[16:46:48.554] Build status: STARTED
[16:46:48.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:13:0) after 4m50s
[16:51:39.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:13:0)
[16:51:39.865] Build status: STARTED
[16:51:39.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:14:0) after 1m26s
[16:53:05.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:14:0)
[16:53:05.913] Build status: STARTED
[16:53:05.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:15:0) after 2m0s
[16:55:06.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:15:0)
[16:55:06.322] Build status: STARTED
[16:55:06.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:16:0) after 8m12s
[17:03:18.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:16:0)
[17:03:18.641] Build status: STARTED
[17:03:18.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:17:0) after 7m55s
[17:11:13.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:17:0)
[17:11:13.773] Build status: STARTED
[17:11:13.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:18:0) after 1m2s
[17:12:15.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:18:0)
[17:12:15.838] Build status: STARTED
[17:12:15.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:19:0) after 5m41s
[17:17:56.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:19:0)
[17:17:56.891] Build status: STARTED
[17:17:56.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:20:0) after 5m44s
[17:23:41.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:20:0)
[17:23:41.037] Build status: STARTED
[17:23:41.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:21:0) after 6m16s
[17:29:57.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:21:0)
[17:29:57.084] Build status: STARTED
[17:29:57.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:22:0) after 8m8s
[17:38:05.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:22:0)
[17:38:05.215] Build status: STARTED
[17:38:05.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:23:0) after 2m26s
[17:40:31.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:23:0)
[17:40:31.379] Build status: STARTED
[17:40:31.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:24:0) after 3m11s
[17:43:42.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:24:0)
[17:43:42.426] Build status: STARTED
[17:43:42.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:25:0) after 6m6s
[17:49:48.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:25:0)
[17:49:48.454] Build status: STARTED
[17:49:48.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:26:0) after 5m2s
[17:54:50.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:26:0)
[17:54:50.515] Build status: STARTED
[17:54:50.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:27:0) after 2m48s
[17:57:38.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:27:0)
[17:57:38.571] Build status: STARTED
[17:57:38.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:28:0) after 2m45s
[18:00:23.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:28:0)
[18:00:23.666] Build status: STARTED
[18:00:23.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:29:0) after 7m23s
[18:07:46.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:29:0)
[18:07:46.751] Build status: STARTED
[18:07:46.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:30:0) after 6m51s
[18:14:37.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:30:0)
[18:14:37.820] Build status: STARTED
[18:14:37.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:31:0) after 1m43s
[18:16:20.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:31:0)
[18:16:20.871] Build status: STARTED
[18:16:20.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:32:0) after 2m44s
[18:19:04.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:32:0)
[18:19:05.038] Build status: STARTED
[18:19:05.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:33:0) after 4m14s
[18:23:19.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:33:0)
[18:23:19.092] Build status: STARTED
[18:23:19.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:34:0) after 4m55s
[18:28:14.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:34:0)
[18:28:14.501] Build status: STARTED
[18:28:14.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:35:0) after 4m2s
[18:32:16.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:35:0)
[18:32:16.956] Build status: STARTED
[18:32:16.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:36:0) after 9m15s
[18:41:32.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:36:0)
[18:41:32.552] Build status: STARTED
[18:41:32.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:37:0) after 4m10s
[18:45:43.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:37:0)
[18:45:43.520] Build status: STARTED
[18:45:43.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:38:0) after 4m13s
[18:49:56.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:38:0)
[18:49:56.572] Build status: STARTED
[18:49:56.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:39:0) after 4m25s
[18:54:22.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:39:0)
[18:54:23.189] Build status: STARTED
[18:54:23.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:40:0) after 9m56s
[19:04:19.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:40:0)
[19:04:19.519] Build status: STARTED
[19:04:19.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:41:0) after 9m28s
[19:13:47.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:41:0)
[19:13:47.724] Build status: STARTED
[19:13:47.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:42:0) after 1m1s
[19:14:48.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:42:0)
[19:14:48.909] Build status: STARTED
[19:14:48.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:43:0) after 2m18s
[19:17:07.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:43:0)
[19:17:07.393] Build status: STARTED
[19:17:07.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:44:0) after 4m46s
[19:21:54.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:44:0)
[19:21:54.427] Build status: STARTED
[19:21:54.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:45:0) after 1m30s
[19:23:24.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:45:0)
[19:23:24.680] Build status: STARTED
[19:23:24.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:46:0) after 9m32s
[19:32:56.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:46:0)
[19:32:56.867] Build status: STARTED
[19:32:56.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:47:0) after 2m53s
[19:35:50.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:47:0)
[19:35:50.151] Build status: STARTED
[19:35:50.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:48:0) after 9m57s
[19:45:47.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:48:0)
[19:45:47.260] Build status: STARTED
[19:45:47.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:49:0) after 3m18s
[19:49:05.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:49:0)
[19:49:05.604] Build status: STARTED
[19:49:05.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:50:0) after 9m19s
[19:58:24.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:50:0)
[19:58:24.637] Build status: STARTED
[19:58:24.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:51:0) after 5m55s
[20:04:20.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:51:0)
[20:04:20.418] Build status: STARTED
[20:04:20.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:52:0) after 1m6s
[20:05:26.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:52:0)
[20:05:26.499] Build status: STARTED
[20:05:26.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:53:0) after 2m1s
[20:07:27.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:53:0)
[20:07:27.558] Build status: STARTED
[20:07:27.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:54:0) after 7m20s
[20:14:47.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:54:0)
[20:14:47.624] Build status: STARTED
[20:14:47.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:55:0) after 9m14s
[20:24:01.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:55:0)
[20:24:01.712] Build status: STARTED
[20:24:01.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:56:0) after 7m47s
[20:31:48.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:56:0)
[20:31:48.763] Build status: STARTED
[20:31:48.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:57:0) after 1m40s
[20:33:28.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:57:0)
[20:33:28.817] Build status: STARTED
[20:33:28.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:58:0) after 6m44s
[20:40:12.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:58:0)
[20:40:12.846] Build status: STARTED
[20:40:12.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:59:0) after 6m40s
[20:46:52.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:59:0)
[20:46:52.939] Build status: STARTED
[20:46:52.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:60:0) after 7m3s
[20:53:55.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:60:0)
[20:53:56.066] Build status: STARTED
[20:53:56.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:61:0) after 1m21s
[20:55:17.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:61:0)
[20:55:17.127] Build status: STARTED
[20:55:17.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:62:0) after 5m59s
[21:01:16.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:62:0)
[21:01:16.279] Build status: STARTED
[21:01:16.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:63:0) after 6m6s
[21:07:22.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:63:0)
[21:07:22.578] Build status: STARTED
[21:07:22.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:64:0) after 9m42s
[21:17:04.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:64:0)
[21:17:04.611] Build status: STARTED
[21:17:04.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:65:0) after 7m54s
[21:24:58.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:65:0)
[21:24:58.664] Build status: STARTED
[21:24:58.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997364709592806080:66:0) after 8m4s
[21:30:32.748] Received PubSub notification, asking Buildbucket for the build status
[21:30:32.781] Build:
{
"id": "8831934647724828881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23485,
"createdBy": "project:chromium",
"createTime": "2021-10-30T15:29:44.494691283Z",
"startTime": "2021-10-30T15:32:13.170183Z",
"endTime": "2021-10-30T21:30:32.320034711Z",
"updateTime": "2021-10-30T21:30:32.320034711Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "322d483f81a3fdb7c003bc7bad84b12aec85fe73",
"ref": "refs/heads/main"
}
}
}
[21:30:32.781] Invocation finished in 6h0m49.452304765s with status FAILED