[16:14:54.222] New invocation is queued and will start shortly
[16:14:55.324] Starting the invocation (attempt 1)
[16:14:55.354] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6494f300739d17b9597ef0f50c0b27b76f818986"
[16:14:55.354] Popped gitiles commit info from properties and tags
[16:14:55.354] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:14:55.354] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:14:55.354] Buildbucket request:
{
"requestId": "8945812193144678816",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6494f300739d17b9597ef0f50c0b27b76f818986",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945812193144678816"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:14:55.950] Scheduled build:
{
"id": "8780382131219684177",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29453,
"createdBy": "project:chromium",
"createTime": "2023-05-22T16:14:55.431913257Z",
"updateTime": "2023-05-22T16:14:55.431913257Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6494f300739d17b9597ef0f50c0b27b76f818986",
"ref": "refs/heads/main"
}
}
}
[16:14:55.950] Task URL: https://cr-buildbucket.appspot.com/build/8780382131219684177
[16:14:55.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:2:0) after 2m22s
[16:17:18.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:2:0)
[16:17:18.259] Build status: SCHEDULED
[16:17:18.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:3:0) after 4m37s
[16:17:48.494] Received PubSub notification, asking Buildbucket for the build status
[16:17:48.529] Build status: STARTED
[16:21:55.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:3:0)
[16:21:55.304] Build status: STARTED
[16:21:55.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:5:0) after 9m54s
[16:31:50.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:5:0)
[16:31:50.041] Build status: STARTED
[16:31:50.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:6:0) after 5m46s
[16:37:36.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:6:0)
[16:37:36.352] Build status: STARTED
[16:37:36.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:7:0) after 8m25s
[16:46:01.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:7:0)
[16:46:01.382] Build status: STARTED
[16:46:01.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:8:0) after 4m37s
[16:50:38.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:8:0)
[16:50:39.060] Build status: STARTED
[16:50:39.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:9:0) after 1m32s
[16:52:11.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:9:0)
[16:52:11.080] Build status: STARTED
[16:52:11.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:10:0) after 4m23s
[16:56:34.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:10:0)
[16:56:34.096] Build status: STARTED
[16:56:34.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:11:0) after 7m50s
[17:04:24.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:11:0)
[17:04:24.282] Build status: STARTED
[17:04:24.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:12:0) after 2m40s
[17:07:04.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:12:0)
[17:07:04.371] Build status: STARTED
[17:07:04.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:13:0) after 4m20s
[17:11:24.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:13:0)
[17:11:24.431] Build status: STARTED
[17:11:24.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:14:0) after 2m22s
[17:13:46.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:14:0)
[17:13:46.572] Build status: STARTED
[17:13:46.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:15:0) after 6m51s
[17:20:37.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:15:0)
[17:20:37.652] Build status: STARTED
[17:20:37.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:16:0) after 4m7s
[17:24:44.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:16:0)
[17:24:44.730] Build status: STARTED
[17:24:44.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:17:0) after 1m34s
[17:26:18.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:17:0)
[17:26:18.876] Build status: STARTED
[17:26:18.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:18:0) after 5m46s
[17:32:04.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:18:0)
[17:32:04.960] Build status: STARTED
[17:32:04.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:19:0) after 9m48s
[17:41:53.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:19:0)
[17:41:53.368] Build status: STARTED
[17:41:53.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:20:0) after 4m43s
[17:46:36.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:20:0)
[17:46:36.596] Build status: STARTED
[17:46:36.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:21:0) after 8m42s
[17:55:18.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:21:0)
[17:55:18.913] Build status: STARTED
[17:55:18.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:22:0) after 5m3s
[18:00:22.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:22:0)
[18:00:22.491] Build status: STARTED
[18:00:22.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:23:0) after 4m49s
[18:05:12.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:23:0)
[18:05:12.103] Build status: STARTED
[18:05:12.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:24:0) after 9m0s
[18:14:12.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:24:0)
[18:14:12.605] Build status: STARTED
[18:14:12.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:25:0) after 7m45s
[18:21:57.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:25:0)
[18:21:57.906] Build status: STARTED
[18:21:57.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:26:0) after 2m22s
[18:24:19.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:26:0)
[18:24:19.936] Build status: STARTED
[18:24:19.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:27:0) after 6m34s
[18:30:53.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:27:0)
[18:30:53.981] Build status: STARTED
[18:30:53.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:28:0) after 4m11s
[18:35:05.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:28:0)
[18:35:05.135] Build status: STARTED
[18:35:05.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:29:0) after 3m50s
[18:38:55.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:29:0)
[18:38:55.275] Build status: STARTED
[18:38:55.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:30:0) after 5m26s
[18:44:21.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:30:0)
[18:44:21.383] Build status: STARTED
[18:44:21.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:31:0) after 7m40s
[18:52:01.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:31:0)
[18:52:01.513] Build status: STARTED
[18:52:01.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:32:0) after 1m31s
[18:53:32.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:32:0)
[18:53:32.736] Build status: STARTED
[18:53:32.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:33:0) after 4m22s
[18:57:54.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:33:0)
[18:57:54.901] Build status: STARTED
[18:57:54.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:34:0) after 1m39s
[18:59:33.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:34:0)
[18:59:34.019] Build status: STARTED
[18:59:34.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:35:0) after 3m3s
[19:02:37.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:35:0)
[19:02:37.144] Build status: STARTED
[19:02:37.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:36:0) after 8m29s
[19:11:06.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:36:0)
[19:11:06.221] Build status: STARTED
[19:11:06.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:37:0) after 2m41s
[19:13:47.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:37:0)
[19:13:47.290] Build status: STARTED
[19:13:47.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:38:0) after 9m14s
[19:23:01.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:38:0)
[19:23:01.359] Build status: STARTED
[19:23:01.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:39:0) after 3m12s
[19:26:13.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:39:0)
[19:26:13.715] Build status: STARTED
[19:26:13.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:40:0) after 5m14s
[19:31:27.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:40:0)
[19:31:27.921] Build status: STARTED
[19:31:27.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:41:0) after 3m11s
[19:34:39.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:41:0)
[19:34:39.132] Build status: STARTED
[19:34:39.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:42:0) after 6m47s
[19:41:26.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:42:0)
[19:41:26.235] Build status: STARTED
[19:41:26.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:43:0) after 4m52s
[19:46:18.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:43:0)
[19:46:18.835] Build status: STARTED
[19:46:18.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:44:0) after 8m15s
[19:54:34.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:44:0)
[19:54:34.489] Build status: STARTED
[19:54:34.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:45:0) after 2m32s
[19:57:06.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:45:0)
[19:57:06.907] Build status: STARTED
[19:57:06.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:46:0) after 9m11s
[20:06:17.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:46:0)
[20:06:17.981] Build status: STARTED
[20:06:17.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:47:0) after 7m25s
[20:13:43.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:47:0)
[20:13:43.430] Build status: STARTED
[20:13:43.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:48:0) after 7m23s
[20:21:06.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:48:0)
[20:21:06.499] Build status: STARTED
[20:21:06.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:49:0) after 8m18s
[20:29:24.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:49:0)
[20:29:24.820] Build status: STARTED
[20:29:24.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:50:0) after 2m42s
[20:32:06.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:50:0)
[20:32:07.020] Build status: STARTED
[20:32:07.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:51:0) after 3m15s
[20:35:22.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:51:0)
[20:35:22.135] Build status: STARTED
[20:35:22.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:52:0) after 6m23s
[20:41:45.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:52:0)
[20:41:45.208] Build status: STARTED
[20:41:45.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:53:0) after 2m9s
[20:43:54.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:53:0)
[20:43:54.234] Build status: STARTED
[20:43:54.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:54:0) after 1m24s
[20:45:18.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:54:0)
[20:45:18.304] Build status: STARTED
[20:45:18.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:55:0) after 3m55s
[20:49:14.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:55:0)
[20:49:14.114] Build status: STARTED
[20:49:14.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:56:0) after 6m23s
[20:55:37.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:56:0)
[20:55:37.181] Build status: STARTED
[20:55:37.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:57:0) after 3m9s
[20:58:46.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:57:0)
[20:58:46.989] Build status: STARTED
[20:58:46.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:58:0) after 3m42s
[21:02:29.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:58:0)
[21:02:29.486] Build status: STARTED
[21:02:29.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:59:0) after 4m16s
[21:06:45.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:59:0)
[21:06:45.589] Build status: STARTED
[21:06:45.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:60:0) after 2m6s
[21:08:51.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:60:0)
[21:08:51.816] Build status: STARTED
[21:08:51.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:61:0) after 1m50s
[21:10:41.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:61:0)
[21:10:41.874] Build status: STARTED
[21:10:41.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:62:0) after 2m1s
[21:12:43.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:62:0)
[21:12:43.398] Build status: STARTED
[21:12:43.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:63:0) after 9m27s
[21:22:11.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:63:0)
[21:22:11.173] Build status: STARTED
[21:22:11.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:64:0) after 3m23s
[21:25:35.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:64:0)
[21:25:35.081] Build status: STARTED
[21:25:35.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:65:0) after 2m5s
[21:27:40.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:65:0)
[21:27:40.124] Build status: STARTED
[21:27:40.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945812193144678816:66:0) after 9m44s
[21:32:28.381] Received PubSub notification, asking Buildbucket for the build status
[21:32:28.436] Build:
{
"id": "8780382131219684177",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29453,
"createdBy": "project:chromium",
"createTime": "2023-05-22T16:14:55.431913257Z",
"startTime": "2023-05-22T16:17:47.428745Z",
"endTime": "2023-05-22T21:32:27.929910119Z",
"updateTime": "2023-05-22T21:32:27.929910119Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6494f300739d17b9597ef0f50c0b27b76f818986",
"ref": "refs/heads/main"
}
}
}
[21:32:28.436] Invocation finished in 5h17m34.224371926s with status FAILED