[05:04:09.677] New invocation is queued and will start shortly
[05:04:13.069] Starting the invocation (attempt 1)
[05:04:13.102] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/934726889d2f038d6ee952d77e1048a30e7053e1"
[05:04:13.102] Popped gitiles commit info from properties and tags
[05:04:13.102] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:04:13.102] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:04:13.102] Buildbucket request:
{
"requestId": "8954279910486378448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "934726889d2f038d6ee952d77e1048a30e7053e1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8954279910486378448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:04:14.144] Scheduled build:
{
"id": "8788849845864175681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28961,
"createdBy": "project:chromium",
"createTime": "2023-02-18T05:04:13.456208626Z",
"updateTime": "2023-02-18T05:04:13.456208626Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "934726889d2f038d6ee952d77e1048a30e7053e1",
"ref": "refs/heads/main"
}
}
}
[05:04:14.144] Task URL: https://cr-buildbucket.appspot.com/build/8788849845864175681
[05:04:14.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:2:0) after 9m18s
[05:06:52.470] Received PubSub notification, asking Buildbucket for the build status
[05:06:52.499] Build status: STARTED
[05:13:32.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:2:0)
[05:13:32.353] Build status: STARTED
[05:13:32.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:4:0) after 4m53s
[05:18:25.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:4:0)
[05:18:25.567] Build status: STARTED
[05:18:25.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:5:0) after 2m47s
[05:21:12.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:5:0)
[05:21:12.707] Build status: STARTED
[05:21:12.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:6:0) after 6m51s
[05:28:03.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:6:0)
[05:28:03.796] Build status: STARTED
[05:28:03.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:7:0) after 4m34s
[05:32:37.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:7:0)
[05:32:37.914] Build status: STARTED
[05:32:37.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:8:0) after 5m7s
[05:37:44.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:8:0)
[05:37:44.973] Build status: STARTED
[05:37:44.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:9:0) after 1m19s
[05:39:04.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:9:0)
[05:39:04.051] Build status: STARTED
[05:39:04.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:10:0) after 9m54s
[05:48:58.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:10:0)
[05:48:58.101] Build status: STARTED
[05:48:58.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:11:0) after 6m46s
[05:55:44.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:11:0)
[05:55:44.265] Build status: STARTED
[05:55:44.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:12:0) after 5m31s
[06:01:15.639] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:12:0)
[06:01:15.660] Build status: STARTED
[06:01:15.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:13:0) after 2m25s
[06:03:40.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:13:0)
[06:03:40.704] Build status: STARTED
[06:03:40.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:14:0) after 3m50s
[06:07:30.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:14:0)
[06:07:30.875] Build status: STARTED
[06:07:30.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:15:0) after 2m21s
[06:09:52.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:15:0)
[06:09:52.071] Build status: STARTED
[06:09:52.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:16:0) after 2m42s
[06:12:34.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:16:0)
[06:12:34.122] Build status: STARTED
[06:12:34.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:17:0) after 4m44s
[06:17:18.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:17:0)
[06:17:18.252] Build status: STARTED
[06:17:18.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:18:0) after 2m54s
[06:20:12.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:18:0)
[06:20:12.495] Build status: STARTED
[06:20:12.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:19:0) after 6m25s
[06:26:38.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:19:0)
[06:26:38.373] Build status: STARTED
[06:26:38.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:20:0) after 2m4s
[06:28:42.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:20:0)
[06:28:42.587] Build status: STARTED
[06:28:42.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:21:0) after 5m20s
[06:34:02.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:21:0)
[06:34:02.594] Build status: STARTED
[06:34:02.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:22:0) after 3m48s
[06:37:50.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:22:0)
[06:37:50.608] Build status: STARTED
[06:37:50.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:23:0) after 3m14s
[06:41:05.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:23:0)
[06:41:05.702] Build status: STARTED
[06:41:05.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:24:0) after 2m41s
[06:43:46.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:24:0)
[06:43:46.905] Build status: STARTED
[06:43:46.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:25:0) after 4m14s
[06:48:00.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:25:0)
[06:48:00.946] Build status: STARTED
[06:48:00.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:26:0) after 8m53s
[06:56:54.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:26:0)
[06:56:54.200] Build status: STARTED
[06:56:54.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:27:0) after 8m23s
[07:05:17.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:27:0)
[07:05:17.396] Build status: STARTED
[07:05:17.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:28:0) after 6m23s
[07:11:40.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:28:0)
[07:11:40.433] Build status: STARTED
[07:11:40.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:29:0) after 4m47s
[07:16:27.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:29:0)
[07:16:27.649] Build status: STARTED
[07:16:27.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:30:0) after 2m1s
[07:18:28.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:30:0)
[07:18:28.689] Build status: STARTED
[07:18:28.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:31:0) after 4m31s
[07:22:59.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:31:0)
[07:22:59.738] Build status: STARTED
[07:22:59.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:32:0) after 5m49s
[07:28:48.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:32:0)
[07:28:49.006] Build status: STARTED
[07:28:49.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:33:0) after 8m24s
[07:37:13.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:33:0)
[07:37:13.397] Build status: STARTED
[07:37:13.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:34:0) after 7m24s
[07:44:37.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:34:0)
[07:44:37.438] Build status: STARTED
[07:44:37.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:35:0) after 8m47s
[07:53:24.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:35:0)
[07:53:24.544] Build status: STARTED
[07:53:24.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:36:0) after 8m27s
[08:01:51.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:36:0)
[08:01:51.594] Build status: STARTED
[08:01:51.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:37:0) after 2m26s
[08:04:17.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:37:0)
[08:04:17.649] Build status: STARTED
[08:04:17.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:38:0) after 2m57s
[08:07:15.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:38:0)
[08:07:15.025] Build status: STARTED
[08:07:15.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:39:0) after 7m44s
[08:14:59.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:39:0)
[08:14:59.075] Build status: STARTED
[08:14:59.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:40:0) after 3m50s
[08:18:49.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:40:0)
[08:18:49.127] Build status: STARTED
[08:18:49.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:41:0) after 8m18s
[08:27:07.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:41:0)
[08:27:07.265] Build status: STARTED
[08:27:07.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:42:0) after 4m53s
[08:32:00.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:42:0)
[08:32:00.459] Build status: STARTED
[08:32:00.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:43:0) after 6m11s
[08:38:11.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:43:0)
[08:38:11.822] Build status: STARTED
[08:38:11.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:44:0) after 9m41s
[08:47:52.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:44:0)
[08:47:52.987] Build status: STARTED
[08:47:52.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:45:0) after 7m55s
[08:55:48.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:45:0)
[08:55:48.100] Build status: STARTED
[08:55:48.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:46:0) after 3m34s
[08:59:22.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:46:0)
[08:59:22.250] Build status: STARTED
[08:59:22.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:47:0) after 3m56s
[09:03:18.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:47:0)
[09:03:18.317] Build status: STARTED
[09:03:18.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:48:0) after 6m59s
[09:10:17.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:48:0)
[09:10:17.376] Build status: STARTED
[09:10:17.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:49:0) after 7m18s
[09:17:35.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:49:0)
[09:17:35.452] Build status: STARTED
[09:17:35.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:50:0) after 9m8s
[09:26:43.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:50:0)
[09:26:43.501] Build status: STARTED
[09:26:43.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:51:0) after 6m54s
[09:33:37.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:51:0)
[09:33:37.544] Build status: STARTED
[09:33:37.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:52:0) after 8m2s
[09:41:39.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:52:0)
[09:41:39.913] Build status: STARTED
[09:41:39.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:53:0) after 9m6s
[09:50:45.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:53:0)
[09:50:46.011] Build status: STARTED
[09:50:46.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:54:0) after 3m8s
[09:53:54.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:54:0)
[09:53:54.177] Build status: STARTED
[09:53:54.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:55:0) after 1m44s
[09:55:38.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:55:0)
[09:55:38.383] Build status: STARTED
[09:55:38.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:56:0) after 9m18s
[10:04:56.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:56:0)
[10:04:56.522] Build status: STARTED
[10:04:56.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:57:0) after 3m26s
[10:08:22.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:57:0)
[10:08:22.610] Build status: STARTED
[10:08:22.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954279910486378448:58:0) after 7m24s
[10:15:07.060] Received PubSub notification, asking Buildbucket for the build status
[10:15:07.084] Build:
{
"id": "8788849845864175681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28961,
"createdBy": "project:chromium",
"createTime": "2023-02-18T05:04:13.456208626Z",
"startTime": "2023-02-18T05:06:51.914668Z",
"endTime": "2023-02-18T10:15:06.805285049Z",
"updateTime": "2023-02-18T10:15:06.805285049Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "934726889d2f038d6ee952d77e1048a30e7053e1",
"ref": "refs/heads/main"
}
}
}
[10:15:07.084] Invocation finished in 5h10m57.420148053s with status FAILED