[00:13:38.154] New invocation is queued and will start shortly
[00:13:39.233] Starting the invocation (attempt 1)
[00:13:39.271] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/33b7daa8965001b1fec08ad7bdd800199984bcd3"
[00:13:39.271] Popped gitiles commit info from properties and tags
[00:13:39.271] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:13:39.271] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:13:39.271] Buildbucket request:
{
"requestId": "9006029056581321344",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33b7daa8965001b1fec08ad7bdd800199984bcd3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9006029056581321344"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:13:39.871] Scheduled build:
{
"id": "8840598994658706096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22602,
"createdBy": "project:chromium",
"createTime": "2021-07-27T00:13:39.355515Z",
"updateTime": "2021-07-27T00:13:39.796850Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33b7daa8965001b1fec08ad7bdd800199984bcd3",
"ref": "refs/heads/main"
}
}
}
[00:13:39.871] Task URL: https://cr-buildbucket.appspot.com/build/8840598994658706096
[00:13:39.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:2:0) after 3m32s
[00:16:38.274] Received PubSub notification, asking Buildbucket for the build status
[00:16:38.302] Build status: STARTED
[00:17:11.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:2:0)
[00:17:11.886] Build status: STARTED
[00:17:11.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:4:0) after 5m9s
[00:22:21.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:4:0)
[00:22:21.296] Build status: STARTED
[00:22:21.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:5:0) after 4m49s
[00:27:10.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:5:0)
[00:27:10.411] Build status: STARTED
[00:27:10.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:6:0) after 8m28s
[00:35:38.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:6:0)
[00:35:38.546] Build status: STARTED
[00:35:38.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:7:0) after 7m39s
[00:43:17.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:7:0)
[00:43:17.615] Build status: STARTED
[00:43:17.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:8:0) after 5m48s
[00:49:05.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:8:0)
[00:49:05.677] Build status: STARTED
[00:49:05.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:9:0) after 8m19s
[00:57:24.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:9:0)
[00:57:24.829] Build status: STARTED
[00:57:24.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:10:0) after 3m20s
[01:00:45.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:10:0)
[01:00:45.064] Build status: STARTED
[01:00:45.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:11:0) after 1m32s
[01:02:17.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:11:0)
[01:02:17.222] Build status: STARTED
[01:02:17.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:12:0) after 5m56s
[01:08:13.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:12:0)
[01:08:13.566] Build status: STARTED
[01:08:13.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:13:0) after 9m29s
[01:17:42.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:13:0)
[01:17:42.628] Build status: STARTED
[01:17:42.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:14:0) after 9m40s
[01:27:22.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:14:0)
[01:27:22.701] Build status: STARTED
[01:27:22.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:15:0) after 2m36s
[01:29:58.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:15:0)
[01:29:58.909] Build status: STARTED
[01:29:58.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:16:0) after 1m53s
[01:31:52.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:16:0)
[01:31:52.042] Build status: STARTED
[01:31:52.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:17:0) after 5m42s
[01:37:34.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:17:0)
[01:37:34.358] Build status: STARTED
[01:37:34.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:18:0) after 5m19s
[01:42:53.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:18:0)
[01:42:53.977] Build status: STARTED
[01:42:53.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:19:0) after 7m5s
[01:49:59.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:19:0)
[01:49:59.031] Build status: STARTED
[01:49:59.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:20:0) after 4m6s
[01:54:05.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:20:0)
[01:54:05.130] Build status: STARTED
[01:54:05.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:21:0) after 8m53s
[02:02:58.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:21:0)
[02:02:58.466] Build status: STARTED
[02:02:58.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:22:0) after 3m25s
[02:06:23.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:22:0)
[02:06:23.566] Build status: STARTED
[02:06:23.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:23:0) after 2m47s
[02:09:10.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:23:0)
[02:09:10.863] Build status: STARTED
[02:09:10.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:24:0) after 5m11s
[02:14:22.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:24:0)
[02:14:22.039] Build status: STARTED
[02:14:22.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:25:0) after 8m49s
[02:23:11.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:25:0)
[02:23:11.099] Build status: STARTED
[02:23:11.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:26:0) after 4m25s
[02:27:36.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:26:0)
[02:27:36.158] Build status: STARTED
[02:27:36.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:27:0) after 5m51s
[02:33:27.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:27:0)
[02:33:27.362] Build status: STARTED
[02:33:27.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:28:0) after 1m2s
[02:34:29.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:28:0)
[02:34:29.558] Build status: STARTED
[02:34:29.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:29:0) after 7m16s
[02:41:45.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:29:0)
[02:41:45.796] Build status: STARTED
[02:41:45.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:30:0) after 1m17s
[02:43:02.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:30:0)
[02:43:02.941] Build status: STARTED
[02:43:02.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:31:0) after 5m46s
[02:48:49.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:31:0)
[02:48:49.414] Build status: STARTED
[02:48:49.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:32:0) after 3m21s
[02:52:10.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:32:0)
[02:52:10.595] Build status: STARTED
[02:52:10.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:33:0) after 9m7s
[03:01:17.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:33:0)
[03:01:17.681] Build status: STARTED
[03:01:17.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:34:0) after 5m22s
[03:06:39.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:34:0)
[03:06:39.735] Build status: STARTED
[03:06:39.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:35:0) after 5m5s
[03:11:45.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:35:0)
[03:11:45.062] Build status: STARTED
[03:11:45.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:36:0) after 6m39s
[03:18:24.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:36:0)
[03:18:24.227] Build status: STARTED
[03:18:24.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:37:0) after 1m7s
[03:19:31.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:37:0)
[03:19:31.280] Build status: STARTED
[03:19:31.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:38:0) after 5m24s
[03:24:55.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:38:0)
[03:24:55.606] Build status: STARTED
[03:24:55.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:39:0) after 4m55s
[03:29:50.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:39:0)
[03:29:50.663] Build status: STARTED
[03:29:50.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:40:0) after 5m44s
[03:35:34.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:40:0)
[03:35:34.858] Build status: STARTED
[03:35:34.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:41:0) after 9m34s
[03:45:08.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:41:0)
[03:45:08.930] Build status: STARTED
[03:45:08.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:42:0) after 8m23s
[03:53:31.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:42:0)
[03:53:31.960] Build status: STARTED
[03:53:31.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:43:0) after 2m11s
[03:55:43.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:43:0)
[03:55:43.083] Build status: STARTED
[03:55:43.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:44:0) after 9m14s
[04:04:57.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:44:0)
[04:04:57.254] Build status: STARTED
[04:04:57.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:45:0) after 8m14s
[04:13:11.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:45:0)
[04:13:11.341] Build status: STARTED
[04:13:11.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:46:0) after 8m49s
[04:22:00.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:46:0)
[04:22:00.490] Build status: STARTED
[04:22:00.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:47:0) after 5m38s
[04:27:38.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:47:0)
[04:27:38.547] Build status: STARTED
[04:27:38.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:48:0) after 3m37s
[04:31:15.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:48:0)
[04:31:15.620] Build status: STARTED
[04:31:15.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:49:0) after 8m31s
[04:39:46.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:49:0)
[04:39:46.681] Build status: STARTED
[04:39:46.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:50:0) after 5m16s
[04:45:02.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:50:0)
[04:45:02.783] Build status: STARTED
[04:45:02.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:51:0) after 5m52s
[04:50:54.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:51:0)
[04:50:54.863] Build status: STARTED
[04:50:54.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:52:0) after 3m25s
[04:54:19.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:52:0)
[04:54:19.926] Build status: STARTED
[04:54:19.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:53:0) after 4m27s
[04:58:47.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:53:0)
[04:58:47.202] Build status: STARTED
[04:58:47.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:54:0) after 9m30s
[05:08:17.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:54:0)
[05:08:17.266] Build status: STARTED
[05:08:17.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:55:0) after 3m44s
[05:12:01.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:55:0)
[05:12:01.364] Build status: STARTED
[05:12:01.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:56:0) after 6m57s
[05:18:58.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:56:0)
[05:18:58.419] Build status: STARTED
[05:18:58.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:57:0) after 2m20s
[05:21:18.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:57:0)
[05:21:18.470] Build status: STARTED
[05:21:18.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:58:0) after 7m7s
[05:28:25.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:58:0)
[05:28:25.542] Build status: STARTED
[05:28:25.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:59:0) after 6m48s
[05:35:13.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:59:0)
[05:35:13.616] Build status: STARTED
[05:35:13.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:60:0) after 1m20s
[05:36:33.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:60:0)
[05:36:33.682] Build status: STARTED
[05:36:33.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:61:0) after 5m38s
[05:42:11.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:61:0)
[05:42:11.779] Build status: STARTED
[05:42:11.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006029056581321344:62:0) after 3m3s
[05:43:32.130] Received PubSub notification, asking Buildbucket for the build status
[05:43:32.178] Build:
{
"id": "8840598994658706096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22602,
"createdBy": "project:chromium",
"createTime": "2021-07-27T00:13:39.355515Z",
"startTime": "2021-07-27T00:16:27.327701Z",
"endTime": "2021-07-27T05:43:31.896676734Z",
"updateTime": "2021-07-27T05:43:31.897212482Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33b7daa8965001b1fec08ad7bdd800199984bcd3",
"ref": "refs/heads/main"
}
}
}
[05:43:32.178] Invocation finished in 5h29m54.041069351s with status FAILED