[19:35:12.126] New invocation is queued and will start shortly
[19:35:13.212] Starting the invocation (attempt 1)
[19:35:13.245] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8e027bc8c9c928cb68b87566be5181757d191d85"
[19:35:13.245] Popped gitiles commit info from properties and tags
[19:35:13.245] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:35:13.245] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:35:13.245] Buildbucket request:
{
"requestId": "8948608097422431968",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e027bc8c9c928cb68b87566be5181757d191d85",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8948608097422431968"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:35:13.735] Scheduled build:
{
"id": "8783178035483058161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29295,
"createdBy": "project:chromium",
"createTime": "2023-04-21T19:35:13.344159187Z",
"updateTime": "2023-04-21T19:35:13.344159187Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e027bc8c9c928cb68b87566be5181757d191d85",
"ref": "refs/heads/main"
}
}
}
[19:35:13.735] Task URL: https://cr-buildbucket.appspot.com/build/8783178035483058161
[19:35:13.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:2:0) after 2m43s
[19:37:57.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:2:0)
[19:37:57.267] Build status: SCHEDULED
[19:37:57.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:3:0) after 6m4s
[19:38:03.091] Received PubSub notification, asking Buildbucket for the build status
[19:38:03.122] Build status: STARTED
[19:44:01.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:3:0)
[19:44:01.317] Build status: STARTED
[19:44:01.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:5:0) after 7m30s
[19:51:31.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:5:0)
[19:51:31.360] Build status: STARTED
[19:51:31.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:6:0) after 3m17s
[19:54:48.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:6:0)
[19:54:48.571] Build status: STARTED
[19:54:48.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:7:0) after 2m39s
[19:57:27.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:7:0)
[19:57:27.608] Build status: STARTED
[19:57:27.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:8:0) after 6m54s
[20:04:21.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:8:0)
[20:04:21.971] Build status: STARTED
[20:04:21.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:9:0) after 8m17s
[20:12:39.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:9:0)
[20:12:39.078] Build status: STARTED
[20:12:39.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:10:0) after 3m35s
[20:16:14.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:10:0)
[20:16:14.504] Build status: STARTED
[20:16:14.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:11:0) after 3m20s
[20:19:34.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:11:0)
[20:19:34.549] Build status: STARTED
[20:19:34.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:12:0) after 7m28s
[20:27:02.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:12:0)
[20:27:02.648] Build status: STARTED
[20:27:02.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:13:0) after 3m55s
[20:30:57.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:13:0)
[20:30:57.722] Build status: STARTED
[20:30:57.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:14:0) after 8m48s
[20:39:45.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:14:0)
[20:39:45.777] Build status: STARTED
[20:39:45.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:15:0) after 9m48s
[20:49:34.150] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:15:0)
[20:49:34.171] Build status: STARTED
[20:49:34.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:16:0) after 3m23s
[20:52:57.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:16:0)
[20:52:57.215] Build status: STARTED
[20:52:57.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:17:0) after 3m11s
[20:56:08.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:17:0)
[20:56:08.465] Build status: STARTED
[20:56:08.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:18:0) after 5m50s
[21:01:58.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:18:0)
[21:01:58.857] Build status: STARTED
[21:01:58.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:19:0) after 1m8s
[21:03:06.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:19:0)
[21:03:06.860] Build status: STARTED
[21:03:06.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:20:0) after 6m50s
[21:09:57.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:20:0)
[21:09:57.101] Build status: STARTED
[21:09:57.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:21:0) after 7m42s
[21:17:39.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:21:0)
[21:17:39.230] Build status: STARTED
[21:17:39.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:22:0) after 5m55s
[21:23:34.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:22:0)
[21:23:34.282] Build status: STARTED
[21:23:34.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:23:0) after 8m37s
[21:32:11.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:23:0)
[21:32:11.470] Build status: STARTED
[21:32:11.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:24:0) after 7m48s
[21:39:59.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:24:0)
[21:39:59.513] Build status: STARTED
[21:39:59.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:25:0) after 2m23s
[21:42:22.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:25:0)
[21:42:22.717] Build status: STARTED
[21:42:22.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:26:0) after 4m42s
[21:47:04.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:26:0)
[21:47:04.758] Build status: STARTED
[21:47:04.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:27:0) after 7m56s
[21:55:00.974] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:27:0)
[21:55:00.997] Build status: STARTED
[21:55:00.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:28:0) after 2m20s
[21:57:21.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:28:0)
[21:57:21.052] Build status: STARTED
[21:57:21.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:29:0) after 1m15s
[21:58:36.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:29:0)
[21:58:36.086] Build status: STARTED
[21:58:36.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:30:0) after 4m5s
[22:02:41.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:30:0)
[22:02:41.295] Build status: STARTED
[22:02:41.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:31:0) after 2m7s
[22:04:48.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:31:0)
[22:04:48.437] Build status: STARTED
[22:04:48.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:32:0) after 1m26s
[22:06:14.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:32:0)
[22:06:14.598] Build status: STARTED
[22:06:14.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:33:0) after 9m20s
[22:15:34.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:33:0)
[22:15:34.736] Build status: STARTED
[22:15:34.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:34:0) after 5m53s
[22:21:27.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:34:0)
[22:21:27.856] Build status: STARTED
[22:21:27.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:35:0) after 3m18s
[22:24:45.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:35:0)
[22:24:45.995] Build status: STARTED
[22:24:45.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:36:0) after 7m11s
[22:31:57.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:36:0)
[22:31:57.041] Build status: STARTED
[22:31:57.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:37:0) after 6m20s
[22:38:17.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:37:0)
[22:38:17.090] Build status: STARTED
[22:38:17.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:38:0) after 7m55s
[22:46:12.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:38:0)
[22:46:12.293] Build status: STARTED
[22:46:12.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:39:0) after 6m37s
[22:52:49.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:39:0)
[22:52:49.448] Build status: STARTED
[22:52:49.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:40:0) after 4m35s
[22:57:24.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:40:0)
[22:57:24.733] Build status: STARTED
[22:57:24.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:41:0) after 4m5s
[23:01:29.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:41:0)
[23:01:29.808] Build status: STARTED
[23:01:29.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:42:0) after 3m10s
[23:04:40.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:42:0)
[23:04:40.365] Build status: STARTED
[23:04:40.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:43:0) after 2m52s
[23:07:32.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:43:0)
[23:07:32.438] Build status: STARTED
[23:07:32.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:44:0) after 9m58s
[23:17:30.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:44:0)
[23:17:30.450] Build status: STARTED
[23:17:30.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:45:0) after 6m1s
[23:23:31.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:45:0)
[23:23:31.955] Build status: STARTED
[23:23:31.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:46:0) after 3m15s
[23:26:47.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:46:0)
[23:26:47.910] Build status: STARTED
[23:26:47.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:47:0) after 3m0s
[23:29:47.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:47:0)
[23:29:48.049] Build status: STARTED
[23:29:48.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:48:0) after 6m49s
[23:36:37.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:48:0)
[23:36:37.200] Build status: STARTED
[23:36:37.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:49:0) after 6m9s
[23:42:46.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:49:0)
[23:42:46.302] Build status: STARTED
[23:42:46.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:50:0) after 6m23s
[23:49:09.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:50:0)
[23:49:09.493] Build status: STARTED
[23:49:09.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:51:0) after 7m20s
[23:56:29.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:51:0)
[23:56:29.738] Build status: STARTED
[23:56:29.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:52:0) after 7m34s
[00:04:03.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:52:0)
[00:04:03.818] Build status: STARTED
[00:04:03.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:53:0) after 8m7s
[00:12:10.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:53:0)
[00:12:10.903] Build status: STARTED
[00:12:10.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:54:0) after 3m30s
[00:15:41.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:54:0)
[00:15:41.057] Build status: STARTED
[00:15:41.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:55:0) after 5m36s
[00:21:17.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:55:0)
[00:21:17.183] Build status: STARTED
[00:21:17.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:56:0) after 6m2s
[00:27:19.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:56:0)
[00:27:19.585] Build status: STARTED
[00:27:19.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:57:0) after 1m43s
[00:29:02.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:57:0)
[00:29:02.650] Build status: STARTED
[00:29:02.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:58:0) after 3m9s
[00:32:11.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:58:0)
[00:32:11.928] Build status: STARTED
[00:32:11.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:59:0) after 5m40s
[00:37:51.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:59:0)
[00:37:52.068] Build status: STARTED
[00:37:52.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:60:0) after 1m20s
[00:39:12.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:60:0)
[00:39:12.292] Build status: STARTED
[00:39:12.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:61:0) after 4m25s
[00:43:37.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:61:0)
[00:43:37.358] Build status: STARTED
[00:43:37.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8948608097422431968:62:0) after 9m3s
[00:49:51.428] Received PubSub notification, asking Buildbucket for the build status
[00:49:51.450] Build:
{
"id": "8783178035483058161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29295,
"createdBy": "project:chromium",
"createTime": "2023-04-21T19:35:13.344159187Z",
"startTime": "2023-04-21T19:38:01.407735Z",
"endTime": "2023-04-22T00:49:51.094373660Z",
"updateTime": "2023-04-22T00:49:51.094373660Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e027bc8c9c928cb68b87566be5181757d191d85",
"ref": "refs/heads/main"
}
}
}
[00:49:51.450] Invocation finished in 5h14m39.339685084s with status FAILED