[17:30:12.990] New invocation is queued and will start shortly
[17:30:14.138] Starting the invocation (attempt 1)
[17:30:14.171] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/185a844b6481028e1ba70e0354a4c4737d44ae4e"
[17:30:14.171] Popped gitiles commit info from properties and tags
[17:30:14.171] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:30:14.171] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:30:14.171] Buildbucket request:
{
"requestId": "8941458800496154112",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "185a844b6481028e1ba70e0354a4c4737d44ae4e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941458800496154112"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:30:14.650] Scheduled build:
{
"id": "8776028738463405345",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29883,
"createdBy": "project:chromium",
"createTime": "2023-07-09T17:30:14.292698215Z",
"updateTime": "2023-07-09T17:30:14.292698215Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "185a844b6481028e1ba70e0354a4c4737d44ae4e",
"ref": "refs/heads/main"
}
}
}
[17:30:14.650] Task URL: https://cr-buildbucket.appspot.com/build/8776028738463405345
[17:30:14.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:2:0) after 7m19s
[17:33:40.856] Received PubSub notification, asking Buildbucket for the build status
[17:33:40.876] Build status: STARTED
[17:37:33.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:2:0)
[17:37:33.955] Build status: STARTED
[17:37:33.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:4:0) after 1m48s
[17:39:22.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:4:0)
[17:39:22.131] Build status: STARTED
[17:39:22.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:5:0) after 2m39s
[17:42:01.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:5:0)
[17:42:01.184] Build status: STARTED
[17:42:01.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:6:0) after 5m48s
[17:47:49.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:6:0)
[17:47:49.242] Build status: STARTED
[17:47:49.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:7:0) after 1m12s
[17:49:01.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:7:0)
[17:49:01.274] Build status: STARTED
[17:49:01.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:8:0) after 6m17s
[17:55:18.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:8:0)
[17:55:18.366] Build status: STARTED
[17:55:18.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:9:0) after 7m46s
[18:03:04.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:9:0)
[18:03:04.460] Build status: STARTED
[18:03:04.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:10:0) after 6m53s
[18:09:57.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:10:0)
[18:09:57.479] Build status: STARTED
[18:09:57.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:11:0) after 4m44s
[18:14:41.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:11:0)
[18:14:41.515] Build status: STARTED
[18:14:41.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:12:0) after 4m28s
[18:19:09.557] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:12:0)
[18:19:09.576] Build status: STARTED
[18:19:09.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:13:0) after 9m57s
[18:29:06.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:13:0)
[18:29:06.628] Build status: STARTED
[18:29:06.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:14:0) after 8m52s
[18:37:58.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:14:0)
[18:37:58.713] Build status: STARTED
[18:37:58.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:15:0) after 4m11s
[18:42:09.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:15:0)
[18:42:09.733] Build status: STARTED
[18:42:09.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:16:0) after 1m26s
[18:43:35.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:16:0)
[18:43:35.783] Build status: STARTED
[18:43:35.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:17:0) after 4m32s
[18:48:07.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:17:0)
[18:48:07.817] Build status: STARTED
[18:48:07.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:18:0) after 1m47s
[18:49:55.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:18:0)
[18:49:55.043] Build status: STARTED
[18:49:55.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:19:0) after 8m31s
[18:58:26.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:19:0)
[18:58:26.766] Build status: STARTED
[18:58:26.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:20:0) after 8m26s
[19:06:52.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:20:0)
[19:06:52.911] Build status: STARTED
[19:06:52.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:21:0) after 7m23s
[19:14:15.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:21:0)
[19:14:15.951] Build status: STARTED
[19:14:15.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:22:0) after 7m45s
[19:22:00.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:22:0)
[19:22:00.989] Build status: STARTED
[19:22:00.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:23:0) after 3m13s
[19:25:14.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:23:0)
[19:25:14.289] Build status: STARTED
[19:25:14.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:24:0) after 6m4s
[19:31:18.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:24:0)
[19:31:18.431] Build status: STARTED
[19:31:18.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:25:0) after 2m35s
[19:33:53.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:25:0)
[19:33:53.475] Build status: STARTED
[19:33:53.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:26:0) after 8m14s
[19:42:07.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:26:0)
[19:42:07.570] Build status: STARTED
[19:42:07.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:27:0) after 6m44s
[19:48:51.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:27:0)
[19:48:51.644] Build status: STARTED
[19:48:51.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:28:0) after 2m5s
[19:50:56.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:28:0)
[19:50:56.907] Build status: STARTED
[19:50:56.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:29:0) after 4m7s
[19:55:03.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:29:0)
[19:55:03.952] Build status: STARTED
[19:55:03.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:30:0) after 1m10s
[19:56:14.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:30:0)
[19:56:14.184] Build status: STARTED
[19:56:14.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:31:0) after 1m7s
[19:57:21.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:31:0)
[19:57:21.402] Build status: STARTED
[19:57:21.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:32:0) after 7m7s
[20:04:28.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:32:0)
[20:04:28.615] Build status: STARTED
[20:04:28.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:33:0) after 5m7s
[20:09:35.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:33:0)
[20:09:35.825] Build status: STARTED
[20:09:35.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:34:0) after 9m44s
[20:19:20.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:34:0)
[20:19:20.171] Build status: STARTED
[20:19:20.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:35:0) after 3m15s
[20:22:35.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:35:0)
[20:22:35.215] Build status: STARTED
[20:22:35.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:36:0) after 9m15s
[20:31:50.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:36:0)
[20:31:50.622] Build status: STARTED
[20:31:50.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:37:0) after 8m26s
[20:40:16.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:37:0)
[20:40:16.659] Build status: STARTED
[20:40:16.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:38:0) after 3m11s
[20:43:27.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:38:0)
[20:43:27.819] Build status: STARTED
[20:43:27.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:39:0) after 7m16s
[20:50:44.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:39:0)
[20:50:44.039] Build status: STARTED
[20:50:44.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:40:0) after 9m46s
[21:00:30.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:40:0)
[21:00:30.340] Build status: STARTED
[21:00:30.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:41:0) after 7m59s
[21:08:29.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:41:0)
[21:08:29.456] Build status: STARTED
[21:08:29.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:42:0) after 2m22s
[21:10:51.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:42:0)
[21:10:51.489] Build status: STARTED
[21:10:51.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:43:0) after 3m24s
[21:14:15.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:43:0)
[21:14:15.534] Build status: STARTED
[21:14:15.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:44:0) after 2m59s
[21:17:14.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:44:0)
[21:17:14.932] Build status: STARTED
[21:17:14.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:45:0) after 7m16s
[21:24:31.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:45:0)
[21:24:31.108] Build status: STARTED
[21:24:31.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:46:0) after 5m8s
[21:29:39.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:46:0)
[21:29:39.138] Build status: STARTED
[21:29:39.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:47:0) after 5m43s
[21:35:22.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:47:0)
[21:35:22.627] Build status: STARTED
[21:35:22.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:48:0) after 4m18s
[21:39:40.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:48:0)
[21:39:40.812] Build status: STARTED
[21:39:40.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:49:0) after 9m2s
[21:48:42.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:49:0)
[21:48:42.873] Build status: STARTED
[21:48:42.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:50:0) after 7m52s
[21:56:34.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:50:0)
[21:56:34.914] Build status: STARTED
[21:56:34.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:51:0) after 8m17s
[22:04:51.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:51:0)
[22:04:51.946] Build status: STARTED
[22:04:51.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:52:0) after 6m54s
[22:11:46.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:52:0)
[22:11:46.133] Build status: STARTED
[22:11:46.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:53:0) after 6m1s
[22:17:47.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:53:0)
[22:17:47.374] Build status: STARTED
[22:17:47.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:54:0) after 9m23s
[22:27:10.523] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:54:0)
[22:27:10.553] Build status: STARTED
[22:27:10.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:55:0) after 5m17s
[22:32:27.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:55:0)
[22:32:27.771] Build status: STARTED
[22:32:27.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:56:0) after 3m52s
[22:36:19.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:56:0)
[22:36:19.811] Build status: STARTED
[22:36:19.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:57:0) after 7m39s
[22:43:58.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:57:0)
[22:43:58.850] Build status: STARTED
[22:43:58.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:58:0) after 5m39s
[22:49:37.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:58:0)
[22:49:38.071] Build status: STARTED
[22:49:38.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:59:0) after 6m44s
[22:56:22.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:59:0)
[22:56:22.110] Build status: STARTED
[22:56:22.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:60:0) after 3m11s
[22:59:33.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:60:0)
[22:59:33.150] Build status: STARTED
[22:59:33.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:61:0) after 9m30s
[23:09:03.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:61:0)
[23:09:03.920] Build status: STARTED
[23:09:03.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:62:0) after 4m39s
[23:13:42.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:62:0)
[23:13:42.961] Build status: STARTED
[23:13:42.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941458800496154112:63:0) after 7m13s
[23:14:24.868] Received PubSub notification, asking Buildbucket for the build status
[23:14:24.920] Build:
{
"id": "8776028738463405345",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29883,
"createdBy": "project:chromium",
"createTime": "2023-07-09T17:30:14.292698215Z",
"startTime": "2023-07-09T17:33:40.357165Z",
"endTime": "2023-07-09T23:14:24.557511639Z",
"updateTime": "2023-07-09T23:14:24.557511639Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "185a844b6481028e1ba70e0354a4c4737d44ae4e",
"ref": "refs/heads/main"
}
}
}
[23:14:24.920] Invocation finished in 5h44m11.949228784s with status FAILED