[20:44:25.226] New invocation is queued and will start shortly
[20:44:26.362] Starting the invocation (attempt 1)
[20:44:26.390] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/095c532cf336015882bb65015bddbc5424459172"
[20:44:26.390] Popped gitiles commit info from properties and tags
[20:44:26.390] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:44:26.390] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:44:26.390] Buildbucket request:
{
"requestId": "8940178224701481552",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "095c532cf336015882bb65015bddbc5424459172",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8940178224701481552"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:44:26.971] Scheduled build:
{
"id": "8774748162730456785",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30032,
"createdBy": "project:chromium",
"createTime": "2023-07-23T20:44:26.479915510Z",
"updateTime": "2023-07-23T20:44:26.479915510Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "095c532cf336015882bb65015bddbc5424459172",
"ref": "refs/heads/main"
}
}
}
[20:44:26.971] Task URL: https://cr-buildbucket.appspot.com/build/8774748162730456785
[20:44:26.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:2:0) after 5m15s
[20:44:27.883] Received PubSub notification, asking Buildbucket for the build status
[20:44:27.900] Build status: SCHEDULED
[20:47:41.888] Received PubSub notification, asking Buildbucket for the build status
[20:47:41.949] Build status: STARTED
[20:49:42.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:2:0)
[20:49:42.069] Build status: STARTED
[20:49:42.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:5:0) after 7m20s
[20:57:02.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:5:0)
[20:57:02.207] Build status: STARTED
[20:57:02.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:6:0) after 6m49s
[21:03:51.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:6:0)
[21:03:51.317] Build status: STARTED
[21:03:51.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:7:0) after 3m31s
[21:07:22.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:7:0)
[21:07:22.426] Build status: STARTED
[21:07:22.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:8:0) after 2m40s
[21:10:02.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:8:0)
[21:10:02.480] Build status: STARTED
[21:10:02.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:9:0) after 5m10s
[21:15:12.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:9:0)
[21:15:12.527] Build status: STARTED
[21:15:12.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:10:0) after 3m3s
[21:18:15.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:10:0)
[21:18:15.564] Build status: STARTED
[21:18:15.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:11:0) after 2m24s
[21:20:39.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:11:0)
[21:20:39.609] Build status: STARTED
[21:20:39.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:12:0) after 6m52s
[21:27:31.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:12:0)
[21:27:31.639] Build status: STARTED
[21:27:31.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:13:0) after 6m0s
[21:33:31.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:13:0)
[21:33:31.736] Build status: STARTED
[21:33:31.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:14:0) after 4m40s
[21:38:11.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:14:0)
[21:38:11.914] Build status: STARTED
[21:38:11.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:15:0) after 9m5s
[21:47:16.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:15:0)
[21:47:17.007] Build status: STARTED
[21:47:17.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:16:0) after 5m35s
[21:52:52.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:16:0)
[21:52:52.071] Build status: STARTED
[21:52:52.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:17:0) after 7m28s
[22:00:20.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:17:0)
[22:00:20.354] Build status: STARTED
[22:00:20.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:18:0) after 8m41s
[22:09:01.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:18:0)
[22:09:01.411] Build status: STARTED
[22:09:01.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:19:0) after 9m10s
[22:18:11.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:19:0)
[22:18:11.445] Build status: STARTED
[22:18:11.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:20:0) after 9m40s
[22:27:51.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:20:0)
[22:27:51.482] Build status: STARTED
[22:27:51.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:21:0) after 2m11s
[22:30:02.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:21:0)
[22:30:02.569] Build status: STARTED
[22:30:02.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:22:0) after 7m2s
[22:37:04.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:22:0)
[22:37:04.638] Build status: STARTED
[22:37:04.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:23:0) after 9m22s
[22:46:26.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:23:0)
[22:46:26.690] Build status: STARTED
[22:46:26.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:24:0) after 5m2s
[22:51:28.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:24:0)
[22:51:28.931] Build status: STARTED
[22:51:28.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:25:0) after 7m15s
[22:58:44.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:25:0)
[22:58:44.101] Build status: STARTED
[22:58:44.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:26:0) after 1m58s
[23:00:42.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:26:0)
[23:00:42.333] Build status: STARTED
[23:00:42.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:27:0) after 6m19s
[23:07:01.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:27:0)
[23:07:01.607] Build status: STARTED
[23:07:01.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:28:0) after 8m51s
[23:15:52.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:28:0)
[23:15:52.713] Build status: STARTED
[23:15:52.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:29:0) after 4m19s
[23:20:12.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:29:0)
[23:20:12.151] Build status: STARTED
[23:20:12.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:30:0) after 6m23s
[23:26:35.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:30:0)
[23:26:35.205] Build status: STARTED
[23:26:35.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:31:0) after 3m55s
[23:30:30.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:31:0)
[23:30:30.245] Build status: STARTED
[23:30:30.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:32:0) after 9m1s
[23:39:31.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:32:0)
[23:39:31.317] Build status: STARTED
[23:39:31.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:33:0) after 4m52s
[23:44:23.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:33:0)
[23:44:23.555] Build status: STARTED
[23:44:23.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:34:0) after 9m10s
[23:53:33.632] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:34:0)
[23:53:33.651] Build status: STARTED
[23:53:33.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:35:0) after 6m35s
[00:00:08.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:35:0)
[00:00:08.728] Build status: STARTED
[00:00:08.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:36:0) after 2m48s
[00:02:56.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:36:0)
[00:02:56.839] Build status: STARTED
[00:02:56.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:37:0) after 2m6s
[00:05:02.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:37:0)
[00:05:02.883] Build status: STARTED
[00:05:02.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:38:0) after 8m9s
[00:13:11.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:38:0)
[00:13:11.987] Build status: STARTED
[00:13:11.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:39:0) after 2m20s
[00:15:32.021] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:39:0)
[00:15:32.041] Build status: STARTED
[00:15:32.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:40:0) after 9m14s
[00:24:46.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:40:0)
[00:24:46.214] Build status: STARTED
[00:24:46.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:41:0) after 9m52s
[00:34:38.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:41:0)
[00:34:38.321] Build status: STARTED
[00:34:38.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:42:0) after 2m40s
[00:37:18.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:42:0)
[00:37:18.349] Build status: STARTED
[00:37:18.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:43:0) after 2m57s
[00:40:15.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:43:0)
[00:40:15.369] Build status: STARTED
[00:40:15.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:44:0) after 7m52s
[00:48:07.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:44:0)
[00:48:07.643] Build status: STARTED
[00:48:07.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:45:0) after 4m0s
[00:52:07.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:45:0)
[00:52:07.876] Build status: STARTED
[00:52:07.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:46:0) after 8m37s
[01:00:44.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:46:0)
[01:00:44.928] Build status: STARTED
[01:00:44.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:47:0) after 2m2s
[01:02:46.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:47:0)
[01:02:46.998] Build status: STARTED
[01:02:46.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:48:0) after 6m30s
[01:09:17.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:48:0)
[01:09:17.059] Build status: STARTED
[01:09:17.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:49:0) after 3m14s
[01:12:31.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:49:0)
[01:12:31.149] Build status: STARTED
[01:12:31.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:50:0) after 4m24s
[01:16:55.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:50:0)
[01:16:55.514] Build status: STARTED
[01:16:55.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:51:0) after 8m6s
[01:25:01.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:51:0)
[01:25:01.568] Build status: STARTED
[01:25:01.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:52:0) after 4m43s
[01:29:44.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:52:0)
[01:29:44.674] Build status: STARTED
[01:29:44.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:53:0) after 2m39s
[01:32:23.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:53:0)
[01:32:23.945] Build status: STARTED
[01:32:23.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:54:0) after 4m4s
[01:36:28.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:54:0)
[01:36:28.092] Build status: STARTED
[01:36:28.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:55:0) after 8m41s
[01:45:09.124] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:55:0)
[01:45:09.180] Build status: STARTED
[01:45:09.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:56:0) after 6m6s
[01:51:15.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:56:0)
[01:51:15.301] Build status: STARTED
[01:51:15.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:57:0) after 1m28s
[01:52:43.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:57:0)
[01:52:43.457] Build status: STARTED
[01:52:43.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:58:0) after 5m36s
[01:58:19.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:58:0)
[01:58:19.603] Build status: STARTED
[01:58:19.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:59:0) after 5m43s
[02:04:02.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:59:0)
[02:04:02.677] Build status: STARTED
[02:04:02.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:60:0) after 2m32s
[02:06:34.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:60:0)
[02:06:34.724] Build status: STARTED
[02:06:34.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:61:0) after 7m4s
[02:13:38.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:61:0)
[02:13:38.769] Build status: STARTED
[02:13:38.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:62:0) after 7m46s
[02:21:24.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:62:0)
[02:21:24.960] Build status: STARTED
[02:21:24.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940178224701481552:63:0) after 5m4s
[02:24:23.503] Received PubSub notification, asking Buildbucket for the build status
[02:24:23.524] Build:
{
"id": "8774748162730456785",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30032,
"createdBy": "project:chromium",
"createTime": "2023-07-23T20:44:26.479915510Z",
"startTime": "2023-07-23T20:47:41.390613Z",
"endTime": "2023-07-24T02:24:02.761459932Z",
"updateTime": "2023-07-24T02:24:02.761459932Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "095c532cf336015882bb65015bddbc5424459172",
"ref": "refs/heads/main"
}
}
}
[02:24:23.524] Invocation finished in 5h39m58.308805212s with status FAILED