[08:59:48.827] New invocation is queued and will start shortly
[08:59:50.021] Starting the invocation (attempt 1)
[08:59:50.062] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/573f39f3fbee3431bee614889cc0646202896193"
[08:59:50.062] Popped gitiles commit info from properties and tags
[08:59:50.062] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:59:50.062] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:59:50.062] Buildbucket request:
{
"requestId": "8952634339111275744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "573f39f3fbee3431bee614889cc0646202896193",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952634339111275744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:59:50.602] Scheduled build:
{
"id": "8787204276978386561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29041,
"createdBy": "project:chromium",
"createTime": "2023-03-08T08:59:50.238880503Z",
"updateTime": "2023-03-08T08:59:50.238880503Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "573f39f3fbee3431bee614889cc0646202896193",
"ref": "refs/heads/main"
}
}
}
[08:59:50.602] Task URL: https://cr-buildbucket.appspot.com/build/8787204276978386561
[08:59:50.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:2:0) after 4m49s
[09:02:35.830] Received PubSub notification, asking Buildbucket for the build status
[09:02:35.867] Build status: STARTED
[09:04:39.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:2:0)
[09:04:39.773] Build status: STARTED
[09:04:39.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:4:0) after 7m42s
[09:12:21.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:4:0)
[09:12:21.904] Build status: STARTED
[09:12:21.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:5:0) after 1m50s
[09:14:11.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:5:0)
[09:14:11.962] Build status: STARTED
[09:14:11.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:6:0) after 9m28s
[09:23:40.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:6:0)
[09:23:40.071] Build status: STARTED
[09:23:40.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:7:0) after 3m27s
[09:27:07.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:7:0)
[09:27:07.307] Build status: STARTED
[09:27:07.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:8:0) after 6m14s
[09:33:21.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:8:0)
[09:33:21.344] Build status: STARTED
[09:33:21.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:9:0) after 1m53s
[09:35:14.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:9:0)
[09:35:14.483] Build status: STARTED
[09:35:14.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:10:0) after 7m22s
[09:42:36.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:10:0)
[09:42:36.675] Build status: STARTED
[09:42:36.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:11:0) after 1m59s
[09:44:35.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:11:0)
[09:44:35.886] Build status: STARTED
[09:44:35.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:12:0) after 6m53s
[09:51:29.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:12:0)
[09:51:29.086] Build status: STARTED
[09:51:29.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:13:0) after 3m11s
[09:54:40.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:13:0)
[09:54:40.131] Build status: STARTED
[09:54:40.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:14:0) after 6m10s
[10:00:50.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:14:0)
[10:00:50.443] Build status: STARTED
[10:00:50.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:15:0) after 1m58s
[10:02:48.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:15:0)
[10:02:48.491] Build status: STARTED
[10:02:48.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:16:0) after 2m30s
[10:05:18.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:16:0)
[10:05:18.782] Build status: STARTED
[10:05:18.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:17:0) after 9m7s
[10:14:25.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:17:0)
[10:14:25.973] Build status: STARTED
[10:14:25.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:18:0) after 4m11s
[10:18:37.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:18:0)
[10:18:37.052] Build status: STARTED
[10:18:37.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:19:0) after 9m10s
[10:27:47.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:19:0)
[10:27:47.267] Build status: STARTED
[10:27:47.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:20:0) after 6m49s
[10:34:36.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:20:0)
[10:34:36.503] Build status: STARTED
[10:34:36.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:21:0) after 7m50s
[10:42:26.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:21:0)
[10:42:26.557] Build status: STARTED
[10:42:26.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:22:0) after 5m33s
[10:47:59.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:22:0)
[10:47:59.604] Build status: STARTED
[10:47:59.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:23:0) after 5m5s
[10:53:04.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:23:0)
[10:53:04.658] Build status: STARTED
[10:53:04.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:24:0) after 7m36s
[11:00:40.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:24:0)
[11:00:40.767] Build status: STARTED
[11:00:40.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:25:0) after 3m7s
[11:03:47.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:25:0)
[11:03:47.927] Build status: STARTED
[11:03:47.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:26:0) after 2m47s
[11:06:34.947] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:26:0)
[11:06:34.969] Build status: STARTED
[11:06:34.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:27:0) after 9m0s
[11:15:35.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:27:0)
[11:15:35.179] Build status: STARTED
[11:15:35.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:28:0) after 7m27s
[11:23:02.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:28:0)
[11:23:02.485] Build status: STARTED
[11:23:02.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:29:0) after 8m16s
[11:31:18.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:29:0)
[11:31:18.750] Build status: STARTED
[11:31:18.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:30:0) after 2m57s
[11:34:15.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:30:0)
[11:34:15.975] Build status: STARTED
[11:34:15.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:31:0) after 7m29s
[11:41:45.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:31:0)
[11:41:45.304] Build status: STARTED
[11:41:45.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:32:0) after 8m49s
[11:50:34.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:32:0)
[11:50:34.354] Build status: STARTED
[11:50:34.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:33:0) after 7m46s
[11:58:20.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:33:0)
[11:58:20.542] Build status: STARTED
[11:58:20.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:34:0) after 8m53s
[12:07:13.632] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:34:0)
[12:07:13.661] Build status: STARTED
[12:07:13.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:35:0) after 3m56s
[12:11:09.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:35:0)
[12:11:09.717] Build status: STARTED
[12:11:09.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:36:0) after 8m23s
[12:19:32.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:36:0)
[12:19:32.890] Build status: STARTED
[12:19:32.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:37:0) after 3m0s
[12:22:32.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:37:0)
[12:22:32.935] Build status: STARTED
[12:22:32.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:38:0) after 7m40s
[12:30:13.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:38:0)
[12:30:13.106] Build status: STARTED
[12:30:13.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:39:0) after 4m14s
[12:34:27.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:39:0)
[12:34:27.176] Build status: STARTED
[12:34:27.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:40:0) after 9m33s
[12:44:00.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:40:0)
[12:44:00.312] Build status: STARTED
[12:44:00.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:41:0) after 8m41s
[12:52:41.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:41:0)
[12:52:41.513] Build status: STARTED
[12:52:41.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:42:0) after 1m52s
[12:54:33.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:42:0)
[12:54:33.784] Build status: STARTED
[12:54:33.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:43:0) after 1m5s
[12:55:38.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:43:0)
[12:55:38.879] Build status: STARTED
[12:55:38.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:44:0) after 3m57s
[12:59:35.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:44:0)
[12:59:35.976] Build status: STARTED
[12:59:35.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:45:0) after 5m11s
[13:04:46.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:45:0)
[13:04:47.024] Build status: STARTED
[13:04:47.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:46:0) after 6m51s
[13:11:38.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:46:0)
[13:11:38.179] Build status: STARTED
[13:11:38.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:47:0) after 1m36s
[13:13:14.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:47:0)
[13:13:14.358] Build status: STARTED
[13:13:14.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:48:0) after 5m4s
[13:18:18.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:48:0)
[13:18:18.434] Build status: STARTED
[13:18:18.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:49:0) after 6m50s
[13:25:08.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:49:0)
[13:25:08.771] Build status: STARTED
[13:25:08.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:50:0) after 9m15s
[13:34:23.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:50:0)
[13:34:23.816] Build status: STARTED
[13:34:23.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:51:0) after 5m53s
[13:40:16.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:51:0)
[13:40:16.859] Build status: STARTED
[13:40:16.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:52:0) after 4m23s
[13:44:39.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:52:0)
[13:44:40.008] Build status: STARTED
[13:44:40.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:53:0) after 8m31s
[13:53:11.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:53:0)
[13:53:11.063] Build status: STARTED
[13:53:11.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:54:0) after 6m11s
[13:59:22.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:54:0)
[13:59:22.190] Build status: STARTED
[13:59:22.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952634339111275744:55:0) after 7m14s
[14:02:42.489] Received PubSub notification, asking Buildbucket for the build status
[14:02:42.513] Build:
{
"id": "8787204276978386561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29041,
"createdBy": "project:chromium",
"createTime": "2023-03-08T08:59:50.238880503Z",
"startTime": "2023-03-08T09:02:34.156756Z",
"endTime": "2023-03-08T14:02:42.232555028Z",
"updateTime": "2023-03-08T14:02:42.232555028Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "573f39f3fbee3431bee614889cc0646202896193",
"ref": "refs/heads/main"
}
}
}
[14:02:42.514] Invocation finished in 5h2m53.69392242s with status FAILED