[21:04:09.303] New invocation is queued and will start shortly
[21:04:10.749] Starting the invocation (attempt 1)
[21:04:10.786] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/83049f88aa99bbdac5ec9bd8f234c966be9c531e"
[21:04:10.786] Popped gitiles commit info from properties and tags
[21:04:10.786] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:04:10.786] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:04:10.786] Buildbucket request:
{
"requestId": "8997524862843054624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "83049f88aa99bbdac5ec9bd8f234c966be9c531e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8997524862843054624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:04:11.397] Scheduled build:
{
"id": "8832094800555288913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23477,
"createdBy": "project:chromium",
"createTime": "2021-10-28T21:04:10.853148165Z",
"updateTime": "2021-10-28T21:04:10.853148165Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "83049f88aa99bbdac5ec9bd8f234c966be9c531e",
"ref": "refs/heads/main"
}
}
}
[21:04:11.397] Task URL: https://cr-buildbucket.appspot.com/build/8832094800555288913
[21:04:11.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:2:0) after 9m6s
[21:06:40.913] Received PubSub notification, asking Buildbucket for the build status
[21:06:40.947] Build status: STARTED
[21:13:17.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:2:0)
[21:13:17.484] Build status: STARTED
[21:13:17.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:4:0) after 2m51s
[21:16:08.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:4:0)
[21:16:08.530] Build status: STARTED
[21:16:08.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:5:0) after 9m33s
[21:25:41.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:5:0)
[21:25:41.700] Build status: STARTED
[21:25:41.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:6:0) after 1m45s
[21:27:26.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:6:0)
[21:27:26.755] Build status: STARTED
[21:27:26.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:7:0) after 9m6s
[21:36:32.781] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:7:0)
[21:36:32.814] Build status: STARTED
[21:36:32.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:8:0) after 7m47s
[21:44:19.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:8:0)
[21:44:19.907] Build status: STARTED
[21:44:19.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:9:0) after 9m33s
[21:53:53.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:9:0)
[21:53:53.090] Build status: STARTED
[21:53:53.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:10:0) after 3m23s
[21:57:16.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:10:0)
[21:57:16.301] Build status: STARTED
[21:57:16.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:11:0) after 3m35s
[22:00:51.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:11:0)
[22:00:51.462] Build status: STARTED
[22:00:51.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:12:0) after 4m51s
[22:05:42.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:12:0)
[22:05:42.733] Build status: STARTED
[22:05:42.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:13:0) after 2m2s
[22:07:44.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:13:0)
[22:07:44.793] Build status: STARTED
[22:07:44.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:14:0) after 8m36s
[22:16:20.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:14:0)
[22:16:20.917] Build status: STARTED
[22:16:20.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:15:0) after 9m21s
[22:25:42.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:15:0)
[22:25:42.089] Build status: STARTED
[22:25:42.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:16:0) after 2m3s
[22:27:45.275] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:16:0)
[22:27:45.307] Build status: STARTED
[22:27:45.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:17:0) after 8m11s
[22:35:56.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:17:0)
[22:35:56.567] Build status: STARTED
[22:35:56.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:18:0) after 2m43s
[22:38:39.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:18:0)
[22:38:39.732] Build status: STARTED
[22:38:39.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:19:0) after 4m37s
[22:43:17.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:19:0)
[22:43:17.130] Build status: STARTED
[22:43:17.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:20:0) after 3m41s
[22:46:58.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:20:0)
[22:46:58.271] Build status: STARTED
[22:46:58.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:21:0) after 4m47s
[22:51:45.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:21:0)
[22:51:45.310] Build status: STARTED
[22:51:45.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:22:0) after 1m33s
[22:53:18.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:22:0)
[22:53:18.432] Build status: STARTED
[22:53:18.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:23:0) after 5m2s
[22:58:20.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:23:0)
[22:58:20.564] Build status: STARTED
[22:58:20.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:24:0) after 5m38s
[23:03:58.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:24:0)
[23:03:58.791] Build status: STARTED
[23:03:58.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:25:0) after 2m4s
[23:06:02.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:25:0)
[23:06:02.869] Build status: STARTED
[23:06:02.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:26:0) after 5m42s
[23:11:44.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:26:0)
[23:11:44.927] Build status: STARTED
[23:11:44.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:27:0) after 7m47s
[23:19:32.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:27:0)
[23:19:32.238] Build status: STARTED
[23:19:32.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:28:0) after 3m3s
[23:22:35.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:28:0)
[23:22:35.386] Build status: STARTED
[23:22:35.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:29:0) after 5m48s
[23:28:23.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:29:0)
[23:28:23.587] Build status: STARTED
[23:28:23.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:30:0) after 6m15s
[23:34:38.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:30:0)
[23:34:38.642] Build status: STARTED
[23:34:38.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:31:0) after 2m5s
[23:36:43.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:31:0)
[23:36:43.753] Build status: STARTED
[23:36:43.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:32:0) after 7m28s
[23:44:11.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:32:0)
[23:44:11.936] Build status: STARTED
[23:44:11.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:33:0) after 5m24s
[23:49:35.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:33:0)
[23:49:36.089] Build status: STARTED
[23:49:36.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:34:0) after 7m2s
[23:56:38.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:34:0)
[23:56:38.176] Build status: STARTED
[23:56:38.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:35:0) after 9m11s
[00:05:49.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:35:0)
[00:05:49.513] Build status: STARTED
[00:05:49.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:36:0) after 5m29s
[00:11:18.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:36:0)
[00:11:18.752] Build status: STARTED
[00:11:18.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:37:0) after 9m32s
[00:20:50.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:37:0)
[00:20:50.915] Build status: STARTED
[00:20:50.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:38:0) after 7m19s
[00:28:09.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:38:0)
[00:28:09.971] Build status: STARTED
[00:28:09.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:39:0) after 6m26s
[00:34:36.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:39:0)
[00:34:36.036] Build status: STARTED
[00:34:36.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:40:0) after 8m43s
[00:43:19.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:40:0)
[00:43:19.111] Build status: STARTED
[00:43:19.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:41:0) after 8m22s
[00:51:41.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:41:0)
[00:51:41.216] Build status: STARTED
[00:51:41.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:42:0) after 8m49s
[01:00:30.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:42:0)
[01:00:30.526] Build status: STARTED
[01:00:30.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:43:0) after 8m59s
[01:09:29.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:43:0)
[01:09:29.957] Build status: STARTED
[01:09:29.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:44:0) after 8m58s
[01:18:28.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:44:0)
[01:18:28.136] Build status: STARTED
[01:18:28.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:45:0) after 1m38s
[01:20:06.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:45:0)
[01:20:06.298] Build status: STARTED
[01:20:06.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:46:0) after 9m15s
[01:29:21.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:46:0)
[01:29:21.478] Build status: STARTED
[01:29:21.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:47:0) after 1m6s
[01:30:27.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:47:0)
[01:30:27.650] Build status: STARTED
[01:30:27.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:48:0) after 3m17s
[01:33:44.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:48:0)
[01:33:44.848] Build status: STARTED
[01:33:44.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:49:0) after 4m52s
[01:38:37.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:49:0)
[01:38:37.254] Build status: STARTED
[01:38:37.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:50:0) after 3m43s
[01:42:20.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:50:0)
[01:42:20.347] Build status: STARTED
[01:42:20.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:51:0) after 6m0s
[01:48:20.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:51:0)
[01:48:20.407] Build status: STARTED
[01:48:20.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:52:0) after 6m36s
[01:54:56.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:52:0)
[01:54:56.461] Build status: STARTED
[01:54:56.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:53:0) after 5m10s
[02:00:06.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:53:0)
[02:00:06.554] Build status: STARTED
[02:00:06.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:54:0) after 8m17s
[02:08:23.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:54:0)
[02:08:23.618] Build status: STARTED
[02:08:23.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:55:0) after 3m23s
[02:11:46.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:55:0)
[02:11:46.780] Build status: STARTED
[02:11:46.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:56:0) after 3m30s
[02:15:16.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:56:0)
[02:15:16.928] Build status: STARTED
[02:15:16.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:57:0) after 4m55s
[02:20:12.021] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:57:0)
[02:20:12.052] Build status: STARTED
[02:20:12.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997524862843054624:58:0) after 2m10s
[02:20:24.009] Received PubSub notification, asking Buildbucket for the build status
[02:20:24.041] Build:
{
"id": "8832094800555288913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23477,
"createdBy": "project:chromium",
"createTime": "2021-10-28T21:04:10.853148165Z",
"startTime": "2021-10-28T21:06:39.117631Z",
"endTime": "2021-10-29T02:20:23.591399821Z",
"updateTime": "2021-10-29T02:20:23.591399821Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "83049f88aa99bbdac5ec9bd8f234c966be9c531e",
"ref": "refs/heads/main"
}
}
}
[02:20:24.041] Invocation finished in 5h16m14.753277271s with status FAILED