[04:09:22.634] New invocation is queued and will start shortly
[04:09:23.711] Starting the invocation (attempt 1)
[04:09:23.753] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/54ecb5683d1ec8dc457dac61a5b83c4f5be97293"
[04:09:23.753] Popped gitiles commit info from properties and tags
[04:09:23.753] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:09:23.758] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:09:23.758] Buildbucket request:
{
"requestId": "9014802130759636048",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "54ecb5683d1ec8dc457dac61a5b83c4f5be97293",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9014802130759636048"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:09:24.772] Scheduled build:
{
"id": "8849372068367347712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21960,
"createdBy": "project:chromium",
"createTime": "2021-04-21T04:09:24.283524Z",
"updateTime": "2021-04-21T04:09:24.699477Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "54ecb5683d1ec8dc457dac61a5b83c4f5be97293",
"ref": "refs/heads/main"
}
}
}
[04:09:24.772] Task URL: https://cr-buildbucket.appspot.com/build/8849372068367347712
[04:09:24.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:2:0) after 2m26s
[04:11:50.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:2:0)
[04:11:50.871] Build status: SCHEDULED
[04:11:50.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:3:0) after 1m56s
[04:12:35.574] Received PubSub notification, asking Buildbucket for the build status
[04:12:35.603] Build status: STARTED
[04:13:46.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:3:0)
[04:13:46.999] Build status: STARTED
[04:13:46.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:5:0) after 3m1s
[04:16:48.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:5:0)
[04:16:48.044] Build status: STARTED
[04:16:48.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:6:0) after 6m56s
[04:23:44.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:6:0)
[04:23:44.167] Build status: STARTED
[04:23:44.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:7:0) after 4m6s
[04:27:50.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:7:0)
[04:27:50.436] Build status: STARTED
[04:27:50.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:8:0) after 1m26s
[04:29:16.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:8:0)
[04:29:16.511] Build status: STARTED
[04:29:16.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:9:0) after 9m18s
[04:38:34.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:9:0)
[04:38:34.868] Build status: STARTED
[04:38:34.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:10:0) after 1m57s
[04:40:31.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:10:0)
[04:40:31.990] Build status: STARTED
[04:40:31.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:11:0) after 5m7s
[04:45:39.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:11:0)
[04:45:39.050] Build status: STARTED
[04:45:39.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:12:0) after 1m57s
[04:47:36.632] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:12:0)
[04:47:36.660] Build status: STARTED
[04:47:36.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:13:0) after 9m36s
[04:57:12.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:13:0)
[04:57:12.896] Build status: STARTED
[04:57:12.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:14:0) after 3m51s
[05:01:03.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:14:0)
[05:01:03.959] Build status: STARTED
[05:01:03.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:15:0) after 9m21s
[05:10:24.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:15:0)
[05:10:25.008] Build status: STARTED
[05:10:25.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:16:0) after 1m22s
[05:11:47.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:16:0)
[05:11:47.206] Build status: STARTED
[05:11:47.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:17:0) after 7m39s
[05:19:26.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:17:0)
[05:19:26.424] Build status: STARTED
[05:19:26.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:18:0) after 7m47s
[05:27:13.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:18:0)
[05:27:13.472] Build status: STARTED
[05:27:13.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:19:0) after 3m18s
[05:30:31.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:19:0)
[05:30:31.952] Build status: STARTED
[05:30:31.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:20:0) after 8m17s
[05:38:49.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:20:0)
[05:38:49.050] Build status: STARTED
[05:38:49.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:21:0) after 5m6s
[05:43:55.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:21:0)
[05:43:55.112] Build status: STARTED
[05:43:55.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:22:0) after 4m6s
[05:48:01.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:22:0)
[05:48:01.303] Build status: STARTED
[05:48:01.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:23:0) after 9m47s
[05:57:48.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:23:0)
[05:57:48.555] Build status: STARTED
[05:57:48.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:24:0) after 8m54s
[06:06:42.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:24:0)
[06:06:42.655] Build status: STARTED
[06:06:42.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:25:0) after 4m52s
[06:11:34.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:25:0)
[06:11:34.712] Build status: STARTED
[06:11:34.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:26:0) after 1m12s
[06:12:46.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:26:0)
[06:12:46.719] Build status: STARTED
[06:12:46.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:27:0) after 1m5s
[06:13:51.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:27:0)
[06:13:51.767] Build status: STARTED
[06:13:51.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:28:0) after 1m56s
[06:15:47.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:28:0)
[06:15:47.896] Build status: STARTED
[06:15:47.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:29:0) after 6m35s
[06:22:22.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:29:0)
[06:22:22.977] Build status: STARTED
[06:22:22.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:30:0) after 1m44s
[06:24:06.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:30:0)
[06:24:07.028] Build status: STARTED
[06:24:07.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:31:0) after 1m43s
[06:25:50.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:31:0)
[06:25:50.105] Build status: STARTED
[06:25:50.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:32:0) after 4m43s
[06:30:33.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:32:0)
[06:30:33.228] Build status: STARTED
[06:30:33.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:33:0) after 7m23s
[06:37:56.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:33:0)
[06:37:56.374] Build status: STARTED
[06:37:56.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:34:0) after 3m52s
[06:41:48.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:34:0)
[06:41:48.459] Build status: STARTED
[06:41:48.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:35:0) after 7m38s
[06:49:26.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:35:0)
[06:49:26.610] Build status: STARTED
[06:49:26.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:36:0) after 2m7s
[06:51:33.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:36:0)
[06:51:33.626] Build status: STARTED
[06:51:33.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:37:0) after 5m2s
[06:56:35.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:37:0)
[06:56:35.684] Build status: STARTED
[06:56:35.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:38:0) after 9m47s
[07:06:22.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:38:0)
[07:06:22.795] Build status: STARTED
[07:06:22.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:39:0) after 8m56s
[07:15:18.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:39:0)
[07:15:18.853] Build status: STARTED
[07:15:18.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:40:0) after 5m28s
[07:20:46.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:40:0)
[07:20:46.912] Build status: STARTED
[07:20:46.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:41:0) after 9m4s
[07:29:50.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:41:0)
[07:29:50.968] Build status: STARTED
[07:29:50.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:42:0) after 6m12s
[07:36:03.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:42:0)
[07:36:03.099] Build status: STARTED
[07:36:03.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:43:0) after 4m47s
[07:40:50.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:43:0)
[07:40:50.251] Build status: STARTED
[07:40:50.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:44:0) after 5m22s
[07:46:12.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:44:0)
[07:46:12.349] Build status: STARTED
[07:46:12.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:45:0) after 8m5s
[07:54:17.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:45:0)
[07:54:17.400] Build status: STARTED
[07:54:17.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:46:0) after 3m33s
[07:57:50.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:46:0)
[07:57:50.449] Build status: STARTED
[07:57:50.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:47:0) after 9m48s
[08:07:38.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:47:0)
[08:07:38.675] Build status: STARTED
[08:07:38.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:48:0) after 4m50s
[08:12:28.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:48:0)
[08:12:28.690] Build status: STARTED
[08:12:28.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:49:0) after 1m9s
[08:13:37.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:49:0)
[08:13:37.750] Build status: STARTED
[08:13:37.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:50:0) after 7m25s
[08:21:02.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:50:0)
[08:21:02.891] Build status: STARTED
[08:21:02.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:51:0) after 6m6s
[08:27:09.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:51:0)
[08:27:09.057] Build status: STARTED
[08:27:09.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:52:0) after 9m41s
[08:36:50.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:52:0)
[08:36:50.264] Build status: STARTED
[08:36:50.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:53:0) after 2m14s
[08:39:04.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:53:0)
[08:39:04.361] Build status: STARTED
[08:39:04.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:54:0) after 2m56s
[08:42:00.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:54:0)
[08:42:00.419] Build status: STARTED
[08:42:00.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:55:0) after 5m35s
[08:47:35.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:55:0)
[08:47:35.487] Build status: STARTED
[08:47:35.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:56:0) after 7m36s
[08:55:11.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:56:0)
[08:55:11.576] Build status: STARTED
[08:55:11.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:57:0) after 3m52s
[08:59:03.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:57:0)
[08:59:03.582] Build status: STARTED
[08:59:03.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:58:0) after 9m28s
[09:08:32.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:58:0)
[09:08:32.127] Build status: STARTED
[09:08:32.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014802130759636048:59:0) after 7m18s
[09:13:56.982] Received PubSub notification, asking Buildbucket for the build status
[09:13:57.011] Build:
{
"id": "8849372068367347712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21960,
"createdBy": "project:chromium",
"createTime": "2021-04-21T04:09:24.283524Z",
"startTime": "2021-04-21T04:12:34.358499Z",
"endTime": "2021-04-21T09:13:56.696191603Z",
"updateTime": "2021-04-21T09:13:56.696626205Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "54ecb5683d1ec8dc457dac61a5b83c4f5be97293",
"ref": "refs/heads/main"
}
}
}
[09:13:57.011] Invocation finished in 5h4m34.393324063s with status FAILED