[03:19:17.356] New invocation is queued and will start shortly
[03:19:18.534] Starting the invocation (attempt 1)
[03:19:18.566] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f39a2193452f7f8e52b9761e0eb3d4d9f5d71733"
[03:19:18.566] Popped gitiles commit info from properties and tags
[03:19:18.566] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:19:18.566] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:19:18.566] Buildbucket request:
{
"requestId": "9006198570212002064",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f39a2193452f7f8e52b9761e0eb3d4d9f5d71733",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9006198570212002064"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:19:19.319] Scheduled build:
{
"id": "8840768508196377104",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22593,
"createdBy": "project:chromium",
"createTime": "2021-07-25T03:19:18.647966Z",
"updateTime": "2021-07-25T03:19:19.201493Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f39a2193452f7f8e52b9761e0eb3d4d9f5d71733",
"ref": "refs/heads/main"
}
}
}
[03:19:19.319] Task URL: https://cr-buildbucket.appspot.com/build/8840768508196377104
[03:19:19.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:2:0) after 7m5s
[03:22:07.236] Received PubSub notification, asking Buildbucket for the build status
[03:22:07.262] Build status: STARTED
[03:26:25.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:2:0)
[03:26:25.083] Build status: STARTED
[03:26:25.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:4:0) after 6m36s
[03:33:01.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:4:0)
[03:33:01.127] Build status: STARTED
[03:33:01.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:5:0) after 1m44s
[03:34:45.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:5:0)
[03:34:45.198] Build status: STARTED
[03:34:45.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:6:0) after 1m37s
[03:36:22.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:6:0)
[03:36:22.350] Build status: STARTED
[03:36:22.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:7:0) after 1m27s
[03:37:49.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:7:0)
[03:37:49.394] Build status: STARTED
[03:37:49.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:8:0) after 6m48s
[03:44:37.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:8:0)
[03:44:37.543] Build status: STARTED
[03:44:37.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:9:0) after 2m1s
[03:46:38.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:9:0)
[03:46:38.578] Build status: STARTED
[03:46:38.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:10:0) after 5m55s
[03:52:33.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:10:0)
[03:52:33.840] Build status: STARTED
[03:52:33.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:11:0) after 7m2s
[03:59:36.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:11:0)
[03:59:36.129] Build status: STARTED
[03:59:36.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:12:0) after 8m7s
[04:07:43.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:12:0)
[04:07:43.447] Build status: STARTED
[04:07:43.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:13:0) after 7m4s
[04:14:47.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:13:0)
[04:14:47.570] Build status: STARTED
[04:14:47.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:14:0) after 5m3s
[04:19:50.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:14:0)
[04:19:50.666] Build status: STARTED
[04:19:50.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:15:0) after 5m27s
[04:25:17.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:15:0)
[04:25:17.711] Build status: STARTED
[04:25:17.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:16:0) after 3m18s
[04:28:35.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:16:0)
[04:28:35.772] Build status: STARTED
[04:28:35.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:17:0) after 6m27s
[04:35:02.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:17:0)
[04:35:02.823] Build status: STARTED
[04:35:02.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:18:0) after 1m15s
[04:36:17.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:18:0)
[04:36:17.875] Build status: STARTED
[04:36:17.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:19:0) after 3m52s
[04:40:09.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:19:0)
[04:40:09.923] Build status: STARTED
[04:40:09.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:20:0) after 9m49s
[04:49:58.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:20:0)
[04:49:58.987] Build status: STARTED
[04:49:58.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:21:0) after 5m9s
[04:55:08.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:21:0)
[04:55:08.256] Build status: STARTED
[04:55:08.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:22:0) after 5m24s
[05:00:32.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:22:0)
[05:00:32.327] Build status: STARTED
[05:00:32.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:23:0) after 6m34s
[05:07:06.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:23:0)
[05:07:06.897] Build status: STARTED
[05:07:06.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:24:0) after 6m51s
[05:13:58.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:24:0)
[05:13:58.124] Build status: STARTED
[05:13:58.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:25:0) after 1m17s
[05:15:15.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:25:0)
[05:15:15.386] Build status: STARTED
[05:15:15.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:26:0) after 9m23s
[05:24:39.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:26:0)
[05:24:39.356] Build status: STARTED
[05:24:39.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:27:0) after 2m48s
[05:27:27.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:27:0)
[05:27:27.864] Build status: STARTED
[05:27:27.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:28:0) after 6m56s
[05:34:23.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:28:0)
[05:34:23.917] Build status: STARTED
[05:34:23.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:29:0) after 6m51s
[05:41:14.936] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:29:0)
[05:41:14.962] Build status: STARTED
[05:41:14.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:30:0) after 7m52s
[05:49:06.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:30:0)
[05:49:07.009] Build status: STARTED
[05:49:07.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:31:0) after 7m40s
[05:56:47.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:31:0)
[05:56:47.574] Build status: STARTED
[05:56:47.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:32:0) after 8m11s
[06:04:58.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:32:0)
[06:04:58.633] Build status: STARTED
[06:04:58.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:33:0) after 7m35s
[06:12:34.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:33:0)
[06:12:34.369] Build status: STARTED
[06:12:34.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:34:0) after 2m35s
[06:15:09.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:34:0)
[06:15:09.810] Build status: STARTED
[06:15:09.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:35:0) after 1m48s
[06:16:58.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:35:0)
[06:16:58.347] Build status: STARTED
[06:16:58.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:36:0) after 7m41s
[06:24:39.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:36:0)
[06:24:39.391] Build status: STARTED
[06:24:39.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:37:0) after 5m54s
[06:30:35.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:37:0)
[06:30:35.367] Build status: STARTED
[06:30:35.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:38:0) after 3m19s
[06:33:54.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:38:0)
[06:33:54.540] Build status: STARTED
[06:33:54.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:39:0) after 8m1s
[06:41:56.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:39:0)
[06:41:56.107] Build status: STARTED
[06:41:56.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:40:0) after 9m5s
[06:51:01.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:40:0)
[06:51:01.433] Build status: STARTED
[06:51:01.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:41:0) after 1m5s
[06:52:06.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:41:0)
[06:52:06.699] Build status: STARTED
[06:52:06.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:42:0) after 4m21s
[06:56:27.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:42:0)
[06:56:27.869] Build status: STARTED
[06:56:27.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:43:0) after 9m51s
[07:06:19.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:43:0)
[07:06:19.121] Build status: STARTED
[07:06:19.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:44:0) after 9m5s
[07:15:24.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:44:0)
[07:15:24.783] Build status: STARTED
[07:15:24.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:45:0) after 7m56s
[07:23:20.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:45:0)
[07:23:20.841] Build status: STARTED
[07:23:20.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:46:0) after 4m12s
[07:27:33.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:46:0)
[07:27:33.584] Build status: STARTED
[07:27:33.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:47:0) after 7m33s
[07:35:06.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:47:0)
[07:35:06.841] Build status: STARTED
[07:35:06.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:48:0) after 5m42s
[07:40:48.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:48:0)
[07:40:48.946] Build status: STARTED
[07:40:48.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:49:0) after 5m50s
[07:46:38.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:49:0)
[07:46:39.000] Build status: STARTED
[07:46:39.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:50:0) after 7m30s
[07:54:09.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:50:0)
[07:54:09.047] Build status: STARTED
[07:54:09.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:51:0) after 1m36s
[07:55:45.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:51:0)
[07:55:45.598] Build status: STARTED
[07:55:45.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:52:0) after 9m36s
[08:05:21.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:52:0)
[08:05:21.647] Build status: STARTED
[08:05:21.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:53:0) after 6m25s
[08:11:46.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:53:0)
[08:11:46.704] Build status: STARTED
[08:11:46.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:54:0) after 4m46s
[08:16:32.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:54:0)
[08:16:32.788] Build status: STARTED
[08:16:32.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:55:0) after 5m19s
[08:21:51.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:55:0)
[08:21:51.970] Build status: STARTED
[08:21:51.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:56:0) after 6m12s
[08:28:05.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:56:0)
[08:28:05.599] Build status: STARTED
[08:28:05.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:57:0) after 7m12s
[08:35:18.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:57:0)
[08:35:18.238] Build status: STARTED
[08:35:18.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:58:0) after 3m46s
[08:39:04.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:58:0)
[08:39:04.399] Build status: STARTED
[08:39:04.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:59:0) after 4m40s
[08:43:44.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:59:0)
[08:43:44.543] Build status: STARTED
[08:43:44.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:60:0) after 4m0s
[08:47:44.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:60:0)
[08:47:44.948] Build status: STARTED
[08:47:44.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006198570212002064:61:0) after 2m20s
[08:47:46.642] Received PubSub notification, asking Buildbucket for the build status
[08:47:46.668] Build:
{
"id": "8840768508196377104",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22593,
"createdBy": "project:chromium",
"createTime": "2021-07-25T03:19:18.647966Z",
"startTime": "2021-07-25T03:22:07.061820200Z",
"endTime": "2021-07-25T08:47:46.274115273Z",
"updateTime": "2021-07-25T08:47:46.274750115Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f39a2193452f7f8e52b9761e0eb3d4d9f5d71733",
"ref": "refs/heads/main"
}
}
}
[08:47:46.668] Invocation finished in 5h28m29.326391805s with status FAILED