[04:02:06.358] New invocation is queued and will start shortly
[04:02:07.471] Starting the invocation (attempt 1)
[04:02:07.510] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/653ed0c4d1c521e463f701805ab7a6c016ac9221"
[04:02:07.510] Popped gitiles commit info from properties and tags
[04:02:07.510] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:02:07.510] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:02:07.510] Buildbucket request:
{
"requestId": "9008913785411114864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "653ed0c4d1c521e463f701805ab7a6c016ac9221",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9008913785411114864"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:02:07.999] Scheduled build:
{
"id": "8843483723473028337",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22390,
"createdBy": "project:chromium",
"createTime": "2021-06-25T04:02:07.575675264Z",
"updateTime": "2021-06-25T04:02:07.807953963Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "653ed0c4d1c521e463f701805ab7a6c016ac9221",
"ref": "refs/heads/main"
}
}
}
[04:02:07.999] Task URL: https://cr-buildbucket.appspot.com/build/8843483723473028337
[04:02:07.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:2:0) after 8m55s
[04:05:17.282] Received PubSub notification, asking Buildbucket for the build status
[04:05:17.314] Build status: STARTED
[04:11:03.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:2:0)
[04:11:03.214] Build status: STARTED
[04:11:03.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:4:0) after 5m54s
[04:16:57.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:4:0)
[04:16:57.301] Build status: STARTED
[04:16:57.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:5:0) after 7m42s
[04:24:39.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:5:0)
[04:24:39.405] Build status: STARTED
[04:24:39.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:6:0) after 2m22s
[04:27:01.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:6:0)
[04:27:01.538] Build status: STARTED
[04:27:01.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:7:0) after 6m50s
[04:33:51.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:7:0)
[04:33:51.601] Build status: STARTED
[04:33:51.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:8:0) after 5m37s
[04:39:28.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:8:0)
[04:39:28.737] Build status: STARTED
[04:39:28.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:9:0) after 6m54s
[04:46:22.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:9:0)
[04:46:22.811] Build status: STARTED
[04:46:22.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:10:0) after 1m27s
[04:47:50.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:10:0)
[04:47:50.068] Build status: STARTED
[04:47:50.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:11:0) after 2m12s
[04:50:02.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:11:0)
[04:50:02.137] Build status: STARTED
[04:50:02.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:12:0) after 9m25s
[04:59:27.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:12:0)
[04:59:27.191] Build status: STARTED
[04:59:27.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:13:0) after 3m46s
[05:03:13.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:13:0)
[05:03:13.350] Build status: STARTED
[05:03:13.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:14:0) after 8m34s
[05:11:47.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:14:0)
[05:11:47.442] Build status: STARTED
[05:11:47.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:15:0) after 4m56s
[05:16:43.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:15:0)
[05:16:43.508] Build status: STARTED
[05:16:43.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:16:0) after 9m59s
[05:26:42.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:16:0)
[05:26:42.821] Build status: STARTED
[05:26:42.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:17:0) after 8m13s
[05:34:55.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:17:0)
[05:34:56.020] Build status: STARTED
[05:34:56.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:18:0) after 8m38s
[05:43:34.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:18:0)
[05:43:34.244] Build status: STARTED
[05:43:34.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:19:0) after 8m17s
[05:51:51.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:19:0)
[05:51:51.272] Build status: STARTED
[05:51:51.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:20:0) after 4m29s
[05:56:20.349] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:20:0)
[05:56:20.384] Build status: STARTED
[05:56:20.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:21:0) after 7m30s
[06:03:50.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:21:0)
[06:03:50.549] Build status: STARTED
[06:03:50.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:22:0) after 5m50s
[06:09:40.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:22:0)
[06:09:40.613] Build status: STARTED
[06:09:40.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:23:0) after 1m12s
[06:10:52.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:23:0)
[06:10:52.792] Build status: STARTED
[06:10:52.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:24:0) after 2m31s
[06:13:23.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:24:0)
[06:13:23.872] Build status: STARTED
[06:13:23.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:25:0) after 5m51s
[06:19:14.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:25:0)
[06:19:14.957] Build status: STARTED
[06:19:14.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:26:0) after 8m0s
[06:27:14.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:26:0)
[06:27:15.016] Build status: STARTED
[06:27:15.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:27:0) after 2m33s
[06:29:48.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:27:0)
[06:29:48.073] Build status: STARTED
[06:29:48.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:28:0) after 2m19s
[06:32:07.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:28:0)
[06:32:07.120] Build status: STARTED
[06:32:07.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:29:0) after 7m28s
[06:39:35.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:29:0)
[06:39:35.320] Build status: STARTED
[06:39:35.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:30:0) after 5m48s
[06:45:23.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:30:0)
[06:45:23.480] Build status: STARTED
[06:45:23.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:31:0) after 9m35s
[06:54:58.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:31:0)
[06:54:58.567] Build status: STARTED
[06:54:58.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:32:0) after 2m28s
[06:57:26.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:32:0)
[06:57:26.646] Build status: STARTED
[06:57:26.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:33:0) after 8m50s
[07:06:16.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:33:0)
[07:06:16.910] Build status: STARTED
[07:06:16.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:34:0) after 1m53s
[07:08:09.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:34:0)
[07:08:09.991] Build status: STARTED
[07:08:09.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:35:0) after 9m30s
[07:17:40.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:35:0)
[07:17:40.227] Build status: STARTED
[07:17:40.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:36:0) after 4m11s
[07:21:51.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:36:0)
[07:21:51.488] Build status: STARTED
[07:21:51.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:37:0) after 9m56s
[07:31:47.603] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:37:0)
[07:31:47.635] Build status: STARTED
[07:31:47.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:38:0) after 8m5s
[07:39:52.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:38:0)
[07:39:52.721] Build status: STARTED
[07:39:52.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:39:0) after 6m29s
[07:46:21.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:39:0)
[07:46:21.904] Build status: STARTED
[07:46:21.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:40:0) after 6m58s
[07:53:19.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:40:0)
[07:53:19.987] Build status: STARTED
[07:53:19.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:41:0) after 4m4s
[07:57:24.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:41:0)
[07:57:24.197] Build status: STARTED
[07:57:24.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:42:0) after 4m18s
[08:01:42.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:42:0)
[08:01:42.411] Build status: STARTED
[08:01:42.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:43:0) after 9m2s
[08:10:44.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:43:0)
[08:10:44.915] Build status: STARTED
[08:10:44.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:44:0) after 4m15s
[08:14:59.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:44:0)
[08:14:59.918] Build status: STARTED
[08:14:59.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:45:0) after 4m17s
[08:19:17.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:45:0)
[08:19:17.161] Build status: STARTED
[08:19:17.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:46:0) after 7m16s
[08:26:33.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:46:0)
[08:26:33.231] Build status: STARTED
[08:26:33.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:47:0) after 3m3s
[08:29:36.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:47:0)
[08:29:36.259] Build status: STARTED
[08:29:36.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:48:0) after 5m48s
[08:35:24.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:48:0)
[08:35:24.391] Build status: STARTED
[08:35:24.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:49:0) after 3m39s
[08:39:03.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:49:0)
[08:39:03.413] Build status: STARTED
[08:39:03.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:50:0) after 3m53s
[08:42:56.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:50:0)
[08:42:56.465] Build status: STARTED
[08:42:56.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:51:0) after 8m48s
[08:51:44.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:51:0)
[08:51:44.833] Build status: STARTED
[08:51:44.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:52:0) after 4m14s
[08:55:58.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:52:0)
[08:55:58.880] Build status: STARTED
[08:55:58.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:53:0) after 1m40s
[08:57:38.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:53:0)
[08:57:38.941] Build status: STARTED
[08:57:38.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:54:0) after 3m37s
[09:01:15.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:54:0)
[09:01:16.009] Build status: STARTED
[09:01:16.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:55:0) after 3m43s
[09:04:59.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:55:0)
[09:04:59.075] Build status: STARTED
[09:04:59.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008913785411114864:56:0) after 9m28s
[09:12:23.485] Received PubSub notification, asking Buildbucket for the build status
[09:12:23.541] Build:
{
"id": "8843483723473028337",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22390,
"createdBy": "project:chromium",
"createTime": "2021-06-25T04:02:07.575675264Z",
"startTime": "2021-06-25T04:05:15.949911Z",
"endTime": "2021-06-25T09:12:22.885178567Z",
"updateTime": "2021-06-25T09:12:22.885453549Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "653ed0c4d1c521e463f701805ab7a6c016ac9221",
"ref": "refs/heads/main"
}
}
}
[09:12:23.541] Invocation finished in 5h10m17.198308022s with status FAILED