[07:23:30.300] New invocation is queued and will start shortly
[07:23:31.367] Starting the invocation (attempt 1)
[07:23:31.403] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a76d1c52384fbb9cb1a128d8961926a26d1b031c"
[07:23:31.403] Popped gitiles commit info from properties and tags
[07:23:31.403] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:23:31.403] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:23:31.403] Buildbucket request:
{
"requestId": "9000203805705679360",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a76d1c52384fbb9cb1a128d8961926a26d1b031c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9000203805705679360"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:23:31.880] Scheduled build:
{
"id": "8834773743814573857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23263,
"createdBy": "project:chromium",
"createTime": "2021-09-29T07:23:31.471328727Z",
"updateTime": "2021-09-29T07:23:31.728690015Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a76d1c52384fbb9cb1a128d8961926a26d1b031c",
"ref": "refs/heads/main"
}
}
}
[07:23:31.880] Task URL: https://cr-buildbucket.appspot.com/build/8834773743814573857
[07:23:31.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:2:0) after 8m1s
[07:27:00.965] Received PubSub notification, asking Buildbucket for the build status
[07:27:01.055] Build status: STARTED
[07:31:32.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:2:0)
[07:31:32.947] Build status: STARTED
[07:31:32.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:4:0) after 9m29s
[07:41:01.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:4:0)
[07:41:02.007] Build status: STARTED
[07:41:02.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:5:0) after 2m49s
[07:43:51.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:5:0)
[07:43:51.333] Build status: STARTED
[07:43:51.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:6:0) after 5m16s
[07:49:07.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:6:0)
[07:49:07.381] Build status: STARTED
[07:49:07.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:7:0) after 5m21s
[07:54:28.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:7:0)
[07:54:28.442] Build status: STARTED
[07:54:28.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:8:0) after 1m10s
[07:55:38.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:8:0)
[07:55:38.763] Build status: STARTED
[07:55:38.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:9:0) after 8m52s
[08:04:30.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:9:0)
[08:04:30.896] Build status: STARTED
[08:04:30.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:10:0) after 2m51s
[08:07:21.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:10:0)
[08:07:21.994] Build status: STARTED
[08:07:21.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:11:0) after 5m30s
[08:12:52.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:11:0)
[08:12:52.126] Build status: STARTED
[08:12:52.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:12:0) after 7m54s
[08:20:46.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:12:0)
[08:20:46.181] Build status: STARTED
[08:20:46.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:13:0) after 9m42s
[08:30:28.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:13:0)
[08:30:28.402] Build status: STARTED
[08:30:28.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:14:0) after 4m47s
[08:35:15.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:14:0)
[08:35:15.426] Build status: STARTED
[08:35:15.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:15:0) after 7m6s
[08:42:21.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:15:0)
[08:42:21.537] Build status: STARTED
[08:42:21.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:16:0) after 9m1s
[08:51:22.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:16:0)
[08:51:22.711] Build status: STARTED
[08:51:22.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:17:0) after 9m56s
[09:01:18.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:17:0)
[09:01:18.774] Build status: STARTED
[09:01:18.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:18:0) after 3m26s
[09:04:44.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:18:0)
[09:04:44.827] Build status: STARTED
[09:04:44.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:19:0) after 4m42s
[09:09:26.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:19:0)
[09:09:26.899] Build status: STARTED
[09:09:26.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:20:0) after 8m7s
[09:17:33.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:20:0)
[09:17:33.970] Build status: STARTED
[09:17:33.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:21:0) after 1m3s
[09:18:37.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:21:0)
[09:18:37.058] Build status: STARTED
[09:18:37.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:22:0) after 9m51s
[09:28:28.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:22:0)
[09:28:28.134] Build status: STARTED
[09:28:28.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:23:0) after 2m9s
[09:30:37.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:23:0)
[09:30:37.158] Build status: STARTED
[09:30:37.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:24:0) after 6m21s
[09:36:58.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:24:0)
[09:36:58.230] Build status: STARTED
[09:36:58.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:25:0) after 9m46s
[09:46:44.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:25:0)
[09:46:44.283] Build status: STARTED
[09:46:44.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:26:0) after 2m33s
[09:49:17.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:26:0)
[09:49:17.352] Build status: STARTED
[09:49:17.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:27:0) after 8m54s
[09:58:11.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:27:0)
[09:58:11.403] Build status: STARTED
[09:58:11.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:28:0) after 1m33s
[09:59:44.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:28:0)
[09:59:44.457] Build status: STARTED
[09:59:44.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:29:0) after 3m53s
[10:03:37.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:29:0)
[10:03:37.679] Build status: STARTED
[10:03:37.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:30:0) after 9m7s
[10:12:44.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:30:0)
[10:12:44.887] Build status: STARTED
[10:12:44.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:31:0) after 1m39s
[10:14:23.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:31:0)
[10:14:23.947] Build status: STARTED
[10:14:23.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:32:0) after 9m51s
[10:24:15.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:32:0)
[10:24:15.218] Build status: STARTED
[10:24:15.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:33:0) after 2m3s
[10:26:18.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:33:0)
[10:26:18.279] Build status: STARTED
[10:26:18.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:34:0) after 9m28s
[10:35:46.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:34:0)
[10:35:46.338] Build status: STARTED
[10:35:46.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:35:0) after 2m56s
[10:38:42.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:35:0)
[10:38:42.400] Build status: STARTED
[10:38:42.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:36:0) after 7m0s
[10:45:42.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:36:0)
[10:45:42.547] Build status: STARTED
[10:45:42.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:37:0) after 6m0s
[10:51:42.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:37:0)
[10:51:42.758] Build status: STARTED
[10:51:42.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:38:0) after 5m2s
[10:56:44.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:38:0)
[10:56:44.818] Build status: STARTED
[10:56:44.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:39:0) after 8m3s
[11:04:47.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:39:0)
[11:04:47.918] Build status: STARTED
[11:04:47.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:40:0) after 3m39s
[11:08:26.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:40:0)
[11:08:27.016] Build status: STARTED
[11:08:27.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:41:0) after 4m35s
[11:13:02.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:41:0)
[11:13:02.168] Build status: STARTED
[11:13:02.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:42:0) after 7m16s
[11:20:18.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:42:0)
[11:20:18.515] Build status: STARTED
[11:20:18.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:43:0) after 4m17s
[11:24:35.548] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:43:0)
[11:24:35.577] Build status: STARTED
[11:24:35.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:44:0) after 4m17s
[11:28:52.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:44:0)
[11:28:52.839] Build status: STARTED
[11:28:52.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:45:0) after 4m17s
[11:33:09.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:45:0)
[11:33:09.895] Build status: STARTED
[11:33:09.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:46:0) after 3m6s
[11:36:15.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:46:0)
[11:36:15.991] Build status: STARTED
[11:36:15.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:47:0) after 1m4s
[11:37:20.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:47:0)
[11:37:20.044] Build status: STARTED
[11:37:20.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:48:0) after 1m39s
[11:38:59.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:48:0)
[11:38:59.091] Build status: STARTED
[11:38:59.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:49:0) after 7m43s
[11:46:42.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:49:0)
[11:46:42.144] Build status: STARTED
[11:46:42.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:50:0) after 3m22s
[11:50:04.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:50:0)
[11:50:04.212] Build status: STARTED
[11:50:04.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:51:0) after 3m32s
[11:53:36.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:51:0)
[11:53:36.270] Build status: STARTED
[11:53:36.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:52:0) after 7m35s
[12:01:11.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:52:0)
[12:01:11.350] Build status: STARTED
[12:01:11.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:53:0) after 9m11s
[12:10:22.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:53:0)
[12:10:22.409] Build status: STARTED
[12:10:22.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:54:0) after 4m0s
[12:14:22.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:54:0)
[12:14:22.608] Build status: STARTED
[12:14:22.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:55:0) after 7m26s
[12:21:48.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:55:0)
[12:21:48.739] Build status: STARTED
[12:21:48.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:56:0) after 8m44s
[12:30:32.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:56:0)
[12:30:32.836] Build status: STARTED
[12:30:32.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:57:0) after 9m40s
[12:40:12.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:57:0)
[12:40:13.031] Build status: STARTED
[12:40:13.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:58:0) after 4m52s
[12:45:05.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:58:0)
[12:45:05.231] Build status: STARTED
[12:45:05.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:59:0) after 9m51s
[12:54:56.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:59:0)
[12:54:56.542] Build status: STARTED
[12:54:56.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:60:0) after 9m32s
[13:04:28.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:60:0)
[13:04:28.596] Build status: STARTED
[13:04:28.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000203805705679360:61:0) after 5m21s
[13:04:51.065] Received PubSub notification, asking Buildbucket for the build status
[13:04:51.096] Build:
{
"id": "8834773743814573857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23263,
"createdBy": "project:chromium",
"createTime": "2021-09-29T07:23:31.471328727Z",
"startTime": "2021-09-29T07:27:00.391627Z",
"endTime": "2021-09-29T13:04:50.837369281Z",
"updateTime": "2021-09-29T13:04:50.837676134Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a76d1c52384fbb9cb1a128d8961926a26d1b031c",
"ref": "refs/heads/main"
}
}
}
[13:04:51.096] Invocation finished in 5h41m20.81241452s with status FAILED