Ease interop with infra repository
This repo is a middle layer between a front end and our llm-infrastructure repository. It needs to be easier to set up the two repositories in tandem so they talk to each other. This issue is a place to mark that need and discuss potential resolutions.