Talk to the LLM when generating API responses for smart filtering

We want to use the LLM to actually respond to smart filtering requests.

(Note, I'm under the impression this is actually happening, but I'm making the issue anyway just so we can be sure to capture it / have a reference. Feel free to close this as complete if that is indeed the case!)