Tbh I'll wait for first party LLM providers to build this kind of stuff. If they're not first class citizens they end up corrupting the workflow more than enriching it.