Discussion about this post

User's avatar
Marcos H's avatar

Great write up. Chatbots are often (usually?) more trouble than they are worth. I like that option of just the semantic document search without the LLM summarization.

What is weird is that regular Chat-GPT answers the NYC law questions better than the NYC chatbot. Whatever RAG solution they used, I don’t know how they made it worse than a generic LLM.

Expand full comment

No posts