Great write up. Chatbots are often (usually?) more trouble than they are worth. I like that option of just the semantic document search without the LLM summarization.
What is weird is that regular Chat-GPT answers the NYC law questions better than the NYC chatbot. Whatever RAG solution they used, I don’t know how they made it worse than a generic LLM.
Great write up. Chatbots are often (usually?) more trouble than they are worth. I like that option of just the semantic document search without the LLM summarization.
What is weird is that regular Chat-GPT answers the NYC law questions better than the NYC chatbot. Whatever RAG solution they used, I don’t know how they made it worse than a generic LLM.