3 points | by anphamthanh 13 hours ago
2 comments
what are your thoughts on using LLM as a judge for auto evals?
IMO, if you break down the criteria enough, LLM or not wouldn't be a problem. But if you feed a long answer to it and ask LLM if it's a good answer, then it will be hit or miss.
what are your thoughts on using LLM as a judge for auto evals?
IMO, if you break down the criteria enough, LLM or not wouldn't be a problem. But if you feed a long answer to it and ask LLM if it's a good answer, then it will be hit or miss.