Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Janet Berry-Johnson, CPA, is a freelance writer with a background in accounting and income tax planning and preparation for individuals and small businesses. Her work has appeared in Business Insider ...