Hamel Husain answers a client question — how to eval an AI PE curriculum planner for K-12 — with a one-minute twist: evals and product trust are the same problem. ~1 minute on his own channel.

The eval problem

  • A client building an AI curriculum planner for K-12 physical education couldn’t figure out how to eval it
  • The answer: think creatively — put yourself in the educator’s shoes

Questions an educator actually asks

  • Was this plan created by an expert?
  • What other teachers are using this plan?
  • Is this plan based on best practices and expert knowledge?

The takeaway

  • Infuse those signals into the product — they give the end user trust in what they’re seeing
  • That same design doubles as your eval: provide users a way to assess what they see, and you can assess it too
  • If you can’t eval your product, your product probably sucks

“If you can’t eval your product, your product probably sucks.”