How to evaluate LLMs before production
These are the lessons we learned evaluating LLMs for real-world secret scanning.
Zixiao is a Senior Applied Scientist at Microsoft whose work focuses on secret detection and agentic security systems, with an emphasis on translating research advances into practical security capabilities at scale. She also conducts research on LLM fine-tuning, and token-efficient AI systems, with interests in improving the efficiency, scalability, and real-world deployment of foundation models.
These are the lessons we learned evaluating LLMs for real-world secret scanning.