Introducing Managed Code Evaluators for Enhanced Online Tasks
🎉 Online Task New Feature 🎉 We are releasing managed code evaluators, a set of pre-built, off-the-shelf evaluators to enable Arize users to evaluate spans without requiring requests to an LLM as a Judge. Evaluators available:
Matches Regex: Checks if text matches a specific regular expression pattern.
JSON Parseable: Validate JSON output from LLMs.
Contains Any Keyword: Check if any keywords appear in the text.
Contains All Keywords: Validate that all specified keywords are present.
Let us know what you think as you use this feature - more enhancements to come!
