🎉 Online Task New Feature 🎉 We are releasing managed code evaluators, a set of pre-built, off-the-shelf evaluators to enable Arize users to evaluate spans without requiring requests to an LLM as a Judge. Evaluators available:
Matches Regex: Checks if text matches a specific regular expression pattern.
JSON Parseable: Validate JSON output from LLMs.
Contains Any Keyword: Check if any keywords appear in the text.
Contains All Keywords: Validate that all specified keywords are present.
Let us know what you think as you use this feature - more enhancements to come!
🚀 Exciting Release: Introducing Monitor Downtime! 🚀 We're thrilled to announce a new customization for Monitors that allows you to set recurring downtime. ✨What is Monitor Downtime? Monitor downtime is a scheduled period when monitor evaluations are paused. During this downtime, your monitor will not assess metrics or generate new alerts. ✨When should I Use Monitor Downtime? Use downtime to silence your monitors during times periods when your metric or alerts would not provide meaningful insights, such as during joins, expected low activity times, or weekends. Downtime is a tool to silence noisy alerts, giving you control to optimize your monitoring experience. ✨How Does it Work? Configuring recurring downtime is easy! By default, downtime is off for all monitors. To enable downtime, edit your monitor and turn on the Schedule downtime toggle under Define the Alerting. In this section, you can specify how long the downtime period should be, when it should start and how often it should happen (i.e. every day or every week). And voilà! Your monitors will now stay silent during that schedule you specified, ensuring you only receive alerts when it matters most. Want to learn more? Check out our documentation and the video for an example!
