News on Medial

Microsoftโ€™s new safety system can catch hallucinations in its customersโ€™ AI apps

The VergeThe Verge ยท 1y ago
Microsoftโ€™s new safety system can catch hallucinations in its customersโ€™ AI apps
Medial

Microsoft has introduced new safety features for its Azure AI customers. The features, available on its platform, include Prompt Shields, Groundedness Detection, and safety evaluations. The Prompt Shields tool blocks malicious prompts, while Groundedness Detection identifies and blocks hallucinations. Safety evaluations assess vulnerabilities in models. The company is also planning to add features for directing safe outputs and tracking prompts to identify problematic users. The safety features will not only be attached to popular models like GPT-4, but users will also be able to manually point the features to smaller, open-source models in Azure's model garden.

Related News

Download the medial app to read full posts, comements and news.