AB-100: Agentic AI Business Solutions Architect › Practice Assessment for Exam AB-100: Agentic AI Business Solutions Architect › Question #26603
Single Choice Moderate

Q

A company uses a Microsoft Copilot Studio agent across multiple Dynamics 365 apps to generate natural language responses. The agent supports English and Spanish and relies on Dynamics 365 data and business logic.

The company regularly deploys updates to its Dynamics 365 environment by using CI/CD.

The company's development team wants to detect regressions in agent output quality caused by application updates. The company has anonymized production prompt logs available.

You need to recommend a testing approach to evaluate output quality at scale and detect regressions.

What should you recommend?

ID: #26603 Practice Assessment for Exam AB-100: Agentic AI Business Solutions Architect 9 views
Question Info
#26603Q ID
ModerateDifficulty
Practice Assessment for Exam AB-100: Agentic AI Business Solutions ArchitectTopic
Start Quiz on This Topic
 Your Answer

Choose the Best Option

Click any option to instantly check if you're correct.

  • A Implement prompt-level unit tests with expected outputs. ✔ ✖
  • B Implement automated testing by using synthetic prompts and safety checks only. ✔ ✖
  • C Perform manual review of correctness, tone, and inclusivity for a sampled set of prompts in English and Spanish. ✔ ✖
  • D Implement automated batch testing by using production prompt logs with quality scoring, multilingual coverage, and regression comparison. ✔ ✖
Correct Answer

Explanation

Objective:

3.2 Manage the testing of AI-powered business solutions

What This Item Tests:

Validate effective Copilot prompt best practices

Additional Reading:

Options for regression testing

Rationale:

Automated batch testing using production prompt logs enables evaluation at scale with realistic inputs, supports multilingual validation, and allows consistent regression comparison across updates; Synthetic prompts and safety checks alone do not reflect real-world usage or measure overall quality; Manual review does not scale and cannot reliably detect regressions across large datasets; Prompt-level unit tests are not suitable because LLM outputs are non-deterministic and vary across runs.

 Continue Practice
Previous Question Next Question
 Share

Share This Question

Challenge a friend or share with your study group.

 More from This Topic

Related MCQ Questions

A company has a multi-agent solution built in Microsoft Foundry. The solution grounds responses in internal HR documents and uses agent tools to call internal and external systems. Security testing shows that ... A company uses an agent built in Microsoft Foundry that retrieves internal content and invokes tools to perform actions. Security testing shows that prompt injection attacks can trigger unauthorized tool calls... A company has a Microsoft Copilot Studio agent grounded in a Microsoft SharePoint Online knowledge source. After adding new knowledge documents and updating the agent instructions, responses to the same user q... A company has a customer service agent built in Microsoft Foundry that calls an Azure OpenAI model and a knowledge API. Telemetry and online evaluation scores are sent to Azure Monitor Application Insights. Us... A company has two production agents: One is built in Microsoft Copilot Studio, and the other is built in Microsoft Foundry. Both agents send telemetry to the same Azure Monitor Application Insights resource. U... A company has a Microsoft Copilot Studio agent that performs browser-based automation against a legacy web app by using the Computer Use tool. When multiple users trigger the automation simultaneously, some ru... A company uses Microsoft Dynamics 365 Sales with a custom model-driven app that sellers use instead of the standard Sales Hub app. The sellers cannot open the Copilot immersive experience from the custom app n... A company uses Microsoft Dynamics 365 Supply Chain Management with customizations developed in Microsoft Visual Studio and stored in Azure Repos. Deployable packages are published to the Lifecycle Services (LCS... A company plans to roll out an IT help desk agent that will be available in Microsoft Teams and Microsoft 365 Copilot. The agent must meet the following requirements: Answer questions grounded in Microsoft... A company has multiple Microsoft Copilot Studio agents that create and update service desk tickets by calling an internal ITSM API. The same ticketing actions must be shared across all agents, and the API sche...