AB-100: Agentic AI Business Solutions Architect › Practice Assessment for Exam AB-100: Agentic AI Business Solutions Architect › Question #26663
Single Choice Moderate

Q

A company has a Microsoft Copilot Studio agent that answers HR policy questions by using a Microsoft SharePoint Online knowledge source.

Automated tests in Copilot Studio are failing because the agent's responses do NOT exactly match the expected text, even though the responses convey the correct meaning.

You need to update the validation criteria to ensure that the tests pass when the response meaning matches the expected answer, without requiring exact wording.

Which evaluation method should you select for the test cases in a Copilot Studio test set?

ID: #26663 Practice Assessment for Exam AB-100: Agentic AI Business Solutions Architect 6 views
Question Info
#26663Q ID
ModerateDifficulty
Practice Assessment for Exam AB-100: Agentic AI Business Solutions ArchitectTopic
Start Quiz on This Topic
 Your Answer

Choose the Best Option

Click any option to instantly check if you're correct.

  • A quality test method ✔ ✖
  • B regression testing ✔ ✖
  • C similarity test method ✔ ✖
  • D text match test method ✔ ✖
Correct Answer

Explanation

Objective:

3.2 Manage the testing of AI-powered business solutions

What This Item Tests:

Build the strategy for creating test cases by using Copilot

Additional Reading:

Best practices for testing the Copilot capability

Rationale:

The similarity test method evaluates whether a response is semantically equivalent to the expected answer, making it suitable when wording varies but meaning is correct. Text match requires exact output, quality tests assess response characteristics rather than equivalence, and regression testing is not an evaluation method for individual test cases.

 Continue Practice
Previous Question Next Question
 Share

Share This Question

Challenge a friend or share with your study group.

 More from This Topic

Related MCQ Questions

A company has a multi-agent solution built in Microsoft Foundry. The solution grounds responses in internal HR documents and uses agent tools to call internal and external systems. Security testing shows that ... A company uses an agent built in Microsoft Foundry that retrieves internal content and invokes tools to perform actions. Security testing shows that prompt injection attacks can trigger unauthorized tool calls... A company has a Microsoft Copilot Studio agent grounded in a Microsoft SharePoint Online knowledge source. After adding new knowledge documents and updating the agent instructions, responses to the same user q... A company has two production agents: One is built in Microsoft Copilot Studio, and the other is built in Microsoft Foundry. Both agents send telemetry to the same Azure Monitor Application Insights resource. U... A company has a Microsoft Copilot Studio agent that performs browser-based automation against a legacy web app by using the Computer Use tool. When multiple users trigger the automation simultaneously, some ru... A company uses Microsoft Dynamics 365 Sales with a custom model-driven app that sellers use instead of the standard Sales Hub app. The sellers cannot open the Copilot immersive experience from the custom app n... A company has a customer service agent built in Microsoft Foundry that calls an Azure OpenAI model and a knowledge API. Telemetry and online evaluation scores are sent to Azure Monitor Application Insights. Us... A company plans to roll out an IT help desk agent that will be available in Microsoft Teams and Microsoft 365 Copilot. The agent must meet the following requirements: Answer questions grounded in Microsoft... A company has multiple Microsoft Copilot Studio agents that create and update service desk tickets by calling an internal ITSM API. The same ticketing actions must be shared across all agents, and the API sche... A company has a Microsoft Copilot Studio agent that generates a daily incident summary from a user-provided transcript and incident data stored in a Microsoft Dataverse table. The response must always be forma...