AB-100: Agentic AI Business Solutions Architect › Practice Assessment for Exam AB-100: Agentic AI Business Solutions Architect › Question #26600
Single Choice Moderate

Q

A company has a Microsoft Copilot Studio agent grounded in a Microsoft SharePoint Online knowledge source.

After adding new knowledge documents and updating the agent instructions, responses to the same user questions vary in wording but remain correct.

You need to implement a validation method that passes test cases when the response meaning matches the expected answer, without requiring exact text matching or scoring response quality attributes.

Which Copilot Studio evaluation method should you use?

ID: #26600 Practice Assessment for Exam AB-100: Agentic AI Business Solutions Architect 10 views
Question Info
#26600Q ID
ModerateDifficulty
Practice Assessment for Exam AB-100: Agentic AI Business Solutions ArchitectTopic
Start Quiz on This Topic
 Your Answer

Choose the Best Option

Click any option to instantly check if you're correct.

  • A quality test method ✔ ✖
  • B response match test method ✔ ✖
  • C similarity test method ✔ ✖
  • D text match test method ✔ ✖
Correct Answer

Explanation

Objective:

3.2 Manage the testing of AI-powered business solutions

What This Item Tests:

Build the strategy for creating test cases by using Copilot

Additional Reading:

Evaluate agents in Copilot Studio

Testing guidance in Copilot Studio unified authoring

Rationale:

The similarity test method validates semantic equivalence between the expected and actual responses, ensuring that tests pass when wording varies but meaning is preserved. Text and response match methods depend on output matching, and the quality test method evaluates response characteristics rather than equivalence.

 Continue Practice
Previous Question Next Question
 Share

Share This Question

Challenge a friend or share with your study group.

 More from This Topic

Related MCQ Questions

A company has a multi-agent solution built in Microsoft Foundry. The solution grounds responses in internal HR documents and uses agent tools to call internal and external systems. Security testing shows that ... A company has two production agents: One is built in Microsoft Copilot Studio, and the other is built in Microsoft Foundry. Both agents send telemetry to the same Azure Monitor Application Insights resource. U... A company has a Microsoft Copilot Studio agent that performs browser-based automation against a legacy web app by using the Computer Use tool. When multiple users trigger the automation simultaneously, some ru... A company uses Microsoft Dynamics 365 Sales with a custom model-driven app that sellers use instead of the standard Sales Hub app. The sellers cannot open the Copilot immersive experience from the custom app n... A company uses an agent built in Microsoft Foundry that retrieves internal content and invokes tools to perform actions. Security testing shows that prompt injection attacks can trigger unauthorized tool calls... A company has a customer service agent built in Microsoft Foundry that calls an Azure OpenAI model and a knowledge API. Telemetry and online evaluation scores are sent to Azure Monitor Application Insights. Us... A company plans to roll out an IT help desk agent that will be available in Microsoft Teams and Microsoft 365 Copilot. The agent must meet the following requirements: Answer questions grounded in Microsoft... A company has multiple Microsoft Copilot Studio agents that create and update service desk tickets by calling an internal ITSM API. The same ticketing actions must be shared across all agents, and the API sche... A company has a Microsoft Copilot Studio agent that generates a daily incident summary from a user-provided transcript and incident data stored in a Microsoft Dataverse table. The response must always be forma... A company has a Microsoft Copilot Studio agent that uses Azure OpenAI to generate responses and retrieves grounding data from Microsoft Dataverse. Multiple users can modify the agent's configurations, includin...