Skip to content

Commit 46822b5

Browse files
authored
Merge pull request #40 from MicrosoftDocs/repo_sync_working_branch
Resolve syncing conflicts from repo_sync_working_branch to main
2 parents 039d6f7 + 38df7a7 commit 46822b5

20 files changed

+405
-345
lines changed

.acrolinx-config.edn

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
{
2-
:allowed-branchname-matches ["main" "live"]
2+
:allowed-branchname-matches ["main" "live" "build.*"]
33
:allowed-filename-matches ["(?i)(?!(^.*/p|^p)osts-api\\.yml$|(^.*/r|^r)eadme\\.md$)^docs/.*$"] ;; Can be overridden in repo-specific edn file. This is an allow list that identifies which folders contain the files Acrolinx will check. Separate multiple folders as follows ["folder/" "folder2"]
44

55
:use-gh-statuses true

.vscode/settings.json

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,5 +7,8 @@
77
],
88
"yaml.schemas": {
99
"https://json.schemastore.org/github-issue-config.json": ".github/ISSUE_TEMPLATE/config.yml"
10-
}
10+
},
11+
"cSpell.words": [
12+
"preconfigured"
13+
]
1114
}

docs/TOC.yml

Lines changed: 9 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -95,7 +95,14 @@
9595
- name: Write instructions for agents with API plugins
9696
href: instructions-api-plugins.md
9797
- name: Add capabilities and knowledge sources
98-
href: add-agent-capabilities.md
98+
expanded: false
99+
items:
100+
- name: Code interpreter
101+
href: code-interpreter.md
102+
- name: Image generator
103+
href: image-generator.md
104+
- name: Knowledge sources
105+
href: knowledge-sources.md
99106
- name: Optimize SharePoint content retrieval
100107
href: optimize-sharepoint-content.md
101108
- name: Document interaction
@@ -104,7 +111,7 @@
104111
href: localize-agents.md
105112
- name: Test and debug agents
106113
href: debugging-copilot-agent.md
107-
- name: RAI validation
114+
- name: Responsible AI validation
108115
href: rai-validation.md
109116
- name: Build a custom engine agent
110117
expanded: false

docs/add-agent-capabilities.md

Lines changed: 0 additions & 319 deletions
This file was deleted.

docs/code-interpreter.md

Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
---
2+
title: Code Interpreter Capability for Declarative Agents for Microsoft 365 Copilot.
3+
description: Learn about the code interpreter capability and how to add it to your declarative agents.
4+
author: kmkoenen
5+
ms.author: v-koenenkaty
6+
ms.topic: concept-article
7+
ms.localizationpriority: medium
8+
ms.date: 5/09/2025
9+
---
10+
11+
# Add the code interpreter capability to your agent
12+
13+
You can enhance the user experience of your declarative agent for Microsoft 365 Copilot by adding the code interpreter capability. The [**capabilities** element](/microsoft-365-copilot/extensibility/declarative-agent-manifest-1.3#capabilities-object) in the manifest reference and the **Capabilities** section in the Copilot Studio agent builder provide several options for you to unlock features for your users. This article describes the code interpreter capability and how to add it to your declarative agents.
14+
15+
Code interpreter is an advanced tool designed to solve complex tasks via Python code. It uses the reasoning model to write and run code, enabling users to solve complex math problems, analyze data, generate visualizations, and more. After the code runs, code interpreter outputs the results and generated code. It can also produce images or files based on the scenario, and accepts files as input for modifications and analysis.
16+
17+
The code interpreter capability is available to Copilot Chat users with no metered usage or Microsoft 365 Copilot license.
18+
19+
> [!NOTE]
20+
> Support for in-context agents that have code interpreter enabled varies by host.
21+
22+
## Code interpreter examples
23+
24+
### Data graphing
25+
26+
The user prompt "Graph the first 20 numbers in a Fibonacci sequence" generates both a line graph and, when the user clicks the `</> Code` button, provides the corresponding Python code.
27+
28+
The following images show examples of the results of a data graphing request.
29+
30+
:::image type="content" source="assets/images/code-interpreter-python-1.png" alt-text="Graph response to the user prompt":::
31+
32+
:::image type="content" source="assets/images/code-interpreter-python-2.png" alt-text="Python code response to the user prompt":::
33+
34+
### Data visualization
35+
36+
The user prompt "Create a word cloud of top pet names" generates a word cloud that includes the top names, as shown in the following example.
37+
38+
:::image type="content" source="assets/images/code-interpreter-pet-word-cloud.png" alt-text="Word cloud response to the user prompt":::
39+
40+
### Enable code interpreter
41+
42+
**Agents Toolkit**
43+
If you're using [Agents Toolkit and Visual Studio Code](build-declarative-agents.yml) to create your agent, to enable code interpreter, add the `CodeInterpreter` value to the **capabilities** property in your manifest file, as shown in the following example.
44+
45+
> [!NOTE]
46+
> You must be using [version 1.2](declarative-agent-manifest-1.2.md) or later of the declarative agent manifest schema to add the `CodeInterpreter` capability.
47+
48+
```json
49+
{
50+
"capabilities": [
51+
{
52+
"name": "CodeInterpreter"
53+
}
54+
]
55+
}
56+
```
57+
58+
**Copilot Studio agent builder**
59+
If you're using [Copilot Studio agent builder](copilot-studio-agent-builder.md) to create your agent, on the **Configure** tab, under **Capabilities**, choose the toggle next to **Code interpreter**.
60+
61+
:::image type="content" source="assets/images/capabilities-toggle.png" alt-text="Screenshot of the Capabilities section of the agent builder":::
62+
63+
## Related content
64+
65+
- [Declarative agents overview](overview-declarative-agent.md)
66+
- [Declarative agent manifest reference](declarative-agent-manifest-1.3.md)
67+
- [Add the image generator capability to your agent](image-generator.md)
68+
- [Add knowledge sources to your declarative agent](knowledge-sources.md)
69+

docs/copilot-studio-agent-builder-availability.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ This article provides information about Copilot Studio regional availability and
1414

1515
## Regional availability
1616

17-
Copilot Studio agent builder is available if your [Power Platform default environment](/power-platform/admin/environments-overview#default-environment) is in any of the following countries or regions:
17+
Copilot Studio agent builder is available if your [Power Platform default environment](/power-platform/admin/environments-overview#default-environment) is in any of the following countries or regions:
1818

1919
- Asia Pacific
2020
- Australia

docs/copilot-studio-agent-builder-build.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ The following table describes the fields that make up the agent.
5151
| **Description** | The description helps the Large Language Model (LLM) identify and use your agent for a specific task or situation. Make it as short, precise, and simple as possible. It's also displayed in the app file for use in the app catalog. Character limit of 1,000 characters. |
5252
| **Instructions** | Specific instructions to the LLM that you want to use to extend the capabilities of Microsoft 365 Copilot. They direct the behavior of the agent, including its tasks and how it completes them. If you're using the **Describe** tab, they're autogenerated for you. Character limit of 8,000 characters. For more information, see [Write effective instructions](declarative-agent-instructions.md).|
5353
| **Knowledge** | You can specify up to 20 knowledge sources (including SharePoint sites, folders, and files) or Microsoft Graph connectors. For details, see the [Add knowledge sources](#add-knowledge-sources) section. |
54-
| **Capabilities** | You can enhance the user experience of your declarative agent by adding capabilities. For details, see [Add capabilities to your declarative agent](add-agent-capabilities.md). |
54+
| **Capabilities** | You can enhance the user experience of your declarative agent by adding capabilities. |
5555
| **Starter Prompts** | Starter prompts help other users understand commonly supported scenarios by your agent. Each starter prompt comes with a name and description. There's no minimum number of starter prompts. |
5656
<!-- markdownlint-enable MD033 -->
5757

@@ -140,8 +140,8 @@ If at least one connector is enabled, you can add it to your agent. Your agent i
140140

141141
In the **Capabilities** section of the **Configure** tab, you can choose to add the following capabilities to your agent:
142142

143-
- [Code interpreter](add-agent-capabilities.md#code-interpreter) - Uses Python code to solve complex math problems, analyze data, and generate visualizations.
144-
- [Image generator](add-agent-capabilities.md#image-generator) - Generates images base on user prompts.
143+
- [Code interpreter](code-interpreter.md) - Uses Python code to solve complex math problems, analyze data, and generate visualizations.
144+
- [Image generator](image-generator.md) - Generates images base on user prompts.
145145

146146
To add one or more capabilities to your agent, choose the toggle next to the capability you want to enable.
147147

docs/debugging-copilot-agent.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -114,4 +114,3 @@ Enter a message, including the #extensibility tag, in the text box.
114114

115115
- [Build a declarative agent with Visual Studio Code](/microsoft-365-copilot/extensibility/build-declarative-agents)
116116
- [Build agents with Copilot Studio agent builder](copilot-studio-agent-builder-build.md)
117-
- [Add capabilities and knowledge sources to your agent](add-agent-capabilities.md)

docs/declarative-agent-document-interaction.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ For example, a user is working on a job description document, and wants to add a
2323

2424
:::image type="content" source="assets/images/declarative-agents/add-document-selection.png" alt-text="A screenshot of Copilot in Word showing the Add selection option" lightbox="assets/images/declarative-agents/add-document-selection.png":::
2525

26-
The user selects **Add selection** then asks the agent to [generate an image](add-agent-capabilities.md#image-generator) based on the selection.
26+
The user selects **Add selection** then asks the agent to [generate an image](image-generator.md) based on the selection.
2727

2828
:::image type="content" source="assets/images/declarative-agents/document-selection-prompt.png" alt-text="A screenshot of Copilot in Word showing the user prompt including the document selection" lightbox="assets/images/declarative-agents/document-selection-prompt.png":::
2929

docs/declarative-agent-manifest-1.2.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -221,7 +221,7 @@ The connection object contains the following properties.
221221
222222
#### Graphic art object
223223

224-
Indicates that the declarative agent can create images and art based on the text input from the user. For more information, see [Image generator](add-agent-capabilities.md#image-generator).
224+
Indicates that the declarative agent can create images and art based on the text input from the user. For more information, see [Image generator](image-generator.md).
225225

226226
The graphic art object contains the following properties.
227227

@@ -231,7 +231,7 @@ The graphic art object contains the following properties.
231231

232232
#### Code interpreter object
233233

234-
Indicates that the declarative agent can generate and execute Python code to solve complex math problems, analyze data, generate visualizations, and more. For more information, see [Code interpreter](add-agent-capabilities.md#code-interpreter).
234+
Indicates that the declarative agent can generate and execute Python code to solve complex math problems, analyze data, generate visualizations, and more. For more information, see [Code interpreter](code-interpreter.md).
235235

236236
The code interpreter object contains the following properties.
237237

docs/declarative-agent-manifest-1.3.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -257,7 +257,7 @@ The connection object contains the following properties.
257257
258258
#### Graphic art object
259259

260-
Indicates that the declarative agent can create images and art based on the text input from the user. For more information, see [Image generator](add-agent-capabilities.md#image-generator).
260+
Indicates that the declarative agent can create images and art based on the text input from the user. For more information, see [Image generator](image-generator.md).
261261

262262
The graphic art object contains the following properties.
263263

@@ -267,7 +267,7 @@ The graphic art object contains the following properties.
267267

268268
#### Code interpreter object
269269

270-
Indicates that the declarative agent can generate and execute Python code to solve complex math problems, analyze data, generate visualizations, and more. For more information, see [Code interpreter](add-agent-capabilities.md#code-interpreter).
270+
Indicates that the declarative agent can generate and execute Python code to solve complex math problems, analyze data, generate visualizations, and more. For more information, see [Code interpreter](code-interpreter.md).
271271

272272
The code interpreter object contains the following properties.
273273

docs/image-generator.md

Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
---
2+
title: Image Generator Capability for Declarative Agents for Microsoft 365 Copilot
3+
description: Learn about the image generator capability and how to add it to your declarative agents.
4+
author: kmkoenen
5+
ms.author: v-koenenkaty
6+
ms.topic: concept-article
7+
ms.localizationpriority: medium
8+
ms.date: 5/09/2025
9+
---
10+
11+
# Add the image generator capability to your agent
12+
13+
The image generator capability enables declarative agents for Microsoft 365 Copilot to generate images based on user prompts. Image generator uses the existing [Designer](https://designer.microsoft.com/) functionality to create visually appealing and contextually relevant graphics, and includes the following features:
14+
15+
- **Multiple image generation**: For each user prompt, the agent generates four images.
16+
- **Interactive image options**: Users can select each generated image to view it in full size. They can download, copy, or view content credentials for the full-size image. They can also select the side arrow to scroll through the four images.
17+
- **Image modification**: Users can follow up with subsequent prompts to modify the original images without losing context. For example, first prompt: "Create a photo of a happy puppy running around in a yard." Second prompt: "Include a tennis ball."
18+
- **Feedback mechanism**: Users can provide feedback on the generated images by giving a thumbs up or thumbs down. This feedback helps improve the quality of future image generations.
19+
- **Clipboard and sharing**: Users can copy the generated images to their clipboard to paste into other applications, or they can share the generated images directly from the interface.
20+
21+
The image generator capability is available to Copilot Chat users with no metered usage or Microsoft 365 Copilot license.
22+
23+
## Image generator examples
24+
25+
The following examples show what users can do with the image generation capability in your agent.
26+
27+
**User prompt**: Create an image of a serene beach at sunset with palm trees and gentle waves.
28+
29+
The following image shows the result.
30+
31+
:::image type="content" source="assets/images/image-gen-beach-prompt.png" alt-text="Beach image response to the user prompt":::
32+
33+
**User prompt**: Design a flyer for a summer music festival and add a date for May 15, 2024.
34+
35+
The following image shows the result.
36+
37+
:::image type="content" source="assets/images/image-gen-flier-prompt.png" alt-text="Festival flyer image response to the user prompt":::
38+
39+
## Enable image generator
40+
41+
If you're using [Teams Toolkit and Visual Studio Code](build-declarative-agents.yml) to create your agent, to enable image generator in your agent, add the `GraphicArt` value to the **capabilities** property in your manifest file, as shown in the following example.
42+
43+
> [!NOTE]
44+
> You must be using [version 1.2](declarative-agent-manifest-1.2.md) or later of the declarative agent manifest schema to add the `GraphicArt` capability.
45+
46+
47+
```json
48+
{
49+
"capabilities": [
50+
{
51+
"name": "GraphicArt"
52+
}
53+
]
54+
}
55+
```
56+
57+
If you're using [Copilot Studio agent builder](copilot-studio-agent-builder.md) to create your agent, on the **Configure** tab, under **Capabilities**, choose the toggle next to **Image generator**.
58+
59+
:::image type="content" source="assets/images/capabilities-toggle.png" alt-text="Screenshot of the Capabilities section of the agent builder":::
60+
61+
> [!NOTE]
62+
> The image generator doesn't currently work in the test pane in Copilot Studio agent builder.
63+
64+
## Related content
65+
66+
- [Declarative agents overview](overview-declarative-agent.md)
67+
- [Declarative agent manifest reference](declarative-agent-manifest-1.3.md)
68+
- [Add the code interpreter capability to your agent](code-interpreter.md)
69+
- [Add knowledge sources to your declarative agent](knowledge-sources.md)

docs/includes/declarative-agents-walkthrough/08-add-people.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ ms.localizationpriority: medium
44

55
<!-- markdownlint-disable MD041 -->
66

7-
In this section, you add the [people capability](../../add-agent-capabilities.md#people-knowledge) to the declarative agent. The people capability allows you to scope your agent to answer questions about individuals in an organization.
7+
In this section, you add the [people capability](../../knowledge-sources.md#people-knowledge) to the declarative agent. The people capability allows you to scope your agent to answer questions about individuals in an organization.
88

99
1. Open the `appPackage/declarativeAgent.json` file and add the `People` entry to the `capabilities` array.
1010

docs/includes/declarative-agents-walkthrough/09-add-email.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ ms.localizationpriority: medium
44

55
<!-- markdownlint-disable MD041 -->
66

7-
In this section, you add the [email capability](../../add-agent-capabilities.md#email-knowledge) to the declarative agent. The email capability allows you to scope your agent to use email from the user's mailbox or a shared mailbox as a knowledge source.
7+
In this section, you add the [email capability](../../knowledge-sources.md#email-knowledge) to the declarative agent. The email capability allows you to scope your agent to use email from the user's mailbox or a shared mailbox as a knowledge source.
88

99
1. Open the `appPackage/declarativeAgent.json` file and add the `Email` entry to the `capabilities` array.
1010

docs/includes/declarative-agents-walkthrough/10-add-graphic-art.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ ms.localizationpriority: medium
44

55
<!-- markdownlint-disable MD041 -->
66

7-
In this section, you add the [image generator capability](../../add-agent-capabilities.md#image-generator) to the declarative agent.
7+
In this section, you add the [image generator capability](../../image-generator.md) to the declarative agent.
88

99
1. Open the `appPackage/declarativeAgent.json` file and add the `GraphicArt` entry to the `capabilities` array.
1010

docs/includes/declarative-agents-walkthrough/11-add-code-interpreter.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ ms.localizationpriority: medium
44

55
<!-- markdownlint-disable MD041 -->
66

7-
In this section, you add the [code interpreter capability](../../add-agent-capabilities.md#code-interpreter) to the declarative agent. Code interpreter is an advanced tool designed to solve complex tasks via Python code.
7+
In this section, you add the [code interpreter capability](../../code-interpreter.md) to the declarative agent. Code interpreter is an advanced tool designed to solve complex tasks via Python code.
88

99
1. Open the `appPackage/declarativeAgent.json` file and add the `CodeInterpreter` entry to the `capabilities` array.
1010

0 commit comments

Comments
 (0)