MeetStream Guide: Create an AI Agent & Bring It Into a Meeting

View as Markdown

What is MIA?

MIA stands for MeetStream Infrastructure Agent — the platform layer that lets you create, configure, and deploy AI agents into live meetings. Through the MIA tab in the dashboard, you define how your agent listens, thinks, and acts during a call.

This guide walks you through creating an AI agent using MIA, connecting it to an MCP server for tool calling, and deploying it into a live meeting.

Applies to: Google Meet, Zoom, Microsoft Teams. Support: docs.meetstream.ai • API: api.meetstream.ai


1) Open the MeetStream dashboard

  1. Go to app.meetstream.ai.
  2. Navigate to the MIA tab.
  3. Click Create New Agent.

MIA tab — Create New Agent


2) Choose a mode: Realtime vs Pipeline

MeetStream offers two agent modes. Pick the one that fits your use case.

RealtimePipeline
How it worksSingle provider handles everything (LLM, TTS, STT + MCP)Each component (LLM, TTS, STT) can use a different provider
LatencyLower — fewer hops between servicesHigher — each stage is a separate call
Best forFast conversational agents where speed mattersFine-tuned setups where you want the best provider per capability

Tip: Start with Realtime mode if you want the fastest response times. Switch to Pipeline when you need specific provider combinations.


3) Select the agent response type

Choose how the agent should interact during the meeting:

Response typeBehavior
VoiceAgent listens and responds with spoken audio
ChatAgent responds via text in the meeting chat
ActionAgent performs actions silently (no voice or chat output)

In all three modes, the agent can perform tool actions through MCP servers or custom functions (see steps 6 and 6c).


4) Select provider and model

Pick the LLM provider and model that will power your agent. The available options depend on the mode you chose in step 2:

  • Realtime mode — select one provider/model for the entire pipeline.
  • Pipeline mode — select a provider/model individually for LLM, TTS, and STT.

5) Add a system prompt

The system prompt defines how your agent behaves — its personality, constraints, and instructions.

Write a clear prompt that tells the agent:

  • What role it plays (e.g., “You are a meeting assistant that takes notes and creates action items”)
  • What it should and shouldn’t do
  • How it should respond (tone, length, format)

Example

You are a helpful meeting assistant for an engineering team.
Summarize discussions, track action items, and create Linear tickets
when asked. Keep responses concise and professional.

6) Connect an MCP server (tool calling)

MCP (Model Context Protocol) lets your agent call external tools — like creating tickets, querying databases, or triggering workflows. This section shows how to set up an MCP server locally using Docker and expose it to MeetStream.

Step 1: Install Docker

  1. Download and install the latest Docker Desktop from docker.com.
  2. Sign in to Docker Desktop.

Step 2: Add an MCP server from the Docker catalog

  1. In Docker Desktop, look for the MCP tab (new feature).
  2. Go to the Catalogue section.
  3. Search for an MCP server — for example, Linear, GitHub, or any other available server.
  4. Add the server and authorize it when prompted.

Docker MCP Catalogue

Step 3: Run the MCP gateway

Start the Docker MCP gateway with streaming transport on port 8080:

$docker mcp gateway run --transport streaming --port 8080

Docker will start the MCP gateway locally on port 8080. You will also receive a bearer token in the output — save it, you’ll need it in step 4.

Important: Copy and store the bearer token from the command output. You will need it to authenticate MeetStream with your MCP gateway.

Step 4: Tunnel with ngrok

Your MCP gateway is running on localhost:8080, but MeetStream needs a public URL. Use ngrok to create a tunnel:

$ngrok http 8080

ngrok will print a public HTTPS URL like:

https://<YOUR_NGROK_DOMAIN>

Your MCP endpoint is now reachable at:

https://<YOUR_NGROK_DOMAIN>/mcp

For Docker MCP gateway, always append /mcp to the ngrok URL.

Step 5: Add the MCP server URL in the dashboard

Back in the MeetStream dashboard (agent creation screen):

  1. In the MCP Server URL field, enter your full URL:
https://<YOUR_NGROK_DOMAIN>/mcp
  1. In the Header section, add the bearer token:
Authorization: Bearer <YOUR_BEARER_TOKEN>
  1. Click Fetch — MeetStream will connect to your MCP server and retrieve a list of available tools/actions.
  2. Select the tools you want the agent to use (e.g., create, list, edit, etc.).
  3. Click Save to finalize the agent.

MCP Server Configuration


xAI Full Pipeline Agent — Quick Setup

To create an agent powered entirely by xAI (Grok STT + Grok LLM + Aurora TTS) using a single API key:

Step 1: Add your xAI API key

In the MeetStream dashboard → Integrations → add your XAI_API_KEY under the xAI integration.

This single key covers the Grok STT, Grok LLM, xAI TTS, and xAI realtime voice — you only need to add it once.

Step 2: Create the agent via API

$curl -X POST "https://api.meetstream.ai/api/v1/mia" \
> -H "Authorization: Token <YOUR_API_KEY>" \
> -H "Content-Type: application/json" \
> -d '{
> "agent_name": "xAI Meeting Assistant",
> "mode": "pipeline",
> "model": {
> "provider": "xai",
> "model": "grok-3",
> "system_prompt": "You are a helpful AI meeting assistant powered by xAI Grok. Keep responses concise and natural.",
> "first_message": "Hey everyone! I am your xAI meeting assistant. How can I help?",
> "temperature": 0.8,
> "max_tokens": 150
> },
> "voice": {
> "provider": "xai",
> "model": "tts-1",
> "voice_id": "ara"
> },
> "transcriber": {
> "provider": "xai",
> "model": "stt-1",
> "language": "en"
> }
> }'

Parameters:

FieldValueRequiredNotes
model.provider"xai"YesUses Grok LLM
model.model"grok-3" or "grok-3-mini"Yesgrok-3-mini for lower cost
model.system_prompt(your prompt)YesDefines agent behavior
voice.provider"xai"YesUses xAI Aurora TTS
voice.model"tts-1"No (auto-filled)Defaults to tts-1 for xAI
voice.voice_id"ara"YesOptions: ara, eve, leo, rex
transcriber.provider"xai"YesUses Grok STT (stt-1)
transcriber.model"stt-1"No (auto-filled)Defaults to stt-1; 25 languages supported
transcriber.language"en"No (default: en)BCP-47 language code

Minimum required fields (pipeline mode): agent_name, mode, model.provider, model.model, model.system_prompt, voice.provider, voice.voice_id, and transcriber.provider. Provider-aware defaults fill voice.model, transcriber.model, and other optional settings. See the API Reference — Server-Side Defaults for the full defaults table.

Available xAI TTS voices:

Voice IDCharacter
araWarm, friendly (default)
eveEnergetic, upbeat
leoAuthoritative, strong
rexConfident, clear

xAI Aurora TTS also supports expressive speech tags in your LLM responses — e.g. [pause], [laugh], <whisper>text</whisper>. See xAI speech tags docs.

Prefer lower latency? Swap the transcriber for Deepgram nova-3 — it has slightly lower STT latency than xAI stt-1 for English.


6b) (Optional) Add a Virtual Avatar

Give the agent a photorealistic animated face that lip-syncs to its voice in real time. MeetStream uses Anam as the avatar provider.

Step 1: Get an Anam API key

  1. Sign up at anam.ai and create a project.
  2. Copy your API key from the Anam dashboard.

Step 2: Find an avatar id

List the avatars available on your Anam account:

$curl -H "Authorization: Bearer <ANAM_API_KEY>" \
> https://api.anam.ai/v1/avatars

Copy any id field from the response — that’s your avatar_id.

Heads up: Anam has both persona_ids and avatar_ids, both of which are UUIDs. MeetStream needs the avatar id. If you pass a persona id by mistake, MeetStream will tell you exactly that in the error message and show you how to fetch the correct id.

Step 3: Store the key in MeetStream

In the MeetStream dashboard → IntegrationsAvatarAnam, paste your ANAM_API_KEY and save.

Step 4: Enable the avatar on your agent

In the MIA tab, edit your agent and turn on the Avatar toggle. Paste the avatar_id from step 2.

When the bot next joins a meeting, the avatar will render on the bot’s participant tile and lip-sync to every TTS response.


6c) (Optional) Add a Custom Function

If your agent needs to call a single HTTPS endpoint you already host — e.g. a CRM lookup, an order-status API, or a webhook that creates a ticket — you can register it as a custom function directly on the agent, without running an MCP server.

The LLM sees the function’s name, description, and JSON Schema for arguments, and decides on its own when to call it. Your endpoint authenticates MeetStream the same way you’d authenticate any other client — typically a bearer token configured in the function’s headers field.

Step 1: Open the Custom Functions section

In the MIA agent editor, open the Custom Functions panel (sibling to MCP servers) and click Add Function.

Step 2: Fill in the basics

  • Name — snake-case identifier, e.g. lookup_order. Unique per agent.
  • Description — short natural-language description. The LLM reads this to decide when to call.
  • MethodPOST (default), GET, PATCH, PUT, or DELETE.
  • URL — full HTTPS URL. Must resolve to a public IP; private / metadata targets are rejected.
  • Headers (optional) — extra HTTP headers, normally including a dedicated bearer token for your endpoint. Values can use {{variable}} placeholders. Environment expansion works only when the whole value is env:MY_VAR and that variable is provisioned in the managed runtime.

Step 3: Define the argument schema

Paste a small JSON Schema object. Example for a weather lookup:

1{
2 "type": "object",
3 "required": ["city"],
4 "properties": {
5 "city": { "type": "string", "description": "City name" }
6 }
7}

Step 4: Tune runtime behavior (optional)

  • Timeout — 1–120 seconds (default 30).
  • Retries — 0–5 on 5xx / network failures (default 2).
  • Response cap — 1000–50000 characters (default 15000). Longer responses are truncated.
  • Speak during execution — agent can emit a filler while the HTTP call runs. Set a custom filler (“One moment…”) or leave it blank to use the default (“One moment please.”).
  • Speak after execution — turn off for pure side-effect calls (e.g. create-ticket). The agent’s turn ends silently after the call returns.

Step 5: Capture response variables (optional)

If your endpoint returns JSON, you can pull fields out of the response and use them as template variables later in the conversation:

Name: latest_order_status
Path: data.order.status

After the tool runs, {{latest_order_status}} is available to later custom-function templates and to a saved prompt template when update_mia rebuilds it through agent_config_params. A literal system_prompt sent to update_mia is not template-resolved.

Step 6: Test and save

Save the agent. When you launch a bot with this agent, the tool is registered automatically and the LLM can call it whenever the conversation warrants.

See the Custom Functions Guide for a complete end-to-end example, including a receiving-endpoint sketch and response-variable usage.


6d) (Optional) Configure the Wake Word

Pipeline mode only. Realtime mode does not run the wake-word gate.

Pipeline agents currently start with wake-word gating enabled unless you explicitly set wake_word.enabled=false. If no block is stored, the runtime uses "hey assistant" and "hello bot" with a 30-second listening window. Configure the gate explicitly so the saved agent makes the intended behavior clear.

Step 1: Enable the gate

In the MIA agent editor, open the Wake Word panel and toggle Enabled on.

Step 2: Set the trigger phrases and timeout

FieldDefaultNotes
Words["hey assistant", "hello bot"]One or more trigger phrases. Comma-separated string or array. Add domain-specific aliases (e.g. "hey rover") if you’ve branded the assistant.
Timeout (sec)30How long the agent stays active after hearing the wake word. Each new utterance during this window rolls the timer forward.

Step 3 (optional): Tune for your meeting style

Two adaptive knobs let you reshape the gate without disabling it entirely:

FieldDefaultRangeWhen to use
Bypass below participants0 (off)050Set to 1 for direct 1:1 calls (sales / coaching / interviews) so the bot behaves like a normal always-on assistant. When it’s just you and the bot, the gate is skipped. The gate re-enables the moment a second human joins, so you don’t need separate agent configs per call type. The bot is not counted.
Max listening window (sec)0 (off)07200Hard ceiling on a single listening session even if the user keeps talking. Useful for high-traffic shared meetings where you want the wake word to actually re-arm. Combine with the default Timeout: 30 for “always-listen for up to 10 minutes after the wake word, then re-arm”.

Step 4: Test

Save the agent and launch a bot. The bot should stay quiet until you say one of the trigger phrases — try a 1:1 call (you + bot) with Bypass below participants: 1 to confirm the bypass kicks in.

API equivalent: the same fields are accepted on POST /api/v1/mia and PUT /api/v1/mia under wake_word. See wake_word in the Agent Config API Reference for the full schema.

Step 5 (optional): Take live control during a call

The wake-word gate doesn’t have to be set in stone. While the bot is in the meeting you can flip it on/off or change the trigger phrases at runtime via the same update_mia endpoint that updates prompts:

$# Force the gate OFF for the rest of the call (always-on listening)
$curl -X POST "https://api.meetstream.ai/api/v1/bots/{bot_id}/update_mia" \
> -H "Authorization: Token <YOUR_API_KEY>" \
> -d '{ "wake_word_enabled": false }'
$
$# Replace the wake phrases mid-call
$curl -X POST "https://api.meetstream.ai/api/v1/bots/{bot_id}/update_mia" \
> -H "Authorization: Token <YOUR_API_KEY>" \
> -d '{ "wake_words": ["hey ada", "ok ada"] }'

The wake_word_enabled flag set this way supersedes the Bypass below participants rule for the rest of that call — once you’ve taken explicit control, the platform stops auto-bypassing on participant count. This is what you want for “push-to-talk” dashboards or for a meeting host who needs to override the configured behaviour mid-call.

See Live wake-word control in the API Reference for the full contract, validation rules, and combined-update examples.


6e) (Optional) Speaker-Aware Responses

Pipeline mode only. Realtime models handle speaker context implicitly via direct audio.

By default the agent sees every transcribed utterance as coming from a single anonymous user. On multi-participant calls (sales calls, panels, group standups) the agent has no way to tell who said what, so it can’t address people by name or follow turn-taking.

Turn on speaker-aware responses and every user utterance reaching the LLM is prefixed with the active speaker’s display name:

[Rahul]: Can you summarise the action items so far?
[Priya]: I disagree with the budget number, can we revisit it?

The agent’s system prompt is automatically extended with a short note telling it to use the names but not echo the bracketed prefix back in its replies.

How to enable

In the dashboard, toggle Speaker-aware responses under the agent settings. Or via API, set agent.speaker_aware_responses: true in your POST /api/v1/mia payload:

1{
2 "mode": "pipeline",
3 "agent": {
4 "speaker_aware_responses": true
5 }
6}

Customising the LLM instruction (optional)

Out of the box, MeetStream appends a short generic instruction to your model.system_prompt telling the LLM to use the names but not echo the bracketed prefix back. For most agents this is enough. If you want different behaviour — for example, summarise per-speaker at the end of the call, defer authoritative weight to a host, or treat the names as silent metadata that the agent should never speak out loud — provide your own agent.speaker_aware_prompt:

1{
2 "mode": "pipeline",
3 "agent": {
4 "speaker_aware_responses": true,
5 "speaker_aware_prompt": "Each user message is prefixed with [Speaker Name]:. Track each participant's viewpoint separately. When asked to summarise, group the summary by speaker. Never repeat the bracketed prefix in your own replies."
6 }
7}

Rules:

  • Max 2000 characters.
  • Appended verbatim to your model.system_prompt with a leading blank line whenever speaker_aware_responses=true.
  • Omitted / empty / null → MeetStream uses its default instruction.
  • The bracketed prefix on user messages ([Rahul]: ...) is unconditional once the flag is on; the prompt only governs how the LLM interprets it, not whether it appears.

See Speaker-Aware Responses → Customising the instruction in the API Reference for more example prompts.

Speaker accuracy

PlatformAccuracy
ZoomStrongest attribution — native per-user audio is tagged with SDK node_id
Google MeetApproximate — mixed audio uses current active-speaker state; per-track audio is best effort
Microsoft TeamsStrong with isolated participant tracks; approximate on mixed-audio dominant-speaker fallback

The name prefix uses the latest speaker state when an utterance completes, rather than speaker-bound diarization. Treat it as conversational context; rapid hand-offs and overlapping speech can be misattributed.

API equivalent: agent.speaker_aware_responses on POST /api/v1/mia and PUT /api/v1/mia. See Speaker-Aware Responses in the API Reference for full details.


7) Bring the agent into a meeting

Now that your agent is created, you can deploy it into a live meeting using the API.

API endpoint

POST https://api.meetstream.ai/api/v1/bots/create_bot

Required fields

Include agent_config_id in your payload alongside the standard bot parameters:

FieldPurpose
agent_config_idThe ID of the agent you created in the dashboard

When agent_config_id is present, MeetStream auto-populates the internal WebSocket endpoints (socket_connection_url and live_audio_required) that bridge the bot to your agent. You do not need to supply them.

Example cURL

$curl -X POST "https://api.meetstream.ai/api/v1/bots/create_bot" \
> -H "Authorization: Token <YOUR_API_KEY>" \
> -H "Content-Type: application/json" \
> -d '{
> "meeting_link": "<YOUR_MEETING_LINK>",
> "agent_config_id": "<YOUR_AGENT_CONFIG_ID>"
> }'

Once the bot joins the meeting, your AI agent is live — you can start talking to it immediately.


8) End-to-end summary

Here’s the full flow at a glance:

  1. Dashboard → MIA tab → Create New Agent
  2. Mode → Realtime (fast, single provider) or Pipeline (flexible, multi-provider)
  3. Response type → Voice / Chat / Action
  4. Provider & model → Pick the LLM (and TTS/STT if Pipeline)
  5. System prompt → Define the agent’s behavior
  6. MCP server → Docker MCP gateway → ngrok tunnel → add URL + bearer token → fetch & select tools
  7. Custom functions (optional) → Register your own HTTPS endpoints as tools with JSON Schema arguments
  8. Avatar (optional) → Add Anam API key → pick avatar_id → enable on agent
  9. Wake word (optional, pipeline only) → Enable + set trigger phrases; for 1:1 calls set Bypass below participants: 1
  10. Speaker-aware responses (optional, pipeline only) → Enable for multi-participant calls so the agent can address people by name
  11. DeployPOST /api/v1/bots/create_bot with agent_config_id
  12. Talk → Agent is live in the meeting

Troubleshooting

MCP Fetch returns no tools

  • Confirm the Docker MCP gateway is running (docker mcp gateway run ...).
  • Confirm ngrok is tunneling to the correct port (8080).
  • Make sure you appended /mcp to the ngrok URL.
  • Verify the bearer token in the header is correct.

Agent doesn’t respond in the meeting

  • Check that agent_config_id matches the saved agent in the dashboard.
  • Do not add bridge WebSocket URLs manually. When agent_config_id is present, MeetStream supplies socket_connection_url and live_audio_required automatically.
  • Confirm that the API keys required by the configured model, voice, transcriber, and avatar providers are still valid under Integrations.
  • Verify the meeting link is valid and the bot has joined successfully (check webhook events).

Avatar doesn’t appear (or session fails to start)

  • avatar_id is actually a persona id — Anam uses both persona_id and avatar_id (both UUIDs). MeetStream needs the avatar id. Fetch it from GET https://api.anam.ai/v1/avatars or the avatar.id field of a persona.
  • Anam API key rejected (401/403) — the ANAM_API_KEY stored under Integrations was rotated or is invalid. Update it in the MeetStream dashboard.
  • Concurrent session limit — Anam has a per-account concurrent-session cap and no kill-session API. Orphaned sessions auto-expire at maxSessionLengthSeconds (~180s default). The error message MeetStream returns lists the open sessions and their expiry ETA.

Custom function is never called by the LLM

  • Make sure the description is clear and action-oriented. The LLM uses the description (and nothing else) to decide when to call. A vague description (“does stuff”) is the most common cause.
  • Make the name specific (e.g. lookup_order rather than api_call_1).
  • Add an example usage in the system prompt — e.g. “When the caller asks about an order, call lookup_order with the order id.”

Custom function fails with SSRF / URL-rejected error

  • URLs must be HTTPS and their hostname must resolve to a public IP. Private (10.x / 172.16–31.x / 192.168.x), loopback, metadata, and link-local addresses are blocked.
  • Use a proper tunnel (ngrok, Cloudflare Tunnel, etc.) during development instead of pointing at localhost.

Custom function returns data but {{var}} is empty on update_mia

  • Confirm the response is JSON (not plain text / HTML). Response-variable extraction only runs on JSON bodies.
  • Confirm the path matches the JSON structure exactly — dot notation only (e.g. data.user.city), no brackets or $. prefixes.

ngrok tunnel expired

  • Free ngrok tunnels rotate URLs on restart. Re-run ngrok http 8080 and update the MCP Server URL in the dashboard.

For webhook event handling (bot lifecycle + post-call processing), see the Webhook Events Guide.


FAQ

What does MIA stand for?

MeetStream Infrastructure Agent. It’s the platform layer that powers agent creation, configuration, and deployment into meetings.

Can I use my own LLM API key?

Yes. MIA uses BYOK provider keys configured under Integrations in the dashboard or through the Integrations API. The providers accepted by the MIA API are listed in the Agent Config API Reference.

What’s the difference between Realtime and Pipeline mode?

Realtime uses a single provider for LLM, TTS, STT, and MCP — it’s faster because everything runs through one service. Pipeline lets you mix different providers for each component (e.g., one model for speech-to-text, another for the LLM), giving you more flexibility at the cost of slightly higher latency.

Can the agent perform actions in all response types (Voice, Chat, Action)?

Yes. MCP tools and custom functions work with Voice, Chat, and Action response types.

Do I need Docker to use MCP with MeetStream?

Not necessarily. Docker is one way to run an MCP server locally using the built-in MCP catalog and gateway. If you already have an MCP-compatible server hosted elsewhere, you can point MeetStream directly to its URL.

Why do I need to append /mcp to the ngrok URL?

The Docker MCP gateway exposes its MCP endpoint at the /mcp path. Without it, MeetStream won’t reach the correct route and the Fetch will fail.

Can I connect multiple MCP servers to one agent?

Yes. agent.mcp_servers is an array, so an agent can connect to multiple MCP servers. Each server can have independent headers, tool allowlists, and timeouts.

What happens if my ngrok tunnel goes down during a meeting?

The agent loses access to MCP tools while the tunnel is down. It will still be in the meeting but won’t be able to execute tool calls. Restart ngrok, update the MCP URL in the dashboard, and redeploy if needed. For production use, host your MCP server on a stable endpoint instead of a tunnel.

Where do I find my agent_config_id?

After saving your agent in the MIA dashboard, the agent_config_id is shown in the agent details. You can also retrieve it via the MeetStream API.

Can I update an agent’s configuration after creating it?

Yes. Edit the saved configuration through the dashboard or PUT /api/v1/mia; saved changes apply to new sessions. For an agent already in a meeting, use POST /api/v1/bots/{bot_id}/update_mia to update its prompt, template variables, or wake-word state live.

Which meeting platforms are supported?

Google Meet, Zoom, and Microsoft Teams.