# AI clipping Source: https://developers.heygen.com/ai-clipping Turn a long-form video into short, ready-to-share highlight clips with the HeyGen AI Clipping API — the model picks the best moments, cuts them to your target durations, and scores each clip's virality. ## Create a Clip Job * Endpoint: [`POST /v3/ai-clipping`](/reference/create-ai-clipping) * Purpose: Start a clipping job for a source video. Returns an `ai_clipping_id` to poll. ### Quick Example ```bash theme={null} curl -X POST "https://api.heygen.com/v3/ai-clipping" \ -H "X-Api-Key: $HEYGEN_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "video": { "type": "url", "url": "https://example.com/interview.mp4" }, "title": "Founder interview", "output_settings": { "duration_types": ["30", "60"], "aspect_ratio": "portrait", "captions": false, "prompt": "Pull the moments where the founder talks about pricing and growth." } }' ``` ```json Response theme={null} { "data": { "ai_clipping_id": "edf8d2c44ba441b89f395072b3ef7e34" } } ``` ### Request Body | Parameter | Type | Required | Default | Description | | ----------------- | ------ | -------- | ----------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `video` | object | Yes | — | Source video. Provide as `{ "type": "url", "url": "https://..." }` or `{ "type": "asset_id", "asset_id": "..." }` (from [`POST /v3/assets`](/reference/upload-asset) — see [Upload Assets](/docs/upload-assets)). | | `title` | string | No | — | Title for the job. Defaults to the source video's title when omitted. | | `input_language` | string | No | auto-detect | ISO-639-1 source language code (e.g. `en`, `es`). Omit to auto-detect. | | `output_settings` | object | No | — | Configuration for the produced clips — see [Output settings](#output-settings). | | `callback_url` | string | No | — | [Webhook](/docs/webhooks) URL — receives a POST when the job completes or fails. | | `callback_id` | string | No | — | Arbitrary ID echoed back in the webhook payload. | ### Output settings | Field | Type | Required | Default | Description | | ---------------- | ---------------- | -------- | ---------- | ----------------------------------------------------------------------------------------------------------------------------------------------- | | `duration_types` | array of strings | No | — | Target clip durations to produce: `"30"`, `"60"`, `"180"`, or `"long"` (1–4 entries). Each duration produces a separate clip. | | `aspect_ratio` | string | No | `portrait` | Framing for all produced clips: `portrait` (9:16, social-ready), `landscape` (16:9), or `square` (1:1). | | `captions` | boolean | No | `true` | Captions are burned into the clips by default. Set `false` for clean, caption-free footage — as in the example above. | | `caption_style` | string | No | — | Named caption style preset (e.g. `classic`, `bold`) when captions are on. Omit for the default style. | | `prompt` | string | No | — | Editorial guidance for the highlight model — which speaker, what topics (max 500 chars). When omitted, the model selects highlights on its own. | Want captions on some clips and clean footage on others? Captions are a per-job setting, so submit two jobs from the same source `video` — one with `"captions": false` — and pick per platform. To style burned-in captions on other footage, `caption_style` presets like `classic` and `bold` keep the look consistent. ## Get a Clip Job * Endpoint: [`GET /v3/ai-clipping/{job_id}`](/reference/get-ai-clipping) * Purpose: Fetch a clip job's live status and, as they render, its finished clips. ### Quick Example ```bash theme={null} curl -X GET "https://api.heygen.com/v3/ai-clipping/edf8d2c44ba441b89f395072b3ef7e34" \ -H "X-Api-Key: $HEYGEN_API_KEY" ``` ### Path Parameters | Parameter | Type | Required | Description | | --------- | ------ | -------- | ----------------------------------------------------------------------------- | | `job_id` | string | Yes | Unique job identifier returned by `POST /v3/ai-clipping` as `ai_clipping_id`. | ### Response ```json theme={null} { "data": { "id": "edf8d2c44ba441b89f395072b3ef7e34", "title": "Founder interview", "status": "completed", "input_language": "en", "source_duration": 1264.4, "progress": 100, "clips": [ { "id": "92799db89cdf444eb40a3d3db4378f4c", "status": "completed", "title": "Why we changed our pricing", "duration_seconds": 26.4, "aspect_ratio": "portrait", "virality_score": 65, "thumbnail_url": "https://resource2.heygen.ai/video_repurpose/.../1280x720.jpeg", "video_url": "https://resource2.heygen.ai/video_repurpose/.../1280x720.mp4?..." } ], "created_at": 1784649990 } } ``` ### Response Fields | Field | Type | Description | | -------------------------- | --------------- | ------------------------------------------------------------------------------------ | | `id` | string | Unique job identifier. | | `title` | string or null | Display title for the job. | | `status` | string | Job lifecycle status: `pending`, `running`, `completed`, `failed`, or `cancelled`. | | `input_language` | string or null | Detected or supplied source language code. | | `source_duration` | number or null | Duration of the source video in seconds. | | `progress` | integer | Approximate progress (0–100). `100` when all clips are completed. | | `clips` | array | Produced clips. Populates as each clip renders — empty until the first one finishes. | | `clips[].id` | string | Unique clip identifier. | | `clips[].status` | string | Per-clip status: `pending`, `completed`, or `failed`. | | `clips[].title` | string or null | Model-generated clip title. | | `clips[].duration_seconds` | number or null | Final clip length in seconds. Populated when the clip completes. | | `clips[].aspect_ratio` | string or null | Framing of the finished clip. | | `clips[].virality_score` | integer or null | Model-predicted virality score (0–100). | | `clips[].thumbnail_url` | string or null | Pre-signed thumbnail URL. | | `clips[].video_url` | string or null | Pre-signed MP4 download URL. | | `callback_id` | string or null | Client-provided callback ID. | | `created_at` | integer | Unix timestamp (seconds) of job creation. | | `failure_message` | string or null | Error description. Only present when status is `failed`. | Each `video_url` and `thumbnail_url` is a pre-signed link with a limited lifetime. Download the file (or hand the URL to a downstream step) soon after the job completes rather than caching it for later. ## List Clip Jobs * Endpoint: [`GET /v3/ai-clipping`](/reference/list-ai-clipping) * Purpose: List clip jobs with cursor-based pagination. ### Quick Example ```bash theme={null} curl -X GET "https://api.heygen.com/v3/ai-clipping?limit=10" \ -H "X-Api-Key: $HEYGEN_API_KEY" ``` ### Query Parameters | Parameter | Type | Required | Default | Description | | --------- | ------- | -------- | ------- | ---------------------------------------------------------------------------------------- | | `limit` | integer | No | `10` | Results per page. | | `token` | string | No | — | Opaque cursor token. Pass the `next_token` from a prior response to fetch the next page. | ### Response ```json theme={null} { "data": [ { "id": "edf8d2c44ba441b89f395072b3ef7e34", "title": "Founder interview", "status": "completed", "progress": 100, "created_at": 1784649990 } ], "has_more": false, "next_token": null } ``` The list endpoint reports coarse `progress`; poll [`GET /v3/ai-clipping/{job_id}`](#get-a-clip-job) for live in-flight progress on a specific job. ## Delete a Clip Job * Endpoint: [`DELETE /v3/ai-clipping/{job_id}`](/reference/delete-ai-clipping) * Purpose: Permanently delete a clip job and its clips. ### Quick Example ```bash theme={null} curl -X DELETE "https://api.heygen.com/v3/ai-clipping/edf8d2c44ba441b89f395072b3ef7e34" \ -H "X-Api-Key: $HEYGEN_API_KEY" ``` ### Response ```json theme={null} { "data": { "id": "edf8d2c44ba441b89f395072b3ef7e34" } } ``` ## Polling Pattern Clip jobs are processed asynchronously. Poll until status reaches `completed` or `failed`. Status transitions: `pending` → `running` → `completed` | `failed` ```bash theme={null} while true; do STATUS=$(curl -s "https://api.heygen.com/v3/ai-clipping/$JOB_ID" \ -H "X-Api-Key: $HEYGEN_API_KEY" | jq -r '.data.status') echo "Status: $STATUS" [ "$STATUS" = "completed" ] || [ "$STATUS" = "failed" ] && break sleep 10 done ``` For long recordings, prefer a [`callback_url`](/docs/webhooks) over tight polling — HeyGen will POST you the finished job instead (`ai_clipping.success` / `ai_clipping.fail` [webhook events](/docs/webhook-events)). ## Asset Inputs The `video` field accepts two input formats: **By URL** — any publicly accessible HTTPS link: ```json theme={null} { "type": "url", "url": "https://example.com/recording.mp4" } ``` **By asset ID** — reference a file previously uploaded via [`POST /v3/assets`](/reference/upload-asset) (see [Upload Assets](/docs/upload-assets)): ```json theme={null} { "type": "asset_id", "asset_id": "asset_xyz789" } ``` ## Full Example ```python theme={null} import time import requests API_KEY = "YOUR_API_KEY" BASE = "https://api.heygen.com" HEADERS = {"x-api-key": API_KEY, "Content-Type": "application/json"} def clip_video(video_url, prompt=None): """Start a clip job, wait for it, and return the finished clips.""" body = { "video": {"type": "url", "url": video_url}, "output_settings": { "duration_types": ["30", "60"], "aspect_ratio": "portrait", "captions": False, }, } if prompt: body["output_settings"]["prompt"] = prompt job_id = requests.post( f"{BASE}/v3/ai-clipping", headers=HEADERS, json=body ).json()["data"]["ai_clipping_id"] while True: job = requests.get(f"{BASE}/v3/ai-clipping/{job_id}", headers=HEADERS).json()["data"] if job["status"] in ("completed", "failed"): break time.sleep(10) if job["status"] == "failed": raise RuntimeError(job.get("failure_message") or "clip job failed") return job["clips"] for clip in clip_video("https://example.com/interview.mp4", prompt="Best product moments"): print(f"{clip['title']} ({clip['duration_seconds']}s) -> {clip['video_url']}") ``` Pairing clips with audio? The same [Tools](/background-music) suite covers [background music](/background-music) and [sound effects](/sound-effects) to score your cuts. # Assets Source: https://developers.heygen.com/assets Upload, list, and manage images, audio, and video files via the HeyGen Assets API. Reference uploaded assets in any avatar video, translation, or lipsync. Upload images, videos, audio, or PDFs to get an `asset_id` you can reference in other endpoints — like `POST /v3/video-agents`, `POST /v3/videos`, or `POST /v3/avatars`. ## Upload an Asset ```bash theme={null} curl -X POST https://api.heygen.com/v3/assets \ -H "x-api-key: YOUR_API_KEY" \ -F "file=@./my-photo.png" ``` ```json Response theme={null} { "data": { "asset_id": "ast_abc123", "url": "https://files.heygen.com/asset/ast_abc123.png", "mime_type": "image/png", "size_bytes": 204800 } } ``` ## Supported File Types | Category | Formats | | -------- | --------- | | Image | PNG, JPEG | | Video | MP4, WebM | | Audio | MP3, WAV | | Document | PDF | Max file size: **32 MB**. MIME type is auto-detected from file bytes. For larger files, use the direct upload flow below. ## Direct Upload for Large Files `POST /v3/assets` proxies file bytes through the API, which is why it's capped at 32 MB. For larger files, use the presigned direct upload flow — three required steps: 1. [`POST /v3/assets/direct-uploads`](/reference/create-asset-upload) with `filename`, `content_type`, and exact `size_bytes` → returns `asset_id`, a presigned `upload_url`, and `upload_headers`. 2. `PUT` the raw file bytes to `upload_url`, sending `upload_headers` verbatim, before the URL expires (`expires_in_seconds`). 3. [`POST /v3/assets/{asset_id}/complete`](/reference/complete-asset-upload) to finalize. Idempotent. The `asset_id` is not usable until this step succeeds. ```bash theme={null} # 1. Initialize curl -X POST https://api.heygen.com/v3/assets/direct-uploads \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{"filename": "footage.mp4", "content_type": "video/mp4", "size_bytes": 134217728}' # 2. PUT the file bytes to the returned upload_url (with upload_headers) curl -X PUT "UPLOAD_URL" -H "Content-Type: video/mp4" --upload-file ./footage.mp4 # 3. Complete curl -X POST https://api.heygen.com/v3/assets/ASSET_ID/complete \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{}' ``` The per-upload cap for this flow is returned as `max_bytes` in the initialize response. See [Upload Assets](/docs/upload-assets#upload-large-files-direct-upload) for full examples in Python and Node.js. To upload up to 100 files in one call, use the [batch variant](/batch-assets) of this flow. ## Using Assets Once uploaded, reference the `asset_id` anywhere the API accepts asset inputs: ```json theme={null} // In POST /v3/video-agents (file attachments) { "prompt": "Explain this diagram", "files": [{ "type": "asset_id", "asset_id": "ast_abc123" }] } ``` ```json theme={null} // In POST /v3/avatars (photo avatar) { "type": "photo", "name": "My Avatar", "file": { "type": "asset_id", "asset_id": "ast_abc123" } } ``` Anywhere that accepts an asset also accepts a direct URL (`{"type": "url", "url": "https://..."}`) or base64 (`{"type": "base64", "media_type": "image/png", "data": "..."}`). The 32 MB per-file limit applies to URL inputs too — for larger files, upload via the direct upload flow and pass the `asset_id`. Use `asset_id` when you need to reuse the same file across multiple requests. # Automated Broadcast Source: https://developers.heygen.com/automated-broadcast Run scheduled video broadcasts - news roundups, daily briefings, market updates. The HeyGen API generates each clip on a cron schedule from fresh data inputs. ## The Problem Publishing regular video content — daily news roundups, weekly company updates, recurring educational series — is unsustainable without a production team. But consistency is what builds an audience. ## How It Works ``` Schedule triggers → Aggregate content → LLM writes script → Video Agent renders → Auto-distribute ``` A fully automated pipeline that runs on a schedule, collects fresh content from your sources, generates a video, and delivers it to your audience — no human in the loop. ## Build It Pull content from whatever sources feed your broadcast. ```python theme={null} import requests from datetime import datetime def aggregate_content(): stories = [] # RSS feeds import feedparser feed = feedparser.parse("https://news.ycombinator.com/rss") for entry in feed.entries[:5]: stories.append({ "title": entry.title, "summary": entry.get("summary", ""), "source": "Hacker News", "url": entry.link, }) # APIs (example: your internal metrics) metrics = requests.get("https://api.yourapp.com/weekly-stats").json() stories.append({ "title": f"This week: {metrics['new_users']} new users, {metrics['revenue']} revenue", "summary": f"Growth of {metrics['growth_pct']}% week over week", "source": "Internal", }) return stories stories = aggregate_content() ``` ```python theme={null} import anthropic client = anthropic.Anthropic() story_text = "\n".join( f"- {s['title']} ({s['source']}): {s['summary']}" for s in stories ) message = client.messages.create( model="claude-sonnet-4-20250514", max_tokens=1500, messages=[{ "role": "user", "content": f"""Create a HeyGen Video Agent prompt for a 60-second news/update video. Date: {datetime.now().strftime('%B %d, %Y')} Stories to cover: {story_text} Structure: - Intro (5s): "Here's your [daily/weekly] update for [date]" - Stories (45s): Cover the top 3 stories with text overlays for key stats - Sign-off (10s): "That's your update. See you [tomorrow/next week]." Tone: Authoritative but approachable. Clean, news-desk style background. Keep pacing brisk — one story every 15 seconds.""" }], ) video_prompt = message.content[0].text ``` ```python theme={null} resp = requests.post( "https://api.heygen.com/v3/video-agents", headers={ "X-Api-Key": HEYGEN_API_KEY, "Content-Type": "application/json", }, json={"prompt": video_prompt}, ) video_id = resp.json()["data"]["video_id"] # Poll until complete import time while True: status = requests.get( f"https://api.heygen.com/v3/videos/{video_id}", headers={"X-Api-Key": HEYGEN_API_KEY}, ).json()["data"] if status["status"] == "completed": video_url = status["video_url"] break elif status["status"] == "failed": raise Exception(f"Video failed: {status.get('failure_message')}") time.sleep(15) ``` Deliver the video to your audience wherever they are. ```python theme={null} # Telegram import telegram bot = telegram.Bot(token=TELEGRAM_TOKEN) bot.send_video(chat_id=CHANNEL_ID, video=video_url, caption="Daily Update") # Slack requests.post(SLACK_WEBHOOK, json={ "text": f"Daily update is ready: {video_url}", }) # Email (via your ESP) send_email( to=subscriber_list, subject=f"Your Daily Update — {datetime.now().strftime('%B %d')}", html=f'', ) ``` Run the pipeline on a schedule using cron, GitHub Actions, or a cloud function. ```yaml theme={null} # .github/workflows/daily-broadcast.yml name: Daily Video Broadcast on: schedule: - cron: '0 17 * * 1-5' # 5 PM UTC, weekdays jobs: broadcast: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - run: pip install -r requirements.txt - run: python broadcast.py env: HEYGEN_API_KEY: ${{ secrets.HEYGEN_API_KEY }} ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }} TELEGRAM_TOKEN: ${{ secrets.TELEGRAM_TOKEN }} ``` ## Real-World Example STUDIO 47, a German broadcaster, reported these results after adopting HeyGen for automated video production (via [HeyGen customer stories](https://www.heygen.com/customer-stories/studio-47)): * Significantly faster content creation * 24/7 production capability * Substantial cost reduction vs traditional production * Expanded into multilingual content that wasn't feasible before ## Resilient Delivery Build fallbacks for when things go wrong: ```python theme={null} def deliver(video_url, caption): try: # Try primary: send video by URL bot.send_video(chat_id=CHANNEL_ID, video=video_url, caption=caption) except Exception: try: # Fallback: download and upload as file video_data = requests.get(video_url).content bot.send_video(chat_id=CHANNEL_ID, video=video_data, caption=caption) except Exception: # Last resort: send text with link bot.send_message(chat_id=CHANNEL_ID, text=f"{caption}\n\n{video_url}") ``` ## Broadcast Types | Type | Schedule | Content source | Duration | | --------------------- | -------------- | -------------------------------- | -------- | | **Daily news** | Every morning | RSS, APIs, web scrape | 45–60s | | **Weekly roundup** | Monday morning | Internal metrics + industry news | 90s | | **Product changelog** | Each release | Git commits, release notes | 30–45s | | **Company all-hands** | Weekly/monthly | Meeting notes, updates | 60–90s | | **Social digest** | Daily | Trending topics in your niche | 30s | ## Variations * **Multi-language:** Generate once, [translate](/cookbook/video-agent/multilingual-content) for regional audiences * **Different avatars per topic:** Use different presenters for different content categories * **Audience segmentation:** Generate different versions for different subscriber segments *** ## Next Steps Repurpose existing content instead of aggregating new content. Trigger video generation from code changes instead of a schedule. # Automated Video Pipeline Source: https://developers.heygen.com/automated-pipeline Build end-to-end automated video pipelines - data in, finished video out. HeyGen API integrates with your CMS, CRM, or data warehouse to render videos on demand. ## The Problem You need to generate the same type of video repeatedly with different data — weekly reports, personalized onboarding videos, per-customer dashboards, changelog announcements. Doing this manually doesn't scale. ## How It Works ``` Data event → Template composition + injected data → Hyperframes render → Distribute ``` Hyperframes compositions are just HTML files. You can template them, inject data, and render programmatically — no browser, no human, no AI agent in the loop. ## Build It Build one great composition with your AI agent, then extract the variable parts: ```html theme={null}
{{ACTIVE_USERS}} active users this week
{{REVENUE}} revenue
```
```python theme={null} import subprocess import shutil from pathlib import Path def generate_report_video(data: dict, output_path: str): """Generate a weekly report video from data.""" # Copy template work_dir = Path(f"/tmp/report-{data['week']}") shutil.copytree("templates/weekly-report", work_dir, dirs_exist_ok=True) # Inject data into template html = (work_dir / "index.html").read_text() html = html.replace("{{ACTIVE_USERS}}", f"{data['active_users']:,}") html = html.replace("{{REVENUE}}", f"${data['revenue']:,.0f}") html = html.replace("{{GROWTH}}", f"{data['growth_pct']:.1f}%") (work_dir / "index.html").write_text(html) # Render subprocess.run([ "npx", "hyperframes", "render", "--output", output_path, "--quality", "standard", "--fps", "30", ], cwd=str(work_dir), check=True) # Cleanup shutil.rmtree(work_dir) return output_path ``` **GitHub Actions:** ```yaml theme={null} # .github/workflows/weekly-report.yml name: Weekly Report Video on: schedule: - cron: '0 9 * * 1' # Every Monday at 9am jobs: generate: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - uses: actions/setup-node@v4 with: node-version: '22' - run: sudo apt-get install -y ffmpeg - run: python scripts/generate_report.py - uses: actions/upload-artifact@v4 with: name: weekly-report path: renders/*.mp4 ``` **Webhook-triggered:** ```python theme={null} from flask import Flask, request app = Flask(__name__) @app.route("/webhook/new-signup", methods=["POST"]) def on_new_signup(): user = request.json generate_welcome_video( name=user["name"], company=user["company"], output=f"renders/welcome-{user['id']}.mp4" ) # Upload to CDN, send via email, etc. return {"status": "ok"} ```
## Pipeline Patterns | Trigger | Data source | Output | Example | | ----------------- | ---------------------- | --------------------------- | ------------------------- | | **Cron schedule** | Database query | Weekly/monthly report video | Monday metrics recap | | **Webhook** | Event payload | Per-user personalized video | Welcome onboarding | | **Git push** | Changelog / commit log | Release announcement | "What's new in v2.4" | | **API call** | Request parameters | On-demand custom video | Customer dashboard export | ## Combine with Video Agent For the best of both worlds — motion graphics + avatar narration: ```python theme={null} def generate_narrated_report(data): # Step 1: Render the motion graphics with Hyperframes graphics_path = generate_report_video(data, "renders/graphics.mp4") # Step 2: Generate avatar narration with Video Agent narration = requests.post( "https://api.heygen.com/v3/video-agents", headers={"X-Api-Key": HEYGEN_API_KEY}, json={ "prompt": f"""Narrate this weekly report: {data['active_users']:,} active users (up {data['growth_pct']:.0f}%), ${data['revenue']:,.0f} revenue. Keep it under 15 seconds, upbeat and concise.""", }, ).json() # Step 3: Composite in Hyperframes (avatar PiP over graphics) # ... or use ffmpeg to overlay ``` Start simple — get one template working end-to-end, then add automation. A working pipeline that generates one video type reliably is more valuable than a complex system that handles everything. *** ## Next Steps Build the animated visualizations that feed into your pipeline. Similar automation pattern using Video Agent for avatar-based content. # Avatar III Source: https://developers.heygen.com/avatar-iii Avatar III is a HeyGen rendering engine on the v3 API, built around a dedicated photo-to-video pipeline — a higher-quality re-engineered model for photo avatars and video avatars (digital twins and studio avatars). A single `engine` value resolves to the right product based on the avatar look type — mirroring how `avatar_iv` already serves both photo and video avatars: | Look type | Resolves to | Max resolution | | --------------- | ------------ | -------------- | | `digital_twin` | Digital Twin | 4K | | `studio_avatar` | Digital Twin | 4K | | `photo_avatar` | Photo Avatar | 1080p | ## Supported avatar types `digital_twin`, `studio_avatar`, `photo_avatar` — pass the look's `avatar_id` in the request. Studio avatar looks are video avatars, so they take the same Digital Twin pipeline as `digital_twin` looks — same 4K support and the same [Digital Twin rate](/docs/pricing#video-generation-avatar-iii). For `motion_prompt`, `expressiveness`, or animating an arbitrary image, use [Avatar IV](/avatar-iv). ## Example request Select Avatar III by passing `"engine": { "type": "avatar_iii" }` in your [`POST /v3/videos`](/reference/create-video) request: ```bash theme={null} curl -X POST "https://api.heygen.com/v3/videos" \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "type": "avatar", "avatar_id": "YOUR_PHOTO_AVATAR_LOOK_ID", "script": "Hello from Avatar III.", "voice_id": "YOUR_VOICE_ID", "resolution": "1080p", "engine": { "type": "avatar_iii" } }' ``` Video generation is asynchronous — the response returns a `video_id` you poll with `GET /v3/videos/{video_id}`. For pricing, see [Self-Serve Pricing](/docs/pricing#video-generation-avatar-iii) and [Enterprise Pricing](/docs/enterprise-pricing#video-generation-avatar-iii). To compare engines, see [Models](/models). # Avatar IV Source: https://developers.heygen.com/avatar-iv Avatar IV is the default HeyGen v3 rendering engine - the broadest avatar support, arbitrary image animation, motion_prompt, and expressiveness control. ## Supported avatar types `studio_avatar`, `digital_twin`, `photo_avatar`, `image` (arbitrary), `prompt` ## Exclusive features * `motion_prompt` — a natural-language string controlling body motion and hand gestures (e.g. `"walk towards the camera slowly"`). Available for photo avatars and arbitrary images. * `expressiveness` — controls energy and range of movement: `high`, `medium`, or `low`. Available for photo avatars and arbitrary images. Defaults to `low`. * **Arbitrary image support** — animate any image by setting `type: "image"`, with no registered avatar required. ## Example request Avatar IV is the default engine, so you can omit `engine` entirely in your [`POST /v3/videos`](/reference/create-video) request: ```bash theme={null} curl -X POST "https://api.heygen.com/v3/videos" \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "type": "avatar", "avatar_id": "YOUR_LOOK_ID", "script": "Hello from Avatar IV.", "voice_id": "YOUR_VOICE_ID", "resolution": "1080p" }' ``` To request it explicitly — or to be unambiguous in code that switches engines — pass `"engine": { "type": "avatar_iv" }`: ```bash theme={null} curl -X POST "https://api.heygen.com/v3/videos" \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "type": "avatar", "avatar_id": "YOUR_LOOK_ID", "script": "Hello from Avatar IV.", "voice_id": "YOUR_VOICE_ID", "resolution": "1080p", "engine": { "type": "avatar_iv" } }' ``` Video generation is asynchronous — the response returns a `video_id` you poll with `GET /v3/videos/{video_id}`. For a full walkthrough of creating a Digital Twin video and polling for completion, see the [Digital Twin guide](/generate-avatar-video). To compare engines, see [Models](/models); for the highest-fidelity motion, see [Avatar V](/avatar-v). # Avatar Realtime Source: https://developers.heygen.com/avatar-realtime Stream a HeyGen avatar that speaks in real time. Drive speech from a script, an audio file, or a live text stream at 720p. Avatar Realtime opens a **live streaming session** where an avatar speaks in real time — useful for live agents, kiosks, and voice assistants with a face. You create a session, poll for the playback URL, and play it. Avatar Realtime is **agent-agnostic**. Your application owns speech-to-text (STT) and the LLM — Avatar Realtime is only responsible for the face and voice. You stream text or audio to HeyGen, and HeyGen renders the avatar and publishes the video to an **HLS stream**. Because playback is plain HLS, there is no frontend dependency on LiveKit (or any other WebRTC stack): any HLS player can consume the output. This makes Avatar Realtime the right choice when you already have your own agent orchestration and just need to give it a talking face. If you want HeyGen to handle the full conversational loop — STT, LLM, and turn-taking — use [Live Avatar](/live-avatar) instead. Avatar Realtime streams at **720p only**. ## Create a session [`POST /v3/avatar-realtime`](/reference/create-avatar-realtime-session) — choose how to drive speech with the `type` field: * `tts` — speak a script (`avatar_id`, `voice_id`, `text`) * `audio` — lip-sync to your own audio (`avatar_id`, `audio`) * `text_stream` — stream text live, e.g. from an LLM (`avatar_id`, `voice_id`, `text`) ```bash theme={null} curl -X POST "https://api.heygen.com/v3/avatar-realtime" \ -H "X-Api-Key: $HEYGEN_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "type": "tts", "avatar_id": "Daisy-inskirt-20220818", "voice_id": "1bd001e7e50f421d891986aad5158bc8", "text": "Hi there — welcome to HeyGen Avatar Realtime." }' ``` ```json Response theme={null} { "data": { "stream_id": "a1b2c3d4-..." } } ``` ## Get the playback URL `GET /v3/avatar-realtime/{stream_id}` — poll until the session is ready, then play the HLS `url` in any HLS player. ```bash theme={null} curl -X GET "https://api.heygen.com/v3/avatar-realtime/a1b2c3d4-..." \ -H "X-Api-Key: $HEYGEN_API_KEY" ``` ```json Response theme={null} { "data": { "stream_id": "a1b2c3d4-...", "status": "ready", "url": "https://.../stream.m3u8" } } ``` ## Stream more text For `text_stream` sessions, append text as it becomes available — the avatar keeps speaking on the open stream. ```bash theme={null} curl -X POST "https://api.heygen.com/v3/avatar-realtime/a1b2c3d4-.../text" \ -H "X-Api-Key: $HEYGEN_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "text": "Here are the results I found." }' ``` ## Limits | Limit | Default | Notes | | ----------------------------- | ------- | --------------------------------------------------------- | | Idle timeout (`text_stream`) | 30 sec | The session closes if no new text arrives for 30 seconds. | | Max session length | 1 hour | Sessions are capped at one hour. | | Concurrent sessions per space | 3 | Maximum simultaneous realtime sessions. | All three limits are adjustable — [reach out to us](https://www.heygen.com/contact-us/sales) to raise them. ## Pricing Billed per second of session duration (720p only): **\$0.05 / sec** self-serve, **0.05 credits / sec** on Enterprise. See [Self-Serve Pricing](/docs/pricing) and [Enterprise Pricing](/docs/enterprise-pricing). # Avatar V Source: https://developers.heygen.com/avatar-v Avatar V is HeyGen's highest-fidelity v3 rendering engine, using cross-reference-driven animation for the most natural motion and lip-sync. Opt-in per look. ## Supported avatar types `digital_twin` — for eligible looks. ## Supported parameters * `motion_prompt` — natural-language control of body motion and hand gestures. * `reference_look_id` *(optional)* — an `instant_avatar` look to use as the animation reference. Must belong to the same avatar group as `avatar_id`. When omitted, the digital twin self-references. For `expressiveness` control, use [Avatar IV](/avatar-iv). ## Checking eligibility Avatar V is opt-in per look. Before using it, fetch the look and check `supported_api_engines`: ```bash theme={null} GET /v3/avatars/looks/{look_id} ``` ```json theme={null} { "id": "lk_abc123", "name": "My Digital Twin", "avatar_type": "digital_twin", "supported_api_engines": ["avatar_iv", "avatar_v"] } ``` Avatar V is available when `"avatar_v"` appears in `supported_api_engines`. ## Example request Select Avatar V by passing `"engine": { "type": "avatar_v" }` in your [`POST /v3/videos`](/reference/create-video) request: ```bash theme={null} curl -X POST "https://api.heygen.com/v3/videos" \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "type": "avatar", "avatar_id": "YOUR_LOOK_ID", "script": "Hello from Avatar V.", "voice_id": "YOUR_VOICE_ID", "resolution": "1080p", "engine": { "type": "avatar_v" } }' ``` Video generation is asynchronous — the response returns a `video_id` you poll with `GET /v3/videos/{video_id}`. See the [Digital Twin guide](/generate-avatar-video) for the end-to-end request and polling flow, [Models](/models) for an engine comparison, or [Avatar IV](/avatar-iv) for the default engine. # Background music Source: https://developers.heygen.com/background-music Search HeyGen's background-music catalog with natural language and get ready-to-use, pre-signed audio URLs for your videos via the HeyGen API. Find background music by describing the vibe you want — "upbeat lofi hip-hop", "tense cinematic riser", "subtle ambient corporate" — and get back ranked tracks, each with a pre-signed download URL. Search is semantic, not keyword-based, so plain-language descriptions work best. ## Search the Catalog Send a `GET` request to `/v3/audio/sounds` with a natural-language `query`: ```bash theme={null} curl -X GET "https://api.heygen.com/v3/audio/sounds?query=upbeat%20corporate%20background%20music&limit=3" \ -H "x-api-key: YOUR_API_KEY" ``` ```json Response theme={null} { "data": [ { "id": "4cbcca493220487bbae26a2c42dba5e9", "name": "Astral Generated Music: 4cbcca49", "description": "upbeat professional background music", "audio_url": "https://heygen-product.s3-accelerate.amazonaws.com/astral_generated_music/4cbcca49...wav?X-Amz-Algorithm=...", "duration": 30.0, "score": 0.933, "type": "music" }, { "id": "93a98c35d9654029be397d8d27a06da0", "name": "Astral Generated Music: 93a98c35", "description": "Modern, upbeat, and inspiring corporate background music with a light electronic beat.", "audio_url": "https://heygen-product.s3-accelerate.amazonaws.com/astral_generated_music/93a98c35...wav?X-Amz-Algorithm=...", "duration": 60.0, "score": 0.911, "type": "music" } ], "has_more": true, "next_token": "eyJvZmZzZXQiOiAzLCAiX3R5cGUiOiAibXVzaWMifQ==" } ``` ## Query Parameters | Parameter | Type | Default | Description | | ----------- | ------- | ------- | ------------------------------------------------------------------------------------------------------------------------------------------------------- | | `query` | string | — | **Required.** Natural-language description of the audio you want, e.g. `tense cinematic riser`. Results are ranked by semantic similarity to this text. | | `limit` | integer | `10` | Maximum number of results to return (1–50). | | `min_score` | number | `0.7` | Minimum semantic similarity score (0–1). Tracks scoring below this are omitted. Raise it for tighter matches; lower it to widen the net. | | `type` | string | `music` | Audio content type. `music` (the default) searches the background-music catalog; set `sound_effects` to search [sound effects](/sound-effects). | | `token` | string | — | Opaque pagination cursor. Pass the `next_token` from a prior response to fetch the next page. | ## Response Fields | Field | Type | Description | | -------------------- | ------- | ----------------------------------------------------------------------------------------------------- | | `data[].id` | string | Stable identifier for the track. | | `data[].name` | string | Display name of the track. | | `data[].description` | string | Human-readable description of the track's mood and instrumentation. | | `data[].audio_url` | string | Pre-signed download URL for the audio file (WAV). | | `data[].duration` | number | Track length in seconds. | | `data[].score` | number | Semantic similarity score (0–1) against your `query`. Results are returned highest-first. | | `data[].type` | string | `music` for results from the background-music catalog. | | `has_more` | boolean | `true` if more results are available beyond this page. | | `next_token` | string | Cursor for the next page. Pass it as `token` on your next request. Absent when `has_more` is `false`. | Each `audio_url` is a pre-signed link with a limited lifetime. Download the file (or hand the URL to a downstream step) soon after searching rather than caching it for later. ## Paginate Through Results When `has_more` is `true`, pass the returned `next_token` as the `token` parameter to fetch the next page: ```bash theme={null} curl -X GET "https://api.heygen.com/v3/audio/sounds?query=upbeat%20corporate%20background%20music&limit=3&token=eyJvZmZzZXQiOiAzLCAiX3R5cGUiOiAibXVzaWMifQ==" \ -H "x-api-key: YOUR_API_KEY" ``` ## Full Example ```python theme={null} import requests from urllib.parse import urlencode API_KEY = "YOUR_API_KEY" BASE = "https://api.heygen.com" HEADERS = {"x-api-key": API_KEY} def search_music(query, limit=10, min_score=0.7): """Yield every matching track, following pagination.""" token = None while True: params = {"query": query, "limit": limit, "min_score": min_score} if token: params["token"] = token resp = requests.get( f"{BASE}/v3/audio/sounds?{urlencode(params)}", headers=HEADERS, ) page = resp.json() for track in page["data"]: yield track if not page.get("has_more"): break token = page["next_token"] # Grab the single best-matching track best = next(search_music("calm ambient piano for a product walkthrough", limit=1)) print(f"{best['name']} ({best['duration']}s, score {best['score']:.2f})") print(f"Download: {best['audio_url']}") ``` Searching from an AI agent instead of code? The same catalog is available through the [HeyGen MCP](/mcp/overview) via the `search_audio_sounds` tool. # Assets Source: https://developers.heygen.com/batch-assets Upload up to 100 files in one batch: request presigned S3 slots in a single call, PUT the bytes in parallel, then finalize and poll one batch id. ## Overview Asset batches parallelize the [direct upload flow](/assets#direct-upload-for-large-files): instead of presigning, uploading, and completing files one by one, you request up to 100 presigned upload slots in a single call, PUT all the files in parallel, and finalize the whole batch with one request. The flow has three steps: 1. [`POST /v3/assets/direct-uploads/batches`](/reference/create-asset-upload-batch) — get an `asset_id` + presigned `upload_url` per file. 2. `PUT` each file's raw bytes to its `upload_url`, sending `upload_headers` verbatim. 3. [`POST /v3/assets/complete/batches`](/reference/complete-asset-upload-batch) — finalize, then poll [`GET /v3/assets/batches/{batch_id}`](/reference/get-asset-batch). A batch holds up to **100** files. No file bytes flow through the HeyGen API — uploads go straight to S3. On completion, each file is validated and ingested independently, so one bad file does not fail the rest. ## Step 1 — Create a Batch of Upload Slots * Endpoint: `POST /v3/assets/direct-uploads/batches` * Purpose: Presign up to 100 direct-to-S3 upload slots and return them synchronously with a `batch_id`. ### Quick Example ```bash theme={null} curl -X POST "https://api.heygen.com/v3/assets/direct-uploads/batches" \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "title": "Webinar recordings — October", "files": [ { "filename": "session-1.mp4", "content_type": "video/mp4", "size_bytes": 734003200 }, { "filename": "session-2.mp4", "content_type": "video/mp4", "size_bytes": 812646400 } ] }' ``` ```json Response theme={null} { "data": { "batch_id": "batch_as_abc123", "items": [ { "asset_id": "asset_9f2c...", "upload_url": "https://heygen-uploads.s3.amazonaws.com/...", "upload_headers": { "Content-Type": "video/mp4" }, "expires_in_seconds": 3600, "max_bytes": 734003200, "status": "pending_upload" }, { "asset_id": "asset_81aa...", "upload_url": "https://heygen-uploads.s3.amazonaws.com/...", "upload_headers": { "Content-Type": "video/mp4" }, "expires_in_seconds": 3600, "max_bytes": 812646400, "status": "pending_upload" } ] } } ``` Slots are returned **in the submitted order**, one per file. ### Request Body | Parameter | Type | Required | Default | Description | | -------------- | ------ | -------- | ------- | ------------------------------------------------------------------------------------------------------------------------------------- | | `files` | array | Yes | — | Files to presign, each the same shape as [`POST /v3/assets/direct-uploads`](/reference/create-asset-upload). Between 1 and 100 items. | | `title` | string | No | `null` | Display name for the batch, shown in the HeyGen app. | | `callback_url` | string | No | `null` | Reserved for parity with the other batch APIs — track completion by [polling the batch](#step-3--complete-and-poll). | Each entry in `files`: | Field | Type | Required | Description | | ----------------- | ------- | -------- | --------------------------------------------------------------------------------------------------------------------------------------------------- | | `filename` | string | Yes | Original filename for reference/metadata. The stored object's extension is derived from `content_type`. | | `content_type` | string | Yes | Declared MIME type (e.g. `video/mp4`, `image/png`, `audio/mpeg`, `application/pdf`). Verified against the stored bytes when the batch is completed. | | `size_bytes` | integer | Yes | Exact byte size of the file. Signed into the upload URL so it cannot be exceeded. | | `checksum_sha256` | string | No | SHA-256 of the file as hex. When provided, S3 enforces it on upload. | ### Idempotency Pass an `Idempotency-Key` header to make retries safe — replaying the same key returns the same batch and the same slots. ## Step 2 — Upload the Files `PUT` each file's raw bytes to its `upload_url`, sending the returned `upload_headers` verbatim. Uploads are plain S3 PUTs, so you can run them in parallel from any HTTP client: ```bash theme={null} curl -X PUT "https://heygen-uploads.s3.amazonaws.com/..." \ -H "Content-Type: video/mp4" \ --data-binary @session-1.mp4 ``` Each `upload_url` expires after `expires_in_seconds` — request a fresh batch if a slot lapses before you upload. ## Step 3 — Complete and Poll * Endpoint: `POST /v3/assets/complete/batches` * Purpose: Finalize every uploaded file in the batch. Call once, after all PUTs return `200`. ```bash theme={null} curl -X POST "https://api.heygen.com/v3/assets/complete/batches" \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "batch_id": "batch_as_abc123" }' ``` ```json Response theme={null} { "data": { "batch_id": "batch_as_abc123" } } ``` The call returns `202 Accepted` — validation and ingestion run asynchronously per file. The call is idempotent: repeating it re-drives the same batch. Poll [`GET /v3/assets/batches/{batch_id}`](/reference/get-asset-batch) for per-item progress: ```bash theme={null} curl -X GET "https://api.heygen.com/v3/assets/batches/batch_as_abc123?limit=100" \ -H "x-api-key: YOUR_API_KEY" ``` ```json Response theme={null} { "data": { "batch_id": "batch_as_abc123", "title": "Webinar recordings — October", "status": "processing", "total_items": 2, "counts_by_status": { "completed": 1, "processing": 1 }, "created_at": 1783891200, "items": [ { "item_index": 0, "status": "completed", "video_id": "asset_9f2c...", "error": null }, { "item_index": 1, "status": "processing", "video_id": null, "error": null } ], "has_more": false, "next_token": null } } ``` The batch read model is shared across the batch APIs, so the per-item id field is named `video_id` — for asset batches it holds the **asset id**. Once an item is `completed`, that asset id is usable anywhere assets are accepted, e.g. as `audio_asset_id` in [video creation](/generate-avatar-video) or as an `asset_id` source in [translation](/batch-video-translations) and [lipsync](/batch-lipsyncs) batches. ### Query Parameters | Parameter | Type | Required | Default | Description | | --------- | ------- | -------- | ------- | ----------------------------------------------------------------- | | `limit` | integer | No | `100` | Items per page, `1`–`100`. | | `token` | string | No | — | Opaque pagination cursor from a previous response's `next_token`. | The response shape matches the [video batch](/batch-videos#response-fields): aggregate `status` (`processing`, `completed`, or `failed`), `total_items`, `counts_by_status`, and a paged `items` array where each item carries `item_index`, `status` (`queued`, `processing`, `completed`, or `failed`), its id, and `error` details when failed. ## Bulk Statuses * Endpoint: `GET /v3/assets/statuses` * Purpose: Check up to 100 assets in one request — across batches, or for assets uploaded individually. ```bash theme={null} curl -X GET "https://api.heygen.com/v3/assets/statuses?batch_ids=batch_as_abc123" \ -H "x-api-key: YOUR_API_KEY" ``` | Parameter | Type | Required | Description | | ----------- | ------ | -------- | ------------------------------------------------------------- | | `asset_ids` | string | No | Comma-separated asset ids to look up. | | `batch_ids` | string | No | Comma-separated batch ids; each expands to its member assets. | Statuses are `queued`, `processing`, `completed`, or `failed`, plus `not_found` for unknown or unowned ids. # Lipsyncs Source: https://developers.heygen.com/batch-lipsyncs Submit up to 100 lipsync requests in a single call. Re-sync many videos to new audio tracks together, then poll one batch id for per-item progress. ## Overview Lipsync batches let you submit many lipsync jobs in one request instead of calling [`POST /v3/lipsyncs`](/reference/create-lipsync) once per job. You send an array of lipsync payloads, get back a single `batch_id` right away, and poll that one id for the status and id of every item. Each item in a batch is a standard lipsync payload — the exact shape [`POST /v3/lipsyncs`](/reference/create-lipsync) accepts — so anything you can lipsync on its own can be batched, in either [Speed](/lipsync-speed) or [Precision](/lipsync-precision) mode. A batch holds up to **100** items. Each payload becomes exactly one batch item, and each item is created and processed independently — one bad source does not fail the rest. ## Create a Batch * Endpoint: `POST /v3/lipsyncs/batches` * Purpose: Queue up to 100 lipsync payloads and return a `batch_id` immediately. ### Quick Example ```bash theme={null} curl -X POST "https://api.heygen.com/v3/lipsyncs/batches" \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "title": "Course module redubs", "callback_url": "https://example.com/hooks/heygen", "lipsyncs": [ { "video": { "type": "url", "url": "https://example.com/module-1.mp4" }, "audio": { "type": "url", "url": "https://example.com/module-1-v2.mp3" }, "title": "Module 1 — updated narration", "mode": "speed" }, { "video": { "type": "asset_id", "asset_id": "asset_abc123" }, "audio": { "type": "asset_id", "asset_id": "asset_def456" }, "title": "Module 2 — updated narration", "mode": "precision" } ] }' ``` ```json Response theme={null} { "data": { "batch_id": "batch_ls_abc123" } } ``` The call returns `202 Accepted` — the batch is queued, not finished. Use the returned `batch_id` to [poll for progress](#get-a-batch). ### Request Body | Parameter | Type | Required | Default | Description | | -------------- | ------ | -------- | ------- | ----------------------------------------------------------------------------------------------------------------------- | | `lipsyncs` | array | Yes | — | Lipsync payloads, each identical in shape to [`POST /v3/lipsyncs`](/reference/create-lipsync). Between 1 and 100 items. | | `title` | string | No | `null` | Display name for the batch, shown in the HeyGen app. | | `callback_url` | string | No | `null` | [Webhook](/docs/webhooks) URL invoked once when every item in the batch reaches a terminal state. | Each entry in `lipsyncs` takes the full set of lipsync options — `video` and `audio` (each as a `url` or `asset_id`), `mode` (`speed` or `precision`), plus captions, partial-range, and format controls. See [`POST /v3/lipsyncs`](/reference/create-lipsync) for every field. ### Idempotency Pass an `Idempotency-Key` header to make retries safe — replaying the same key returns the original batch instead of creating a duplicate. ## Get a Batch * Endpoint: `GET /v3/lipsyncs/batches/{batch_id}` * Purpose: Return the batch's aggregate status plus one page of items with their id and per-item status. ### Quick Example ```bash theme={null} curl -X GET "https://api.heygen.com/v3/lipsyncs/batches/batch_ls_abc123?limit=100" \ -H "x-api-key: YOUR_API_KEY" ``` ```json Response theme={null} { "data": { "batch_id": "batch_ls_abc123", "title": "Course module redubs", "status": "processing", "total_items": 2, "counts_by_status": { "completed": 1, "processing": 1 }, "created_at": 1783891200, "items": [ { "item_index": 0, "status": "completed", "video_id": "ls_9f2c...", "error": null }, { "item_index": 1, "status": "processing", "video_id": null, "error": null } ], "has_more": false, "next_token": null } } ``` The batch read model is shared across the batch APIs, so the per-item id field is named `video_id` — for lipsync batches it holds the **lipsync id**. Use it with [`GET /v3/lipsyncs/{lipsync_id}`](/reference/get-lipsync) for the full record and download URL. ### Query Parameters | Parameter | Type | Required | Default | Description | | --------- | ------- | -------- | ------- | ----------------------------------------------------------------- | | `limit` | integer | No | `100` | Items per page, `1`–`100`. | | `token` | string | No | — | Opaque pagination cursor from a previous response's `next_token`. | The response shape matches the [video batch](/batch-videos#response-fields): aggregate `status` (`processing`, `completed`, or `failed`), `total_items`, `counts_by_status`, and a paged `items` array where each item carries `item_index`, `status` (`queued`, `processing`, `completed`, or `failed`), its id, and `error` details when failed. ## Bulk Statuses * Endpoint: `GET /v3/lipsyncs/statuses` * Purpose: Check up to 100 lipsyncs in one request — across batches, or for jobs created individually. ```bash theme={null} curl -X GET "https://api.heygen.com/v3/lipsyncs/statuses?batch_ids=batch_ls_abc123" \ -H "x-api-key: YOUR_API_KEY" ``` | Parameter | Type | Required | Description | | ------------- | ------ | -------- | --------------------------------------------------------------- | | `lipsync_ids` | string | No | Comma-separated lipsync ids to look up. | | `batch_ids` | string | No | Comma-separated batch ids; each expands to its member lipsyncs. | Statuses are `queued`, `processing`, `completed`, or `failed`, plus `not_found` for unknown or unowned ids. ## Tracking completion * **Webhook (push).** Set `callback_url` on the batch to be notified once, when the last item reaches a terminal state. See [Webhooks](/docs/webhooks) to register an endpoint and verify signatures. * **Polling (pull).** Call `GET /v3/lipsyncs/batches/{batch_id}` and read `counts_by_status`. Items surface their lipsync id as soon as the job is created, so you can start fetching finished renders with [`GET /v3/lipsyncs/{lipsync_id}`](/reference/get-lipsync) while the rest of the batch is still processing. # Video Translations Source: https://developers.heygen.com/batch-video-translations Submit up to 100 video translation requests in a single call. Fan one source video out to many languages, then poll one batch id for per-item progress. ## Overview Translation batches let you submit many translations in one request instead of calling [`POST /v3/video-translations`](/reference/create-video-translation) once per job. You send an array of translation payloads, get back a single `batch_id` right away, and poll that one id for the status and id of every item. Each item in a batch is a standard translation payload — the exact shape [`POST /v3/video-translations`](/reference/create-video-translation) accepts — so anything you can translate on its own can be batched, in either [Speed](/docs/video-translate) or [Precision](/docs/video-translation-precision) mode. A batch holds up to **100** items. A single payload targeting multiple `output_languages` expands to **one batch item per language**, and the expanded count is what the 100-item cap applies to. Each item is created and processed independently, so one bad source does not fail the rest. ## Create a Batch * Endpoint: `POST /v3/video-translations/batches` * Purpose: Queue up to 100 translation payloads and return a `batch_id` immediately. ### Quick Example One source video fanned out to three languages — this creates three batch items: ```bash theme={null} curl -X POST "https://api.heygen.com/v3/video-translations/batches" \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "title": "Q3 keynote — localized cuts", "callback_url": "https://example.com/hooks/heygen", "video_translations": [ { "video": { "type": "url", "url": "https://example.com/keynote.mp4" }, "title": "Q3 keynote", "output_languages": ["Spanish (Spain)", "French", "Japanese"], "mode": "speed" } ] }' ``` ```json Response theme={null} { "data": { "batch_id": "batch_tr_abc123" } } ``` The call returns `202 Accepted` — the batch is queued, not finished. Use the returned `batch_id` to [poll for progress](#get-a-batch). ### Request Body | Parameter | Type | Required | Default | Description | | -------------------- | ------ | -------- | ------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `video_translations` | array | Yes | — | Translation payloads, each identical in shape to [`POST /v3/video-translations`](/reference/create-video-translation). Up to 100 items after language expansion. | | `title` | string | No | `null` | Display name for the batch, shown in the HeyGen app. | | `callback_url` | string | No | `null` | [Webhook](/docs/webhooks) URL invoked once when every item in the batch reaches a terminal state. | Each entry in `video_translations` takes the full set of translation options — `video` (as a `url` or `asset_id`), `output_languages` (use [`GET /v3/video-translations/languages`](/reference/list-supported-translation-languages) for valid values), `mode` (`speed` or `precision`), plus captions, brand glossary, stock voice, partial-range, and format controls. See [`POST /v3/video-translations`](/reference/create-video-translation) for every field. ### Idempotency Pass an `Idempotency-Key` header to make retries safe — replaying the same key returns the original batch instead of creating a duplicate. ## Get a Batch * Endpoint: `GET /v3/video-translations/batches/{batch_id}` * Purpose: Return the batch's aggregate status plus one page of items with their id and per-item status. ### Quick Example ```bash theme={null} curl -X GET "https://api.heygen.com/v3/video-translations/batches/batch_tr_abc123?limit=100" \ -H "x-api-key: YOUR_API_KEY" ``` ```json Response theme={null} { "data": { "batch_id": "batch_tr_abc123", "title": "Q3 keynote — localized cuts", "status": "processing", "total_items": 3, "counts_by_status": { "completed": 2, "processing": 1 }, "created_at": 1783891200, "items": [ { "item_index": 0, "status": "completed", "video_id": "vt_9f2c...", "error": null }, { "item_index": 1, "status": "completed", "video_id": "vt_81aa...", "error": null }, { "item_index": 2, "status": "processing", "video_id": null, "error": null } ], "has_more": false, "next_token": null } } ``` The batch read model is shared across the batch APIs, so the per-item id field is named `video_id` — for translation batches it holds the **video translation id**. Use it with [`GET /v3/video-translations/{video_translation_id}`](/reference/get-video-translation) for the full record and download URL. ### Query Parameters | Parameter | Type | Required | Default | Description | | --------- | ------- | -------- | ------- | ----------------------------------------------------------------- | | `limit` | integer | No | `100` | Items per page, `1`–`100`. | | `token` | string | No | — | Opaque pagination cursor from a previous response's `next_token`. | The response shape matches the [video batch](/batch-videos#response-fields): aggregate `status` (`processing`, `completed`, or `failed`), `total_items`, `counts_by_status`, and a paged `items` array where each item carries `item_index`, `status` (`queued`, `processing`, `completed`, or `failed`), its id, and `error` details when failed. ## Bulk Statuses * Endpoint: `GET /v3/video-translations/statuses` * Purpose: Check up to 100 translations in one request — across batches, or for jobs created individually. ```bash theme={null} curl -X GET "https://api.heygen.com/v3/video-translations/statuses?batch_ids=batch_tr_abc123" \ -H "x-api-key: YOUR_API_KEY" ``` | Parameter | Type | Required | Description | | ----------------------- | ------ | -------- | ------------------------------------------------------------------- | | `video_translation_ids` | string | No | Comma-separated translation ids to look up. | | `batch_ids` | string | No | Comma-separated batch ids; each expands to its member translations. | Statuses are `queued`, `processing`, `completed`, or `failed`, plus `not_found` for unknown or unowned ids. ## Tracking completion * **Webhook (push).** Set `callback_url` on the batch to be notified once, when the last item reaches a terminal state, or subscribe to `video_translate.success` / `video_translate.fail` [webhook events](/docs/webhook-events) for per-item notifications. * **Polling (pull).** Call `GET /v3/video-translations/batches/{batch_id}` and read `counts_by_status`. Items surface their translation id as soon as the job is created, so you can start fetching finished translations with [`GET /v3/video-translations/{video_translation_id}`](/reference/get-video-translation) while the rest of the batch is still processing. # Videos Source: https://developers.heygen.com/batch-videos Submit up to 100 video creation requests in a single call. Queue avatar, image, and cinematic avatar videos together, then poll one batch id for per-item progress. ## Overview Video batches let you submit many videos in one request instead of calling [`POST /v3/videos`](/reference/create-video) once per video. You send an array of video payloads, get back a single `batch_id` right away, and poll that one id for the status and `video_id` of every item. Each item in a batch is a standard video creation payload — the exact shape [`POST /v3/videos`](/reference/create-video) accepts — so any [Digital Twin](/generate-avatar-video), [image](/image-to-video), or [Cinematic Avatar](/cinematic-avatar) video you can create on its own can be batched. A batch holds up to **100** items. Submission is asynchronous: the response acknowledges the batch, and each video renders on its own. Poll the batch to collect video ids as they become available. ## Create a Batch * Endpoint: `POST /v3/videos/batches` * Purpose: Queue up to 100 video creation payloads and return a `batch_id` immediately. ### Quick Example ```bash theme={null} curl -X POST "https://api.heygen.com/v3/videos/batches" \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "title": "October product update — regional cuts", "callback_url": "https://example.com/hooks/heygen", "videos": [ { "type": "avatar", "avatar_id": "YOUR_DIGITAL_TWIN_LOOK_ID", "script": "Hello from the North America team!", "voice_id": "YOUR_VOICE_ID" }, { "type": "avatar", "avatar_id": "YOUR_DIGITAL_TWIN_LOOK_ID", "script": "Hello from the EMEA team!", "voice_id": "YOUR_VOICE_ID" } ] }' ``` ```json Response theme={null} { "data": { "batch_id": "batch_abc123" } } ``` The call returns `202 Accepted` — the batch is queued, not finished. Use the returned `batch_id` to [poll for progress](#get-a-batch). ### Request Body | Parameter | Type | Required | Default | Description | | -------------- | ------ | -------- | ------- | -------------------------------------------------------------------------------------------------------------------------- | | `videos` | array | Yes | — | Video creation requests, each identical in shape to [`POST /v3/videos`](/reference/create-video). Between 1 and 100 items. | | `title` | string | No | `null` | Display name for the batch, shown in the HeyGen app. | | `callback_url` | string | No | `null` | [Webhook](/docs/webhooks) URL invoked once when every item in the batch reaches a terminal state. | Each entry in `videos` is discriminated by `type`: | `type` | Item shape | Guide | | ------------------ | ------------------------------------ | -------------------------------------- | | `avatar` | Avatar video from a script and voice | [Digital Twin](/generate-avatar-video) | | `image` | Video from a still image | [Image to Video](/image-to-video) | | `cinematic_avatar` | Cinematic Avatar video | [Cinematic Avatar](/cinematic-avatar) | ### Idempotency Pass an `Idempotency-Key` header to make retries safe — replaying the same key returns the original batch instead of creating a duplicate. If a request with that key is still being processed, the API responds with `409`. ## Get a Batch * Endpoint: `GET /v3/videos/batches/{batch_id}` * Purpose: Return the batch's aggregate status plus one page of items with their `video_id` and per-item status. ### Quick Example ```bash theme={null} curl -X GET "https://api.heygen.com/v3/videos/batches/batch_abc123?limit=100" \ -H "x-api-key: YOUR_API_KEY" ``` ```json Response theme={null} { "data": { "batch_id": "batch_abc123", "title": "October product update — regional cuts", "status": "processing", "total_items": 2, "counts_by_status": { "completed": 1, "processing": 1 }, "created_at": 1711929600, "items": [ { "item_index": 0, "status": "completed", "video_id": "vid_9f2c...", "error": null }, { "item_index": 1, "status": "processing", "video_id": null, "error": null } ], "has_more": false, "next_token": null } } ``` ### Query Parameters | Parameter | Type | Required | Default | Description | | --------- | ------- | -------- | ------- | ----------------------------------------------------------------- | | `limit` | integer | No | `100` | Items per page, `1`–`100`. | | `token` | string | No | — | Opaque pagination cursor from a previous response's `next_token`. | ### Response Fields | Field | Type | Description | | ------------------ | ------- | ---------------------------------------------------------------------------------- | | `batch_id` | string | Batch identifier. | | `title` | string | Batch display name, if one was set. | | `status` | string | Aggregate status derived from item states: `processing`, `completed`, or `failed`. | | `total_items` | integer | Number of items submitted in this batch. | | `counts_by_status` | object | Item counts keyed by item status. | | `created_at` | integer | Batch creation time as a Unix timestamp. | | `items` | array | One page of batch items, ordered by `item_index`. | | `has_more` | boolean | Whether more items exist beyond this page. | | `next_token` | string | Cursor for the next page; `null` on the last page. | Each entry in `items`: | Field | Type | Description | | ------------ | ------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `item_index` | integer | Zero-based position of this item in the submitted `videos` array. | | `status` | string | Item status: `queued`, `processing`, `completed`, or `failed`. | | `video_id` | string | Video id, present once the underlying video has been created. Use it with [`GET /v3/videos/{video_id}`](/reference/get-video) for the full record and download URL. | | `error` | object | Failure details, present when `status` is `failed`. | ## Tracking completion You have two ways to know when work finishes, and they pair well: * **Webhook (push).** Set `callback_url` on the batch to be notified once, when the last item reaches a terminal state. See [Webhooks](/docs/webhooks) to register an endpoint and verify signatures. * **Polling (pull).** Call `GET /v3/videos/batches/{batch_id}` and read `counts_by_status`. Individual items surface a `video_id` the moment their video is created, so you can start downloading finished videos while the rest of the batch is still rendering. For large batches, page through `items` with `limit` and `next_token` until `has_more` is `false`, then fetch each finished video with [`GET /v3/videos/{video_id}`](/reference/get-video). # Changelog Source: https://developers.heygen.com/changelog Track every HeyGen API change, new endpoint, deprecation, and version bump in the API changelog. Subscribe via RSS or webhook to get notified on the next. **Compose avatar clips, images, and video footage into one video with a single API call** [`POST /v3/videos`](/reference/create-video) accepts a new creation mode, `"type": "studio"` — send an ordered list of whole-frame scenes and get back one rendered MP4. HeyGen owns the layout: each scene is center-cropped to a global output canvas, scene durations are derived server-side, and a single `video_id` tracks the all-or-nothing render. * New guide: [HeyGen Studio](/studio-videos) under Video Composition. * **Three scene types**, mixable in one request (1–50 scenes): `avatar_video` (an avatar or lip-synced image speaking a script or audio track, with engine selection, motion prompts, and solid-color backgrounds), `image` (a still held for a set `duration` or narrated), and `video` (an existing clip, with `playback` volume/mute control). * **Global output settings** set once per request: `aspect_ratio`, `resolution` (up to `4k`), captions (sidecar `subtitle_url` plus optional burn-in), and webhooks. * **Batches:** studio payloads work as items in [`POST /v3/videos/batches`](/reference/create-video-batch), alongside the other creation modes. **Every high-volume workflow now has a native batch API** Batch creation, introduced for [videos](/batch-videos), now covers video translations, lipsyncs, and asset uploads. Each accepts up to 100 payloads per call, returns a single `batch_id`, processes items independently (one bad item does not fail the rest), and supports `Idempotency-Key` retries. * New guides under Batches: [Video Translations](/batch-video-translations), [Lipsyncs](/batch-lipsyncs), and [Assets](/batch-assets). * **Translations:** [`POST /v3/video-translations/batches`](/reference/create-video-translation-batch) — a payload targeting multiple `output_languages` expands to one item per language. Replaces the CSV-script workflow previously documented as Bulk Video Translation. * **Lipsyncs:** [`POST /v3/lipsyncs/batches`](/reference/create-lipsync-batch) — payloads identical in shape to `POST /v3/lipsyncs`. * **Assets:** [`POST /v3/assets/direct-uploads/batches`](/reference/create-asset-upload-batch) presigns up to 100 direct-to-S3 slots in one call; finalize with [`POST /v3/assets/complete/batches`](/reference/complete-asset-upload-batch). * **Bulk status checks:** [`GET /v3/video-translations/statuses`](/reference/bulk-video-translation-statuses), [`GET /v3/lipsyncs/statuses`](/reference/bulk-lipsync-statuses), [`GET /v3/assets/statuses`](/reference/bulk-asset-statuses), and [`GET /v3/videos/statuses`](/reference/bulk-video-statuses) — up to 100 ids per request, by id or by batch. **Discover Studio templates and generate videos from them over the API** You can now drive [HeyGen Studio](https://app.heygen.com/avatar/studio) templates programmatically — list them, read each one's variable schema, and render a video by filling the variables. * New guide: [HeyGen Studio Template](/templates) under Video Composition. * **List & inspect:** [`GET /v3/templates`](/reference/list-templates) and [`GET /v3/templates/{template_id}`](/reference/get-template) return each template's variable schema (text, image, video, audio, character, voice) and scenes. * **Generate:** [`POST /v3/templates/{template_id}`](/reference/generate-video-from-template) renders a video from your variable values, with options for `scene_ids`, `dimension`, `fps`, captions/subtitles, sharing, and webhooks. **Submit up to 100 videos in a single request** Queue many videos at once instead of calling [`POST /v3/videos`](/reference/create-video) per video. * New guide: [Videos](/batch-videos) under Batches. * **Create:** [`POST /v3/videos/batches`](/reference/create-video-batch) accepts up to 100 payloads — each identical in shape to `POST /v3/videos` (`avatar`, `image`, or `cinematic_avatar`) — and returns a single `batch_id`. * **Track:** [`GET /v3/videos/batches/{batch_id}`](/reference/get-video-batch) returns aggregate status and per-item `video_id`s; a `callback_url` fires once when the whole batch finishes. **Submit a pre-recorded consent video for a digital twin** [`POST /v3/avatars/{group_id}/consent`](/reference/create-avatar-consent) now accepts an optional `consent_video` field (as a `url`, `asset_id`, or `base64` asset). When supplied, the video is submitted directly for review — the avatar subject skips the hosted webcam page, and the response contains the avatar group without a consent `url`. * Available to Enterprise API accounts with your account whitelisted — please [reach out to sales](https://www.heygen.com/contact-us/sales) or your account team to request access. The same applies to skipping the consent flow entirely. * The webcam flow is unchanged and remains the default — see [Avatar Consent](/docs/avatar-consent) for the full breakdown of consent levels. **Compose your avatar videos into finished, produced videos** You can now combine a HeyGen avatar video with background music, sound effects, and Hyperframes graphics into a single composed render — Hyperframes acts as the compositor that lays an avatar clip into a designed scene, scores it, and renders it to one MP4. * New guide: [Hyperframes + HeyGen](/hyperframes-heygen) — an end-to-end pipeline wiring [`POST /v3/videos`](/reference/create-video), [`GET /v3/audio/sounds`](/background-music) (music and sound effects), and [`POST /v3/hyperframes/renders`](/hyperframes) together. * New page: [Introduction to Hyperframes](/hyperframes-overview) — what the framework is, its core concepts, and the ways to render. * Pass the avatar `video_url` and audio `audio_url`s into the render as `variables`, so one composition bundle produces many finished videos. **Support for the Avatar III engine** We have expanded the capabilities of `POST /v3/videos` to include support for the Avatar III engine. * **`POST /v3/videos`:** * Added support for the `avatar_iii` engine configuration. * Updated the `engine` property to include `AvatarIIIEngineConfig` in the `oneOf` schema definition, allowing for more flexible engine selection during video creation. **Expanded API functionality and improved asset management** We have introduced several new endpoints and configuration options to enhance your workflow: * **Realtime Avatar Streaming**: Added comprehensive support for streaming interactions via `POST /v3/avatar-realtime`, including endpoints to manage stream state, send text, and fetch word timing (`GET /v3/avatar-realtime/{stream_id}/words`). * **Background Removals**: New dedicated endpoints to programmatically manage background removal jobs: `GET/POST /v3/background-removals` and `DELETE/GET /v3/background-removals/{job_id}`. * **Voice Management**: Added `DELETE /v3/voices/{voice_id}` for better voice library control. * **Avatar & Video Configuration**: * `POST /v3/avatars`: Added `avatar_id` as an optional property for more granular prompt-based avatar creation. * `POST /v3/videos`: Added `reference_look_id` support within the `AvatarVEngineConfig` to refine video generation. **Clarified Stock Voice configuration for Video Translation** Updated `POST /v2/video_translate` and `POST /v3/video-translations` to better reflect Enterprise capabilities. * The `stock_voice_config` documentation has been updated to clarify that this feature uses preset HeyGen voices instead of cloning the original speaker's voice. * `preferred_stock_voice_ids` is now explicitly defined as an optional pinning mechanism for stock voices. * Note: Stock voice usage is an Enterprise feature gated by account permissions; please contact your HeyGen account team for access. **4K output for Avatar IV & V is temporarily deprecated** 4K rendering for Avatar IV & V video generation is temporarily unavailable. The 4K rate has been removed from the [pricing page](/pricing) for these tiers — 720p / 1080p output and pricing are unaffected. * This is a temporary pause; 4K support is expected to return in a future update. **`avatar_id` is now the visual reference for prompt avatars** [`POST /v3/avatars`](/reference/create-avatar) with `type: "prompt"` now accepts an optional `avatar_id` — an existing look used as the visual reference for the generation. `avatar_group_id` no longer drives the reference image. * Added `avatar_id` (optional): the look whose image conditions the generation. The new look is saved to the referenced avatar's group; if `avatar_group_id` is also provided, the avatar must belong to that group and the result is saved there. Returns 404 `AVATAR_NOT_FOUND` if the avatar doesn't exist, 400 `INVALID_PARAMETER` if it has no usable image or doesn't belong to the given group. * Changed `avatar_group_id`: now only selects the group the generated avatar is saved to. It no longer conditions the generation on one of the group's looks. * Changed `reference_images`: no longer requires `avatar_group_id` — it can be used on its own. * **Migration Note:** if you passed `avatar_group_id` to keep a character's identity consistent across prompt-generated looks, pass the base look's ID as `avatar_id` instead. Requests with only `avatar_group_id` still succeed, but generate purely from the prompt. * `type: "digital_twin"` and `type: "photo"` are unchanged. See [Create Avatar](/docs/create-avatar#prompt-to-avatar) for the full behavior matrix. **Expanded Audio Search with Sound Effects** The audio search functionality has been updated to include support for sound effects, allowing for more versatile audio retrieval beyond just background music. * Updated `GET /v3/audio/sounds` to include `sound_effects` as a searchable type. * The `type` query parameter now supports `sound_effects` in addition to the default `music`. * API responses for `GET /v3/audio/sounds` will now include items with the `sound_effects` type. * **Migration Note:** Clients that strictly validate the `type` field in the response against an enum list may need to update their schema definitions to include the new `sound_effects` value to prevent parsing errors. **Expanded usage insights for user accounts** We have updated the user profile endpoints to provide better visibility into your account's credit consumption. You can now track your allocation and remaining balance directly through the API. * Added `included_credits` and `remaining_credits` fields to the response objects for: * `GET /v1/user/me` * `GET /v3/users/me` **Updated motion prompt capabilities for video generation** The `motion_prompt` parameter for video generation now supports additional configurations for hand gestures and broader engine compatibility. * Updated `motion_prompt` in `POST /v3/videos`: * Now supports natural-language control for both body motion and hand gestures. * Expanded support for photo avatars across both engines. * Added support for video avatars specifically when using `engine.type: 'avatar_v'`. **Generate cinematic avatar video from a single prompt** [`POST /v3/videos`](/reference/create-video) now supports **Cinematic Avatar** — a prompt-driven video type that composes scene, motion, and framing from a natural-language prompt plus one to three avatar looks (with optional reference media). No script or voice required. * Added the `CreateVideoFromCinematicAvatar` schema to `POST /v3/videos` via an additive request discriminator (`cinematic_avatar`). Existing `CreateVideoFromAvatar` and `CreateVideoFromImage` requests are unaffected — this is a **non-breaking** change. * Billed at a flat **\$7.00 per video** (not by duration). Choose any length from **4 to 15 seconds** via the `duration` parameter. * Supports **720p** and **1080p** output. No migration required. See the [Cinematic Avatar guide](/avatar-shots) for the full parameter list. **Expansion of Asset Management and Audio capabilities** We have introduced new endpoints to streamline asset handling and provide better access to audio resources. * `POST /v3/assets/direct-uploads`: Initialize a direct upload process for your custom assets. * `POST /v3/assets/{asset_id}/complete`: Finalize the upload process for a specific asset. * `GET /v3/audio/sounds`: Retrieve a list of available audio sounds for your projects. **HyperFrames render resolution is now strictly typed** We have updated the `POST /v3/hyperframes/renders` endpoint to enforce strict resolution settings. * **Breaking Change:** The `resolution` property in `POST /v3/hyperframes/renders` is now strictly typed as a string enum (`1080p`, `4k`). Null values are no longer accepted. * The `resolution` property now defaults to `1080p`. * Added optional `aspect_ratio` support for `POST /v3/hyperframes/renders` and response schemas for `GET /v3/hyperframes/renders` and `GET /v3/hyperframes/renders/{render_id}`. **Migration Steps:** Ensure that any hardcoded `resolution` values sent to `POST /v3/hyperframes/renders` match the new `1080p` or `4k` enum strings. If you were previously sending `null` to indicate a default, you can now safely omit the property. **Breaking change: `resolution` is now a tier; `aspect_ratio` is a separate field** `POST /v3/hyperframes/renders` previously took a single `resolution` value that conflated aspect ratio and resolution tier into one of six presets (`landscape`, `landscape-4k`, `portrait`, `portrait-4k`, `square`, `square-4k`). The same flat shape lived on `GET /v3/hyperframes/renders/{render_id}`. Effective immediately, both endpoints decompose that single field into two: * `resolution` ∈ `1080p` | `4k` — output resolution tier. Defaults to `1080p`. 4K renders are billed at 1.5× the 1080p rate. * `aspect_ratio` ∈ `16:9` | `9:16` | `1:1` — output aspect ratio. Defaults to `16:9` (landscape). `9:16` is portrait; `1:1` is square. The new shape matches the existing `/v3/videos` endpoint's `resolution` + `aspect_ratio` fields. Aspect ratio does not affect pricing. **Migration table** Map each legacy preset to the new pair: | OLD `resolution` | NEW | | ---------------- | --------------------------------------------------- | | `landscape` | `{ "resolution": "1080p", "aspect_ratio": "16:9" }` | | `landscape-4k` | `{ "resolution": "4k", "aspect_ratio": "16:9" }` | | `portrait` | `{ "resolution": "1080p", "aspect_ratio": "9:16" }` | | `portrait-4k` | `{ "resolution": "4k", "aspect_ratio": "9:16" }` | | `square` | `{ "resolution": "1080p", "aspect_ratio": "1:1" }` | | `square-4k` | `{ "resolution": "4k", "aspect_ratio": "1:1" }` | Requests using the legacy preset strings now return a 422 validation error. Pricing for 4K renders is unchanged — only the field shape moves. **Not yet supported in this enum surface**: `720p`, `4:5`, `5:4`, and `auto`. These will follow in a separate update once the render pipeline supports the additional values. **CLI** `npx hyperframes cloud render` is updated in lockstep: the `--resolution` flag now accepts `1080p` | `4k`, and a new `--aspect-ratio` flag accepts `16:9` | `9:16` | `1:1`. Legacy values are rejected at the CLI layer with the same migration mapping. **Introducing Brand Glossaries for Video Translation** We have introduced Brand Glossaries to help maintain consistency in your video translations. You can now define custom term mappings to ensure specific terminology is translated accurately according to your brand guidelines. * Added `GET /v3/brand-glossaries` to list and discover your available brand glossaries. * Added `brand_glossary_id` as an optional request parameter to `POST /v2/video_translate` and `POST /v3/video-translations/proofreads`. * The `brand_voice_id` parameter in these endpoints now acts as a legacy alias for `brand_glossary_id`, ensuring backward compatibility for your existing integrations. **Refined API documentation and aspect ratio defaults** We have updated our API documentation across various endpoints to provide clearer guidance on usage and functionality. Additionally, we have updated the default behavior for aspect ratio selection. * Updated `POST /v2/videos` and `POST /v3/videos` to clarify that the `aspect_ratio` defaults to `'16:9'` if not specified. * Documentation descriptions for endpoints across Avatars, Lipsync, Video Agents, and Webhooks have been streamlined for improved clarity. * Updated API tags for `GET /v3/brand-kits`, moving them under the `Brand` category. **Generate videos in square, portrait, landscape, and source-matched ratios** `POST /v2/videos` and [`POST /v3/videos`](/reference/create-video) now accept four additional values for `aspect_ratio`: * `1:1` — square, great for feed posts * `4:5` — portrait, optimized for Instagram and LinkedIn feeds * `5:4` — landscape variant for feed placements * `auto` — detects the source's dimensions (avatar footage or uploaded image) and preserves the original ratio, falling back to `16:9` when the source can't be read Combine these with the existing `16:9` and `9:16` options to target multiple placements from a single integration. **Retrieve metadata for an individual asset** [`GET /v3/assets/{asset_id}`](/reference/get-asset) returns metadata for an asset in your workspace — including owner, upload timestamp, file type, and a publicly accessible URL. Use it to look up uploads on demand instead of paginating through the full asset list. **Record the exact consent language presented to the avatar subject** [`POST /v3/avatars/{group_id}/consent`](/reference/create-avatar-consent) now accepts an optional `consent_text` field. Pass the wording the subject agreed to so you have a clear audit trail alongside the recorded consent. The field is optional — existing integrations continue to work unchanged. **Clearer signal when a user-supplied URL can't be fetched** Requests that include a URL for video, image, audio, or any other resource can now return a dedicated `download_failed` error (HTTP `400`) when the URL can't be downloaded. The `message` field tells you which URL failed and why. Common causes: * URL isn't publicly accessible (auth required, private video, restricted sharing). * URL is malformed or points to a page rather than a direct file. * Remote server refused the connection or returned an error. * Google Drive links must be shared with **Anyone with the link**. * YouTube/Vimeo videos must be **public** — unlisted or private videos aren't supported. The `resource_limit_exceeded` error message also now covers instant-avatar redo attempts and verified avatar group slots, with guidance to wait for limits to reset where applicable. See the [error codes reference](/docs/error-codes) for the full list. **Avatar V is billed at the same rates as Avatar IV** Per-second video generation rates for Avatar V now match Avatar IV across both [self-serve](/docs/pricing) and [enterprise](/docs/enterprise-pricing) plans. No action required — pricing tables have been updated to reflect the combined Avatar IV & V rates. **Added Idempotency support and expanded API capabilities** We have introduced support for the `Idempotency-Key` header across key endpoints to ensure safe retries for POST requests. Additionally, several endpoints now return a `409 Conflict` status to handle concurrent requests or state conflicts. * **Idempotency-Key Support:** Added to `POST /v3/assets`, `POST /v3/avatars`, `POST /v3/avatars/{group_id}/consent`, `POST /v3/lipsyncs`, `POST /v3/video-translations`, `POST /v3/video-translations/proofreads`, `POST /v3/video-translations/proofreads/{proofread_id}/generate`, `POST /v3/videos`, `POST /v3/webhooks/endpoints`, and `POST /v3/webhooks/endpoints/{endpoint_id}/rotate-secret`. * **New Endpoints:** Added `DELETE /v3/assets/{asset_id}`, `DELETE /v3/avatars/looks/{look_id}`, and `DELETE /v3/avatars/{group_id}`. * **Default Values:** The `aspect_ratio` parameter now defaults to `16:9` in `POST /v2/videos` and `POST /v3/videos`. **Strict schema validation for frame rate modes** The `fps_mode` property in `POST /v3/video-translations` has been updated to use a strict enum, ensuring more predictable behavior for video output. * **Breaking Change:** The `fps_mode` property is now restricted to an enum. Supported values are now explicitly defined as `vfr`, `cfr`, and `passthrough`. * **Migration:** Ensure your integration passes one of these three strings. Previously provided custom values may now be rejected. **Webhook payload field names now match what's actually delivered** The documented payload for the `avatar_video.success` webhook event has been corrected. If you wired up handlers from the previous documentation, double-check the field names you're reading — the live payload uses these keys: * `video_id`, `url`, `gif_download_url`, `video_page_url`, `video_share_page_url`, `folder_id`, `callback_id` No change to the webhook delivery itself — this aligns the [webhook events reference](/docs/webhook-events) with the payload the API has been sending. **Video engine updates and new brand kit integration** We have updated the video generation workflow and introduced support for Brand Kits across Video Agents. Note that the `engine` parameter structure for `POST /v3/videos` has changed, which is a breaking change for existing integrations. * **Breaking Change:** The `engine` property in `POST /v3/videos` now requires an object structure (e.g., `{"type": "avatar_v"}`) instead of a string. `ApiAvatarEngine` has been removed. * **Video Scaling:** Added a new optional `fit` parameter to `POST /v3/videos` for both `CreateVideoFromAvatar` and `CreateVideoFromImage` request types. * **Brand Kits:** Added `brand_kit_id` as an optional parameter to `POST /v3/video-agents` and `POST /v3/video-agents/{session_id}`. * **New Endpoint:** Added `GET /v3/brand-kits` to retrieve available brand kit resources. * **Parameter Constraints:** Note that `expressiveness` and `motion_prompt` in `POST /v3/videos` are now strictly for Avatar IV and are not supported when `engine.type` is set to `avatar_v`. **New configuration options for Video Translation and Video Generation** We have introduced support for Stock TTS in video translations and added explicit engine selection for avatar-based video generation. * **Video Translation:** Added `stock_voice_config` to `POST /v2/video_translate` and `POST /v3/video-translations`. This allows users to opt into Stock TTS instead of using Voice Cloning. * **Video Generation:** Added an optional `engine` field to `POST /v3/videos` (for `CreateVideoFromAvatar` requests). You can now explicitly select between Avatar IV and Avatar V engines. If omitted, the system defaults to Avatar IV. **Updated schema definitions for Avatar engine support** Metadata for supported API engines has been updated across the avatar look endpoints to ensure consistency when retrieving avatar configurations. * Updated `supported_api_engines` fields in: * `POST /v3/avatars` * `GET /v3/avatars/looks` * `GET /v3/avatars/looks/{look_id}` * `PATCH /v3/avatars/looks/{look_id}` **Fine-tune watermark size, transparency, and position** The `watermark` object on `POST /v3/videos` now accepts three new optional fields for finer control over how your watermark renders: * `scale` (number, `0`–`2`, default `1.0`) — adjust the watermark size relative to its native resolution. * `opacity` (number, `0`–`1`, default `1.0`) — control transparency. * `placement` — choose an anchor corner (`top_left`, `top_right`, `bottom_left`, `bottom_right`) and apply fractional `offset_x` / `offset_y` values for precise positioning. All fields are optional and backward-compatible. Omitting them preserves the existing bottom-right default behavior. **Programmatic voice cloning is now available** You can now create and manage voice clones directly from the API, no dashboard step required. * `POST /v3/voices/clone` initiates a clone from a reference audio sample. * `GET /v3/voices/{voice_id}` returns clone status and details so you can poll until processing completes. * Use the resulting `voice_id` anywhere a voice is accepted (`POST /v3/videos`, `POST /v3/voices/speech`, etc.). See the [voices overview](/docs/voices/overview) for details. **Render captions directly into your videos** `POST /v2/videos` and `POST /v3/videos` now accept a `caption.style` field. Set it to burn captions into the rendered video instead of (or in addition to) consuming the sidecar subtitle file at `subtitle_url`. Useful for social platforms where viewers watch with sound off and you want captions baked into the asset. **Apply your own watermark to generated videos** `POST /v3/videos` accepts a new optional `watermark` property on both `CreateVideoFromAvatar` and `CreateVideoFromImage` requests. Pass a PNG or JPEG image to overlay it onto the rendered output — handy for branding, attribution, or moderation marks. Available as a premium option for select Enterprise customers — [contact support](https://help.heygen.com) to request access. **`watermark` now uses the `WatermarkInput` schema** The inline schema previously used for the `watermark` field on video generation requests has been replaced with the dedicated `WatermarkInput` type. The shape of the property has changed — update existing payloads to match the new schema before upgrading. **Empty `title` queries are no longer accepted** `GET /v2/videos` and `GET /v3/videos` now require at least one character for the `title` query parameter (`minLength` increased from 0 to 1). Omit the parameter entirely if you don't want to filter by title — sending an empty string will return a validation error. **Better error feedback when the voice clone limit is reached** `POST /v3/voices/clone` now returns the `resource_limit_reached` error code (HTTP 400) when your account has hit its voice clone quota, instead of a generic validation error. The response message tells you to delete unused clones or contact support to raise the limit. See the [error codes reference](/docs/error-codes#resource-limit-reached) for handling guidance. **Expanded tool coverage for the HeyGen MCP server** The HeyGen Remote MCP server now includes tools for managing avatars, videos, lipsync, and video translation — making more of the API accessible to AI agents like Claude, Cursor, Gemini CLI, and Manus. * Added avatar management tools: `create_digital_twin`, `create_photo_avatar`, `create_prompt_avatar`, `create_avatar_consent`, `list_avatar_looks`, `get_avatar_look`, `update_avatar_look`, and more. * Added full video CRUD: `create_video_from_avatar`, `create_video_from_image`, `list_videos`, `get_video`, `delete_video`. * Added lipsync and video translation management tools. * Added `design_voice` for finding voices from a natural-language description. * See the [MCP overview](/mcp/overview) for the full tool list. **CLI command surface synced with v3 API** The HeyGen CLI now covers all v3 endpoints, including Video Agent, Lipsync, Video Translation (with Proofreads), Webhooks, and Assets. * Added `--wait` flag for blocking until async operations complete, with configurable `--timeout`. * Added `--request-schema` and `--response-schema` flags to inspect API schemas without authentication. * Added `--force` flag for non-interactive destructive operations in CI. * See the [CLI commands](/commands) and [features](/features) pages for usage details. **v1 and v2 endpoints sunset on October 31, 2026** A formal deprecation timeline is now in place for the v1 and v2 API. Both versions remain fully operational through October 31, 2026, after which they will be retired. * Studio API (multi-scene) and Template API will continue to be supported on v2 until a v3 equivalent is available. * See the [endpoint version comparison](/endpoint-version-comparison) for a full migration checklist and feature comparison. **More granular error responses across the API** New error codes provide clearer feedback when requests fail, making it easier to handle edge cases in your integration. * `ai_vendor_access_restricted` — workspace AI vendor policy blocks the request. * `unlimited_mode_disabled` — avatar doesn't support unlimited mode. * `voice_unavailable` — cloned voice failed processing or expired. * `ephemeral_upload_disabled` — eager upload temporarily disabled for the account. * `gateway_timeout` — external resource could not be fetched in time. * See the full [error codes reference](/docs/error-codes) for details and troubleshooting. **New requirement for Starfish engine compatibility** Text-to-speech generation endpoints now require the use of voices that support the Starfish engine. * Updated `POST /v1/audio/text_to_speech` and `POST /v3/voices/speech` documentation. * Developers should filter for compatible voices by passing `engine=starfish` when calling the voice listing endpoints. **Standardized Asset ID descriptions** Documentation across multiple endpoints has been clarified to consistently refer to asset IDs originating from the HeyGen asset upload endpoint. No functional changes were made to the API behavior. * Applies to request bodies for: * `POST /v3/avatars` * `POST /v3/lipsyncs` * `POST /v3/video-agents` and `POST /v3/video-agents/{session_id}` * `POST /v3/video-translations`, `POST /v3/video-translations/proofreads`, and `PUT /v3/video-translations/proofreads/{proofread_id}/srt` * `POST /v3/videos` **New endpoint for listing Video Agents** We have introduced a new endpoint to allow developers to retrieve a list of all existing video agents associated with their account. * Added `GET /v3/video-agents`: Use this endpoint to fetch your video agents, enabling easier integration and management of your agent instances. **Updated error codes for Avatar endpoints** We have updated the error response codes for avatar-related endpoints to provide more specific feedback when a group cannot be located. * `GET /v3/avatars/{group_id}`: The 404 response error code has been updated from `not_found` to `avatar_group_not_found`. * `POST /v3/avatars/{group_id}/consent`: The 404 response error code has been updated from `not_found` to `avatar_group_not_found`. **Advanced voice customization and output formatting** We have introduced new parameters to provide finer control over generated audio and video output quality. * Added `volume` and `engine_settings` to `voice_settings` for `POST /v2/videos` and `POST /v3/videos`. These settings apply when using text-to-speech (`script` + `voice_id`). * Added `output_format` to `POST /v3/videos` for both `CreateVideoFromAvatar` and `CreateVideoFromImage` request schemas. **Improved error handling for webhook management** We have updated our webhook endpoints to provide more consistent and descriptive error responses. * Added a `409` conflict response to `POST /v3/webhooks/endpoints` to better handle registration errors. * Standardized error codes for `404` responses across `DELETE`, `PATCH`, and `POST /v3/webhooks/endpoints/{endpoint_id}/rotate-secret` by updating the error code to `webhook_not_found`. **Support for custom output formats in video generation** You can now specify a preferred output format when creating videos. The API response now includes the `output_format` field to confirm the format used for your generated video. * Added optional `output_format` request property to `POST /v2/videos`. * Added `output_format` to the response body of `POST /v2/videos` (200 OK). * Added `output_format` to the response body of `POST /v3/videos` (200 OK). **Comprehensive API Documentation Updates** We have updated the endpoint descriptions across our entire V3 API to provide clearer guidance, better parameter context, and more precise functionality definitions. While the underlying API logic remains consistent, the improved documentation clarifies how to integrate with our latest engine versions and features. * **Video Generation**: `POST /v3/videos` now officially documents support for the Avatar IV engine and upcoming Avatar V. * **Avatars**: Clarified workflows for `POST /v3/avatars` (asynchronous training) and added guidance on the mandatory consent flow for private avatars via `POST /v3/avatars/{group_id}/consent`. * **Video Agent**: Streamlined descriptions for session-based interactions, clearly distinguishing between `generate` (one-shot) and `chat` (multi-turn) modes. * **Lipsync & Translation**: Updated documentation for `POST /v3/lipsyncs` and `POST /v3/video-translations` to emphasize the `speed` vs. `precision` mode selection for output quality. * **Webhooks**: Clarified that `PATCH /v3/webhooks/endpoints/{endpoint_id}` performs a full replacement of the event types array. * **Assets**: Updated supported MIME types for `POST /v3/assets` to include refined file type lists. **Added caption\_url to Lipsync and Video Translation responses** You can now retrieve the `caption_url` for generated lipsyncs and video translations, providing direct access to the generated caption files. * `GET /v3/lipsyncs` and `GET /v3/lipsyncs/{lipsync_id}` * `PATCH /v3/lipsyncs/{lipsync_id}` * `GET /v3/video-translations` and `GET /v3/video-translations/{video_translation_id}` * `PATCH /v3/video-translations/{video_translation_id}` **Updated documentation for avatar consent** Clarified the implementation details for the avatar consent flow to ensure a smoother user experience. * `POST /v3/avatars/{group_id}/consent`: Updated documentation to clarify that the returned URL must be presented directly to the user in a browser to complete the consent process. **Support for avatar-default voices** You can now generate videos using an avatar's default voice without explicitly specifying a `voice_id`. When creating a video, if `voice_id` is omitted while `avatar_id` is present, the system will automatically use the avatar's default voice. * Updated `POST /v3/videos`: The `voice_id` requirement has been relaxed for both `CreateVideoFromAvatar` and `CreateVideoFromImage` schemas, allowing the system to fall back to the avatar's default voice. **Enhanced capabilities for Video Agent interactions** We have updated the description and scope of the `POST /v3/video-agents/{session_id}` endpoint to better reflect its versatility in managing agent-led workflows. * Updated the endpoint description to clarify support for answering agent-posed questions and requesting specific edits or revisions. * The request body schema has been updated to better align with these extended conversational and editing capabilities. **New 'thinking' status for Video Agents** We have introduced a new `thinking` state to the Video Agent response object to provide better visibility into agent processing workflows. * Updated `POST /v3/video-agents` * The `status` field in the response now includes the `thinking` enum value. * Integration note: Ensure your client-side parsers are prepared to handle this new status value in the response body. **Updated Video Agent session retrieval and new video listing** We have refactored how resource data is handled in Video Agent sessions to improve performance. Additionally, we have introduced a new endpoint to fetch videos associated with a session. * **Breaking Change:** The `resources` property has been removed from the response body of `GET /v3/video-agents/{session_id}`. * **Migration:** To access resource details previously found in the session object, please use the new `GET /v3/video-agents/{session_id}/resources/{resource_id}` endpoint. * **New Endpoint:** Added `GET /v3/video-agents/{session_id}/videos` to retrieve a list of videos generated within a specific agent session. **Breaking change: Restructured Video Agent session management** We have updated the Video Agent API to simplify session handling. Please note that the previous `/v3/video-agents/sessions` path structure is deprecated and removed. * **Removed endpoints:** `POST /v3/video-agents/sessions`, `GET /v3/video-agents/sessions/{session_id}`, `POST /v3/video-agents/sessions/{session_id}/messages`, `GET /v3/video-agents/sessions/{session_id}/resources`, and `POST /v3/video-agents/sessions/{session_id}/stop` have been removed. * **Migration:** Replace existing calls with the new flattened endpoints under `/v3/video-agents/{session_id}`. * **New endpoints added:** * `GET /v3/video-agents/{session_id}` * `POST /v3/video-agents/{session_id}` * `GET /v3/video-agents/{session_id}/resources/{resource_id}` * `POST /v3/video-agents/{session_id}/stop` **New configuration options for Video Agent sessions** The `POST /v3/video-agents` endpoint now supports advanced control over session flow. * Added `mode`: Supports `generate` (default, one-shot) and `chat` (multi-turn, allows revisions and follow-ups). * Added `auto_proceed`: Enables automated progression through storyboards. * Added `skip_agentic_stop`: Provides granular control over agent stopping behavior. **API Operation ID update** The operation ID for `GET /v3/users/me` has been updated from `getUserMeV3` to `getCurrentUserV3` to maintain consistency across our SDKs. **Added support for custom voice creation** We have introduced a new endpoint to allow developers to programmatically create and add new voices to their HeyGen account. * Added `POST /v3/voices` to the API. **Refactored POST /v3/videos request body** We have updated the `POST /v3/videos` endpoint to use a discriminated union for improved type safety and flexibility. This change replaces the legacy flat request structure with dedicated schemas for creating videos from avatars versus images. * **Breaking Change:** The request body structure has been completely overhauled. You must now specify a type discriminator: use `CreateVideoFromAvatar` for digital twins/avatars or `CreateVideoFromImage` for custom image animation. * **Migration:** All properties previously passed at the top level of the request (e.g., `avatar_id`, `image_url`, `voice_id`, `script`) must now be nested within the appropriate schema based on the video source. * The operation ID for this endpoint has been updated from `createAvatarVideoV3` to `createVideo`. **Enhanced error messaging across all endpoints** We have updated the error response schemas and examples across the entire API suite. Developers can now expect more consistent and detailed error responses for common issues, including: * Improved `400 Bad Request` messages with clearer parameter validation feedback. * Standardized `401 Unauthorized` responses when API keys are missing or expired. * Consistent `429 Rate Limited` responses that align with standard retry headers. * Better descriptive error messages for resource-specific failures (e.g., `404 Not Found` for specific IDs). These updates ensure that your integrations can better handle exceptions and debugging. **HeyGen for Developers — New v3 API Surface** We've launched a new set of v3 endpoints across the HeyGen API, bringing a consistent interface, cursor-based pagination, and a unified asset input model to all major resources. What's new: * All v3 endpoints share a standard error format, cursor-based pagination (`has_more` / `next_token`), and consistent authentication via `X-Api-Key` or OAuth bearer token. * Asset inputs now use a type-discriminated union — pass files as `{ "type": "url", "url": "..." }`, `{ "type": "asset_id", "asset_id": "..." }`, or `{ "type": "base64", "media_type": "...", "data": "..." }` across all endpoints. * New and updated endpoints include: Video Agent (`POST /v3/video-agents`), Videos (`POST /v3/videos`), Voices (`GET /v3/voices`, `POST /v3/voices/speech`), Video Translations (`POST /v3/video-translations`), Overdub (`POST /v3/overdubs`), Avatars (`POST /v3/avatars`), Assets (`POST /v3/assets`), Webhooks (`/v3/webhooks/*`), and User (`GET /v3/users/me`). The v1/v2 endpoints continue to work, but we recommend migrating to v3 for all new integrations. # Cinematic Avatar Source: https://developers.heygen.com/cinematic-avatar Generate cinematic avatar video from a single prompt with the HeyGen API. Combine up to three avatar looks with reference videos and images — no script or voice required. Cinematic Avatar is a prompt-driven variant of [`POST /v3/videos`](/reference/create-video). Instead of a script and a voice, you describe the shot you want in natural language and hand HeyGen up to three avatar looks (plus optional reference media). The Seedance pipeline composes the scene, motion, and framing for you. ## Prerequisites One to three avatar look IDs. Use `GET /v3/avatars/looks` to browse your looks and copy the `id` field for each one you want in the shot. A prompt describing the scene, action, and framing. This replaces the `script` + `voice_id` you'd use for a [Digital Twin video](/generate-avatar-video). ## Step 1 — Write your prompt The `prompt` (1–10,000 characters) is the creative brief for the shot. Describe what the avatar is doing, the setting, the camera, and the mood — e.g. *"A founder walks through a sunlit startup office, gesturing toward a whiteboard, shot handheld in a documentary style."* See [Writing Effective Video Prompts](/writing-effective-video-prompts) for guidance. ## Step 2 — Pick your avatar looks Pass `avatar_id` as an **array** of 1–3 look IDs. Multiple looks let HeyGen feature more than one avatar in the same shot: ```bash theme={null} curl -X GET "https://api.heygen.com/v3/avatars/looks?ownership=private" \ -H "x-api-key: YOUR_API_KEY" ``` Copy the `id` of each look you want into the array. ## Step 3 — Create the video Send a `POST` to `/v3/videos` with `type: "cinematic_avatar"`: ```bash theme={null} curl -X POST "https://api.heygen.com/v3/videos" \ -H "x-api-key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "type": "cinematic_avatar", "prompt": "A founder walks through a sunlit startup office, gesturing toward a whiteboard, shot handheld in a documentary style.", "avatar_id": ["YOUR_LOOK_ID"], "aspect_ratio": "16:9", "resolution": "1080p", "duration": 10, "title": "Founder office walkthrough" }' ``` The response is the same shape as any other `/v3/videos` job: ```json theme={null} { "data": { "video_id": "abc123", "status": "pending", "output_format": "mp4" } } ``` ### Adding reference media Use `references` to steer style, motion, or composition with your own videos and images. Each reference is a `url`, `asset_id`, or `base64` asset input: ```json theme={null} { "type": "cinematic_avatar", "prompt": "Match the lighting and camera movement of the reference clip.", "avatar_id": ["YOUR_LOOK_ID"], "references": [ { "type": "url", "url": "https://your-cdn.com/reference-clip.mp4" }, { "type": "asset_id", "asset_id": "YOUR_UPLOADED_ASSET_ID" } ] } ``` Avatar looks and references share a combined media budget: **at most 3 videos and 9 images** total across `avatar_id` and `references`. Upload your own files first with [Assets](/assets) to get an `asset_id`. ## Step 4 — Poll for completion Generation is asynchronous. Poll [`GET /v3/videos/{video_id}`](/reference/create-video) until `status` is `completed`: ```bash theme={null} curl -X GET "https://api.heygen.com/v3/videos/YOUR_VIDEO_ID" \ -H "x-api-key: YOUR_API_KEY" ``` | Status | Meaning | | ------------ | ---------------------------------------------- | | `pending` | Queued for processing | | `processing` | Video is being generated | | `completed` | Ready — `video_url` is available | | `failed` | Something went wrong — check `failure_message` | ## Full example ```python theme={null} import requests import time API_KEY = "YOUR_API_KEY" BASE = "https://api.heygen.com" HEADERS = {"x-api-key": API_KEY, "Content-Type": "application/json"} # 1. Create the Cinematic Avatar video resp = requests.post(f"{BASE}/v3/videos", headers=HEADERS, json={ "type": "cinematic_avatar", "prompt": "A founder walks through a sunlit startup office, gesturing toward a whiteboard, shot handheld in a documentary style.", "avatar_id": ["YOUR_LOOK_ID"], "aspect_ratio": "16:9", "resolution": "1080p", "duration": 10, }) video_id = resp.json()["data"]["video_id"] print(f"Video created: {video_id}") # 2. Poll until done while True: status_resp = requests.get(f"{BASE}/v3/videos/{video_id}", headers=HEADERS) data = status_resp.json()["data"] print(f"Status: {data['status']}") if data["status"] == "completed": print(f"Download: {data['video_url']}") break elif data["status"] == "failed": print(f"Error: {data.get('failure_message')}") break time.sleep(10) ``` ## Parameters | Parameter | Type | Required | Description | | ---------------- | ------- | -------- | -------------------------------------------------------------------------------------------- | | `type` | string | Yes | Must be `"cinematic_avatar"` | | `prompt` | string | Yes | 1–10,000 characters describing the shot | | `avatar_id` | array | Yes | 1–3 avatar look IDs | | `references` | array | No | Up to 3 videos / 9 images (shared with `avatar_id`) as `url`, `asset_id`, or `base64` inputs | | `aspect_ratio` | string | No | `16:9` (default), `9:16`, or `1:1` | | `resolution` | string | No | `720p` (default) or `1080p` | | `duration` | integer | No | 4–15 seconds, default `10`. Omit when `auto_duration` is `true` | | `auto_duration` | boolean | No | Let HeyGen pick the duration. Default `false` | | `enhance_prompt` | boolean | No | Auto-expand a short prompt into a richer description. Default `false` | | `title` | string | No | Display name in the HeyGen dashboard | ## Using webhooks instead of polling Pass a `callback_url` when creating the video and HeyGen will POST to it when the job finishes — register an endpoint via `POST /v3/webhooks/endpoints` and subscribe to `avatar_video.success` and `avatar_video.fail` as covered in [Webhooks](/docs/webhooks). # Overview Source: https://developers.heygen.com/cli Generate AI avatar videos from your terminal with the HeyGen CLI. Authenticate once, then script video creation, translation, and lipsync into any local. The HeyGen CLI gives developers and AI agents command-line access to HeyGen's video platform. It wraps the v3 API, outputs structured JSON by default, and works out of the box in scripts, CI pipelines, and agent workflows. ## 1. Install the CLI ```bash theme={null} curl -fsSL https://static.heygen.ai/cli/install.sh | bash ``` This installs the latest stable release into `~/.local/bin`. Verify the installation: ```bash theme={null} heygen --version ``` The CLI ships as a single binary with no runtime prerequisites. macOS (Apple Silicon and Intel) and Linux (x64 and arm64) are supported. Windows support is coming soon — WSL is recommended in the meantime. ## 2. Authenticate Log in with your API key from [API dashboard](https://app.heygen.com/settings/api?nav=API): ```bash theme={null} heygen auth login ``` Paste your API key when prompted. The key is stored locally at `~/.heygen/credentials`. For CI/Docker/agent environments, set the environment variable instead — it takes precedence over stored credentials: ```bash theme={null} export HEYGEN_API_KEY=your-api-key ``` Verify your credentials: ```bash theme={null} heygen auth status ``` ### Log in with OAuth As an alternative to an API key, log in with your HeyGen account via OAuth: ```bash theme={null} heygen auth login --oauth ``` This opens your browser to sign in at HeyGen.com. Logging in one way replaces the other stored credential. Non-interactive shells (piped input, `CI=true`, or `HEYGEN_NONINTERACTIVE=1`) default to the API-key flow — pass `--oauth` explicitly in automation. Set `BROWSER=none` or `HEYGEN_NO_BROWSER=1` to print the sign-in URL instead of opening a browser. ## 3. Create a Video Send a prompt to the Video Agent and let it handle avatar, voice, and layout: ```bash theme={null} heygen video-agent create --prompt "A presenter explaining our product launch in 30 seconds" ``` ```json Output theme={null} { "data": { "session_id": "sess_abc123", "status": "generating", "video_id": "vid_xyz789", "created_at": 1711288320 } } ``` The CLI returns immediately with structured JSON. Your video is generating in the background. For full control over every parameter, use `video create` with a JSON body: ```bash theme={null} heygen video create -d '{ "type": "avatar", "avatar_id": "avt_angela_01", "script": "Welcome to our Q4 earnings call.", "voice_id": "1bd001e7e50f421d891986aad5e3e5d2" }' ``` Use `--request-schema` on any command to discover the expected JSON fields — no auth required: ```bash theme={null} heygen video create --request-schema heygen video-agent create --request-schema ``` ## 4. Check Status Poll for the result using the `video_id` returned from step 3: ```bash theme={null} heygen video get vid_xyz789 ``` ```json Output theme={null} { "data": { "id": "vid_xyz789", "title": "Product launch explainer", "status": "completed", "video_url": "https://files.heygen.com/video/vid_xyz789.mp4", "thumbnail_url": "https://files.heygen.com/thumb/vid_xyz789.jpg", "duration": 32.5, "created_at": 1711288320, "completed_at": 1711288452 } } ``` Status moves through `pending` → `processing` → `completed` or `failed`. If the video fails, the response includes `failure_code` and `failure_message` fields. **Tip:** Add `--wait` to the create command to block until the video is ready instead of polling manually. The default timeout is 20 minutes — override with `--timeout 30m`. On timeout, the CLI exits with code `4` and prints the last known resource state along with a hint to resume polling manually. ## 5. Download the Video Once complete, download to a local file: ```bash theme={null} heygen video download vid_xyz789 --output-path ./launch-video.mp4 ``` ```json Output theme={null} { "asset": "video", "message": "Downloaded video to ./launch-video.mp4", "path": "./launch-video.mp4" } ``` If the video was created with captions enabled, you can download the captioned version: ```bash theme={null} heygen video download vid_xyz789 --asset captioned --output-path ./launch-captioned.mp4 ``` # Commands Source: https://developers.heygen.com/commands Reference every HeyGen CLI command with flags, examples, and expected output. Covers video, avatar, voice, translate, lipsync, and config commands in one place. All commands follow the pattern `heygen `. The command surface is auto-generated from HeyGen's OpenAPI specification — when new v3 endpoints ship, the CLI picks them up automatically. Run `heygen --help` for detailed usage and examples on any command. Use `--request-schema` or `--response-schema` on any command to see the full JSON schema for its request or response — no auth required. ## Ai Clipping Turn long-form videos into ready-to-share short clips with captions | Command | API Endpoint | Description | | ------------------------------------ | --------------------------------- | ------------------ | | `heygen ai-clipping create` | `POST /v3/ai-clipping` | Create AI Clipping | | `heygen ai-clipping delete ` | `DELETE /v3/ai-clipping/{job_id}` | Delete AI Clipping | | `heygen ai-clipping get ` | `GET /v3/ai-clipping/{job_id}` | Get AI Clipping | | `heygen ai-clipping list` | `GET /v3/ai-clipping` | List AI Clipping | ### Flags for `ai-clipping create` | Flag | Description | | -------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--callback-id ` | Opaque client identifier echoed verbatim in webhook payloads. Mirrors /v3/video-translations callback\_id. | | `--callback-url ` | HTTPS URL to receive per-job webhook callbacks. Mirrors /v3/video-translations callback\_url. Per-job callback\_url deliveries are NOT HMAC-signed: authenticate them by verifying TLS and matching the echoed callback\_id, and do not trust an unverified body. To receive a signed payload, register a webhook endpoint with a secret (the signature header is sent only to registered endpoints). | | `--input-language ` | ISO-639-1 source language code (e.g. 'en', 'es'). Omit for auto-detect. | | `--title ` | Title for the job. Defaults to the source video's title if omitted. | ### Flags for `ai-clipping list` | Flag | Description | | ----------------- | --------------------------------------------------------------------------------------------------------------------------- | | `--limit ` | Maximum number of items per page. Defaults to 10 (lower than other v3 lists) because each item embeds its full clips array. | | `--token ` | Opaque cursor token for the next page. | ## Asset Upload files for use in video creation | Command | API Endpoint | Description | | ----------------------------------------- | ------------------------------------- | --------------------- | | `heygen asset complete create ` | `POST /v3/assets/{asset_id}/complete` | Complete Asset Upload | | `heygen asset create` | `POST /v3/assets` | Upload Asset | | `heygen asset delete ` | `DELETE /v3/assets/{asset_id}` | Delete Asset | | `heygen asset direct-uploads create` | `POST /v3/assets/direct-uploads` | Create Asset Upload | | `heygen asset get ` | `GET /v3/assets/{asset_id}` | Get Asset | | `heygen asset list` | `GET /v3/assets` | List Assets | ### Flags for `asset complete create` | Flag | Description | | ---------------------------- | ---------------------------------- | | `--checksum-sha-256 ` | Optional SHA256 (hex) cross-check. | ### Flags for `asset create` | Flag | Description | | ---------------- | --------------------------------------------------------------------------------- | | `--file ` | File to upload (image, video, audio, PDF, or SRT subtitle). Max 32 MB. (required) | ### Flags for `asset direct-uploads create` | Flag | Description | | ---------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--checksum-sha-256 ` | Optional SHA256 of the file as hex. When provided, S3 enforces it on upload. | | `--content-type ` | Declared MIME type (e.g. 'video/mp4', 'image/png', 'audio/mpeg', 'application/pdf', 'application/zip'). Verified against the stored bytes at completion. (required) | | `--filename ` | Original filename for reference/metadata. The stored object's extension is derived from content\_type. (required) | | `--size-bytes ` | Exact byte size of the file. Signed into the upload URL so it cannot be exceeded. (required) | ### Flags for `asset list` | Flag | Description | | --------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--username ` | Username of the workspace member whose assets to list — the same value as asset items' 'owner' field. Required while this endpoint is in beta; it will become an optional filter in a future release. (required) | | `--limit ` | Maximum number of assets to return per page (1-100). | | `--token ` | Opaque cursor from a previous response's next\_token. Omit for the first page. | | `--folder-id ` | Optional folder filter. Omit to list ALL workspace assets across folders. Pass a folder id to list that folder only, or an empty value (folder\_id=) for root-level assets (assets not filed into any folder). | ## Asset Batch Create and track batches of direct-to-S3 asset uploads. | Command | API Endpoint | Description | | -------------------------------------------------- | ---------------------------------------- | --------------------------- | | `heygen asset-batch batches get ` | `GET /v3/assets/batches/{batch_id}` | Get Asset Batch | | `heygen asset-batch complete batches create` | `POST /v3/assets/complete/batches` | Complete Asset Upload Batch | | `heygen asset-batch direct-uploads batches create` | `POST /v3/assets/direct-uploads/batches` | Create Asset Upload Batch | | `heygen asset-batch statuses list` | `GET /v3/assets/statuses` | Bulk Asset Statuses | ### Flags for `asset-batch batches get` | Flag | Description | | ----------------- | -------------------------------------------------- | | `--limit ` | Items per page (1-100). | | `--token ` | Opaque pagination cursor from a previous response. | ### Flags for `asset-batch complete batches create` | Flag | Description | | -------------------- | ------------------------------------------------------------------------- | | `--batch-id ` | Identifier returned by POST /v3/assets/direct-uploads/batches. (required) | ### Flags for `asset-batch direct-uploads batches create` | Flag | Description | | ------------------------ | ---------------------------------------------------------------------------------------- | | `--callback-url ` | Reserved for parity with the other batch APIs; asset completion does not emit a webhook. | | `--title ` | Display name for the batch, shown in the HeyGen app. | ### Flags for `asset-batch statuses list` | Flag | Description | | --------------------- | ------------------------------------------------------------- | | `--asset-ids ` | Comma-separated asset ids to look up. | | `--batch-ids ` | Comma-separated batch ids; each expands to its member assets. | ## Audio Search the background-music and sound-effects catalog | Command | API Endpoint | Description | | -------------------------- | ---------------------- | ------------------------------------- | | `heygen audio sounds list` | `GET /v3/audio/sounds` | Search audio (music or sound effects) | ### Flags for `audio sounds list` | Flag | Description | | ----------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--query ` | Natural-language description of the audio you want, e.g. 'upbeat lofi hip-hop' or 'tense cinematic riser'. Results are ranked by semantic similarity to this text. (required) | | `--type ` | Audio content type to search: 'music' (background-music catalog) or 'sound\_effects' (SFX catalog). Defaults to 'music'. | | `--limit ` | Maximum number of results to return (1-50). | | `--min-score ` | Minimum semantic similarity score (0-1). Tracks scoring below this are omitted. | | `--token ` | Opaque cursor token for the next page, taken from 'next\_token' in a prior response. | ## Avatar List and manage avatars and looks | Command | API Endpoint | Description | | ----------------------------------------- | ------------------------------------- | --------------------- | | `heygen avatar consent create ` | `POST /v3/avatars/{group_id}/consent` | Create Avatar Consent | | `heygen avatar create` | `POST /v3/avatars` | Create Avatar | | `heygen avatar delete ` | `DELETE /v3/avatars/{group_id}` | Delete Avatar Group | | `heygen avatar get ` | `GET /v3/avatars/{group_id}` | Get Avatar Group | | `heygen avatar list` | `GET /v3/avatars` | List Avatar Groups | | `heygen avatar looks delete ` | `DELETE /v3/avatars/looks/{look_id}` | Delete Avatar Look | | `heygen avatar looks get ` | `GET /v3/avatars/looks/{look_id}` | Get Avatar Look | | `heygen avatar looks list` | `GET /v3/avatars/looks` | List Avatar Looks | | `heygen avatar looks update ` | `PATCH /v3/avatars/looks/{look_id}` | Update Avatar Look | ### Flags for `avatar consent create` | Flag | Description | | ----------------------- | ----------------------------------------------------------------------------------------------------------------- | | `--reroute-url ` | Callback URL where the user is redirected after completing consent. Defaults to HeyGen's consent completion page. | ### Flags for `avatar create` This command takes a structured request body. Pass it with `-d` and run the command with `--request-schema` to see all fields. ### Flags for `avatar list` | Flag | Description | | --------------------- | ------------------------------------------------------------------------------------------ | | `--ownership ` | Filter by ownership: 'public' for preset avatars, or 'private' for your own. Omit for all. | | `--limit ` | Maximum number of items to return per page (1-50). | | `--token ` | Opaque cursor token for the next page. | ### Flags for `avatar looks list` | Flag | Description | | ----------------------- | ------------------------------------------------------------------------------------------ | | `--group-id ` | Filter looks to a specific avatar group. Returns only looks belonging to this group. | | `--avatar-type ` | Filter by avatar type: 'studio\_avatar', 'digital\_twin', or 'photo\_avatar'. | | `--ownership ` | Filter by ownership: 'public' for preset avatars, or 'private' for your own. Omit for all. | | `--limit ` | Maximum number of items to return per page (1-50). | | `--token ` | Opaque cursor token for the next page. | ### Flags for `avatar looks update` | Flag | Description | | ---------------- | ------------------------------ | | `--name ` | New display name for the look. | ## Background Removal | Command | API Endpoint | Description | | ------------------------------------------- | ----------------------------------------- | ------------------------- | | `heygen background-removal create` | `POST /v3/background-removals` | Create Background Removal | | `heygen background-removal delete ` | `DELETE /v3/background-removals/{job_id}` | Delete Background Removal | | `heygen background-removal get ` | `GET /v3/background-removals/{job_id}` | Get Background Removal | | `heygen background-removal list` | `GET /v3/background-removals` | List Background Removals | ### Flags for `background-removal create` | Flag | Description | | ---------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--layers ` | Output layers to return. Any of: 'foreground' (subject on a transparent background), 'mask' (grayscale alpha matte), 'background' (the scene with the subject removed). Defaults to all three. | | `--request-id ` | Client-provided idempotency key — *the* idempotency mechanism for this endpoint. Re-sending the same `request_id` returns the *original* job (same `id`, same `status`, same charge) instead of creating a new one — the dedup is over (`space_id`, `request_id`), not over the response body, so a duplicate `request_id` with different content still collides on the original job. The HTTP `Idempotency-Key` header is *not* honored here; pick a per-content `request_id` if you need per-content dedup. | | `--title ` | Optional human-readable title for the job. | ### Flags for `background-removal list` | Flag | Description | | ----------------- | ---------------------------------------------------------------- | | `--limit ` | Maximum number of jobs to return (1-100). | | `--token ` | Opaque pagination cursor from a previous response's next\_token. | ## Brand Brand-related resources — brand kits (colors, fonts, logos) and brand glossaries (custom term translations) | Command | API Endpoint | Description | | ------------------------------ | -------------------------- | --------------------- | | `heygen brand glossaries list` | `GET /v3/brand-glossaries` | List Brand Glossaries | | `heygen brand kits list` | `GET /v3/brand-kits` | List Brand Kits | ### Flags for `brand glossaries list` | Flag | Description | | ----------------- | ------------------------------------------------------------------------------------------ | | `--limit ` | Maximum number of brand glossaries to return (1-100). Default 10. | | `--token ` | Opaque pagination cursor from a previous response's `next_token`. Omit for the first page. | ### Flags for `brand kits list` | Flag | Description | | ----------------- | ---------------------------------------------------------------------------------------- | | `--limit ` | Results per page (1-100). | | `--token ` | Opaque cursor token for the next page. Obtained from next\_token in a previous response. | ## Lipsync Dub or replace audio on existing videos | Command | API Endpoint | Description | | ------------------------------------ | ---------------------------------- | -------------- | | `heygen lipsync create` | `POST /v3/lipsyncs` | Create Lipsync | | `heygen lipsync delete ` | `DELETE /v3/lipsyncs/{lipsync_id}` | Delete Lipsync | | `heygen lipsync get ` | `GET /v3/lipsyncs/{lipsync_id}` | Get Lipsync | | `heygen lipsync list` | `GET /v3/lipsyncs` | List Lipsyncs | | `heygen lipsync update ` | `PATCH /v3/lipsyncs/{lipsync_id}` | Update Lipsync | ### Flags for `lipsync create` | Flag | Description | | ----------------------------- | ------------------------------------------------------------------------------------- | | `--callback-id ` | ID included in webhook payload | | `--callback-url ` | Webhook URL for completion notifications | | `--disable-music-track` | Remove background music | | `--enable-caption` | Generate captions for the output video | | `--enable-dynamic-duration` | Allow dynamic duration adjustment | | `--enable-speech-enhancement` | Enhance speech quality | | `--enable-watermark` | Add watermark to output | | `--end-time ` | End time in seconds for partial lipsync | | `--folder-id ` | Project/folder ID to organize lipsync into | | `--fps-mode ` | Frame rate mode: 'vfr', 'cfr', or 'passthrough'. | | `--keep-the-same-format` | Preserve the source video's encoding specs (resolution, bitrate). | | `--mode ` | Quality mode: 'speed' (faster) or 'precision' (higher quality, uses avatar inference) | | `--start-time ` | Start time in seconds for partial lipsync | | `--title ` | Title for the lipsync job | ### Flags for `lipsync list` | Flag | Description | | ----------------- | ------------------------------------- | | `--limit ` | Maximum number of items per page | | `--token ` | Opaque cursor token for the next page | ### Flags for `lipsync update` | Flag | Description | | ----------------- | ------------------------------------ | | `--title ` | New title for the lipsync (required) | ## Lipsync Batch Create and track batches of lipsyncs. | Command | API Endpoint | Description | | --------------------------------------------- | ------------------------------------- | --------------------- | | `heygen lipsync-batch batches create` | `POST /v3/lipsyncs/batches` | Create Lipsync Batch | | `heygen lipsync-batch batches get ` | `GET /v3/lipsyncs/batches/{batch_id}` | Get Lipsync Batch | | `heygen lipsync-batch statuses list` | `GET /v3/lipsyncs/statuses` | Bulk Lipsync Statuses | ### Flags for `lipsync-batch batches create` | Flag | Description | | ------------------------ | ------------------------------------------------------------------------------- | | `--callback-url ` | Webhook URL invoked once when every item in the batch reaches a terminal state. | | `--title ` | Display name for the batch, shown in the HeyGen app. | ### Flags for `lipsync-batch batches get` | Flag | Description | | ----------------- | -------------------------------------------------- | | `--limit ` | Items per page (1-100). | | `--token ` | Opaque pagination cursor from a previous response. | ### Flags for `lipsync-batch statuses list` | Flag | Description | | ----------------------- | --------------------------------------------------------------- | | `--lipsync-ids ` | Comma-separated lipsync ids to look up. | | `--batch-ids ` | Comma-separated batch ids; each expands to its member lipsyncs. | ## Template Generate videos from reusable templates by replacing their variables | Command | API Endpoint | Description | | ---------------------------------------- | ---------------------------------- | ---------------------------- | | `heygen template generate ` | `POST /v3/templates/{template_id}` | Generate Video from Template | | `heygen template get ` | `GET /v3/templates/{template_id}` | Get Template | | `heygen template list` | `GET /v3/templates` | List Templates | ### Flags for `template generate` | Flag | Description | | --------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--brand-voice-id ` | Brand voice ID controlling pronunciation | | `--callback-id ` | Opaque ID echoed back in webhook events for this video | | `--callback-url ` | URL called with the video result in addition to registered webhook endpoints | | `--caption` | Whether to burn captions into the video | | `--enable-sharing` | Whether the generated video's share page is publicly accessible | | `--folder-id ` | Folder to place the generated video in | | `--fps ` | Output frame rate. One of 25, 30, or 60. | | `--include-gif` | Whether to include a GIF preview in the webhook payload | | `--keep-text-vertically-centered` | When true, replaced text elements are vertically re-centered based on their rendered height | | `--reorder-music` | When true (default), background audio tracks move with their scenes. When false, tracks stay pinned to layout positions. | | `--scene-ids ` | Scene IDs to render, in order (repeats allowed). Scenes must already exist in the template; the API can select, reorder, and repeat scenes but cannot create new ones. Omit to render all scenes in template order. | | `--title ` | Title for the generated video | ### Flags for `template list` | Flag | Description | | ----------------- | -------------------------------------------------------------- | | `--limit ` | Maximum number of templates to return per page | | `--token ` | Opaque pagination token from a previous response's next\_token | ## User Account information and billing | Command | API Endpoint | Description | | -------------------- | ------------------ | ---------------- | | `heygen user me get` | `GET /v3/users/me` | Get Current User | ## Video Create, list, retrieve, and delete videos | Command | API Endpoint | Description | | ------------------------------------- | ----------------------------------- | ------------------- | | `heygen video batches create` | `POST /v3/videos/batches` | Create Video Batch | | `heygen video batches get ` | `GET /v3/videos/batches/{batch_id}` | Get Video Batch | | `heygen video create` | `POST /v3/videos` | Create Video | | `heygen video delete ` | `DELETE /v3/videos/{video_id}` | Delete Video | | `heygen video get ` | `GET /v3/videos/{video_id}` | Get Video | | `heygen video list` | `GET /v3/videos` | List Videos | | `heygen video statuses list` | `GET /v3/videos/statuses` | Bulk Video Statuses | ### Flags for `video batches create` | Flag | Description | | ------------------------ | ------------------------------------------------------------------------------- | | `--callback-url ` | Webhook URL invoked once when every item in the batch reaches a terminal state. | | `--title ` | Display name for the batch, shown in the HeyGen app. | ### Flags for `video batches get` | Flag | Description | | ----------------- | -------------------------------------------------- | | `--limit ` | Items per page (1-100). | | `--token ` | Opaque pagination cursor from a previous response. | ### Flags for `video create` This command takes a structured request body. Pass it with `-d` and run the command with `--request-schema` to see all fields. ### Flags for `video list` | Flag | Description | | --------------------- | ------------------------------------------------- | | `--limit ` | Maximum number of items to return per page | | `--token ` | Opaque pagination cursor from a previous response | | `--folder-id ` | Filter videos by folder ID | | `--title ` | Filter videos by title substring | ### Flags for `video statuses list` | Flag | Description | | --------------------- | ------------------------------------------------------------- | | `--video-ids ` | Comma-separated video ids to look up. | | `--batch-ids ` | Comma-separated batch ids; each expands to its member videos. | ## Video Agent Create videos from text prompts using AI | Command | API Endpoint | Description | | ------------------------------------------------------------- | ----------------------------------------------------------- | -------------------------------- | | `heygen video-agent create` | `POST /v3/video-agents` | Create Video Agent Session | | `heygen video-agent get ` | `GET /v3/video-agents/{session_id}` | Get Video Agent Session | | `heygen video-agent list` | `GET /v3/video-agents` | List Video Agent Sessions | | `heygen video-agent resources get ` | `GET /v3/video-agents/{session_id}/resources/{resource_id}` | Get Session Resource | | `heygen video-agent send ` | `POST /v3/video-agents/{session_id}` | Send Message or Request Revision | | `heygen video-agent stop ` | `POST /v3/video-agents/{session_id}/stop` | Stop Video Agent Session | | `heygen video-agent styles list` | `GET /v3/video-agents/styles` | List Video Agent Styles | | `heygen video-agent videos list ` | `GET /v3/video-agents/{session_id}/videos` | List Session Videos | ### Flags for `video-agent create` | Flag | Description | | ------------------------ | -------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--avatar-id ` | Specific avatar ID to use | | `--brand-kit-id ` | Brand kit ID to apply brand colors, fonts, and logos to the generated video. | | `--callback-id ` | Optional callback ID included in webhook payload | | `--callback-url ` | Webhook URL for completion/failure notifications | | `--incognito-mode` | When enabled, disables memory injection and extraction for this session | | `--mode ` | Session mode. 'generate' produces one video (fire-and-forget). 'chat' enables multi-turn interaction — the agent may pause for decisions and allows revisions. | | `--orientation ` | Video orientation. If not provided, auto-detected from content. | | `--prompt ` | The message/prompt for video generation (1-10000 characters) (required) | | `--style-id ` | Style ID from GET /v3/video-agents/styles. Applies a curated visual template to the generated video. | | `--voice-id ` | Specific voice ID to use for narration | ### Flags for `video-agent list` | Flag | Description | | ----------------- | ---------------------------------------------------------------------------------------- | | `--limit ` | Results per page (1-100). | | `--token ` | Opaque cursor token for the next page. Obtained from next\_token in a previous response. | ### Flags for `video-agent send` | Flag | Description | | ------------------------ | -------------------------------------- | | `--avatar-id ` | Override avatar for this message | | `--brand-kit-id ` | Brand kit ID to apply for this message | | `--message ` | Text message to the agent (required) | | `--voice-id ` | Override voice for this message | ### Flags for `video-agent stop` This command takes a structured request body. Pass it with `-d` and run the command with `--request-schema` to see all fields. ### Flags for `video-agent styles list` | Flag | Description | | ----------------- | ----------------------------------------------------------------------------------------------------- | | `--tag ` | Filter by tag (e.g., 'cinematic', 'retro-tech', 'iconic-artist', 'pop-culture', 'handmade', 'print'). | | `--limit ` | Results per page (1-100). | | `--token ` | Opaque cursor token for the next page. Obtained from next\_token in a previous response. | ## Video Translate Translate videos into other languages | Command | API Endpoint | Description | | ------------------------------------------------------------- | ---------------------------------------------------------------- | ------------------------------------ | | `heygen video-translate create` | `POST /v3/video-translations` | Create Video Translation | | `heygen video-translate delete ` | `DELETE /v3/video-translations/{video_translation_id}` | Delete Video Translation | | `heygen video-translate get ` | `GET /v3/video-translations/{video_translation_id}` | Get Video Translation | | `heygen video-translate languages list` | `GET /v3/video-translations/languages` | List Supported Translation Languages | | `heygen video-translate list` | `GET /v3/video-translations` | List Video Translations | | `heygen video-translate proofreads create` | `POST /v3/video-translations/proofreads` | Create Proofread Session | | `heygen video-translate proofreads generate ` | `POST /v3/video-translations/proofreads/{proofread_id}/generate` | Generate Video from Proofread | | `heygen video-translate proofreads get ` | `GET /v3/video-translations/proofreads/{proofread_id}` | Get Proofread Session | | `heygen video-translate proofreads srt get ` | `GET /v3/video-translations/proofreads/{proofread_id}/srt` | Download Proofread SRT | | `heygen video-translate proofreads srt update ` | `PUT /v3/video-translations/proofreads/{proofread_id}/srt` | Upload Proofread SRT | | `heygen video-translate update ` | `PATCH /v3/video-translations/{video_translation_id}` | Update Video Translation | ### Flags for `video-translate create` | Flag | Description | | ----------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | | `--brand-glossary-id ` | Brand glossary ID for custom term translations (e.g. translate 'Reformer' as the Pilates equipment, not 'political activist'). Alias for the legacy `brand_voice_id` field. Discover IDs via GET /v3/brand-glossaries. | | `--brand-voice-id ` | Brand glossary ID for custom term translations. Legacy field name for `brand_glossary_id` — both are accepted and resolve to the same workspace record. Discover IDs via GET /v3/brand-glossaries. | | `--callback-id ` | ID included in webhook payload | | `--callback-url ` | Webhook URL for completion notifications | | `--disable-music-track` | Remove background music | | `--enable-caption` | Generate captions for translated video | | `--enable-dynamic-duration` | Allow dynamic duration adjustment | | `--enable-speech-enhancement` | Enhance speech quality | | `--enable-watermark` | Add watermark to output | | `--end-time ` | End time in seconds for partial translation | | `--folder-id ` | Project/folder ID to organize translation into | | `--fps-mode ` | Frame rate mode for the output video. 'vfr' = variable frame rate, 'cfr' = constant frame rate, 'passthrough' = match the source. Only takes effect when a custom 'audio' track is provided. | | `--input-language ` | Source language code (auto-detected if omitted) | | `--keep-the-same-format` | Preserve the source video's encoding specs (resolution, bitrate). | | `--mode ` | Translation quality mode: 'speed' (faster) or 'precision' (higher quality, uses avatar inference) | | `--output-languages ` | Target language names (e.g. 'Chinese (Cantonese, Traditional)', 'Spanish (Spain)', 'English'). Use GET /v3/video-translations/languages for valid values. Use one for single translation, multiple for batch. (required) | | `--speaker-num ` | Number of speakers (improves speaker separation) | | `--srt-role ` | Which video the subtitle applies to: 'input' (source) or 'output' (translated). | | `--start-time ` | Start time in seconds for partial translation | | `--title ` | Title for the translation job | | `--translate-audio-only` | Only translate audio, keep original video | ### Flags for `video-translate list` | Flag | Description | | ----------------- | ------------------------------------- | | `--limit ` | Maximum number of items per page | | `--token ` | Opaque cursor token for the next page | ### Flags for `video-translate proofreads create` | Flag | Description | | ----------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--brand-glossary-id ` | Brand glossary ID for custom term translations (e.g. translate 'Reformer' as 'Pilates equipment', not 'political activist'). Alias for the legacy `brand_voice_id` field. Discover IDs via GET /v3/brand-glossaries. | | `--brand-voice-id ` | Brand glossary ID for custom term translations. Legacy field name for `brand_glossary_id` — both are accepted and resolve to the same workspace record. Discover IDs via GET /v3/brand-glossaries. | | `--disable-music-track` | Remove background music | | `--enable-speech-enhancement` | Enhance speech quality | | `--enable-video-stretching` | Allow dynamic duration adjustment | | `--folder-id ` | Project/folder ID to organize proofread into | | `--keep-the-same-format` | Preserve the source video's encoding specs (resolution, bitrate) | | `--mode ` | Translation quality mode: 'speed' (faster) or 'precision' (higher quality) | | `--output-languages ` | Target language codes. Use one for single proofread, multiple for batch. (required) | | `--speaker-num ` | Number of speakers (improves speaker separation) | | `--title ` | Title for the proofread job (required) | ### Flags for `video-translate proofreads generate` | Flag | Description | | ------------------------ | ------------------------------------------ | | `--callback-id ` | ID included in webhook payload | | `--callback-url ` | Webhook URL for completion notifications | | `--captions` | Generate captions for the translated video | | `--translate-audio-only` | Only translate audio, keep original video | ### Flags for `video-translate proofreads srt update` This command takes a structured request body. Pass it with `-d` and run the command with `--request-schema` to see all fields. ### Flags for `video-translate update` | Flag | Description | | ----------------- | ---------------------------------------------- | | `--title ` | New title for the video translation (required) | ## Video Translation Batch Create and track batches of video translations. | Command | API Endpoint | Description | | ------------------------------------------------------- | ----------------------------------------------- | ------------------------------- | | `heygen video-translation-batch batches create` | `POST /v3/video-translations/batches` | Create Video Translation Batch | | `heygen video-translation-batch batches get ` | `GET /v3/video-translations/batches/{batch_id}` | Get Video Translation Batch | | `heygen video-translation-batch statuses list` | `GET /v3/video-translations/statuses` | Bulk Video Translation Statuses | ### Flags for `video-translation-batch batches create` | Flag | Description | | ------------------------ | ------------------------------------------------------------------------------- | | `--callback-url ` | Webhook URL invoked once when every item in the batch reaches a terminal state. | | `--title ` | Display name for the batch, shown in the HeyGen app. | ### Flags for `video-translation-batch batches get` | Flag | Description | | ----------------- | -------------------------------------------------- | | `--limit ` | Items per page (1-100). | | `--token ` | Opaque pagination cursor from a previous response. | ### Flags for `video-translation-batch statuses list` | Flag | Description | | --------------------------------- | ------------------------------------------------------------------------- | | `--video-translation-ids ` | Comma-separated video translation ids to look up. | | `--batch-ids ` | Comma-separated batch ids; each expands to its member video translations. | ## Voice Create speech audio and manage voices | Command | API Endpoint | Description | | -------------------------------- | ------------------------------ | --------------- | | `heygen voice clone create` | `POST /v3/voices/clone` | Clone a Voice | | `heygen voice create` | `POST /v3/voices` | Design a Voice | | `heygen voice delete ` | `DELETE /v3/voices/{voice_id}` | Delete a Voice | | `heygen voice get ` | `GET /v3/voices/{voice_id}` | Get Voice | | `heygen voice list` | `GET /v3/voices` | List Voices | | `heygen voice speech create` | `POST /v3/voices/speech` | Generate Speech | ### Flags for `voice clone create` | Flag | Description | | --------------------------- | ------------------------------------------------------------------------- | | `--language ` | Language hint for the voice (e.g., 'en', 'es'). Auto-detected if omitted. | | `--remove-background-noise` | Remove background noise from the audio before cloning. | | `--voice-name ` | Display name for the cloned voice. (required) | ### Flags for `voice create` | Flag | Description | | ------------------ | --------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--gender ` | Filter by gender: 'male' or 'female'. | | `--locale ` | BCP-47 locale tag to filter by (e.g., 'en-US', 'pt-BR'). | | `--prompt ` | Natural language description of the desired voice (e.g., 'warm, confident female narrator'). (required) | | `--seed ` | Controls which batch of results to return. seed=0 returns the top matches, seed=1 the next batch, etc. Same prompt + seed always returns the same voices. | ### Flags for `voice list` | Flag | Description | | -------------------- | --------------------------------------------------------------------------------------------------------- | | `--type ` | Voice type: 'public' for the shared library or 'private' for your cloned voices. | | `--engine ` | Filter by voice engine (e.g. 'starfish'). When set, only voices compatible with that engine are returned. | | `--language ` | Filter by language (e.g. 'English'). | | `--gender ` | Filter by gender ('male' or 'female'). | | `--limit ` | Results per page (1-100). | | `--token ` | Opaque cursor token for the next page. | ### Flags for `voice speech create` | Flag | Description | | ---------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------- | | `--input-type ` | Type of the input: 'text' for plain text, 'ssml' for SSML markup. Defaults to 'text'. | | `--language ` | Base language code (e.g. 'en', 'pt', 'zh'). Optional — auto-detected from text when omitted. | | `--locale ` | BCP-47 locale tag (e.g. 'en-US', 'pt-BR'). When set, language is inferred from locale. | | `--speed ` | Speed multiplier (0.5-2.0). | | `--text ` | Text to synthesize (1-5000 characters). (required) | | `--voice-id ` | Voice ID to use. The voice must support the starfish engine. Filter compatible voices by passing engine=starfish to the voice listing endpoint. (required) | ## Webhook Create, list, and manage webhook endpoints and events | Command | API Endpoint | Description | | ------------------------------------------------------ | --------------------------------------------------------- | ----------------------------- | | `heygen webhook endpoints create` | `POST /v3/webhooks/endpoints` | Create Webhook Endpoint | | `heygen webhook endpoints delete ` | `DELETE /v3/webhooks/endpoints/{endpoint_id}` | Delete Webhook Endpoint | | `heygen webhook endpoints list` | `GET /v3/webhooks/endpoints` | List Webhook Endpoints | | `heygen webhook endpoints rotate-secret ` | `POST /v3/webhooks/endpoints/{endpoint_id}/rotate-secret` | Rotate Webhook Signing Secret | | `heygen webhook endpoints update ` | `PATCH /v3/webhooks/endpoints/{endpoint_id}` | Update Webhook Endpoint | | `heygen webhook event-types list` | `GET /v3/webhooks/event-types` | List Webhook Event Types | | `heygen webhook events list` | `GET /v3/webhooks/events` | List Webhook Events | ### Flags for `webhook endpoints create` | Flag | Description | | --------------------- | ----------------------------------------------------------------------------------------------------- | | `--entity-id ` | Optional entity ID to scope this endpoint to a specific resource (e.g. a personalized video project). | | `--events ` | Event types to subscribe to. Omit or set to null to receive all events. | | `--url ` | Publicly accessible HTTPS URL that will receive webhook POST requests. (required) | ### Flags for `webhook endpoints list` | Flag | Description | | ----------------- | ---------------------------------------------------------------- | | `--limit ` | Maximum number of endpoints to return (1-100). Default: 10. | | `--token ` | Opaque pagination cursor from a previous response's next\_token. | ### Flags for `webhook endpoints update` | Flag | Description | | ------------------- | -------------------------------------------------------------------- | | `--events ` | New list of event types to subscribe to. Replaces the existing list. | | `--url ` | New URL for the endpoint. Must be publicly accessible HTTPS. | ### Flags for `webhook events list` | Flag | Description | | ---------------------- | ---------------------------------------------------------------- | | `--event-type ` | Filter events by type, e.g. 'avatar\_video.success'. | | `--entity-id ` | Filter events by entity ID. | | `--limit ` | Maximum number of events to return (1-100). Default: 10. | | `--token ` | Opaque pagination cursor from a previous response's next\_token. | ## Authentication | Command | Description | | --------------------------- | --------------------------------------------------------------------------------------------------- | | `heygen auth login` | Authenticate interactively (prompts for API key) | | `heygen auth login --oauth` | Log in via browser OAuth — uses subscription credits ([free usage](/docs/for-ai-agents#free-usage)) | | `heygen auth status` | Verify stored credentials and show account info | For CI/Docker, use the `HEYGEN_API_KEY` environment variable instead. It takes precedence over stored credentials. ## Utility Commands | Command | Description | | --------------------------------- | -------------------------------------------- | | `heygen config set ` | Set a persistent config value | | `heygen config get ` | Read a config value | | `heygen config list` | Show all config values and their sources | | `heygen update` | Self-update to the latest version | | `heygen update --version ` | Update to a specific version (e.g. `v0.1.0`) | ### Config keys | Key | Values | Description | | ----------- | --------------- | ------------------------------------------- | | `output` | `json`, `human` | Default output format (default: `json`) | | `analytics` | `true`, `false` | Enable or disable anonymous usage analytics | # Content Repurposing Source: https://developers.heygen.com/content-repurposing Repurpose blog posts, podcasts, and long-form video into avatar-led short clips with the HeyGen API. One source, dozens of platform-ready outputs. ## The Problem You invest hours writing a great blog post. It reaches your readers — but misses the much larger audience that consumes content through video. Manually converting articles to video takes almost as long as writing them. ## How It Works ``` Written content → LLM extracts key points → Video Agent renders → Distribute on video platforms ``` An LLM reads your content and writes a production-quality video prompt — extracting the most compelling points and restructuring them for video. The same article can become a 90-second YouTube explainer, a 30-second TikTok, and a 60-second LinkedIn post. ## Build It Pull the article from your CMS, a URL, or a local file. ```python theme={null} # From a file with open("article.md") as f: article = f.read() # Or from a URL (use a proper extraction library for production) import requests article = requests.get("https://yourblog.com/posts/your-article").text ``` The LLM acts as a producer — extracting the most engaging points and structuring them for video. ```python theme={null} import anthropic client = anthropic.Anthropic() message = client.messages.create( model="claude-sonnet-4-20250514", max_tokens=1024, messages=[{ "role": "user", "content": f"""You are a video producer converting a written article into a HeyGen Video Agent prompt. Read this article and create a 60-second video prompt that: 1. Opens with the most compelling insight or stat (hook) 2. Covers the 3 most important points — not everything, the best bits 3. Uses specific visual descriptions — what the viewer sees on screen 4. Ends with a CTA to read the full article 5. Matches the tone of the original Article: {article} Output ONLY the Video Agent prompt.""" }], ) video_prompt = message.content[0].text ``` **Don't summarize — adapt.** The LLM shouldn't just compress the article. It should identify the most *visual* and *engaging* points and restructure them for video. A great blog point might be boring on video, and vice versa. Submit the prompt. Attach any images or charts from the article as file inputs. ```python theme={null} resp = requests.post( "https://api.heygen.com/v3/video-agents", headers={ "X-Api-Key": HEYGEN_API_KEY, "Content-Type": "application/json", }, json={ "prompt": video_prompt, "files": [ {"type": "url", "url": "https://yourblog.com/images/chart.png"}, ], }, ) video_id = resp.json()["data"]["video_id"] ``` Then poll for completion — see [Video Agent docs](/docs/video-agent). One article can become multiple videos for different platforms: ```python theme={null} formats = [ {"platform": "YouTube", "duration": "90s", "orientation": "landscape", "style": "in-depth"}, {"platform": "TikTok/Reels", "duration": "30s", "orientation": "portrait", "style": "hook-driven"}, {"platform": "LinkedIn", "duration": "60s", "orientation": "landscape", "style": "professional"}, ] for fmt in formats: # Regenerate the LLM prompt with platform-specific instructions platform_prompt = generate_prompt_for(article, fmt) # Submit to Video Agent with the right orientation submit_video(platform_prompt, orientation=fmt["orientation"]) ``` ## Content Types That Convert Well | Content type | Video style | Tips | | -------------------- | -------------------- | ------------------------------------------------- | | **How-to articles** | Tutorial walkthrough | Step-by-step with text overlays | | **Listicles** | Quick tips | One point every 5–7 seconds, great for short-form | | **Opinion/analysis** | Thought leadership | Presenter-driven, conversational | | **Case studies** | Story-driven | Before/after structure, stats as highlights | | **Newsletters** | Weekly digest | Cover 3–5 highlights, keep it breezy | ## Automating the Pipeline ``` Blog CMS webhook → "New post published" ↓ Fetch article content ↓ LLM generates video prompt ↓ Video Agent renders ↓ Upload to YouTube / post to social ↓ Add video embed to original article ``` Trigger from a CMS webhook, cron job, or CI/CD. See [Automated Broadcast](/cookbook/video-agent/automated-broadcast) for scheduling and distribution patterns. ## Variations * **Teaser + full:** 15-second teaser for social, 90-second deep dive for YouTube * **Multi-language:** Generate in English, then [translate](/cookbook/video-agent/multilingual-content) for global audiences * **Podcast-to-video:** Extract audio highlights → write visual prompt → avatar presents the key takeaways *** ## Next Steps Generate original social content, not just repurposed articles. Automate the entire content → video → distribute pipeline. # Data Visualization Videos Source: https://developers.heygen.com/data-to-video Convert spreadsheets, dashboards, and analytics into avatar-led explainer videos via the HeyGen API. The agent narrates the data and surfaces the key findings. ## Examples