HunyuanVideo Foley overview
HunyuanVideo Foley by Tencent
HunyuanVideo-Foley is a multimodal AI model that generates high-quality, synchronized audio directly from video input.
HunyuanVideo Foley specs
- Model ID
hunyuan-video-foley- Developer
- Tencent
- Input
- Text, Video
- Output
- Video
- Endpoint
POST https://api.aimlapi.com/v2/video/generations
HunyuanVideo Foley API Description
HunyuanVideo-Foley is a powerful AI model that generates realistic sound effects straight from video. Created by Tencent, it eliminates the need for manual Foley work by automatically producing audio that matches motion, timing, and scene context.
Instead of treating audio as a separate step, the model builds it directly into the video experience. The output feels aligned, responsive, and ready to use, whether you're working on short-form content or full-scale production.
Technical Specifications
| Feature | Description | Value |
|---|---|---|
| Input Types | Video + optional text prompts | Multimodal |
| Output | Foley audio (sound effects, ambience, music) | 48kHz audio |
| Architecture | Multimodal diffusion transformer | Advanced |
| Synchronization | Frame-level alignment | High precision |
| Deployment | Local inference + web UI (Gradio) | Flexible |
Performance Benchmarks
In comprehensive benchmarks including Kling-Audio-Eval, VGGSound-Test, and MovieGen-Audio-Bench, HunyuanVideo Foley consistently outperforms competitors like FoleyCrafter, MMAudio, V-AURA, and ThinkSound.
It consistently leads in audio fidelity, semantic alignment between visuals and sound, temporal synchronization, and distribution matching metrics, outperforming all well-known open-source models in these areas. According to both objective evaluations and professional human assessments. The model showcases robust and stable performance across a wide variety of video content and audio scenarios, confirming its reliability in diverse real-world applications.
Multimodal Diffusion Architecture
At the heart of HunyuanVideo-Foley lies a diffusion-based transformer that operates across multiple modalities. It encodes video frames into structured representations, aligns them with optional textual prompts, and generates audio through a latent diffusion process.
This architecture enables the model to maintain both acoustic realism and semantic coherence, ensuring that generated sounds match not just what is visible, but what is happening.
Temporal Alignment Mechanism
One of the defining features of the model is its ability to synchronize sound with visual events at a fine-grained level. Rather than producing loosely aligned audio, it captures timing details such as motion speed, impact moments, and environmental transitions.
This precision is especially noticeable in scenes involving physical interaction, where even slight desynchronization would break immersion.
Representation Alignment Strategy
To maintain consistency across modalities, the model uses a dedicated alignment framework that harmonizes visual, textual, and audio embeddings. This reduces common issues like mismatched sound cues or overly dominant audio patterns, resulting in a more balanced and believable output.
Use cases
- Short and social video creation
- Film and TV post-production sound design
- Marketing and advertising video audio enhancement
- Immersive audio for game development
- Automated dubbing and Foley replacement
HunyuanVideo Foley API pricing
| Usage | Price | Unit |
|---|---|---|
| Video generation | $0.01 | per second |
Prices from the AI/ML API price list, checked on Nov 4, 2026.
HunyuanVideo Foley vs other video models: prices
AI/ML API rates for 5 models, per second.
| Model | Per second |
|---|---|
 HunyuanVideo Foley | $0.01 |
 Kandinsky5 Text to Video Distill | $0.01 |
| Kandinsky5 Text to Video | $0.016 |
 Wan 2.6 Image to Video Flash | $0.025 |
 Krea WAN 14B Text to Video | $0.025 |
How to use the HunyuanVideo Foley API
View docs
Build with your agent
Give your agent the model details, code and documentation.
1Get your API key
Create API keyexport AIMLAPI_KEY="8f2b4c7d9a1e6b3f…"2Make your first request
curl 'https://api.aimlapi.com/v2/video/generations' \
-H "Authorization: Bearer $AIMLAPI_KEY" \
-H 'Content-Type: application/json' \
-d '{
"model": "hunyuan-video-foley",
"video_url": "https://example.com/input.mp3"
}'import os
import requests
headers = {
"Authorization": f"Bearer {os.environ['AIMLAPI_KEY']}",
"Content-Type": "application/json",
}
payload = {
"model": "hunyuan-video-foley",
"video_url": "https://example.com/input.mp3"
}
response = requests.post("https://api.aimlapi.com/v2/video/generations", headers=headers, json=payload, timeout=120)
response.raise_for_status()
print(response.json())const response = await fetch("https://api.aimlapi.com/v2/video/generations", {
method: "POST",
headers: {
Authorization: `Bearer ${process.env.AIMLAPI_KEY}`,
"Content-Type": "application/json",
},
body: JSON.stringify({
"model": "hunyuan-video-foley",
"video_url": "https://example.com/input.mp3"
}),
});
if (!response.ok) throw new Error(`HTTP ${response.status}`);
console.log(await response.json());The request returns a generation id. Poll GET https://api.aimlapi.com/v2/video/generations?generation_id=<id> until the status is completed.
Models similar to HunyuanVideo Foley
Related articles
HunyuanVideo Foley FAQ
What inputs and outputs does HunyuanVideo Foley support?
HunyuanVideo Foley takes image, text, video as input and returns video.
How much does HunyuanVideo Foley cost?
HunyuanVideo Foley costs $0.01 per second on AI/ML API, billed as you go with no subscription.
How is HunyuanVideo Foley billed?
HunyuanVideo Foley costs $0.01 per second on AI/ML API, billed as you go with no subscription.
Can HunyuanVideo Foley take an existing image as input?
Yes, HunyuanVideo Foley accepts image input as well as a text prompt.
Who created HunyuanVideo Foley?
HunyuanVideo Foley was built by Tencent.
How do I call HunyuanVideo Foley on AI/ML API?
Use hunyuan-video-foley as the model id on AI/ML API.
Is HunyuanVideo Foley available through a single API key?
Yes. HunyuanVideo Foley is served through AI/ML API, so the same key and endpoint format used for other models applies.
Does HunyuanVideo Foley create new video footage?
No. It generates synchronized foley audio for existing video rather than producing new video content.
What kind of audio does it produce?
It generates realistic sound effects synchronized with the video's content.
What is the HunyuanVideo Foley model ID?
Use hunyuan-video-foley as the model parameter. Requests go to https://api.aimlapi.com/v2/video/generations with your AI/ML API key.