Add directors-cut: an LLM directs, PixVerse shoots with native audio - #10
Merged
Merged
Conversation
A premise goes to Claude, which writes the film as a strict JSON shot list: a style bible that describes the characters identically in every shot, plus N shots with action, camera move, sound and length. PixVerse renders each shot with native audio, in one of three modes: all at once, chained (each shot starts from the previous shot's last frame), or one multi-shot take that PixVerse cuts itself. ffmpeg normalizes the shots, fills in silence where a shot has no sound, and cuts them behind a title card. Any shot can be reshot from the page with a new note. Tested with a real key: a 4-shot, 16 s film in 66 s for $0.78, with a consistent rider across shots, and a reshoot in 46 s for $0.19. All three modes, reshoots and the page were tested offline with fakes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ght theme - The director picker now offers eight LLMs, grouped on the page: - Anthropic: Claude Sonnet (default) and Claude Opus. - OpenAI: GPT-6 Astra, Sol and Luna. - Open weights: Kimi K3, GLM 5.3 and DeepSeek V4 Pro. Each is pinned to an endpoint that supports JSON-schema output, with a fallback serving the same model elsewhere. GPT-6 is served by Azure, because OpenAI's own endpoint returned 401s on the account. DeepSeek V4 Pro is served by Nebius, because DeepSeek's own endpoint rejects JSON schema. Kimi K3 uses reasoning_effort low (23 s instead of 58 s). GLM 5.3 always thinks, so it's labelled as slower. - Room for reasoning models: max_tokens 8000, a 240 s timeout on director calls, and no temperature when reasoning_effort is set. - The page gets a light theme: off-white background, white panels, dark text, and dark frames kept for the video. - READMEs: a measured "Pick your director" table (every director returned a valid 4-shot plan), and the cookbook index lists the new directors. Tested with a real key: all eight directors on the same premise, plus a full 3-shot film through the page with GPT-6 Sol (60 s, $0.59). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This adds a fourth demo,
directors-cut/, which shows off PixVerse's video models.You describe a film in a sentence. An LLM director writes it as a strict JSON shot list: a "style bible" that describes the characters identically in every shot, plus N shots, each with its action, camera move, sound and length. PixVerse shoots every shot with native audio, and
ffmpegcuts them behind a title card. Any shot can be reshot with a new note, which re-renders only that shot and re-cuts the film.Shooting modes:
Directors: eight LLMs, grouped on the page. Each is pinned to an endpoint that supports JSON-schema output, with a fallback serving the same model elsewhere.
Page: a light theme (off-white background, white panels, dark video frames), with a live Direct → Shoot → Edit pipeline, storyboard cards, the final cut and a cost table.
Testing (real key, 2026-09-29)
Notes
These are problems on the providers' side or in the Eden AI platform, not in the demo:
401 Incorrect API keyfor GPT-6 (and for OpenAI TTS), withis_byok: false. That's Eden AI's platform OpenAI key. The demo uses Azure, with OpenAI as the fallback.video_generationtool takes noprovider_params, so it can't switch on PixVerse audio or multi-shot. The demo calls the REST API instead.camera_movement,styleandlast_frame_imagearen't on the allow-list, so camera moves are written into the prompts.🤖 Generated with Claude Code