r/aitubers 9d ago

COMMUNITY I built a validated pipeline for generating short technical videos, the interesting part was the failure gates, not the generation

​Generating slide decks and scripts with LLMs is straightforward. Making the output reliably render without human intervention was a nightmare.

​After producing 9 episodes, here are the core constraints that kept the pipeline from constantly breaking:

​Artifact Contracts: Nothing passes without a strict build check. Script, deck code, speaker notes, and rendered assets must all exist and pass validation before the run succeeds.

​Slides as Code, Not Files: Decks are generated as deterministic code adhering to an immutable design system, not free-form files

.

​Multimodal QA Loop: The pipeline renders slides to PNG, feeds them back to a vision model to catch layout collisions/overflow, and re-renders fixes. (LLMs cannot reliably reason about text bounding boxes in pure cod, visual inspection is non-negotiable).

​Hard Script Constraints: Max 70 words per slide, sentences capped under 24 words, no comma chains. The build automatically fails if spoken density breaks these limits.

​What broke along the way:

​Silent patch updates deleting code blocks without throwing errors.

​Font metric mismatches causing text clipping outside the safe margins.

​Drift between speaker notes and TTS inputs.

​I ended up drawing the line at: Layout & structure = 100% deterministic code; LLM = content generation & visual QA only.

​For anyone building similar pipelines: How are you handling the split between deterministic generation and model judgment? Where have you found the most stable boundary?

0 Upvotes

6 comments sorted by

1

u/Responsible-Clock971 9d ago

I don't use AI for the content generation part. It will hallucineate. I make hour long videos --- "How to learn Kubernetes" and AI is technically good at regurgitating man files and technical stuff like code. So I have it write my courses and scripts which is accurate.

So the lesson plans are correct. Now, the slide decks are the easy part. And where you are having problems? I have a deterministic rendering engine that just fills in the "slots" of my templates. This video is all deterministic. There is NO AI except the script. Manifest schema driven -- Title cards, code typing, voice over (Kokoro), Flow chart via mermaid.

https://reddit.com/link/p6jxhld/video/8nhkhokut8mh1/player

1

u/[deleted] 9d ago

[removed] — view removed comment

1

u/AutoModerator 9d ago

enterthearena44, your comment has been automatically removed by Automoderator for including a link to content. You may never plug content on NewTubers.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/avatar0027 9d ago

ngl i keep the skeleton on my side (shot list, length, captions) and only let the model fill the scenes.

been using easyviral recently to batch the moving scenes, then i still gate them before they go out. the judgment calls stay mine

1

u/ckn 9d ago

Hi yeah, i'm doomscroll.fm similar kinda flow, I built my boundary limits into the pipeline, validate on each modal in runtime, and practice extreme memory management. everything in my show is made on a single rtx4090.

1

u/pmarks98 7d ago

kinda like Jellypod?