Omnidesk is a live music-video generation studio for creators.

It takes a creative prompt, pasted lyrics, and optional creator-owned assets; produces a 16-second, two-scene music-video plan; lets a Gemini Managed Agent production desk review and optionally improve the plan; generates Veo clips; creates a separate continuous Lyria soundtrack; combines everything into a final MP4; and publishes watchable work to Discover.

Live app: https://omnidesk-seven.vercel.app

• Creates a rights-safe music-video concept from a prompt, lyrics, and uploaded assets.
• Defaults to two 8-second scenes for a 16-second music video.
• Uses Gemini planning to produce scene descriptions, Veo prompts, safety notes, and music structure.
• Runs a manual 4-role Gemini Managed Agent production desk across IP safety, video prompt quality, creative direction, and music continuity.
• Lets users optionally apply managed-agent recommendations back into the plan, or ignore them and continue unchanged.
• Keeps generation available even if the managed-agent desk is skipped or finds issues.
• Generates individual scene clips with Veo when the API is configured.
• Generates one continuous Lyria 3 music track in a separate audio lane and muxes it over the final video.
• Combines generated clips into a final MP4 with ffmpeg.
• Stores public project records and generated MP4s in Vercel Blob on production.
• Shows watchable community generations in the Discover tab, with love and comment interactions.

The app is intentionally focused on one live workflow:

1. Enter creative direction and optional lyrics.
2. Choose format, duration, and scene count.
3. Upload optional audio, video, image, or reference assets.
4. Create a music-video plan.
5. Manually run the Gemini Managed Agent production desk when the plan is ready for review.
6. Optionally apply the agents' recommendations back into the plan, or ignore them.
7. Generate selected scene clips, generate a separate Lyria soundtrack, or generate all and combine.
8. View watchable public generations in Discover.

Old mock storyboard screens and local demo data have been removed.

Create an original 16-second vertical music video for a creator drop. Use my lyrics, prompt, and creator-owned assets as the source of identity. Build a distinctive visual world with a memorable opening hook, performance-driven movement, bold but rights-safe styling, and two connected 8-second scenes that feel like chapters of the same track. Generate one continuous Lyria music bed across both scenes, not separate songs per scene. Avoid celebrity likenesses, copyrighted characters, franchise references, protected logos, and named-artist imitation.

Omnidesk is an AI production desk for creator music videos. A creator provides a prompt, lyrics, and optional creator-owned assets, and Omnidesk turns them into a rights-safe music-video plan with two connected Veo scenes and one continuous Lyria soundtrack. Gemini 3 Flash creates the scene plan, Veo prompts, safety notes, and music structure. A four-agent Gemini Managed Agent desk then reviews the plan from the perspectives of IP safety, video prompt quality, creative direction, and music continuity. The creator can optionally apply those agent recommendations back into the plan, ignore them, or continue straight to generation. Omnidesk generates Veo clips, produces a separate Lyria music bed, combines the final MP4, stores outputs in Vercel Blob, and publishes watchable results to a community Discover feed.

The core idea is to move beyond a basic prompt-to-video demo into an agentic creative workflow: agents are not just chatbots, they act like a production desk that catches risks, improves prompts, strengthens originality, and helps creators ship more polished, rights-safe music videos.

• Gemini 3 Flash preview for planning, scene writing, prompt generation, and audio-control JSON.
• Gemini Files API for uploaded asset context.
• Gemini Managed Agents / Interactions API for the specialist production desk and plan-review workflow.
• Veo 3 Fast Generate for generated video clips by default.
• Lyria 3 Clip preview for a continuous generated soundtrack.

Note: the current public Gemini API path in this repo uses Veo for video generation. If a public “Gemini Omni” video API becomes available in the target environment, it can be added behind the same scene-generation interface.

Install dependencies:

npm install

Create a local environment file:

cp .env.example .env

Add your AI Studio key to .env:

GEMINI_API_KEY=your_key_here

Run the API server:

npm run api

Run the web app:

npm run dev

Open the local URL printed by Vite.

GEMINI_API_KEY=your_ai_studio_key_here
GEMINI_PLANNER_MODEL=gemini-3-flash-preview
GEMINI_VIDEO_MODEL=veo-3.0-fast-generate-001
GEMINI_LYRIA_MODEL=lyria-3-clip-preview
GEMINI_MANAGED_AGENT=antigravity-preview-05-2026
OMNIDESK_API_PORT=8787
BLOB_READ_WRITE_TOKEN=vercel_blob_token_for_durable_public_media

Only GEMINI_API_KEY is required for planning and generation. BLOB_READ_WRITE_TOKEN is required for durable production storage and Discover persistence on Vercel. The model variables are optional overrides.

The frontend is deployed on Vercel. The API is wired through a small set of serverless entry points that all reuse server/app.js:

• api/[...path].js for top-level API routes such as health and Discover list.
• api/live/[...path].js for live generation, planning, agent, Lyria, video, and compile routes.
• api/discover/[projectId]/love.js and api/discover/[projectId]/comments.js for community interactions.

Video jobs start through POST /api/live/videos and are polled through GET /api/live/video-job?jobId=.... The query-string polling route avoids Vercel dynamic-route 404s for nested job IDs.

For live generation on Vercel, set GEMINI_API_KEY in the Vercel project environment and redeploy production. Without that environment variable, the deployed UI will load but show API offline, and generation buttons will stay disabled.

For community Discover persistence, link a Vercel Blob store to the project so BLOB_READ_WRITE_TOKEN is available in production. Without Blob, local development falls back to filesystem storage.

npm run dev
npm run api
npm run build
npm run lint

• src/App.jsx - app shell and top-level product surface.
• src/components/LiveGeneration.jsx - prompt, upload, planning, managed-agent review, and clip generation workflow.
• src/services/liveApi.js - client-side API helpers.
• server/app.js - Express API used locally and by Vercel serverless.
• server/index.js - local API server entry point.
• api/[...path].js - top-level Vercel API entry point.
• api/live/[...path].js - Vercel live-generation API entry point.
• api/discover/[projectId]/love.js and api/discover/[projectId]/comments.js - Vercel Discover interaction routes.
• docs/ - product, technical, build, safety, and live setup notes.
• docs/todos.md - current implementation gaps and next steps.

MIT License. See LICENSE.