A webui for different audio related Neural Networks

🔊 Text-Prompted Generative Audio Model with Gradio

A repository for generating and training short audio samples with unconditional waveform diffusion on accessible consumer hardware (<2GB VRAM GPU)

Generate YouTube Shorts using Reddit posts scraped with PRAW, title and captions generated with GPT, images and thumbnails generated with Stable Diffusion and voiceover with 11Labs

Design new algorithmic patterns to generate music samples or build drum machines and on top of it, build user-friendly and beautiful UIs to make the music tools available outside music environments and DAWs.

A music making experiment

A Go API client library for the ElevenLabs speech synthesis platform

ComfyUI custom nodes for Suno — generate, remix, extend, and shape AI music inside ComfyUI via the muapi.ai API.

Memory-optimized SongGeneration (v2 Large) for 16GB VRAM GPUs. Features 8-bit µ-law KV-caching, fused layers, and SDPA/Triton integration.

A SuperCollider instrument for autonomous embedded audio recording, generative sound, and musical performance.

Pre/post-processing utility for generating quantized log-normally-distributed spike-intervals from raw audio, and back again (C++, AVX2)

A 3D interactive web app combining Google Maps Photorealistic 3D Tiles and Google Lyria to simulate paper plane flight over Tokyo. Powered by Next.js and R3F.

Tailored Music For Your Videos

[arXiv 2024] Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis

AI Drums:

Use Wotja to generate Live Generative Music

Interactive chandelier that lights and sounds respond to people approaching, using time-of-flight sensors, an ESP32, and a Raspberry Pi.

StyleGAN2 + MelGAN Audio Loop Generation

🎵 final project for multichannel media installation & performance at NYU, spring 2014