惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

V
V2EX
Cisco Talos Blog
Cisco Talos Blog
MongoDB | Blog
MongoDB | Blog
IT之家
IT之家
N
News and Events Feed by Topic
博客园 - 叶小钗
Help Net Security
Help Net Security
美团技术团队
Attack and Defense Labs
Attack and Defense Labs
雷峰网
雷峰网
S
Security @ Cisco Blogs
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
WordPress大学
WordPress大学
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
AI
AI
Hacker News: Ask HN
Hacker News: Ask HN
T
The Blog of Author Tim Ferriss
Security Latest
Security Latest
Last Week in AI
Last Week in AI
S
Secure Thoughts
Simon Willison's Weblog
Simon Willison's Weblog
TaoSecurity Blog
TaoSecurity Blog
N
News and Events Feed by Topic
A
Arctic Wolf
Y
Y Combinator Blog
MyScale Blog
MyScale Blog
Cyberwarzone
Cyberwarzone
酷 壳 – CoolShell
酷 壳 – CoolShell
S
SegmentFault 最新的问题
罗磊的独立博客
Vercel News
Vercel News
D
DataBreaches.Net
博客园 - 聂微东
P
Palo Alto Networks Blog
N
News | PayPal Newsroom
GbyAI
GbyAI
B
Blog
A
About on SuperTechFans
PCI Perspectives
PCI Perspectives
S
Schneier on Security
Apple Machine Learning Research
Apple Machine Learning Research
I
InfoQ
The GitHub Blog
The GitHub Blog
P
Privacy International News Feed
Blog — PlanetScale
Blog — PlanetScale
博客园_首页
T
The Exploit Database - CXSecurity.com
V
Vulnerabilities – Threatpost
aimingoo的专栏
aimingoo的专栏
Google DeepMind News
Google DeepMind News

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant Common SOC 2 Failures (Real World) Stop Vibe-Checking Your AI App: A Practical Guide to Evals How to Use SonarQube and SonarScanner Locally to Level Up Your Code Quality Your Next To-Do App Is Dead — I Replaced Mine with an OpenClaw AI Sign a Nostr event in 60 lines of Python using coincurve — no nostr-sdk, no nbxplorer, no rust toolchain ITGC Audit Explained Like You’re in Big 4 Patch Tuesday abril 2026: Microsoft parcha 163 vulnerabilidades y un zero-day en SharePoint Stop scraping everything: a better way to track competitor price changes Listing on MCPize + the Official MCP Registry while routing payments OUTSIDE the marketplace — how I kept 100% of my x402 revenue Building an AI-Powered Risk Intelligence System Using Serverless Architecture Why We Ripped Function Overloading Out of Our AI Toolchain Testing AI-Generated Code: How to Actually Know If It Works SaaS Churn Is Killing Your Business. Here Is What to Do About It (Without a Support Team) The Speed of AI Is No Longer Linear - And Self-Improving Models Are Why How to Implement RBAC for MCP Tools: A Practical Guide for Engineering Teams From Standard Quote to Persuasive Proposal: AI Automation for Arborists I built a CLI that scaffolds complete multi-tenant SaaS apps Axios CVE-2025–62718: The Silent SSRF Bug That Could Be Hiding in Your Node.js App Right Now The dashboard that ended our friendship Data Pipelines Explained Simply (and How to Build Them with Python) The Hidden Cost of AI Systems Nobody Talks About. undefined vs undeclared, and how typeof behaves Switching from file-based jobs to NATS/Kafka in Rust without changing code io_uring Adventures: Rust Servers That Love Syscalls Why Agentic AI is Killing the Traditional Database The POUR principles of web accessibility for developers and designers Quantum Neural Network 3D — A Deep Dive into Interactive WebGL Visualization How To Install Caveman In Codex On macOS And Windows Automation Pipeline Reliability: Why Your Workflow Breaks When Nobody Is Watching I Built an 'Open World' AI Coding Agent — It Works From ANY Folder From Freelancing to Product: A Tech Service Company's SaaS Transformation China's AI Giants: Adding Tencent Hunyuan & ByteDance Doubao to AI University (74 Providers) On the Vibe Coders and Their Lies clerk: Auto-Summarize Your Claude Code Sessions AI Weekly — 2026/04/10–04/17 | The Model Lockdown Is Here, but the Toolchain Is the Real Battleground AI 週報 — 2026/04/10–2026/04/17 模型封鎖潮來了,但工具鏈才是真戰場 Maybe this is how Open-Source apps are born... 🚀 Fine-Tune LLMs with LoRA and QLoRA: 2026 Guide tRPC v11 + Next.js App Router: End-to-End Type Safety Without the Boilerplate ShadCN UI in 2026: Why I Stopped Installing Component Libraries and Started Owning My Components SaaS Billing in React Server Components: Stripe + Supabase Without a Single `useEffect` Join our DEV Weekend Challenge — $1,000 in Prizes Across TEN winners! Submissions Due April 20 at 6:59 AM UTC. Implementing FSRS Spaced Repetition in Flutter + Supabase — Adding Memory Science to an AI Learning App "I Texted My Localhost From the Train — Claude Code Fixed the Bug Before I Got Home" I Built a Sales Prep AI and It Went Deeper Than Expected Design to Code #2: One JSON, Eleven Outputs Solving the 100M-Row Problem: A Summary Table Pattern for High-Volume Push Notification Logs Flutter Web With Wasm: What Actually Changes For Developers I Built 50 Royalty-Free Soundtracks for My Side Project in a Weekend Using AI Music Generation The Vibe Coding Security Checklist: 7 Things to Check Before You Ship Stop Letting Googlebot Guess Fix Your React App's SEO Right Desconstruindo o Streaming do LinkedIn: Como Criar um Engine de Extração de Vídeo de Alta Performance com HLS e FFmpeg (EDA Part-1) EDA (Exploratory Data Analysis) Explained With Real Life — Why Looking at Your Data Is the Most Important Step in Machine Learning Brand Relationship Management at Scale: Our 4-Touch Outreach System for 200+ Brands Why String.fromEnvironment() Might Return an Empty String in Dart JGuardrails 1.0.0 — Hardening Java LLM Apps Against Jailbreaks, Toxicity, and Prompt Injection Plan and Schedule a Full Week of Threads Content From One Claude Conversation Coding Cat Oran Ep3, Five Tables Changed Everything Updated: BFF Pattern I'm done watching freelancers get buried by 200 proposals. So I'm building the alternative. This is my first post BFS Algorithm in Java Step by Step Tutorial with Examples Tracking LLM Pricing Monthly: An Open Dataset for 22 AI Models How We Measure Content ROI on a Comparison Site: Revenue Attribution Without Perfect Data Introducing Nova AI Ops: The AI-Native Operating System for SRE Teams I built a free desktop video downloader for Windows — Grabbit How Talkie OCR Helps Vision-Impaired & Dyslexic Users Read the World Around Them VRCFaceTracking安装和iPhone面捕配置教程,有bug Even CrowdStrike Can't See Your Agents The Automation Gold Rush: What n8n Workflows and Claude Are Opening Up for Developers Right Now
ACE-Step XL 1.5 Premium + Facebook / META Sam Audio + Auto-Editor Trim + Audio Tools Enhancement Full Tutorial
Furkan Gözükara · 2026-06-19 · via DEV Community

Video Tutorial

https://youtu.be/9C_6qNKjgpA

Source Video, Links, And Chapters

The public video description presents this as a full ACE-Step XL 1.5 Premium guide for local AI music generation, remix, repaint, stem extraction, wildcard prompt variation, audio processing, SAM Audio segmentation, Windows installation, RunPod, Massed Compute, SimplePod, and Linux/cloud workflows.

Video Chapters

  • 0:00 — Intro: ACESTEP XL 1.5 Premium local music, segmentation and processing tutorial
  • 0:52 — Fast song generation examples across styles in under one minute
  • 1:55 — Output manifest proof, 40-second generation time and supported models
  • 2:29 — Turbo/SFT/Base models, LoRA support, GPU presets and Torch Compile boost
  • 3:10 — Remix feature preview, same-lyrics requirement and responsible usage note
  • 4:16 — Repaint mode: regenerate and merge only a selected song section
  • 5:38 — Extract mode: stems, silence trimming, all-stems and batch folders
  • 6:30 — Lego mode: add an instrument stem such as guitar into existing audio
  • 7:25 — Audio Processing presets and manual enhancement controls for AI songs
  • 8:35 — Auto-Editor silent trim for tutorials, videos, audio and workflow export
  • 9:48 — DaVinci/Premiere/Final Cut/ShotCut/Kdenlive timeline export demo
  • 11:01 — SAM Audio Segment: BF16 models, VRAM presets and advanced segmentation
  • 11:47 — SAM outputs demo: vocals, drums, bass, remaining audio and saved files
  • 12:47 — Custom SAM prompts, semicolon batch segmenting and speech cleanup example
  • 14:19 — Batch processing, load metadata, manifests, saved settings and presets
  • 15:09 — Why local open-source models matter and where to run ACESTEP
  • 15:55 — Windows install begins: Patreon zip, changelog, attachments and download
  • 16:53 — Windows requirements tutorial before Python/CUDA/C++/FFmpeg setup
  • 17:29 — Extract zip safely, avoid bad paths and run Windows_Install_or_Update.bat
  • 18:24 — Automatic VENV, FFmpeg, UV install, model downloads and hash verification
  • 19:24 — Turbo default vs all-model download for SFT/Base and BF16 safetensors
  • 20:32 — First Windows launch, default Generate Song test and CMD progress
  • 21:44 — Model recommendations, VRAM tiers, languages, vocals and MP4 image output
  • 23:29 — Torch Compile setup for faster repeated generations
  • 24:05 — Outputs folder, model switching and full remix setup workflow
  • 25:24 — Practical remix loop: adapted lyrics, strength, reference audio and seed lock
  • 28:03 — Repaint workflow with source range preview, generated result and comparison
  • 29:13 — Recap: extraction, Lego, audio processing and SAM text-prompt usage
  • 30:20 — Windows wrap-up, LoRA training teaser and move to cloud installs
  • 31:16 — RunPod setup: credits, template, CUDA filters, GPU choice and storage
  • 34:53 — Upload zip in Jupyter Lab, extract, run instructions and handle installs
  • 35:43 — RunPod errors, resume behavior, model downloads and hash verification
  • 38:04 — Start ACESTEP on RunPod with Gradio Live, proxy ports and persistence
  • 40:18 — Add 7860/7861 ports, verify storage reuse and rerun installer after resume
  • 42:10 — RunPod connection troubleshooting and Gradio Live recommendation
  • 44:12 — Fix corrupted VENV/stale handle errors, reinstall safely and retest
  • 47:24 — Successful RunPod relaunch, default generation, nvitop and loading tips
  • 49:26 — RunPod first load vs fast inference, 15-second second generation example
  • 51:02 — Download outputs and delete RunPod pods/storage to stop spending
  • 53:30 — Massed Compute setup: coupon, Creator image, GPU prices and ThinLinc
  • 57:13 — Massed install from extracted folder, Linux notes and ultra-fast downloads
  • 59:18 — Start app on Massed Compute via localhost or Gradio Live
  • 1:00:23 — Default Massed generation, nvitop, faster loading and speed test
  • 1:02:03 — Sync/download outputs and delete Massed Compute instance safely
  • 1:03:25 — SimplePod setup: template, persistent volume, pricing and GPU choice
  • 1:06:39 — Jupyter upload, direct file browser, install command and model downloads
  • 1:08:21 — Start SimplePod, Gradio Live, default generation and one-time load errors
  • 1:09:31 — nvitop monitoring, newer driver/CUDA details and generation completion
  • 1:10:42 — Direct output/model downloads through SimplePod file browser
  • 1:11:42 — Delete instance, keep storage, relaunch GPU and verify install
  • 1:13:15 — Discord, subreddit, changelog, update guidance and support links
  • 1:14:30 — Final cleanup: terminate servers, delete storage and LoRA training outro

1. What ACE-Step XL 1.5 Premium Is

ACE-Step XL 1.5 Premium is a local-first music generation and audio utility suite. The video presents it as more than a song generator: it also includes Wildcards for prompt variation, advanced generation modes, remix/repaint workflows, stem extraction, LEGO-style stem addition, SAM Audio segmentation, Auto-Editor trimming, mastering-style audio processing, dataset tools, and LoRA/LoKr training pages.

Responsible-use note: the source tutorial says to use the application respectfully and for research/education. For remix, repaint, extraction, and pitch work, use material you own, have permission to process, or are otherwise allowed to use.

Video introduction

Video introduction

Feature overview

Feature overview

Core jobs covered in the tutorial:

  • Generate complete songs from a style prompt, structured lyrics, model choice, duration, language, and seed settings.
  • Use Wildcards in style, Music Caption, and Lyrics fields to randomly pick bracketed options at generation time.
  • Remix, repaint, extract, LEGO-add, complete, retake, edit, and reuse LM code hints when the selected model supports the workflow.
  • Trim silence, export audio/video, enhance or pre-master generated songs, and optionally run pitch correction with DiffPitcher.
  • Use SAM Audio with quick prompts, custom prompts, explicit spans, or batch prompt lists to extract target audio and save the remaining audio.
  • Use Library, Load Metadata, Results, and the preset system to restore, inspect, score, save, and reuse generation runs.

2. Install And Start On Windows

The Windows workflow uses the included batch files. Extract the ZIP, keep the folder structure intact, run the installer/update script, optionally download all models, then start the app with the Windows launcher.

Windows installer

Windows installer

  1. Extract the ACE-Step Premium ZIP to a path with enough free disk space for the virtual environment, model files, outputs, and FFmpeg runtime.
  2. Run Windows_Install_or_Update.bat. The installer creates the Python virtual environment, downloads or uses shared FFmpeg, installs packages with UV, and prepares the app.
  3. Run Windows_Download_All_Models.bat if you want SFT and Base models in addition to the automatically available Turbo path.
  4. Run Windows_Start_App.bat. In this workspace the launcher started ACE-Step at http://127.0.0.1:7862 because other Gradio apps were already using 7860 and 7861.
  5. Watch the command window for model download, model load, generation, and error details. The video recommends trusting the terminal status more than only the browser UI.

Model availability: Turbo is the quick default. SFT and Base require additional model files. Remix is recommended with SFT in the video; some modes are marked Base-only or unavailable until the matching model is selected.

Windows first generation

Windows first generation

3. Quick Song Generation

The Generate Song tab is the fast path. It exposes the controls most users need: style, lyrics, Wildcards, model, LoRA, GPU preset, quantization, language, vocal type, instrumental toggle, duration, count, seed, optional MP4 image, and video resolution.

Generate Song overview

Generate Song overview

Generate Song filled

Generate Song filled

Wildcards For Prompt Variation

ACE-Step XL 1.5 Premium v5.3 adds Wildcards. Write bracketed choices separated by pipes, such as [option A|option B|option C], and one option is picked when you generate. Wildcards can be used in the quick Generate Song Style field, the Advanced Music Caption field, and Lyrics.

Wildcards in Generate Song

Wildcards in Generate Song

Wildcards in Advanced caption and lyrics

Wildcards in Advanced caption and lyrics

  • Basic syntax: [piano|guitar|synth] picks one option when the job starts.
  • Nested syntax is supported. Example: cinematic [piano|guitar [clean|crunchy]] hook.
  • Lyrics can use the same pattern, for example: I feel [alive|ready|free] tonight.
  • Lyric tags without a pipe, such as [Verse], [Chorus], and [Instrumental], stay unchanged.
  • Do not enable Auto/Enhance Style or Auto/Enhance Lyrics when you need exact wildcard behavior; those improvement tools may rewrite the text and overwrite or remove wildcard expressions.
  • Batch folder processing uses the same Wildcards behavior, so batch jobs can vary instruments, moods, hooks, or lyric phrases across outputs without manually editing every run.
  • For repeatable comparisons, save the manifest/settings and lock other variables such as model, duration, and seed while testing wildcard choices.
  1. Write a concise Style prompt that describes genre, vocal character, instrumentation, production quality, tempo or mood, and mix target.
  2. Write Lyrics with section tags such as [Verse] and [Chorus]. The included ACE_Step_Lyric_Generation_Instructions_For_LLMs.txt file can be given to an LLM to format lyrics or style prompts.
  3. Optionally add Wildcards to Style or Lyrics when you want the app to choose between prompt variants automatically.
  4. Select the Model. Start with ACE-Step XL 1.5 Turbo to verify the machine and workflow quickly.
  5. Leave GPU Optimization Preset and DiT Quantization at safe defaults unless you are solving VRAM pressure or repeating a known workflow.
  6. Set Song Duration and Songs. The demo run used 20 seconds and 1 song.
  7. Use Random Seed while exploring. When a promising result appears, uncheck Random Seed and keep the seed so future edits stay comparable.
  8. Click Generate Song and monitor the Status field plus the terminal window.

Demo generation result

Demo generation result

Useful quick-tab buttons:

  • Random Style creates a starting style prompt.
  • Enhance Style improves the style prompt.
  • Enhance Lyrics improves lyric structure or phrasing before generation.
  • Cancel Generation stops a run from the UI.
  • Open Outputs Folder opens the app’s outputs directory where audio, manifests, lyrics, captions, sessions, and metadata are saved.

4. Results, Seeds, And Reuse

The tutorial stresses generating repeatedly until you have a good base result, then locking the seed and making controlled edits. This is especially important for remix and repaint work, where small prompt or range changes can be tested against the same underlying random state.

Seed and remix discussion

Seed and remix discussion

Results after generation

Results after generation

  • Send To Remix loads the generated song as Source Audio and prepares the advanced Remix workflow.
  • Send To Repaint loads the generated song and prepares a repaint range workflow.
  • Convert To Codes reuses the musical plan as LM Codes Hints in compatible Custom workflows.
  • Get Score and Get LRC create quality-score and lyric-timestamp artifacts.
  • Save and All Generated Files expose generated files for download or reuse.

Seed workflow:

  1. Keep Random Seed on while searching for a usable base result.
  2. When the result is close, copy or keep the seed shown by the UI.
  3. Turn Random Seed off.
  4. Change one word, one range, or one strength setting at a time.
  5. Compare outputs against the locked seed.

5. Advanced Generation Modes

The ACESTEP Advanced tab is the full workstation. It exposes generation mode, runtime settings, source/reference audio, LM code utilities, advanced prompts, Wildcards in Music Caption/Lyrics, metadata, sampler settings, output settings, and batch processing.

Advanced overview

Advanced overview

Generation modes:

  • Simple: plain-language generation when you want the app to fill many details.
  • Custom: precise manual control over caption, lyrics, BPM, key, time signature, language, duration, and advanced settings.
  • Remix: create a new version from source audio. The video recommends SFT for Remix and keeping the same lyrics for best results.
  • Repaint: replace or modify a selected time range while preserving the rest of the source audio.
  • Extract: use ACE-Step extraction or stem workflows where the selected model supports it.
  • LEGO: add a new stem to existing audio, such as adding a guitar stem to a track.
  • Complete: continue or complete source audio when the selected model supports it.

Advanced source audio

Advanced source audio

Advanced generation controls

Advanced generation controls

Important advanced controls:

  • Source Audio is required for Remix, Repaint, Extract, LEGO, and Complete.
  • Reference Audio guides timbre, mix, performance feel, and atmosphere; it is not meant to copy exact melody, rhythm, or lyrics.
  • Analyze can fill or update caption/lyrics/metadata from source audio.
  • BPM Auto, Key Auto, TimeSig Auto, Language Auto, and Duration Auto let the model infer metadata.
  • Think enables LM planning. Turn it off only when deliberately using pasted LM Codes Hints.
  • Wildcards in Music Caption and Lyrics are expanded at generation time and also work when the same prompt fields are used for batch folder processing.
  • Retake creates controlled variation from the same seed/settings.
  • Edit changes the whole uploaded source using source and target prompts.
  • Auto Score, AutoGen, and Auto LRC can create score, metadata, and lyric timing outputs during generation.

Engine settings

Engine settings

Engine settings include GPU tier, checkpoint file, main model path, device, VAE, 5Hz LM model/backend, Flash Attention, CPU offload, compile, DiT quantization, LoRA path/folder, LoRA scale, inference steps, sampler, DCW, ADG, MP3 bitrate/sample rate, normalization, fades, LM temperature, top-k/top-p, negative prompt, and LM code settings. Leave these at defaults until you have verified a basic generation.

6. Remix, Repaint, Extract, LEGO, And Auto-Editor Features

The first part of the video demonstrates feature outcomes before the installation section. These are not separate apps; they are modes and panels inside the same ACE-Step interface.

Remix demo

Remix demo

Extract and LEGO demo

Extract and LEGO demo

Auto-Editor demo

Auto-Editor demo

  • For Remix, upload the source song, keep the same lyrics, use SFT when available, and start with the default remix strength before changing one variable at a time.
  • For Repaint, set Repainting Start and End carefully, preview the selected range, then choose repaint mode and strength.
  • For Extract, choose Track Name or Extract All Stems. Batch folder processing can extract from multiple files.
  • For LEGO, choose or describe the new stem to add and use source audio as the foundation.
  • For Auto-Editor, set threshold, margin, mincut, and minclip. Workflow export can produce an editor timeline instead of rendering media.

7. Audio Processing

Audio Processing is used on uploaded or local audio/video and can also be applied automatically to generated songs. It includes format output, Auto-Editor trimming, video re-encode controls, audio enhancement stages, pre-mastering stages, DiffPitcher, and batch folder processing.

Audio Processing overview

Audio Processing overview

Generated song loaded for processing

Generated song loaded for processing

Audio Processing result

Audio Processing result

Core Audio Processing controls:

  • Apply automatically to generated songs runs the processing chain after generation.
  • Save original plus processed song keeps an untouched copy beside the processed copy.
  • Processed Output selects WAV/MP3 or another output format.
  • Processing Preset sets a preset chain before you tune individual stages.
  • Run as subprocess isolates processing so cancellation and memory cleanup are safer.
  • Export Only Audio extracts processed audio from video inputs.
  • Auto-Editor trim silent sections removes quiet/silent segments using threshold, margin, mincut, and minclip.
  • Auto-Editor workflow export exports an editing timeline/workflow instead of only rendering media.
  • Disable upload preview helps with very large MKV or multi-GB media.

Audio Enhancement and Pre-Mastering

Audio Enhancement and Pre-Mastering

Audio Enhancement includes Stereo Depth, Stereo Width, HF Refinement, Harmonic Enrichment, Timing Humanizer, and Ambience Shaping. Pre-Mastering includes Multiband Compressor, Tape Saturation, Glue Compressor, Mid/Side EQ, Soft Clipper, and LUFS Normalization.

DiffPitcher controls

DiffPitcher controls

DiffPitcher is for isolated vocals that sing the wrong notes. Use a guide vocal or MIDI score for the same phrase. The tutorial text in the UI warns that this is not for copying another singer or another song.

8. SAM Audio Segment

SAM Audio Segment is a heavier but more flexible segmentation system. It can extract target audio from a prompt, save the residual/remaining audio, process video inputs, use explicit span anchors, and run batch prompt lists separated by semicolons.

SAM Audio source-video demo

SAM Audio source-video demo

SAM Audio overview

SAM Audio overview

SAM prompt runtime controls

SAM prompt runtime controls

  1. Upload an audio or video file. Optionally upload a visual mask video for video-guided workflows.
  2. Choose Mode and Quick Prompt, or type a Custom Prompt such as vocals, guitar, bass, drums, applause, or another target.
  3. Enable Batch Segment when you want several prompts in one run; separate prompts with semicolons.
  4. Use Predict spans when you want SAM Audio to estimate target time ranges from text.
  5. Use explicit span anchor only when you can provide positive/negative time anchors as JSON.
  6. Choose a VRAM preset and candidate count that match the GPU. Higher candidate counts can improve quality but cost runtime and VRAM.
  7. Enable Save remaining audio when you need both the extracted target and the residual track.

9. Library, Metadata, Presets, Dataset, And Training Pages

The remaining app tabs are operational pages. They help you find previous generations, restore metadata, manage presets, inspect datasets, and train adapters.

Library

Library

Load Metadata

Load Metadata

Custom Preset System

Custom Preset System

Dataset browser

Dataset browser

LoRA Dataset Builder

LoRA Dataset Builder

Train LoRA

Train LoRA

  • Use Library when you want to find a past song by day and inspect its lyrics/metadata.
  • Use Load Metadata when you have a generation_manifest.json and want to restore a generation into the UI.
  • Use Custom Preset System to persist frequently used model, GPU, LoRA, audio, and generation defaults across sessions.
  • Use Dataset Builder to scan audio, auto-label captions/lyrics/BPM/key/time signature, review samples, and save a dataset JSON.
  • Use Preprocess before training; it creates tensor files for faster LoRA or LoKr training.
  • Use Train LoRA or Train LoKr only after preparing a clean dataset. The video states LoRA training is intended for a separate deeper tutorial.

10. RunPod Deployment

The RunPod chapter focuses on persistent network storage, GPU/region selection, unreliable installs, Gradio live URLs, nvitop monitoring, output downloads, and safe termination.

RunPod storage

RunPod storage

RunPod install

RunPod install

RunPod Gradio services

RunPod Gradio services

RunPod monitoring

RunPod monitoring

  1. Create persistent network storage in the same region as the GPU you intend to rent.
  2. Deploy the pod/template with the storage mounted. Choose a GPU with enough VRAM for the selected model and quality target.
  3. Run the installer. If RunPod throws an OS/server error, run the installer again; it should resume from completed work.
  4. If installation stalls from excessive parallelism, delete the virtual environment, lower installer thread count as shown in the video, and rerun.
  5. Start the app and prefer the Gradio live link when the RunPod proxy is unreliable. If port 7860 does not open, try the port shown by the terminal, sometimes 7861.
  6. Use nvitop to monitor GPU memory and load. First model load can be slow on RunPod storage; later generations are faster.
  7. Download outputs from JupyterLab by right-clicking the outputs folder and downloading it as an archive.
  8. Stop or terminate the pod deliberately. Delete storage too if you no longer want monthly storage charges.

11. Massed Compute Deployment

The Massed Compute chapter is similar to the Linux/cloud workflow, but the tutorial emphasizes faster disk performance and lower friction compared with RunPod. The tradeoff called out in the video is the lack of the same persistent network storage flow.

Massed Compute GPU selection

Massed Compute GPU selection

Massed Compute install

Massed Compute install

  1. Choose the creator category and the SECourses image when following the video workflow.
  2. Select a GPU appropriate for ACE-Step XL 1.5. The tutorial mentions RTX Pro 6000 and RTX 5090 class GPUs.
  3. Upload the ACE-Step ZIP to Downloads, extract it, open Massed_Compute_Instructions_READ.txt, and copy the install command.
  4. Open a terminal inside the extracted ACE-Step folder and run the command from that location.
  5. Start ACE-Step and use the Gradio live URL. If Gradio live shows a transient error, refresh the page.
  6. Back up large outputs or model/data folders to Hugging Face, Google Drive, OneDrive, or another storage service if you need to recreate the machine later.

12. SimplePod Deployment

The SimplePod chapter uses the RunPod/SimplePod instruction file and shows a persistent-storage flow that resembles RunPod. The tutorial demonstrates starting, generating, monitoring, stopping, and resuming from the same storage volume.

SimplePod setup

SimplePod setup

SimplePod generation

SimplePod generation

SimplePod resume

SimplePod resume

  1. Register, add credits, and create/use persistent storage as shown in the instruction file.
  2. Open the template link, attach the storage volume, choose a GPU, and run the machine.
  3. Use the JupyterLab or console link to run the installer/start commands from the workspace.
  4. If the Gradio live page throws a first-click error, refresh or click again after the page is fully loaded.
  5. Install nvitop when you want GPU/VRAM visibility: pip install nvitop, then run nvitop.
  6. To resume, reuse the template link, attach the same volume, select a GPU, start the machine, and run the app start command again.
  7. Stop or terminate compute and remove storage when finished to avoid unwanted billing.

13. Troubleshooting And Best Practices

  • If Gradio errors after opening, refresh the browser or click again after the page finishes loading.
  • If RunPod installer errors, rerun the installer. If the virtual environment is corrupt, delete only the virtual environment and run the installer again.
  • If first generation is slow, wait for model load and monitor the terminal or nvitop.
  • For Remix quality, use SFT when available, keep lyrics aligned with the source, generate until you get a good base, then lock the seed.
  • For very large videos, use Disable upload preview in Audio Processing or supply a local path when available.
  • For prompt variation in many runs, use Wildcards in Style, Music Caption, or Lyrics. Batch folder processing can use the same wildcard syntax to vary each batch output. Keep Auto/Enhance Style and Auto/Enhance Lyrics disabled if you want exact wildcard expressions preserved.
  • Save presets and keep generation_manifest.json with outputs.
  • For VRAM pressure, use GPU Optimization Preset, quantization, offload controls, smaller duration/count, lower SAM candidates, or a larger GPU.
  • Stop/terminate cloud compute and delete storage volumes when the tutorial work is finished.