NovaSynth
AISends synthetic users at your voice and chat agents over real SIP calls and LiveKit audio, with personas, interruptions and adversarial intent.
NovaSynth
Sends synthetic users at your voice and chat agents over real SIP calls and LiveKit audio, with personas, interruptions and adversarial intent.
About NovaSynth
NovaSynth is a pre-production rehearsal and testing system for conversational AI agents, built on Noveum's evaluation platform. Rather than replaying mocked transcripts, it dials your agent over real telephony — SIP via Twilio, Plivo or Vobiz — plus LiveKit real-time audio and HTTP chat, so failures surface under real audio and real latency. It generates synthetic callers systematically from your agent context (system prompt, PRD, workflow docs) with goals, moods, accents and behaviors: the frustrated repeat caller, the rapid interrupter who talks over the agent, the user who switches language mid-sentence, the prompt-injection probe. Runs execute as batch matrices of personas by scenarios on an async queue built on BullMQ, PostgreSQL and Redis, scaling to 2,000 concurrent lines for load testing. Tool virtualization replays reads and sandboxes writes so a changed decision is exercised end to end without touching production systems, and every call is captured as a full trace and scored with 30+ voice AI metrics.
Screenshots
Key Features
Use Cases
Frequently asked questions about NovaSynth
What is NovaSynth?
Sends synthetic users at your voice and chat agents over real SIP calls and LiveKit audio, with personas, interruptions and adversarial intent.
How does NovaSynth work?
NovaSynth works by combining Real Telephony Calls: Dials your agent over SIP through Twilio, Plivo or Vobiz and LiveKit real-time audio, exercising real phone-network latency and audio rather than a mocked transcript., Systematic Persona Generation: Builds callers with goals, moods, accents and interruption behavior from your own agent context, instead of hand-authored scripts that go stale on every prompt change., Adversarial Scenarios: Includes prompt-injection probes, barge-in, silence and mid-sentence topic switches to test safety boundaries, refusal behavior and turn-taking recovery., Batch Matrix Runs: Runs the full persona-by-scenario matrix under a shared batch id for combinatorial coverage, grouped and comparable in one place., Concurrency and Load Testing: Raises concurrency up to 2,000 simultaneous lines to find how many calls an agent can actually hold at once. to help users with Pre-Release Rehearsal: Point NovaSynth at a staging SIP number or an unshipped agent and surface failures before any customer hears them., Regression Testing After Prompt Changes: Re-run the same persona matrix after a prompt or workflow edit to confirm a fix held and nothing else broke., Safety and Injection Testing: Probe whether an agent leaks its system prompt or tool definitions under adversarial callers., Interruption and Turn-Taking QA: Stress barge-in, talk-over and mid-call mind changes that scripted happy-path tests never exercise., Capacity Planning: Load-test how many concurrent calls an agent stack sustains before latency or quality degrades..
What are the main features of NovaSynth?
Key features include Real Telephony Calls: Dials your agent over SIP through Twilio, Plivo or Vobiz and LiveKit real-time audio, exercising real phone-network latency and audio rather than a mocked transcript., Systematic Persona Generation: Builds callers with goals, moods, accents and interruption behavior from your own agent context, instead of hand-authored scripts that go stale on every prompt change., Adversarial Scenarios: Includes prompt-injection probes, barge-in, silence and mid-sentence topic switches to test safety boundaries, refusal behavior and turn-taking recovery., Batch Matrix Runs: Runs the full persona-by-scenario matrix under a shared batch id for combinatorial coverage, grouped and comparable in one place., Concurrency and Load Testing: Raises concurrency up to 2,000 simultaneous lines to find how many calls an agent can actually hold at once..
Who is NovaSynth for?
NovaSynth is useful for anyone interested in Pre-Release Rehearsal: Point NovaSynth at a staging SIP number or an unshipped agent and surface failures before any customer hears them., Regression Testing After Prompt Changes: Re-run the same persona matrix after a prompt or workflow edit to confirm a fix held and nothing else broke., Safety and Injection Testing: Probe whether an agent leaks its system prompt or tool definitions under adversarial callers., Interruption and Turn-Taking QA: Stress barge-in, talk-over and mid-call mind changes that scripted happy-path tests never exercise., Capacity Planning: Load-test how many concurrent calls an agent stack sustains before latency or quality degrades..
How much does NovaSynth cost?
NovaSynth offers a free tier with paid plans for advanced features.
How do I get started with NovaSynth?
Visit https://noveum.ai/en/novasynth to sign up and explore NovaSynth.
Explore more AI Ai Tools tools
Browse all Ai Tools tools →Compare NovaSynth: vs Mise · vs BiBimba · vs VoiceCap · vs NM Signals