Features

Audio

The Audio API enables your applications to understand and generate speech using NovaAI's speech models. Convert speech to text, generate natural-sounding voices from text, and build voice-powered experiences with a unified API.

Overview

NovaAI Audio combines Speech-to-Text (STT) and Text-to-Speech (TTS) capabilities into a single API. Whether you're building voice assistants, meeting transcription tools, accessibility features, podcasts, or customer support systems, the Audio API provides fast, accurate, and scalable speech processing.

The same authentication, request structure, and SDKs used throughout NovaAI also apply to audio workloads.

Note: The Audio API supports multiple audio formats and automatically processes speech using the selected audio model.

Note: The Audio API supports multiple audio formats and automatically processes speech using the selected audio model.

Audio Capabilities

Capability

Description

Speech-to-Text

Convert spoken audio into searchable text.

Text-to-Speech

Generate natural-sounding speech from text.

Language Detection

Automatically identify the spoken language.

Timestamp Generation

Return word and sentence timestamps.

Speaker Recognition

Differentiate between multiple speakers.

Audio Translation

Translate speech into supported languages.

Audio Processing Workflow

Rendering diagram…

Speech-to-Text

Convert recorded speech into structured text.

import { NovaAI } from "@novaai/sdk";
 
const client = new NovaAI({
apiKey: process.env.NOVA_API_KEY,
});
 
const transcript = await client.audio.transcribe({
model: "nova-audio-1",
file: "./meeting.mp3"
});
 
console.log(transcript.text);

Text-to-Speech

Generate natural voice output from text.

const speech = await client.audio.speech({
model: "nova-audio-1",
voice: "nova",
input: "Welcome to NovaAI documentation."
});
 
console.log(speech.url);

Request Properties

model

string

required

Audio model identifier.

file

file

required

Audio file to transcribe.

language

string

optional

Spoken language.

timestamps

boolean

optional

Include timestamps in the response.Speech-to-Text

Text-to-Speech

model

string

required

Audio generation model.

voice

string

required

Voice preset used for synthesis.

input

string

required

Text to convert into speech.

format

string

optional

Output audio format.

Supported Audio Formats

Format

Upload

Download

MP3

WAV

M4A

FLAC

OGG

Response Example

Speech-to-Text

{
"id": "audio_91ab72",
"text": "Welcome to the NovaAI documentation.",
"language": "en",
"duration": 4.2
}

Voice Preview

0:00/1:34

0:00/1:34

Available Voices

Voice

Style

Recommended Use

Nova

Neutral

General-purpose assistants

Echo

Professional

Customer support

Aura

Friendly

Educational applications

Pulse

Conversational

Voice chat experiences

Orion

Deep

Narration and presentations

Best Practices

  • Upload high-quality recordings for better transcription accuracy.

  • Minimize background noise whenever possible.

  • Choose a voice that matches your application's personality.

  • Use compressed formats like MP3 for faster uploads.

  • Split long recordings into smaller segments for improved processing.

Tip: Recording audio at a consistent volume significantly improves transcription accuracy and reduces recognition errors.

Tip: Recording audio at a consistent volume significantly improves transcription accuracy and reduces recognition errors.

Common Errors

Unsupported Audio Format

The uploaded file format is not supported.

Solution

Convert the file to MP3, WAV, M4A, FLAC, or OGG before uploading.

Corrupted Audio File

The uploaded file cannot be decoded.

Solution

Verify the audio file and upload a valid recording.

Audio Duration Exceeded

The uploaded recording exceeds the maximum supported duration.

Solution

Split the recording into smaller segments and process them individually.

Warning: Low-quality recordings with excessive background noise may reduce transcription accuracy and increase processing time.

Warning: Low-quality recordings with excessive background noise may reduce transcription accuracy and increase processing time.

Frequently Asked Questions

Can NovaAI identify multiple speakers?

Yes. Speaker recognition is available for supported transcription models and can return speaker-separated transcripts.

Which format should I use?

MP3 offers the best balance between quality and file size for most applications.

Can I generate speech in multiple voices?

Yes. Simply change the voice parameter when creating a Text-to-Speech request.

Can NovaAI identify multiple speakers?

Yes. Speaker recognition is available for supported transcription models and can return speaker-separated transcripts.

Which format should I use?

MP3 offers the best balance between quality and file size for most applications.

Can I generate speech in multiple voices?

Yes. Simply change the voice parameter when creating a Text-to-Speech request.

Next Step

Now that you've learned how NovaAI processes speech, continue to Vision to explore image understanding, visual reasoning, and multimodal AI capabilities.

Related Documentaion

Was this helpful?

Was this helpful?

Create a free website with Framer, the website builder loved by startups, designers and agencies.