Streaming

Overview

With streaming enabled, the model sends small chunks of generated text as they become available. Your application can display these chunks immediately, reducing perceived latency and making conversations feel more natural.

How Streaming Works

Enable Streaming

1const stream = await client.chat.create({
2  model: "nova-chat-4",
3  stream: true,
4  messages: [
5    {
6      role: "user",
7      content: "Write a short introduction to artificial intelligence."
8    }
9  ]
10});
11 
12for await (const chunk of stream) {
13  process.stdout.write(chunk.delta);
14}

Streaming Properties

Enables real-time response streaming.

Model used for generation.

Conversation history sent to the model.

Common Use Cases

• AI chat interfaces

• Writing assistants

• Live code generation

• Customer support bots

• Real-time content generation

Next Step

Continue to Function Calling to learn how NovaAI models can invoke external tools and APIs to perform actions beyond text generation.