Class References
Function References
- text
- textOptions
- combineStrategies
- convertMessagesToModelMessages
- convertZodToJsonSchema
- createReplayStream
- embedding
- generateMessageId
- maxIterations
- messages
- modelMessageToUIMessage
- modelMessagesToUIMessages
- normalizeToUIMessage
- parsePartialJSON
- summarize
- toServerSentEventsStream
- toServerSentEventsResponse
- toolDefinition
- uiMessageToModelMessages
- realtimeToken
- untilFinishReason
Interface References
- AIAdapter
- AIAdapterConfig
- AgentLoopState
- ApprovalRequestedStreamChunk
- AudioPart
- AudioVisualization
- BaseStreamChunk
- TextCompletionChunk
- TextOptions
- ChunkRecording
- ChunkStrategy
- ClientTool
- ContentPartSource
- ContentStreamChunk
- DefaultMessageMetadataByModality
- DocumentPart
- DoneStreamChunk
- EmbeddingOptions
- EmbeddingResult
- ErrorStreamChunk
- ImagePart
- InternalToolCallState
- JSONParser
- ModelMessage
- ProcessorResult
- ProcessorState
- RealtimeAdapter
- RealtimeClientOptions
- RealtimeConnection
- RealtimeMessage
- RealtimeSessionConfig
- RealtimeToken
- RealtimeTokenAdapter
- RealtimeTokenOptions
- ResponseFormat
- ServerTool
- StreamProcessorEvents
- StreamProcessorHandlers
- StreamProcessorOptions
- SummarizationOptions
- SummarizationResult
- TextPart
- ThinkingPart
- ThinkingStreamChunk
- Tool
- ToolCall
- ToolCallPart
- ToolCallStreamChunk
- ToolConfig
- ToolDefinition
- ToolDefinitionConfig
- ToolDefinitionInstance
- ToolInputAvailableStreamChunk
- ToolResultPart
- ToolResultStreamChunk
- UIMessage
- VideoPart
Type Alias References
- AgentLoopStrategy
- AnyClientTool
- TextStreamOptionsForModel
- TextStreamOptionsUnion
- ConstrainedContent
- ConstrainedModelMessage
- ContentPart
- ContentPartForModalities
- ExtractModalitiesForModel
- ExtractModelsFromAdapter
- InferToolInput
- InferToolName
- InferToolOutput
- MessagePart
- RealtimeEvent
- RealtimeMessagePart
- RealtimeMode
- RealtimeStatus
- ModalitiesArrayToUnion
- Modality
- StreamChunk
- StreamChunkType
- ToolCallState
- ToolResultState
Variable References
AudioVisualization
Defined in: packages/ai/src/realtime/types.ts:205
Interface for accessing audio visualization data
Properties#
getInputFrequencyData#
getInputFrequencyData: () => Uint8Array;Defined in: packages/ai/src/realtime/types.ts:212
Get frequency data for input audio visualization
Returns#
Uint8Array
getInputTimeDomainData#
getInputTimeDomainData: () => Uint8Array;Defined in: packages/ai/src/realtime/types.ts:217
Get time domain data for input waveform
Returns#
Uint8Array
getOutputFrequencyData#
getOutputFrequencyData: () => Uint8Array;Defined in: packages/ai/src/realtime/types.ts:214
Get frequency data for output audio visualization
Returns#
Uint8Array
getOutputTimeDomainData#
getOutputTimeDomainData: () => Uint8Array;Defined in: packages/ai/src/realtime/types.ts:219
Get time domain data for output waveform
Returns#
Uint8Array
inputLevel#
readonly inputLevel: number;Defined in: packages/ai/src/realtime/types.ts:207
Input volume level (0-1 normalized)
inputSampleRate#
readonly inputSampleRate: number;Defined in: packages/ai/src/realtime/types.ts:222
Input sample rate
onInputAudio?#
optional onInputAudio?: (callback) => () => void;Defined in: packages/ai/src/realtime/types.ts:227
Subscribe to raw input audio samples
Parameters#
callback#
(samples, sampleRate) => void
Returns#
() => void
onOutputAudio?#
optional onOutputAudio?: (callback) => () => void;Defined in: packages/ai/src/realtime/types.ts:231
Subscribe to raw output audio samples
Parameters#
callback#
(samples, sampleRate) => void
Returns#
() => void
outputLevel#
readonly outputLevel: number;Defined in: packages/ai/src/realtime/types.ts:209
Output volume level (0-1 normalized)
outputSampleRate#
readonly outputSampleRate: number;Defined in: packages/ai/src/realtime/types.ts:224
Output sample rate