Type Alias LlmModelMetadata

Stats about a given LLM model.

type LlmModelMetadata = {
displayName: string;
maxTokens: number;
}

Index

Properties

displayName maxTokens

Properties

displayName

displayName: string

A friendly name for the model, to display in UIs.

maxTokens

maxTokens: number

The max number of input tokens that the model can handle.