rama::telemetry::opentelemetry::semantic_conventions::metric

Constant GEN_AI_SERVER_TIME_TO_FIRST_TOKEN

pub const GEN_AI_SERVER_TIME_TO_FIRST_TOKEN: &'static str;
Expand description

§Description

Time to generate first token for successful responses

§Metadata

Instrument:histogram
Unit:s
Status:Development

§Attributes

NameRequirement
crate::attribute::GEN_AI_OPERATION_NAMERequired
crate::attribute::GEN_AI_REQUEST_MODELConditionally_required: If available.
crate::attribute::GEN_AI_RESPONSE_MODELRecommended
crate::attribute::GEN_AI_SYSTEMRequired
crate::attribute::SERVER_ADDRESSRecommended
crate::attribute::SERVER_PORTConditionally_required: If server.address is set.