Constant GEN_AI_SERVER_TIME_PER_OUTPUT_TOKEN

pub const GEN_AI_SERVER_TIME_PER_OUTPUT_TOKEN: &'static str;

Description

Time per output token generated after the first token for successful responses

Metadata

Instrument:	histogram
Unit:	s
Status:	Experimental

Attributes

Name	Requirement
crate::attribute::GEN_AI_OPERATION_NAME	Required
crate::attribute::GEN_AI_REQUEST_MODEL	Required
crate::attribute::GEN_AI_RESPONSE_MODEL	Recommended
crate::attribute::GEN_AI_SYSTEM	Required
crate::attribute::SERVER_ADDRESS	Recommended
crate::attribute::SERVER_PORT	Conditionally_required: If server.address is set.