GEN_AI_REQUEST_MAX_TOKENS

rama::telemetry::opentelemetry::semantic_conventions::trace

Constant GEN_AI_REQUEST_MAX_TOKENS 

pub const GEN_AI_REQUEST_MAX_TOKENS: &'static str;
Available on crate features opentelemetry and semconv_experimental only.
Expand description

The maximum number of tokens the model generates for a request.

§Notes

§Examples

  • 100