GEN_AI_REQUEST_STOP_SEQUENCES

Constant GEN_AI_REQUEST_STOP_SEQUENCES 

pub const GEN_AI_REQUEST_STOP_SEQUENCES: &'static str;
Available on crate features opentelemetry and semconv_experimental only.
Expand description

List of sequences that the model will use to stop generating further tokens.

§Notes

§Examples

  • [ "forest", "lived", ]