Struct Tokenizer 

pub struct Tokenizer { /* private fields */ }

Incremental strict JSON tokenizer.

Implementations

impl Tokenizer

pub fn new() -> Tokenizer

Creates an empty tokenizer.

pub fn with_max_buffered_bytes(max_buffered_bytes: usize) -> Tokenizer

Creates an empty tokenizer with a custom buffered-input limit.

pub const fn max_buffered_bytes(&self) -> usize

Returns the configured buffered-input limit.

pub fn set_max_buffered_bytes(&mut self, max_buffered_bytes: usize)

Sets the buffered-input limit.

pub fn write( &mut self, chunk: &[u8], sink: &mut impl TokenSink, ) -> Result<(), JsonError>

Feeds a chunk into the tokenizer.

Complete tokens are emitted to sink; an incomplete final token is kept until a later write or end.

pub fn end(&mut self, sink: &mut impl TokenSink) -> Result<(), JsonError>

Finalizes the tokenizer.

Trait Implementations

impl Debug for Tokenizer

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for Tokenizer

fn default() -> Tokenizer

Returns the “default value” for a type.