Struct AnyDelimiterCodec
pub struct AnyDelimiterCodec { /* private fields */ }
Expand description
A simple Decoder
and Encoder
implementation that splits up data into chunks based on any character in the given delimiter string.
§Example
Decode string of bytes containing various different delimiters.
use tokio_util::codec::{AnyDelimiterCodec, Decoder};
use bytes::{BufMut, BytesMut};
let mut codec = AnyDelimiterCodec::new(b",;\r\n".to_vec(),b";".to_vec());
let buf = &mut BytesMut::new();
buf.reserve(200);
buf.put_slice(b"chunk 1,chunk 2;chunk 3\n\r");
assert_eq!("chunk 1", codec.decode(buf).unwrap().unwrap());
assert_eq!("chunk 2", codec.decode(buf).unwrap().unwrap());
assert_eq!("chunk 3", codec.decode(buf).unwrap().unwrap());
assert_eq!("", codec.decode(buf).unwrap().unwrap());
assert_eq!(None, codec.decode(buf).unwrap());
Implementations§
§impl AnyDelimiterCodec
impl AnyDelimiterCodec
pub fn new(
seek_delimiters: Vec<u8>,
sequence_writer: Vec<u8>,
) -> AnyDelimiterCodec
pub fn new( seek_delimiters: Vec<u8>, sequence_writer: Vec<u8>, ) -> AnyDelimiterCodec
Returns a AnyDelimiterCodec
for splitting up data into chunks.
§Note
The returned AnyDelimiterCodec
will not have an upper bound on the length
of a buffered chunk. See the documentation for new_with_max_length
for information on why this could be a potential security risk.
pub fn new_with_max_length(
seek_delimiters: Vec<u8>,
sequence_writer: Vec<u8>,
max_length: usize,
) -> AnyDelimiterCodec
pub fn new_with_max_length( seek_delimiters: Vec<u8>, sequence_writer: Vec<u8>, max_length: usize, ) -> AnyDelimiterCodec
Returns a AnyDelimiterCodec
with a maximum chunk length limit.
If this is set, calls to AnyDelimiterCodec::decode
will return a
AnyDelimiterCodecError
when a chunk exceeds the length limit. Subsequent calls
will discard up to limit
bytes from that chunk until a delimiter
character is reached, returning None
until the delimiter over the limit
has been fully discarded. After that point, calls to decode
will
function as normal.
§Note
Setting a length limit is highly recommended for any AnyDelimiterCodec
which
will be exposed to untrusted input. Otherwise, the size of the buffer
that holds the chunk currently being read is unbounded. An attacker could
exploit this unbounded buffer by sending an unbounded amount of input
without any delimiter characters, causing unbounded memory consumption.
pub fn max_length(&self) -> usize
pub fn max_length(&self) -> usize
Returns the maximum chunk length when decoding.
use std::usize;
use tokio_util::codec::AnyDelimiterCodec;
let codec = AnyDelimiterCodec::new(b",;\n".to_vec(), b";".to_vec());
assert_eq!(codec.max_length(), usize::MAX);
use tokio_util::codec::AnyDelimiterCodec;
let codec = AnyDelimiterCodec::new_with_max_length(b",;\n".to_vec(), b";".to_vec(), 256);
assert_eq!(codec.max_length(), 256);
Trait Implementations§
§impl Clone for AnyDelimiterCodec
impl Clone for AnyDelimiterCodec
§fn clone(&self) -> AnyDelimiterCodec
fn clone(&self) -> AnyDelimiterCodec
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source
. Read more§impl Debug for AnyDelimiterCodec
impl Debug for AnyDelimiterCodec
§impl Decoder for AnyDelimiterCodec
impl Decoder for AnyDelimiterCodec
§type Error = AnyDelimiterCodecError
type Error = AnyDelimiterCodecError
§fn decode(
&mut self,
buf: &mut BytesMut,
) -> Result<Option<Bytes>, AnyDelimiterCodecError>
fn decode( &mut self, buf: &mut BytesMut, ) -> Result<Option<Bytes>, AnyDelimiterCodecError>
§fn decode_eof(
&mut self,
buf: &mut BytesMut,
) -> Result<Option<Bytes>, AnyDelimiterCodecError>
fn decode_eof( &mut self, buf: &mut BytesMut, ) -> Result<Option<Bytes>, AnyDelimiterCodecError>
§impl Default for AnyDelimiterCodec
impl Default for AnyDelimiterCodec
§fn default() -> AnyDelimiterCodec
fn default() -> AnyDelimiterCodec
§impl<T> Encoder<T> for AnyDelimiterCodec
impl<T> Encoder<T> for AnyDelimiterCodec
§impl Hash for AnyDelimiterCodec
impl Hash for AnyDelimiterCodec
§impl Ord for AnyDelimiterCodec
impl Ord for AnyDelimiterCodec
§fn cmp(&self, other: &AnyDelimiterCodec) -> Ordering
fn cmp(&self, other: &AnyDelimiterCodec) -> Ordering
1.21.0 · Source§fn max(self, other: Self) -> Selfwhere
Self: Sized,
fn max(self, other: Self) -> Selfwhere
Self: Sized,
§impl PartialEq for AnyDelimiterCodec
impl PartialEq for AnyDelimiterCodec
§impl PartialOrd for AnyDelimiterCodec
impl PartialOrd for AnyDelimiterCodec
impl Eq for AnyDelimiterCodec
impl StructuralPartialEq for AnyDelimiterCodec
Auto Trait Implementations§
impl Freeze for AnyDelimiterCodec
impl RefUnwindSafe for AnyDelimiterCodec
impl Send for AnyDelimiterCodec
impl Sync for AnyDelimiterCodec
impl Unpin for AnyDelimiterCodec
impl UnwindSafe for AnyDelimiterCodec
Blanket Implementations§
§impl<'a, T, E> AsTaggedExplicit<'a, E> for Twhere
T: 'a,
impl<'a, T, E> AsTaggedExplicit<'a, E> for Twhere
T: 'a,
§impl<'a, T, E> AsTaggedImplicit<'a, E> for Twhere
T: 'a,
impl<'a, T, E> AsTaggedImplicit<'a, E> for Twhere
T: 'a,
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Comparable<K> for Q
impl<Q, K> Comparable<K> for Q
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key
and return true
if they are equal.§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ
fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ
§fn with_current_context(self) -> WithContext<Self> ⓘ
fn with_current_context(self) -> WithContext<Self> ⓘ
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self
into a Left
variant of Either<Self, Self>
if into_left
is true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self
into a Left
variant of Either<Self, Self>
if into_left(&self)
returns true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read more§impl<T> Pointable for T
impl<T> Pointable for T
§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
§fn and<P, B, E>(self, other: P) -> And<T, P>
fn and<P, B, E>(self, other: P) -> And<T, P>
Policy
that returns Action::Follow
only if self
and other
return
Action::Follow
. Read more