Struct PipelineBuilder 

pub struct PipelineBuilder { /* private fields */ }

Available on crate feature dial9 only.

Closure-scoped builder for assembling a custom processor pipeline.

Obtained via with_custom_pipeline(|p| ...) on the runtime builder. Built-in processors are reachable through dedicated methods (gzip, write_back, s3, symbolize); custom processors are added with pipe.

Example

struct Logger;
impl SegmentProcessor for Logger {
    fn name(&self) -> &'static str { "logger" }
    fn process(&mut self, data: SegmentData)
        -> Pin<Box<dyn Future<Output = Result<SegmentData, ProcessError>> + Send + '_>>
    {
        Box::pin(async move {
            println!("segment {} ({} bytes)", data.segment().index(), data.payload().len());
            Ok(data)
        })
    }
}

builder.with_custom_pipeline(|p| p.pipe(Logger).gzip().write_back())

Implementations

impl PipelineBuilder

pub fn pipe<S>(self, processor: S) -> PipelineBuilder

where S: SegmentProcessor + 'static,

Append a user-supplied SegmentProcessor to the pipeline.

pub fn gzip(self) -> PipelineBuilder

Gzip the segment payload in-memory.

pub fn write_back(self) -> PipelineBuilder

Write the current payload bytes back to disk. When the payload has been gzipped earlier in the pipeline, the file is written with a .gz suffix and the original sealed segment is removed.

Trait Implementations

impl Debug for PipelineBuilder

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.