Struct PipelineBuilder 

pub struct PipelineBuilder<Mode = Disk>
where
    Mode: BufferMode,
{ /* private fields */ }

Available on crate features dial9 and pipeline only.

Closure-scoped builder for assembling a custom processor pipeline.

Obtained via with_custom_pipeline(|p| ...) on the runtime builder. The Mode type parameter binds the pipeline to the writer’s storage mode: disk-only processors like write_back are not in scope on PipelineBuilder<Memory>, so wiring write-back into an in-memory pipeline is a compile error.

Example

struct Logger;
impl SegmentProcessor for Logger {
    fn name(&self) -> &'static str { "logger" }
    fn process(&mut self, data: SegmentData)
        -> Pin<Box<dyn Future<Output = Result<SegmentData, ProcessError>> + Send + '_>>
    {
        Box::pin(async move {
            println!("segment {} ({} bytes)", data.segment().index(), data.payload().len());
            Ok(data)
        })
    }
}

builder.with_custom_pipeline(|p| p.pipe(Logger).gzip().write_back())

Implementations

impl<Mode> PipelineBuilder<Mode>

where Mode: BufferMode,

pub fn pipe<S>(self, processor: S) -> PipelineBuilder<Mode>

where S: SegmentProcessor + 'static,

Append a user-supplied SegmentProcessor to the pipeline.

pub fn gzip(self) -> PipelineBuilder<Mode>

Gzip the segment payload in-memory.

impl PipelineBuilder

Disk-only methods on the pipeline builder.

pub fn write_back(self) -> PipelineBuilder

Write the current payload bytes back to disk. When the payload has been gzipped earlier in the pipeline, the file is written with a .gz suffix and the original sealed segment is removed.

pub fn write_back_to(self, dir: impl Into<PathBuf>) -> PipelineBuilder

Write the current payload bytes to a specific directory instead of back alongside the original segment. The file name is preserved; when the payload has been gzipped, a .gz suffix is appended. The original sealed segment is removed after a successful write.

Trait Implementations

impl<Mode> Debug for PipelineBuilder<Mode>

where Mode: BufferMode,

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.