Skip to main content

Module processors

Module processors 

Available on crate features dial9 and pipeline only.
Expand description

Built-in segment processors (gzip, write-back). Built-in segment processors: gzip compression and disk write-back.

Structs§

GzipCompressor
Gzips the segment payload in-memory. Sets the content_encoding and write_back_extension metadata keys so downstream stages know the payload is gzipped. Already-gzipped segments (detected by magic bytes) pass through unchanged.
WriteBackProcessor
Writes the current payload bytes back to disk. If a write_back_extension metadata key is present, the bytes are written to {original}{extension} and the original segment file is removed. When dir is set, the file is written to that directory instead of alongside the original.