Pipeline Manual¶

Introduction¶

Starting from DataKit v1.4.0, the data collected or received by DataKit can be modified, extracted, filtered, and aggregated through the built-in Pipeline data processor function, supporting all current data categories (such as Logging, Metric, Tracing, Network and Object, ETC.).

The DataKit Pipeline programmable data processor enables Guance Cloud to develop a custom domain-specific language runtime provided by Platypus. More programming languages and runtimes will be added to Pipeline in the future.

Table of Contents¶

1. Quick Start
2. Basics and Principles
3. Platypus Grammar
4. Built-in Function
5. Additional Features
6. Performance Benchmarks and Optimizations