Gigapipe

Gigapipe is an open-source, self-hosted observability server that provides a unified stack for logs, metrics, traces, and profiling. It functions as a polyglot observability server designed to consolidate telemetry data into a single platform to prevent the creation of data silos. The software is deployed as a server and can be managed via a CLI or a built-in web explorer for direct data interaction.

Gigapipe is designed for drop-in compatibility with existing observability ecosystems. It independently implements the APIs for several popular standards, allowing users to send and query data using familiar tools and languages without requiring additional middleware or proxies. It integrates natively with Grafana as a datasource, enabling the use of standard dashboards and panels for visualization without the need for extra plugins.

Key features

• Native API compatibility with Loki, Prometheus, Tempo, and Pyroscope
• Support for LogQL, PromQL, and TraceQL query languages
• Ingestion support for OpenTelemetry and InfluxDB
• Built-in lightweight data explorer for logs, metrics, and traces
• Storage options including ClickHouse, DuckDB, and S3 object storage
• Support for continuous profiling with DOT graph rendering for visualization
• TraceQL metrics endpoints for calculating error rates and latency from traces
• Enhanced live-tailing for logs with limit and start parameters

The architecture focuses on independence from vendor-controlled stacks by implementing observability protocols from scratch. It utilizes WASM for PromQL compatibility and supports the export of profiling data in DOT format for Graphviz visualization. The system provides specific endpoints for index statistics, allowing users to retrieve stream counts, entry counts, and byte volumes. It is intended for DevOps engineers and SREs who require a centralized observability platform that maintains compatibility with the LGTM stack and OpenTelemetry while retaining total control over their data storage.

Gigapipe is a lightweight, anti-lock-in solution for infrastructure monitoring and data observability.