Architecture Overview
Logtrail is designed for extreme scale and low-latency access. Our architecture is optimized to ensure that logs are available for search within milliseconds of being received.
Data Flow
Section titled “Data Flow”- Ingestion: Logs are sent via the REST API or one of our native SDKs.
- Validation: Every log entry is validated against your plan’s limits (size, nesting depth, etc.).
- Buffering: Validated logs are placed in a high-speed ingestion buffer.
- Storage: Logs are persisted to our optimized Postgres storage engine, where they are indexed using Trigram and GIN indexes for fast retrieval.
- Querying: When you search via the dashboard or API, our query engine translates your LCQL into highly efficient SQL.
High Availability
Section titled “High Availability”Logtrail is built on a distributed cloud infrastructure. We maintain multiple redundancies for our ingestion pipeline and storage layers to ensure that your logs are never lost, even during infrastructure failures.
Scalability
Section titled “Scalability”Our backend automatically scales horizontally based on ingestion volume. Whether you are sending 100 logs per hour or 100,000 per second, Logtrail maintains consistent performance.