Shared agentsMetrics
PromQL and SQL, full resolution, retained.
- Observability & Monitoring
//Logs
Every log. Fully indexed.Instantly searchable.
All indexed, no sampling. Every log field forever queryable, powered by columnar Parquet storage and a Rust query engine.
Storage
Storage efficient by design
Columnar Parquet storage cuts log storage cost without cutting retention.
Speed
Sub-second queries at terabyte scale
A Rust query engine keeps searches fast as data grows.
OpenTelemetry
OTel-native logs
Standardized collection with zero vendor lock-in.
//Overview
What is log management?
Log management is the collection, parsing, storage, search and retention of the event logs that applications and infrastructure produce, so teams can troubleshoot, audit and analyse what their systems did.
DataObserve Sense indexes every log without sampling and stores it in columnar Parquet on object storage, queried by a Rust engine. Logs arrive natively over OpenTelemetry, are parsed and transformed on ingest and are searchable the moment they land.
//Log management & analytics
Every log, searchable the moment it lands
Scale from gigabytes to petabytes without the bill scaling with it.
Automated parsing
Raw logs become structured data, with built-in parsing for JSON, CSV, Syslog, CEF, nginx, and more.
Flexible transformation
Enrich, filter, and reshape logs during ingestion with Vector Remap Language.
Retention management
Retention per data source keeps valuable logs accessible longer without escalating costs.
Instant ingest-to-dashboard
Sub-second results, even across petabytes of data.
Log-centric visualizations
Drag-and-drop dashboards that update live and share with one click.
Simple, precise queries
SQL for precise queries and aggregations across every source.
//Explore more withDataObserve
More from Sense · Observability & Monitoring
Traces
OpenTelemetry-native, no sampling.
- Observability & Monitoring
Frontend Monitoring
Real user monitoring, session to stack trace.
- Observability & Monitoring
Synthetic Monitoring
API and browser checks, global or private, unified with the rest of your observability.
- Observability & Monitoring
//FAQs
Logs: questions teams ask
What's the cheapest way to store logs at scale?
Columnar storage on object storage like S3 instead of an indexed cluster. Logs live in Apache Parquet on S3 or any S3-compatible store.
How do I migrate from Elasticsearch?
Point Fluent Bit, Filebeat, Vector, or Logstash at the HTTP ingestion endpoint. Run both side by side while you switch.
How is it different from Elasticsearch?
Lower storage cost, no shards, replicas, or heap sizes to tune, and SQL and PromQL instead of a proprietary language.
Does DataObserve Sense sample logs?
No. Every log is kept and indexed, so the line you need during an incident was never dropped.
Which log shippers work with DataObserve Sense?
OpenTelemetry Collector, Fluent Bit, Filebeat, Vector and Logstash, through the HTTP ingestion endpoint or OTLP.
How are log queries written?
With SQL, or in plain English through the AI Assistant, which writes the query for you.
