.svg)
Apache Pinot Overview
Pinot is a real-time distributed OLAP datastore, purpose-built to provide ultra low-latency analytics, even at extremely high throughput. It can ingest directly from streaming data sources - such as Apache Kafka and Amazon Kinesis - and make the events available for querying instantly. It can also ingest from batch data sources such as Hadoop HDFS, Amazon S3, Azure ADLS, and Google Cloud Storage. At the heart of the system is a columnar store, with several smart indexing and pre-aggregation techniques for low latency. This makes Pinot the most perfect fit for user-facing real-time analytics. At the same time, Pinot is also a great choice for other analytical use-cases, such as internal dashboards, anomaly detection, and ad-hoc data exploration.
Decodable + Apache Pinot
Decodable provides a low-latency transport and transformation for ingesting data in a way that's matched to Apache Pinot's real-time analytics. After all, there's no point running real-time queries on stale data! For an example using Decodable to ingest IoT data to Apache Pinot using Decodable for ingestion please check out the blog and accompanying demo of Decodable cleansing security logs before sending to Apache Pinot.
