Databricks has officially launched a serverless service for real-time data collection called Zerobus Ingest, SiliconANGLE reported on Feb. 23 local time.
The service allows applications to send event data directly to Delta tables without a message broker. It supports reducing infrastructure costs and minimising latency.
Databricks said Zerobus Ingest is built on a serverless architecture and can scale automatically without manual configuration. The company stressed it adopted a single-sink approach instead of an existing multi-sink architecture, reducing maintenance burdens that occur in Kafka-based pipelines.
Developers can use gRPC, REST APIs and SDKs for Python, Java, Rust, Go and TypeScript to write data directly to a lakehouse with minimal code. Zerobus Ingest is optimised for environments that must process large volumes of data in real time, such as IoT data, clickstream analysis and cybersecurity event streams.
Chi-gyu Hwang
delight@d-today.co.kr