Streamlio Brings Stream-Native Processing to Apache Pulsar

Announces Pulsar Functions to Enable Fast, Easy Transformation and Analysis of Data in Motion

SAN JOSE, Calif.--()--Streamlio, the intelligent platform for fast data, today announced Pulsar Functions, a new stream-native processing capability for Apache Pulsar. Pulsar Functions allows developers to create fast, flexible data processing tasks that operate on data in motion as it passes through Pulsar, without requiring external systems or add-ons.

As enterprises transition from the batch-oriented “slow data” era to the new “fast data” era of data-driven applications, it has become critical to process data in motion, without waiting for it to work its way through batch processing pipelines into data lakes and data warehouses. That requires that the technology used to connect and move data needs to provide not just simple messaging and queuing, it also needs to process data transformations, augmentation, enrichment, and analysis as it streams data to users and applications. However, existing technologies require add-on components, a steep learning curve, or significant limitations that add cumbersome complexity and inefficiency to data pipelines.

To eliminate those obstacles, Streamlio is bringing stream-native processing into the streaming data pipeline. Leveraging its deep experience in real-time and streaming data at Twitter and Yahoo, Streamlio has extended Apache Pulsar, the high-performance messaging solution developed and proven in production at Yahoo, with Pulsar Functions. Pulsar Functions allows users to create flexible procedures that can be deployed to Apache Pulsar and applied to Pulsar message topics. Because Pulsar handles resource management, security, resiliency, and data protection, developers can focus on creating the valuable logic that they need to transform data and apply analytics instead of being burdened with management and operational complexity.

“Customers looking for solutions for fast data are demanding more than just the ability to move data,” said Lewis Kaneshiro, CEO of Streamlio. “Bringing stream-native processing to Apache Pulsar gives developers and architects a simple, fast and scalable solution that enables them to act on data as it arrives, taking advantage of Pulsar’s proven enterprise-grade capabilities.”

Use cases that Pulsar Functions enables include:

  • Just-in-time transformation: perform data cleansing, normalization, enrichment and more on data as it arrives.
  • Intelligent message management: apply content-based filtering and routing to get exactly the data needed to exactly the consumers that need it.
  • Real-time analytics: deploy models for analytics, machine learning, and artificial intelligence directly into streams of data for real-time insights.

Pulsar Functions is a powerful new addition that further innovates Streamlio’s intelligent platform for fast data. Streamlio’s combination of proven technology for high-performance messaging, real-time compute, and stream storage provides users and applications with a robust, flexible platform to connect and power their data-driven applications that can handle demanding scale and performance requirements.

Pulsar Functions is now available for testing as preview functionality from the Apache Pulsar repository available from To learn more about Pulsar Functions, visit the Streamlio blog.



Streamlio Blog:



About Streamlio

Streamlio delivers the first intelligent platform for fast data. Streamlio’s solution is built on leading open source technologies for messaging, processing, and storage of streaming data that have been proven at scale in companies including Twitter and Yahoo. Founded by industry veterans and funded by Lightspeed Venture Partners, Streamlio helps organizations build the data-driven applications they need to react to data in real-time. Learn more online at


Jon Bock

Release Summary

Streamlio announces Pulsar Functions, bringing stream-native processing to the Apache Pulsar messaging and queuing solution.


Jon Bock