Data is never static. In the modern enterprise, it flows constantly between operational and analytical systems. To stay competitive, organizations need a real-time data fabric that doesn’t just move information but actively connects these two worlds.
We are excited to announce major updates to VMware Tanzu RabbitMQ that are designed to bridge the gap between real-time operations and big data analytics. With native Apache Spark integration and enhanced visibility tools, we are making it easier than ever to build a data lakehouse architecture for VMware Cloud Foundation. New Java Message Service (JMS) capabilities can enable you to quickly migrate legacy applications to Tanzu RabbitMQ, setting the stage for future application modernization initiatives.
Here is a closer look at what is coming.
The analytics bridge: Apache Spark integration
The separation between “operational” data (e.g., logs, transactions) and “analytical” data (e.g., trends, ML models) is slowly fading away. The new VMware Tanzu RabbitMQ connector for Apache Spark works across this silo by creating a high-speed, bidirectional data exchange between Tanzu RabbitMQ and your data lake, such as VMware Tanzu Data Lake.
This new connector allows Apache Spark jobs to natively read from and write to RabbitMQ Streams with enterprise-grade reliability, including offset tracking, exactly-once processing, and historical replay capabilities.
Why it matters:
- Real-time ingestion – Instead of batch ETL jobs that run overnight, you can now stream operational logs and events directly from Tanzu RabbitMQ into Apache Spark for instant analysis
- Enrichment loops – Read a stream of raw data, enrich it in real-time using Apache Spark (e.g., joining with static customer data), and write the clean, enriched result back to a new Tanzu RabbitMQ stream for downstream apps to consume immediately
- Closed-loop feedback – Use Apache Spark to detect anomalies (like fraud patterns) in your data lake and instantly publish an alert back to Tanzu RabbitMQ to trigger a defensive action in your operational apps
By enabling RabbitMQ Streams as a first-class citizen for the Apache Spark ecosystem, we are making it possible for data to move into the lake for computation and for insights to flow back out to the business in real time.
Enhanced visibility with a new Stream Browser
As adoption of RabbitMQ Streams grows, developers need better tools to inspect the data flowing through their pipes without writing custom code. We are introducing Stream Browser, a VMware Tanzu-exclusive plug-in for the Management UI.
This feature allows users to “browse” messages within a stream directly from the UI. You can search for specific messages based on attributes like timestamp or offset, giving you a clearer window into your data.
Why it matters:
- Faster troubleshooting – Developers can instantly verify whether a specific message was published or identify malformed data without needing to consume the entire stream
- Simplified development – It provides visibility for data residing in Streams, making them easier to manage and debug compared to complex Apache Kafka topics
Modernizing the legacy: JMS Message Selectors
Many enterprises are stuck with legacy brokers simply because their Java applications rely on older patterns, such as Message Selectors. With this release, we are addressing that roadblock and providing a way to save on licensing costs.
We have further enhanced our JMS support with JMS Message Selectors. This allows Java-based consumer applications to filter messages directly on the broker based on header or property values, mimicking SQL-like queries before the message is even sent to the client.
Why it matters:
- Ease of migration – You can now migrate legacy Java applications to Tanzu RabbitMQ with minimal code changes. The application logic stays the same, but the infrastructure gets a massive upgrade
- Durability upgrade – Unlike the fragile legacy brokers of the past, running these selectors on Tanzu RabbitMQ gives you access to modern Quorum Queues and AMQP 1.0, enabling your data to remain replicated and safe, even while supporting “vintage” architectural patterns
These updates mark an important moment for Tanzu RabbitMQ. We are doing more than just moving messages. We are continuing to innovate and redefine the modern data lakehouse for the private cloud. Whether you are streamlining real-time analytics with Apache Spark, debugging complex streams with a click, or finally retiring expensive legacy brokers without rewriting code, Tanzu RabbitMQ can help. To sum it up, if your architecture demands a broker capable of mastering both traditional enterprise messaging and high-throughput streaming, your solution is here.
While these deliver powerful capabilities on their own, they are just one piece of a much larger set of innovations rolled out in VMware Tanzu Data Intelligence 10.4. This major release brings in new innovations, including an AI-assisted SQL Assistant, automated platform administration, and new Apache Iceberg support—all designed to help you query data in place. To see how Tanzu Data Intelligence can break down silos and make your data AI-ready behind the firewall, read the full release announcement here.
