Version 6.3.1 Live ! 🎉😊

This release focuses on quality-of-life improvements, platform integrations, and powerful new features to help you work smarter with Apache Spark and your data lakehouse stack.

🚀 What’s New

✅ Trino now in AIO Stack

You asked, we listened, Trino is now included in the default All-in-One (AIO) Ilum deployment. Run blazing-fast distributed SQL queries across your data lake right out of the box.

✅ New Spark Session Form for Jupyter (Sparkmagic)

No more hand-crafted JSON. Create Spark sessions in Jupyter using a streamlined form:

✅ Markdown Support in SQL Editor

Turn your SQL editor into a lightweight data notebook. Add headers, notes, and explanations with Markdown for clear, documented analysis in-line with your queries.

✅ Resource Quotas & Limits for Spark Jobs

Gain fine-grained control over Spark resources:

✅ Grafana in UI Modules

Monitor your workloads in real time. Grafana dashboards are now integrated into Ilum’s UI, providing insights into Spark usage, resource consumption, and system health.

✅ Extra Buckets for Spark Storage

Now you can define additional storage buckets to separate workloads, support multi-tenant setups, or expand available storage for Spark jobs.

🛠️ Under the Hood

This is a minor release, but it brings major improvements to everyday workflows. We’re continuously evolving Ilum to support modern data teams—from infrastructure to analysis.

Thanks for being part of the journey. More coming soon! 🚀💡