New
Release
Version 6.2.1 Live ! 🎉😊
Ilum 6.2.1 is a robust update that will supercharge your data workflows and enhance your experience with Spark.
We’re excited to bring you one of our strongest releases to date, with new features, performance enhancements, and essential integrations that enable advanced data processing and governance for Spark users.
SQL API/UI Section: Making Data Easier with Ilum.
Initiate a New Era of Querying Data! Execute SQL queries directly on your cluster! Full SQL dialect support allows you to work natively with any modern open formats like Delta Lake, Apache Iceberg, and Apache Hudi. Also, you can also use multiple engines SparkSQL, Trino(Comming) and Apache Flink(Comming).
Advanced Spark Metrics Integration.
With enhanced metrics, you can analyze your spark jobs better. Check the resources, jobs, and health of running applications quickly and troubleshoot the issues quickly. Whether you're a data engineer or a developer or a scientist, you can drive efficiency with these metrics.
Auto-Scaling for Interactive Sessions.
Efficient Resource Utilization Is The Key! Inactive interactive jobs will automatically scale down to zero after inactivity, freeing up resources for other jobs. When the activity resumes, the sessions smoothly scale back up by themselves.
Automated Spark job scheduling with cron
No need to trigger jobs by hand! With our new cron-based scheduling, you can automate your Spark job executions using a familiar cron-like syntax. Our system is integrated with Kubernetes so that your jobs run on time with automated retries and notifications.
Integration with Superset.
Get better visualisation and analytics through Superset integration. You can check the insights in your data by using Analytics, and you can share them too.
Spark Memory Settings Section.
Customize Spark's settings for memory for better performance tweaks. Adjust Spark memory settings for better resource use and improved job performance.
Integration with MLflow.
Speed up your machine learning! Using MLflow Integration, manage your ML experiments, track result and help streamline model deployment within Ilum.
Prepare to take your data journey to the next level with Ilum 6.2.1 – enhancing your analytics, Spark job management, and data interactions like never before. Get the latest version and see!
Happy Data Processing! 🚀✨
We’re excited to bring you one of our strongest releases to date, with new features, performance enhancements, and essential integrations that enable advanced data processing and governance for Spark users.
SQL API/UI Section: Making Data Easier with Ilum.
Initiate a New Era of Querying Data! Execute SQL queries directly on your cluster! Full SQL dialect support allows you to work natively with any modern open formats like Delta Lake, Apache Iceberg, and Apache Hudi. Also, you can also use multiple engines SparkSQL, Trino(Comming) and Apache Flink(Comming).
Advanced Spark Metrics Integration.
With enhanced metrics, you can analyze your spark jobs better. Check the resources, jobs, and health of running applications quickly and troubleshoot the issues quickly. Whether you're a data engineer or a developer or a scientist, you can drive efficiency with these metrics.
Auto-Scaling for Interactive Sessions.
Efficient Resource Utilization Is The Key! Inactive interactive jobs will automatically scale down to zero after inactivity, freeing up resources for other jobs. When the activity resumes, the sessions smoothly scale back up by themselves.
Automated Spark job scheduling with cron
No need to trigger jobs by hand! With our new cron-based scheduling, you can automate your Spark job executions using a familiar cron-like syntax. Our system is integrated with Kubernetes so that your jobs run on time with automated retries and notifications.
Integration with Superset.
Get better visualisation and analytics through Superset integration. You can check the insights in your data by using Analytics, and you can share them too.
Spark Memory Settings Section.
Customize Spark's settings for memory for better performance tweaks. Adjust Spark memory settings for better resource use and improved job performance.
Integration with MLflow.
Speed up your machine learning! Using MLflow Integration, manage your ML experiments, track result and help streamline model deployment within Ilum.
Prepare to take your data journey to the next level with Ilum 6.2.1 – enhancing your analytics, Spark job management, and data interactions like never before. Get the latest version and see!
Happy Data Processing! 🚀✨