Delight: An Improved Apache Spark UI, Free and Cross-Platform


Jun 21, 12:00PM PDT(07:00PM GMT).
  • Free 97 Attendees
Description
Speaker
This event is hosted by SF Big Analytics Group. https://www.meetup.com/SF-Big-Analytics

Delight (https://www.datamechanics.co/delight) is a free & cross-platform monitoring dashboard for Apache Spark, which display system metrics (CPU Usage, Memory Usage) along with Spark information (jobs, stages, tasks) on the same timeline. Delight is a great complement to the Spark UI when it comes to troubleshooting your Spark application and understanding its performance bottleneck. It works freely on top of any Spark platform (whether it’s open-source or commercial, in the cloud or on-premise).
In this session, the co-founders of Data Mechanics will take you through performance troubleshooting sessions with Delight on real-world data engineering pipelines. You will see how Delight and the Spark UI can jointly help you spot the performance bottleneck of your applications, and how you can use these insights to make your applications more cost-effective and stable.

Jean-Yves Stephan

Jean-Yves Stephan, CEO and Co-Founder, Data Mechanics.
Julien Dumazert, CTO and Co-Founder, Data Mechanics
The event ended.
Watch Recording
*Recordings hosted on Youtube, click the link will open the Youtube page.