How to Share State Across Multiple Spark Jobs using Apache Ignite™
Watch this deep-dive webinar to learn how to easily share state in-memory across multiple Spark jobs, either within the same application or between different Spark applications using an implementation of Spark RDD abstraction provided in Apache Ignite™.
In this one-hour webinar, Dmitriy Setrakyan, Apache Ignite Project Management Committee Chairman and co-founder and EVP of Engineering at GridGain, will explain in detail how IgniteRDD — an implementation of native Spark RDD and DataFrame APIs — shares the state of the RDD across other Spark jobs, applications and workers. Dmitriy will also demonstrate how IgniteRDD, with its advanced in-memory indexing capabilities, allows execution of SQL queries many times faster than native Spark RDDs or Data Frames.
Founder & CPO, GridGain Systems
As a founder and Chief Product Officer at GridGain, Dmitriy Setrakyan is responsible for leading product development, professional services, and customer support operations. Dmitriy has been designing, architecting and developing software and applications for over 15 years and has expertise in the development of distributed computing systems, middleware platforms, financial trading systems, CRM applications and similar systems.
Prior to GridGain, Dmitriy worked at eBay where he was responsible for the architecture of performance sensitive high-traffic components of an add-serving system processing several billion hits a day. Before that Dmitriy served as a Lead Architect at Fitech Labs, focusing on high-performance software for trading systems, where he jump-started a new distributed caching and grid computing product line scaling out to 100s computers.
Dmitriy holds a Bachelor of Science in Computer Science from University of California at Davis specializing in Networking and Algorithms.
Read Dmitriy’s personal blog on Blogspot.com.