GridGain technical evangelist Akmal Chaudhri will be presenting at the Spark Summit Europe conference, Oct. 24-26 at the Convention Centre Dublin in Ireland.
His session is titled: "How to Share State Across Multiple Spark Jobs using Apache® Ignite™."
Attend this session to learn how to easily share state in-memory across multiple Spark jobs, either within the same application or between different Spark applications using an implementation of the Spark RDD abstraction provided in Apache Ignite.
During the talk, attendees will learn in detail how IgniteRDD – an implementation of native Spark RDD and
DataFrame APIs – shares the state of the RDD across other Spark jobs, applications and workers. Examples will
show how IgniteRDD, with its advanced in-memory indexing capabilities, allows execution of SQL queries many
times faster than native Spark RDDs or Data Frames.
Billed as the the world's largest event for the Apache Spark™ community, an estimated 1,200 developers, engineers, data scientists, researchers and business professionals will be on-hand for three days of in-depth learning and networking.
With over 70 sessions and nine tracks to choose from — including Developer, Data Science, Enterprise, AI and Streaming — there’s content for every level and role.
- Structured Spark, Spark Streaming and related projects
- The future of Apache Spark
- How to use the Spark stack in a variety of applications
- Best practices for deploying Spark at scale
Apache Spark is a powerful open source processing engine built around speed, ease of use, and sophisticated analytics. It was started at UC Berkeley in 2009 and is now developed at the vendor-independent Apache Software Foundation. Since its release, Spark has seen rapid adoption by enterprises across a wide range of industries. Internet powerhouses such as Yahoo, eBay and Netflix have deployed Spark at massive scale, processing multiple petabytes of data on clusters of over 8,000 nodes. Apache Spark has also become the largest open source community in big data, with over 1000 contributors from 250+ organizations.
Technical Evangelist, GridGain Systems