Improving Apache Spark™ In-Memory Computing with Apache Ignite™

Learn how Apache Ignite™ simplifies development and improves performance for Apache Spark™. This session will explain how Apache Spark and Ignite are integrated, and how they are used to together for analytics, stream processing and machine learning.  By the end of this session you will understand:

  • How Apache Ignite's native RDD and new native DataFrame APIs work
  • How to use Ignite as an in-memory database and massively parallel processing (MPP) style collocated processing for preparing and managing data for Spark
  • How to leverage Ignite to easily share state across Spark jobs using mutable RDDs and DataFrames
  • How to leverage Ignite distributed SQL and advanced indexing in memory to improve SQL performance
Akmal B. Chaudhri
Akmal B. Chaudhri
Technical Evangelist, GridGain Systems