This Bay Area In-Memory Computing Meetup featured talks on Native Persistence and Data Recovery, bringing data locality to your containerized big data workloads, and using in-memory computing to make money.
- Talk 1: "Best Practices for Native Persistence and Data Recovery." With Valentin (Val) Kulichenko, Lead Architect at GridGain Systems.
As an in-memory computing platform, GridGain and Apache Ignite support native persistence that stores data and indexes transparently on non-volatile memory, SSD or disk. When persistence is enabled, memory becomes a cache for the most frequently used data and indexes. Native persistence is ACID-compliant, durable and enables immediate availability on a restart of each node. Data is never lost, GridGain supports full and incremental snapshots along with continuous archiving, and Point-in-Time recovery to an individual transaction.
- Talk 2: "Feeding Data to the Kubernetes Beast: Bringing Data Locality to Your Containerized Big Data Workloads." With Bin Fan, Founding Engineer of Alluxio, Inc. and PMC Member of the Alluxio Open Source Project.
The latest advances in container orchestration by Kubernetes bring cost savings and flexibility to compute workloads in public/hybrid cloud and multi-cloud environment. Such architectures typically lead to physically separated compute and storage services, where S3, Azure Data Lake or Google Cloud Storage are commonly used to provide data persistence.
Open source Alluxio approaches this problem in a new way. It helps elastic compute workloads realize the true benefits of the cloud, while bringing data locality and data accessibility to workloads orchestrated by Kubernetes. Alluxio can orchestrate data locality from any persistent storage including object store such as Ceph and cloud storage such as AWS S3 or GCS and make it accessible to compute running in Kubernetes pods. As a stateless data access layer (as opposed to a long-running data storage daemon service), Alluxio runs as a native service making data-intensive compute workloads Kubernetes friendly.
Bin will explain how this new approach of bringing data locality to data-intensive compute workloads in Kubernetes environments. He'll also cover the Alluxio, architecture, deployment with Kubernetes and real-world production use cases.
- Talk 3: "Using In-Memory Computing to Make Money!" With Doug Hood, Oracle TimesTen Scaleout Evangelist.
This talk is a case study of how using an in-memory database is used to both make and save money for a trading system.