Apache Spark and Apache Ignite PDF
Preview Apache Spark and Apache Ignite
In-Memory Performance Durability of Disk © 2018GridGainSystems, Inc. Apache Ignite and Apache Spark Where Fast Data Meets the IoT Akmal Chaudhri GridGain Systems © 2018GridGainSystems, Inc. Agenda • IoT Demands to Software • IoT Software Stack • Device OS/RTOS • Data Collection and Enrichment • NewSQL Database • Application APIs • Demo © 2018GridGainSystems, Inc. IoT Demands to Software Real-time Processing SQL, Geo-Spatial Analytics (BI, ML) High-Availability Simple Scalability © 2018GridGainSystems, Inc. IoT Software Stack Application APIs NewSQL Database Data Collection and Enrichment Device OS/Real-Time OS © 2018GridGainSystems, Inc. Apache IoT Software Stack Application APIs NewSQL Database Data Collection and Enrichment Device OS/Real-Time OS © 2018GridGainSystems, Inc. Apache MyNewt Open Source RTOS Cortex M, MIPS Bluetooth, Wifi, TCP/IP Secured Bootloader Remote Firmware Upgrade © 2018GridGainSystems, Inc. Data Collection and Enrichment DURABLE MEMORY DURABLE MEMORY Ignite Cluster © 2018GridGainSystems, Inc. Apache Ignite Database, Caching and Processing Platform Financial Telco Travel & E-Commerce Pharma & IoT Services Logistics Healthcare SQL Key/Value Transactions Compute Services Streaming ML Memory-Centric Storage Third-Party Persistence Ignite Native Persistence (Flash, SSD, Intel 3D XPoint) (RDBMS, HDFS, NoSQL) © 2018GridGainSystems, Inc. Ignite and Spark Integration Spark Application Spark Worker Spark Worker Spark Worker Share state and Boost DataFrame data among and SQL Spark jobs Performance Spark Spark Spark Spark Spark Spark Job Job Job Job Job Job No data SQL on top In-Memory Shared RDD or DataFrame movement of RDDs GridGain Node GridGain Node GridGain Node In-place query execution Yarn Mesos Docker HDFS © 2018GridGainSystems, Inc.
Description:The list of books you might like
