2.4 Using Oracle SQL Connector for HDFS with Oracle Big Data Appliance and Oracle Exadata

374 Pages·2017·4.28 MB·English

by  Frederick Kush

Oracle® Big Data Connectors
User's Guide
Release 4 (4.7)
E81085-02
February 2017
Describes installation and use of Oracle Big Data Connectors:
Oracle SQL Connector for Hadoop Distributed File System,
Oracle Loader for Hadoop, Oracle Data Integrator, Oracle
XQuery for Hadoop, and Oracle R Advanced Analytics for
Hadoop.
Oracle Big Data Connectors User's Guide, Release 4 (4.7)
E81085-02
Copyright © 2011, 2016, Oracle and/or its affiliates. All rights reserved.
Primary Author: Frederick Kush
This software and related documentation are provided under a license agreement containing restrictions on
use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your
license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license,
transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse
engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is
prohibited.
The information contained herein is subject to change without notice and is not warranted to be error-free. If
you find any errors, please report them to us in writing.
If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on
behalf of the U.S. Government, then the following notice is applicable:
U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software,
any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are
"commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-
specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the
programs, including any operating system, integrated software, any programs installed on the hardware,
and/or documentation, shall be subject to license terms and license restrictions applicable to the programs.
No other rights are granted to the U.S. Government.
This software or hardware is developed for general use in a variety of information management applications.
It is not developed or intended for use in any inherently dangerous applications, including applications that
may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you
shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its
safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this
software or hardware in dangerous applications.
Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of
their respective owners.
Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are
used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron,
the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro
Devices. UNIX is a registered trademark of The Open Group.
This software or hardware and documentation may provide access to or information about content, products,
and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly
disclaim all warranties of any kind with respect to third-party content, products, and services unless
otherwise set forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates
will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party
content, products, or services, except as set forth in an applicable agreement between you and Oracle.
Contents
Preface................................................................................................................................................................ xi
Audience....................................................................................................................................................... xi
Documentation Accessibility..................................................................................................................... xi
Related Documents..................................................................................................................................... xii
Text Conventions........................................................................................................................................ xii
Syntax Conventions.................................................................................................................................... xii
Changes in Oracle Big Data Connectors Release 4 (4.7)........................................................................ xii
Change History for Previous Releases................................................................................................... xiv
Changes in Oracle Big Data Connectors Release 4 (4.6).............................................................. xiv
Changes in Oracle Big Data Connectors Release 4 (4.5)............................................................... xv
Changes in Oracle Big Data Connectors Release 4 (4.4).............................................................. xvi
Changes in Oracle Big Data Connectors Release 4 (4.3)............................................................. xvii
Changes in Oracle Big Data Connectors Release 4 (4.2)............................................................. xvii
Changes in Oracle Big Data Connectors Release 4 (4.1)............................................................. xvii
Changes in Oracle Big Data Connectors Release 4 (4.0)............................................................ xviii
Part I Setup
1 Getting Started with Oracle Big Data Connectors
1.1 About Oracle Big Data Connectors................................................................................................ 1-1
1.2 Big Data Concepts and Technologies............................................................................................. 1-2
1.2.1 What is MapReduce?............................................................................................................ 1-3
1.2.2 What is Apache Hadoop?..................................................................................................... 1-3
1.3 Downloading the Oracle Big Data Connectors Software............................................................ 1-4
1.4 Oracle SQL Connector for Hadoop Distributed File System Setup.......................................... 1-4
1.4.1 Software Requirements........................................................................................................ 1-5
1.4.2 Installing and Configuring a Hadoop Client on the Oracle Database System............. 1-6
1.4.3 Installing Oracle SQL Connector for HDFS....................................................................... 1-7
1.4.4 Granting User Privileges in Oracle Database.................................................................. 1-11
1.4.5 Setting Up User Accounts on the Oracle Database System........................................... 1-12
1.4.6 Using Oracle SQL Connector for HDFS on a Secure Hadoop Cluster........................ 1-12
1.5 Oracle Loader for Hadoop Setup................................................................................................. 1-13
iii
1.5.1 Software Requirements...................................................................................................... 1-13
1.5.2 Installing Oracle Loader for Hadoop............................................................................... 1-13
1.5.3 Providing Support for Offline Database Mode............................................................... 1-14
1.5.4 Using Oracle Loader for Hadoop on a Secure Hadoop Cluster................................... 1-15
1.6 Oracle Shell for Hadoop Loaders Setup...................................................................................... 1-15
1.7 Oracle XQuery for Hadoop Setup................................................................................................ 1-16
1.7.1 Software Requirements...................................................................................................... 1-16
1.7.2 Installing Oracle XQuery for Hadoop.............................................................................. 1-17
1.7.3 Troubleshooting the File Paths.......................................................................................... 1-18
1.7.4 Configuring Oozie for the Oracle XQuery for Hadoop Action.................................... 1-19
1.8 Oracle R Advanced Analytics for Hadoop Setup...................................................................... 1-19
1.8.1 Installing the Software on Hadoop................................................................................... 1-20
1.8.2 Installing Additional R Packages...................................................................................... 1-23
1.8.3 Providing Remote Client Access to R Users.................................................................... 1-25
1.9 Oracle Data Integrator.................................................................................................................... 1-27
1.10 Oracle Datasource for Apache Hadoop Setup......................................................................... 1-27
Part II Oracle Database Connectors
2 Oracle SQL Connector for Hadoop Distributed File System
2.1 About Oracle SQL Connector for HDFS........................................................................................ 2-1
2.2 Getting Started With Oracle SQL Connector for HDFS.............................................................. 2-2
2.3 Configuring Your System for Oracle SQL Connector for HDFS............................................... 2-6
2.4 Using Oracle SQL Connector for HDFS with Oracle Big Data Appliance and Oracle
Exadata................................................................................................................................................. 2-7
2.5 Using the ExternalTable Command-Line Tool............................................................................. 2-7
2.5.1 About ExternalTable............................................................................................................. 2-7
2.5.2 ExternalTable Command-Line Tool Syntax...................................................................... 2-7
2.6 Creating External Tables.................................................................................................................. 2-9
2.6.1 Creating External Tables with the ExternalTable Tool.................................................... 2-9
2.6.2 Creating External Tables from Data Pump Format Files............................................... 2-10
2.6.3 Creating External Tables from Hive Tables..................................................................... 2-12
2.6.4 Creating External Tables from Delimited Text Files...................................................... 2-20
2.6.5 Creating External Tables in SQL....................................................................................... 2-23
2.7 Publishing the HDFS Data Paths.................................................................................................. 2-23
2.7.1 ExternalTable Syntax for Publish...................................................................................... 2-24
2.7.2 ExternalTable Example for Publish.................................................................................. 2-24
2.8 Exploring External Tables and Location Files............................................................................ 2-24
2.8.1 ExternalTable Syntax for Describe.................................................................................... 2-25
2.8.2 ExternalTable Example for Describe................................................................................ 2-25
2.9 Dropping Database Objects Created by Oracle SQL Connector for HDFS............................ 2-25
2.9.1 ExternalTable Syntax for Drop.......................................................................................... 2-26
2.9.2 ExternalTable Example for Drop...................................................................................... 2-26
iv
2.10 More About External Tables Generated by the ExternalTable Tool..................................... 2-26
2.10.1 About Configurable Column Mappings........................................................................ 2-26
2.10.2 What Are Location Files?................................................................................................. 2-28
2.10.3 Enabling Parallel Processing............................................................................................ 2-28
2.10.4 Location File Management............................................................................................... 2-29
2.10.5 Location File Names.......................................................................................................... 2-30
2.11 Configuring Oracle SQL Connector for HDFS......................................................................... 2-30
2.11.1 Creating a Configuration File.......................................................................................... 2-30
2.11.2 Oracle SQL Connector for HDFS Configuration Property Reference....................... 2-31
2.12 Performance Tips for Querying Data in HDFS........................................................................ 2-45
3 Oracle Loader for Hadoop
3.1 What Is Oracle Loader for Hadoop?.............................................................................................. 3-1
3.2 About the Modes of Operation....................................................................................................... 3-2
3.2.1 Online Database Mode......................................................................................................... 3-2
3.2.2 Offline Database Mode......................................................................................................... 3-4
3.3 Getting Started With Oracle Loader for Hadoop......................................................................... 3-6
3.4 Creating the Target Table................................................................................................................ 3-7
3.4.1 Supported Data Types for Target Tables........................................................................... 3-7
3.4.2 Supported Partitioning Strategies for Target Tables........................................................ 3-8
3.4.3 Compression.......................................................................................................................... 3-8
3.5 Creating a Job Configuration File................................................................................................... 3-9
3.6 About the Target Table Metadata................................................................................................. 3-11
3.6.1 Providing the Connection Details for Online Database Mode..................................... 3-11
3.6.2 Generating the Target Table Metadata for Offline Database Mode............................. 3-11
3.7 About Input Formats...................................................................................................................... 3-13
3.7.1 Delimited Text Input Format............................................................................................. 3-14
3.7.2 Complex Text Input Formats............................................................................................. 3-15
3.7.3 Hive Table Input Format.................................................................................................... 3-15
3.7.4 Avro Input Format.............................................................................................................. 3-16
3.7.5 Oracle NoSQL Database Input Format............................................................................ 3-17
3.7.6 Custom Input Formats........................................................................................................ 3-17
3.8 Mapping Input Fields to Target Table Columns ....................................................................... 3-18
3.8.1 Automatic Mapping............................................................................................................ 3-18
3.8.2 Manual Mapping................................................................................................................. 3-19
3.8.3 Converting a Loader Map File........................................................................................... 3-19
3.9 About Output Formats................................................................................................................... 3-21
3.9.1 JDBC Output Format.......................................................................................................... 3-21
3.9.2 Oracle OCI Direct Path Output Format........................................................................... 3-22
3.9.3 Delimited Text Output Format.......................................................................................... 3-22
3.9.4 Oracle Data Pump Output Format................................................................................... 3-24
3.10 Running a Loader Job................................................................................................................... 3-25
3.10.1 Specifying Hive Input Format JAR Files........................................................................ 3-26
v
3.10.2 Specifying Oracle NoSQL Database Input Format JAR Files..................................... 3-26
3.10.3 Job Reporting..................................................................................................................... 3-26
3.11 Handling Rejected Records......................................................................................................... 3-26
3.11.1 Logging Rejected Records in Bad Files.......................................................................... 3-27
3.11.2 Setting a Job Reject Limit.................................................................................................. 3-27
3.12 Balancing Loads When Loading Data into Partitioned Tables.............................................. 3-27
3.12.1 Using the Sampling Feature............................................................................................. 3-27
3.12.2 Tuning Load Balancing.................................................................................................... 3-27
3.12.3 Tuning Sampling Behavior.............................................................................................. 3-28
3.12.4 When Does Oracle Loader for Hadoop Use the Sampler's Partitioning Scheme?... 3-28
3.12.5 Resolving Memory Issues................................................................................................ 3-29
3.12.6 What Happens When a Sampling Feature Property Has an Invalid Value?............ 3-29
3.13 Optimizing Communications Between Oracle Engineered Systems ................................... 3-29
3.14 Oracle Loader for Hadoop Configuration Property Reference.............................................. 3-30
3.15 Third-Party Licenses for Bundled Software.............................................................................. 3-52
3.15.1 Apache Licensed Code..................................................................................................... 3-52
3.15.2 Apache License.................................................................................................................. 3-53
4 Ease of Use Tools for Oracle Big Data Connectors
4.1 Introducing Oracle Shell for Hadoop Loaders............................................................................. 4-1
4.1.1 Third-Party Licenses for Bundled Software...................................................................... 4-2
Part III Oracle XQuery for Hadoop
5 Using Oracle XQuery for Hadoop
5.1 What Is Oracle XQuery for Hadoop?............................................................................................. 5-1
5.2 Getting Started With Oracle XQuery for Hadoop....................................................................... 5-3
5.2.1 Basic Steps.............................................................................................................................. 5-3
5.2.2 Example: Hello World!......................................................................................................... 5-3
5.3 About the Oracle XQuery for Hadoop Functions........................................................................ 5-4
5.3.1 About the Adapters............................................................................................................... 5-4
5.3.2 About Other Modules for Use With Oracle XQuery for Hadoop.................................. 5-6
5.4 Creating an XQuery Transformation............................................................................................. 5-6
5.4.1 XQuery Transformation Requirements.............................................................................. 5-6
5.4.2 About XQuery Language Support...................................................................................... 5-7
5.4.3 Accessing Data in the Hadoop Distributed Cache........................................................... 5-8
5.4.4 Calling Custom Java Functions from XQuery.................................................................. 5-8
5.4.5 Accessing User-Defined XQuery Library Modules and XML Schemas........................ 5-8
5.4.6 XQuery Transformation Examples..................................................................................... 5-9
5.5 Running Queries............................................................................................................................. 5-14
5.5.1 Oracle XQuery for Hadoop Options................................................................................. 5-14
5.5.2 Generic Options................................................................................................................... 5-15
5.5.3 About Running Queries Locally....................................................................................... 5-16
vi
5.6 Running Queries from Apache Oozie......................................................................................... 5-16
5.6.1 Getting Started Using the Oracle XQuery for Hadoop Oozie Action......................... 5-16
5.6.2 Supported XML Elements.................................................................................................. 5-17
5.6.3 Example: Hello World........................................................................................................ 5-18
5.7 Oracle XQuery for Hadoop Configuration Properties.............................................................. 5-19
5.8 Third-Party Licenses for Bundled Software................................................................................ 5-22
5.8.1 Apache Licensed Code....................................................................................................... 5-22
5.8.2 Apache License.................................................................................................................... 5-23
5.8.3 ANTLR 3.2............................................................................................................................ 5-26
5.8.4 Apache Ant 1.7.1.................................................................................................................. 5-26
5.8.5 Apache Xerces 2.11.............................................................................................................. 5-28
5.8.6 Apache XMLBeans 2.3, 2.5................................................................................................. 5-29
5.8.7 Jackson 1.8.8......................................................................................................................... 5-29
5.8.8 Woodstox XML Parser 4.2.0............................................................................................... 5-30
6 Oracle XQuery for Hadoop Reference
6.1.1 Avro File Adapter.......................................................................................................................... 6-1
6.1.1.1 Built-in Functions for Reading Avro Files...................................................................... 6-2
6.1.1.2 Custom Functions for Reading Avro Container Files................................................... 6-3
6.1.1.3 Custom Functions for Writing Avro Files...................................................................... 6-5
6.1.1.4 Examples of Avro File Adapter Functions..................................................................... 6-6
6.1.1.5 About Converting Values Between Avro and XML...................................................... 6-7
6.1.2 JSON File Adapter....................................................................................................................... 6-17
6.1.2.1 Built-in Functions for Reading JSON............................................................................ 6-17
6.1.2.2 Custom Functions for Reading JSON Files................................................................... 6-19
6.1.2.3 Examples of JSON Functions.......................................................................................... 6-19
6.1.2.4 JSON File Adapter Configuration Properties............................................................... 6-21
6.1.2.5 About Converting JSON Data Formats to XML.......................................................... 6-22
6.1.3 Oracle Database Adapter............................................................................................................ 6-23
6.1.3.1 Custom Functions for Writing to Oracle Database..................................................... 6-23
6.1.3.2 Examples of Oracle Database Adapter Functions....................................................... 6-27
6.1.3.3 Oracle Loader for Hadoop Configuration Properties and Corresponding %oracle-
property Annotations .............................................................................................................. 6-29
6.1.4 Oracle NoSQL Database Adapter.............................................................................................. 6-32
6.1.4.1 Prerequisites for Using the Oracle NoSQL Database Adapter.................................. 6-33
6.1.4.2 Built-in Functions for Reading from and Writing to Oracle NoSQL Database....... 6-33
6.1.4.3 Built-in Functions for Reading from and Writing to Oracle NoSQL Database
using Table API......................................................................................................................... 6-38
6.1.4.4 Built-in Functions for Reading from and Writing to Oracle NoSQL Database
using Large Object API............................................................................................................ 6-40
6.1.4.5 Custom Functions for Reading Values from Oracle NoSQL Database.................... 6-42
6.1.4.6 Custom Functions for Retrieving Single Values from Oracle NoSQL Database.... 6-45
vii
6.1.4.7 Custom Functions for Reading Values from Oracle NoSQL Database using Table
API.............................................................................................................................................. 6-46
6.1.4.8 Custom Functions for Reading Single Row from Oracle NoSQL Database using
Table API.................................................................................................................................... 6-47
6.1.4.9 Custom Functions for Retrieving Single Values from Oracle NoSQL Database
using Large Object API............................................................................................................ 6-47
6.1.4.10 Custom Functions for Writing to Oracle NoSQL Database..................................... 6-48
6.1.4.11 Custom Functions for Writing Values to Oracle NoSQL Database using Table
API.............................................................................................................................................. 6-49
6.1.4.12 Custom Functions for Writing Values to Oracle NoSQL Database using Large
Object API.................................................................................................................................. 6-50
6.1.4.13 Examples of Oracle NoSQL Database Adapter Functions....................................... 6-51
6.1.4.14 Oracle NoSQL Database Adapter Configuration Properties................................... 6-56
6.1.5 Sequence File Adapter................................................................................................................ 6-60
6.1.5.1 Built-in Functions for Reading and Writing Sequence Files...................................... 6-61
6.1.5.2 Custom Functions for Reading Sequence Files............................................................ 6-65
6.1.5.3 Custom Functions for Writing Sequence Files............................................................. 6-67
6.1.5.4 Examples of Sequence File Adapter Functions............................................................ 6-68
6.1.6 Solr Adapter.................................................................................................................................. 6-70
6.1.6.1 Prerequisites for Using the Solr Adapter...................................................................... 6-70
6.1.6.2 Built-in Functions for Loading Data into Solr Servers................................................ 6-71
6.1.6.3 Custom Functions for Loading Data into Solr Servers............................................... 6-72
6.1.6.4 Examples of Solr Adapter Functions............................................................................. 6-72
6.1.6.5 Solr Adapter Configuration Properties......................................................................... 6-73
6.1.7 Text File Adapter......................................................................................................................... 6-75
6.1.7.1 Built-in Functions for Reading and Writing Text Files............................................... 6-76
6.1.7.2 Custom Functions for Reading Text Files..................................................................... 6-78
6.1.7.3 Custom Functions for Writing Text Files...................................................................... 6-80
6.1.7.4 Examples of Text File Adapter Functions .................................................................... 6-81
6.1.8 Tika File Adapter......................................................................................................................... 6-84
6.1.8.1 Built-in Library Functions for Parsing Files with Tika............................................... 6-84
6.1.8.2 Custom Functions for Parsing Files with Tika............................................................. 6-85
6.1.8.3 Tika Parser Output Format............................................................................................. 6-86
6.1.8.4 Tika Adapter Configuration Properties........................................................................ 6-86
6.1.8.5 Examples of Tika File Adapter Functions .................................................................... 6-87
6.1.9 XML File Adapter........................................................................................................................ 6-88
6.1.9.1 Built-in Functions for Reading XML Files.................................................................... 6-88
6.1.9.2 Custom Functions for Reading XML Files.................................................................... 6-90
6.1.9.3 Examples of XML File Adapter Functions.................................................................... 6-93
6.1.10 Utility Module............................................................................................................................ 6-95
6.1.10.1 Oracle XQuery Functions for Duration, Date, and Time.......................................... 6-95
6.1.10.2 Oracle XQuery Functions for Strings.......................................................................... 6-99
6.1.11 Hadoop Module....................................................................................................................... 6-102
viii
6.1.11.1 Built-in Functions for Using Hadoop........................................................................ 6-102
6.1.12 Serialization Annotations....................................................................................................... 6-104
7 Oracle XML Extensions for Hive
7.1 What are the XML Extensions for Hive?....................................................................................... 7-1
7.2 Using the Hive Extensions.............................................................................................................. 7-2
7.3 About the Hive Functions............................................................................................................... 7-3
7.4 Creating XML Tables........................................................................................................................ 7-3
7.4.1 Hive CREATE TABLE Syntax for XML Tables................................................................. 7-3
7.4.2 CREATE TABLE Configuration Properties....................................................................... 7-4
7.4.3 CREATE TABLE Examples.................................................................................................. 7-5
7.5.1 Oracle XML Functions for Hive Reference.............................................................................. 7-11
7.5.1.1 Data Type Conversions................................................................................................... 7-11
7.5.1.2 Hive Access to External Files.......................................................................................... 7-12
7.5.2 Online Documentation of Functions......................................................................................... 7-13
7.5.3 xml_exists...................................................................................................................................... 7-13
7.5.4 xml_query..................................................................................................................................... 7-15
7.5.5 xml_query_as_primitive............................................................................................................. 7-17
7.5.6 xml_table....................................................................................................................................... 7-20
Part IV Oracle R Advanced Analytics for Hadoop
8 Using Oracle R Advanced Analytics for Hadoop
8.1 About Oracle R Advanced Analytics for Hadoop....................................................................... 8-1
8.1.1 Oracle R Advanced Analytics for Hadoop Architecture................................................. 8-2
8.1.2 Oracle R Advanced Analytics for Hadoop packages and functions............................. 8-2
8.1.3 Oracle R Advanced Analytics for Hadoop APIs.............................................................. 8-3
8.1.4 Inputs to Oracle R Advanced Analytics for Hadoop....................................................... 8-4
8.2 Access to HDFS Files........................................................................................................................ 8-5
8.3 Access to Apache Hive..................................................................................................................... 8-5
8.3.1 ORCH Functions for Hive.................................................................................................... 8-5
8.3.2 ORE Functions for Hive....................................................................................................... 8-5
8.3.3 Generic R Functions Supported in Hive............................................................................ 8-6
8.3.4 Support for Hive Data Types............................................................................................... 8-8
8.3.5 Usage Notes for Hive Access............................................................................................... 8-9
8.3.6 Example: Loading Hive Tables into Oracle R Advanced Analytics for Hadoop....... 8-10
8.4 Access to Oracle Database............................................................................................................. 8-10
8.4.1 Usage Notes for Oracle Database Access......................................................................... 8-11
8.4.2 Scenario for Using Oracle R Advanced Analytics for Hadoop with Oracle R
Enterprise................................................................................................................................... 8-11
8.5 Oracle R Advanced Analytics for Hadoop Functions............................................................... 8-11
8.5.1 Native Analytical Functions.............................................................................................. 8-12
8.5.2 Using the Hadoop Distributed File System (HDFS)...................................................... 8-13
ix
8.5.3 Using Apache Hive............................................................................................................. 8-14
8.5.4 Using Aggregate Functions in Hive................................................................................. 8-14
8.5.5 Making Database Connections.......................................................................................... 8-14
8.5.6 Copying Data and Working with HDFS Files................................................................. 8-15
8.5.7 Converting to R Data Types............................................................................................... 8-16
8.5.8 Using MapReduce............................................................................................................... 8-17
8.5.9 Debugging Scripts............................................................................................................... 8-18
8.6 Demos of Oracle R Advanced Analytics for Hadoop Functions............................................. 8-18
8.7 Security Notes for Oracle R Advanced Analytics for Hadoop................................................ 8-19
Part V Oracle DataSource for Apache Hadoop
9 Oracle DataSource for Apache Hadoop (OD4H)
9.1 Operational Data, Big Data and Requirements............................................................................ 9-1
9.2 Overview of Oracle DataSource for Apache Hadoop (OD4H).................................................. 9-1
9.2.1 Opportunity with Hadoop 2.x............................................................................................. 9-2
9.2.2 Oracle Tables as Hadoop Data Source............................................................................... 9-2
9.2.3 External Tables....................................................................................................................... 9-3
9.2.4 List of jars in the OD4H package........................................................................................ 9-5
9.3 How does OD4H work?................................................................................................................... 9-5
9.3.1 Create a new Oracle Database Table or Reuse an Existing Table.................................. 9-6
9.3.2 Hive DDL................................................................................................................................ 9-6
9.3.3 Creating External Tables in Hive........................................................................................ 9-8
9.4 Features of OD4H............................................................................................................................. 9-8
9.4.1 Performance And Scalability Features............................................................................... 9-9
9.4.2 Smart Connection Management........................................................................................ 9-13
9.4.3 Security Features................................................................................................................. 9-14
9.5 Using HiveQL with OD4H............................................................................................................ 9-17
9.6 Using Spark SQL with OD4H....................................................................................................... 9-17
9.7 Writing Back to Oracle Database.................................................................................................. 9-18
A Additional Big Data Connector Resources
Index
x