This guide is intended for system administrators who want to secure a cluster using data encryption, user authentication, and authorization techniques. It provides conceptual overviews and how-to information about setting up various Hadoop components for optimal security, including how to setup a gateway to restrict access. This guide assumes that you have basic knowledge of Linux and systems administration practices, in general.

Continue reading:

• Cloudera Security Overview
• Authentication
• Authorization
• Encrypting Data in Transit
• Encrypting Data at Rest
• Cloudera Navigator Key Trustee Server
• Cloudera Navigator Key HSM
• Cloudera Navigator Encrypt
• Configuring Encryption for Data Spills
• Impala Security Overview
• Kudu Security Overview
• Security How-To Guides
• Troubleshooting Security Issues
• Using Apache Parquet Data Files with CDH
• Installing Impala
• Using CDH with Isilon Storage
• Dynamic Resource Pools
• Dynamic Resource Pools
• Using the Lineage View
• Managing Hive and Impala Lineage Properties
• How to Enable Sensitive Data Redaction
• Hive SQL Syntax for Use with Sentry
• Impala Concepts and Architecture
• Components of the Impala Server
• Components of the Impala Server
• Components of the Impala Server
• Components of the Impala Server
• Developing Impala Applications
• How Impala Fits Into the Hadoop Ecosystem
• Planning for Impala Deployment
• Impala Requirements
• Guidelines for Designing Impala Schemas
• Installing Impala with Cloudera Manager
• Managing Impala
• Post-Installation Configuration for Impala
• Configuring Impala to Work with ODBC
• Configuring Impala to Work with JDBC
• Impala Upgrade Considerations
• Impala Upgrade Considerations
• Modifying Impala Startup Options
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Tutorials
• Impala Administration
• Admission Control and Query Queuing
• Resource Management for Impala
• Resource Management for Impala
• Resource Management for Impala
• Resource Management for Impala
• How to Configure Resource Management for Impala
• Setting Timeout Periods for Daemons, Queries, and Sessions
• Using Impala through a Proxy for High Availability
• Managing Disk Space for Impala Data
• Auditing Impala Operations
• Viewing Lineage Information for Impala Data
• Impala Security Overview
• Security Guidelines for Impala
• Securing Impala Data and Log Files
• Installation Considerations for Impala Security
• Securing the Hive Metastore Database
• Securing the Impala Web User Interface
• Configuring TLS/SSL for Impala
• Enabling Sentry Authorization for Impala
• Impala Authentication
• Enabling Kerberos Authentication for Impala
• Enabling Kerberos Authentication for Impala
• Enabling Kerberos Authentication for Impala
• Enabling Kerberos Authentication for Impala
• Enabling Kerberos Authentication for Impala
• Enabling Kerberos Authentication for Impala
• Enabling Kerberos Authentication for Impala
• Enabling LDAP Authentication for Impala
• Using Multiple Authentication Methods with Impala
• Configuring Impala Delegation for Hue and BI Tools
• Impala SQL Language Reference
• Comments
• Data Types
• ARRAY Complex Type (CDH 5.5 or higher only)
• BIGINT Data Type
• BOOLEAN Data Type
• CHAR Data Type (CDH 5.2 or higher only)
• DECIMAL Data Type (CDH 6.0 / Impala 3.0 or higher only)
• DOUBLE Data Type
• FLOAT Data Type
• INT Data Type
• MAP Complex Type (CDH 5.5 or higher only)
• REAL Data Type
• SMALLINT Data Type
• STRING Data Type
• STRUCT Complex Type (CDH 5.5 or higher only)
• TIMESTAMP Data Type
• TINYINT Data Type
• VARCHAR Data Type (CDH 5.2 or higher only)
• Complex Types (CDH 5.5 or higher only)
• Literals
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• SQL Operators
• Impala Schema Objects and Object Names
• Overview of Impala Aliases
• Overview of Impala Databases
• Overview of Impala Functions
• Overview of Impala Identifiers
• Overview of Impala Tables
• Overview of Impala Tables
• Overview of Impala Views
• Impala SQL Statements
• DDL Statements
• DML Statements
• ALTER TABLE Statement
• ALTER VIEW Statement
• COMPUTE STATS Statement
• CREATE DATABASE Statement
• CREATE FUNCTION Statement
• CREATE ROLE Statement (CDH 5.2 or higher only)
• CREATE TABLE Statement
• CREATE VIEW Statement
• DELETE Statement (CDH 5.10 or higher only)
• DESCRIBE Statement
• DROP DATABASE Statement
• DROP FUNCTION Statement
• DROP ROLE Statement (CDH 5.2 or higher only)
• DROP STATS Statement
• DROP TABLE Statement
• DROP VIEW Statement
• EXPLAIN Statement
• GRANT Statement (CDH 5.2 or higher only)
• INSERT Statement
• INSERT Statement
• INVALIDATE METADATA Statement
• LOAD DATA Statement
• REFRESH Statement
• REVOKE Statement (CDH 5.2 or higher only)
• SELECT Statement
• Joins in Impala SELECT Statements
• ORDER BY Clause
• GROUP BY Clause
• TABLESAMPLE Clause
• HAVING Clause
• LIMIT Clause
• OFFSET Clause
• UNION Clause
• Subqueries in Impala SELECT Statements
• WITH Clause
• DISTINCT Operator
• Optimizer Hints in Impala
• SET Statement
• Query Options for the SET Statement
• ABORT_ON_ERROR Query Option
• ALLOW_UNSUPPORTED_FORMATS Query Option
• APPX_COUNT_DISTINCT Query Option (CDH 5.2 or higher only)
• BATCH_SIZE Query Option
• BUFFER_POOL_LIMIT Query Option
• COMPRESSION_CODEC Query Option (CDH 5.2 or higher only)
• COMPUTE_STATS_MIN_SAMPLE_SIZE Query Option
• DEBUG_ACTION Query Option
• DECIMAL_V2 Query Option
• DEFAULT_JOIN_DISTRIBUTION_MODE Query Option
• DEFAULT_SPILLABLE_BUFFER_SIZE Query Option
• DISABLE_CODEGEN Query Option
• DISABLE_CODEGEN_ROWS_THRESHOLD Query Option (CDH 5.13 / Impala 2.10 or higher only)
• DISABLE_OUTERMOST_TOPN Query Option
• DISABLE_ROW_RUNTIME_FILTERING Query Option (CDH 5.7 or higher only)
• DISABLE_STREAMING_PREAGGREGATIONS Query Option (CDH 5.7 or higher only)
• DISABLE_UNSAFE_SPILLS Query Option (CDH 5.2 or higher only)
• EXEC_SINGLE_NODE_ROWS_THRESHOLD Query Option (CDH 5.3 or higher only)
• EXEC_TIME_LIMIT_S Query Option (CDH 5.15 / Impala 2.12 or higher only)
• EXPLAIN_LEVEL Query Option
• HBASE_CACHE_BLOCKS Query Option
• HBASE_CACHING Query Option
• LIVE_PROGRESS Query Option (CDH 5.5 or higher only)
• LIVE_SUMMARY Query Option (CDH 5.5 or higher only)
• MAX_ERRORS Query Option
• MAX_ROW_SIZE Query Option
• MAX_SCAN_RANGE_LENGTH Query Option
• MAX_NUM_RUNTIME_FILTERS Query Option (CDH 5.7 or higher only)
• MEM_LIMIT Query Option
• MIN_SPILLABLE_BUFFER_SIZE Query Option
• MT_DOP Query Option
• NUM_NODES Query Option
• NUM_SCANNER_THREADS Query Option
• OPTIMIZE_PARTITION_KEY_SCANS Query Option (CDH 5.7 or higher only)
• PARQUET_COMPRESSION_CODEC Query Option
• PARQUET_ANNOTATE_STRINGS_UTF8 Query Option (CDH 5.8 or higher only)
• PARQUET_ARRAY_RESOLUTION Query Option (CDH 5.12 or higher only)
• PARQUET_FALLBACK_SCHEMA_RESOLUTION Query Option (CDH 5.8 or higher only)
• PARQUET_FILE_SIZE Query Option
• PREFETCH_MODE Query Option (CDH 5.8 or higher only)
• QUERY_TIMEOUT_S Query Option (CDH 5.2 or higher only)
• REQUEST_POOL Query Option
• SCHEDULE_RANDOM_REPLICA Query Option (CDH 5.7 or higher only)
• REPLICA_PREFERENCE Query Option (CDH 5.9 or higher only)
• RUNTIME_BLOOM_FILTER_SIZE Query Option (CDH 5.7 or higher only)
• RUNTIME_FILTER_MAX_SIZE Query Option (CDH 5.8 or higher only)
• RUNTIME_FILTER_MIN_SIZE Query Option (CDH 5.8 or higher only)
• RUNTIME_FILTER_MODE Query Option (CDH 5.7 or higher only)
• RUNTIME_FILTER_WAIT_TIME_MS Query Option (CDH 5.7 or higher only)
• S3_SKIP_INSERT_STAGING Query Option (CDH 5.8 or higher only)
• SCRATCH_LIMIT Query Option
• SHUFFLE_DISTINCT_EXPRS Query Option
• SUPPORT_START_OVER Query Option
• SYNC_DDL Query Option
• SHOW Statement
• SHOW Statement
• SHOW Statement
• SHOW Statement
• SHOW Statement
• SHOW Statement
• SHOW Statement
• SHOW Statement
• SHOW Statement
• SHOW Statement
• SHOW Statement
• SHOW Statement
• SHOW Statement
• TRUNCATE TABLE Statement (CDH 5.5 or higher only)
• UPDATE Statement (CDH 5.10 or higher only)
• UPSERT Statement (CDH 5.10 or higher only)
• USE Statement
• Impala Built-In Functions
• Impala Mathematical Functions
• Impala Bit Functions
• Impala Type Conversion Functions
• Impala Date and Time Functions
• Impala Conditional Functions
• Impala String Functions
• Impala Miscellaneous Functions
• Impala Aggregate Functions
• APPX_MEDIAN Function
• AVG Function
• COUNT Function
• GROUP_CONCAT Function
• MAX Function
• MIN Function
• NDV Function
• STDDEV, STDDEV_SAMP, STDDEV_POP Functions
• SUM Function
• VARIANCE, VARIANCE_SAMP, VARIANCE_POP, VAR_SAMP, VAR_POP Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala Analytic Functions
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• Impala User-Defined Functions (UDFs)
• SQL Differences Between Impala and Hive
• Porting SQL from Other Database Systems to Impala
• Using the Impala Shell (impala-shell Command)
• impala-shell Configuration Options
• impala-shell Configuration Options
• impala-shell Configuration Options
• Connecting to impalad through impala-shell
• Running Commands and SQL Statements in impala-shell
• impala-shell Command Reference
• Tuning Impala for Performance
• Impala Performance Guidelines and Best Practices
• Performance Considerations for Join Queries
• Performance Considerations for Join Queries
• Performance Considerations for Join Queries
• Performance Considerations for Join Queries
• Table and Column Statistics
• Benchmarking Impala Queries
• Controlling Impala Resource Usage
• Runtime Filtering for Impala Queries (CDH 5.7 or higher only)
• Using HDFS Caching with Impala (CDH 5.3 or higher only)
• Testing Impala Performance
• Understanding Impala Query Performance - EXPLAIN Plans and Query Profiles
• Understanding Impala Query Performance - EXPLAIN Plans and Query Profiles
• Understanding Impala Query Performance - EXPLAIN Plans and Query Profiles
• Understanding Impala Query Performance - EXPLAIN Plans and Query Profiles
• Detecting and Correcting HDFS Block Skew Conditions
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Scalability Considerations for Impala
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• Partitioning for Impala Tables
• How Impala Works with Hadoop File Formats
• Using Text Data Files with Impala Tables
• Using Text Data Files with Impala Tables
• Using Text Data Files with Impala Tables
• Using Text Data Files with Impala Tables
• Using Text Data Files with Impala Tables
• Using Text Data Files with Impala Tables
• Using Text Data Files with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Parquet File Format with Impala Tables
• Using the Avro File Format with Impala Tables
• Using the Avro File Format with Impala Tables
• Using the Avro File Format with Impala Tables
• Using the Avro File Format with Impala Tables
• Using the Avro File Format with Impala Tables
• Using the Avro File Format with Impala Tables
• Using the Avro File Format with Impala Tables
• Using the Avro File Format with Impala Tables
• Using the Avro File Format with Impala Tables
• Using the Avro File Format with Impala Tables
• Using the RCFile File Format with Impala Tables
• Using the SequenceFile File Format with Impala Tables
• Using Impala to Query Kudu Tables
• Using Impala to Query Kudu Tables
• Using Impala to Query HBase Tables
• Using Impala to Query HBase Tables
• Using Impala to Query HBase Tables
• Using Impala to Query HBase Tables
• Using Impala to Query HBase Tables
• Using Impala to Query HBase Tables
• Using Impala to Query HBase Tables
• Using Impala to Query HBase Tables
• Using Impala to Query HBase Tables
• Using Impala with the Amazon S3 Filesystem
• Using Impala with Isilon Storage
• Using Impala Logging
• Using Impala Logging
• Using Impala Logging
• Using Impala Logging
• Using Impala Logging
• Using Impala Logging
• Using Impala Logging
• Using Impala Logging
• Troubleshooting Impala
• Impala Web User Interface for Debugging
• Breakpad Minidumps for Impala (CDH 5.8 or higher only)
• Ports Used by Impala
• Impala Reserved Words
• Impala Frequently Asked Questions
• Fixed Issues in Apache Impala
• Apache Impala Incompatible Changes
• Known Issues and Limitations in CDH 6.0.0
• New Features in CDH 6.0.0
• Apache Kudu Administration
• Apache Kudu Background Maintenance Tasks
• Apache Kudu Crash Reporting with Breakpad
• Apache Kudu Configuration
• Developing Applications With Apache Kudu
• Using Apache Impala with Kudu
• Installing Kudu
• Installing and Upgrading Apache Kudu
• Cloudera Manager Metrics for Kudu
• More Resources for Apache Kudu
• Apache Kudu Schema Design
• Kudu Security Overview
• Apache Kudu Transaction Semantics
• Troubleshooting Apache Kudu
• Upgrading Kudu
• Managing Spark
• Monitoring Spark Applications
• Spark Authentication
• Spark Encryption
• Spark Guide
• Add-on Services
• Parcels
• Using an Internal Parcel Repository
• Parcels
• Adding a Service
• Managing Roles
• Using the CDH 6 Maven Repository
• Developing and Running a Spark WordCount Application
• Spark Authentication
• Monitoring Spark Applications
• Spark Guide