Cloudera Enterprise 6.0.x | Other versions

Specifying Impala Credentials to Access Data in S3

To allow Impala to access data in S3, specify values for the following configuration settings in your core-site.xml file:

<property>
   <name>fs.s3a.access.key</name>
   <value>your_access_key</value>
</property>
<property>
   <name>fs.s3a.secret.key</name>
   <value>your_secret_key</value>
</property>

After specifying the credentials, restart both the Impala and Hive services. Restarting Hive is required because operations such as Impala queries and CREATE TABLE statements go through the Hive metastore.

Important:

Although you can specify the access key ID and secret key as part of the s3a:// URL in the LOCATION attribute, doing so makes this sensitive information visible in many places, such as DESCRIBE FORMATTED output and Impala log files. Therefore, specify this information centrally in the core-site.xml file, and restrict read access to that file to only trusted users.

Page generated July 25, 2018.