Apache HCatalog
HCatalog is a tool that allows you to access Hive metastore tables within Pig, Spark SQL,
and/or custom MapReduce applications. HCatalog has a REST interface and command line client
that allows you to create tables or do other operations. You then write your applications to
access the tables using HCatalog libraries. For more information, see Using
HCatalog
HCatalog on Amazon EMR release version 5.8.0 and later supports using Amazon Glue Data Catalog as the metastore for Hive. For more information, see Using Amazon Glue Data Catalog as the metastore for Hive.
The following table lists the version of HCatalog included in the latest release of the Amazon EMR 6.x series, along with the components that Amazon EMR installs with HCatalog.
For the version of components installed with HCatalog in this release, see Release 6.15.0 Component Versions.
Amazon EMR Release Label | HCatalog Version | Components Installed With HCatalog |
---|---|---|
emr-6.15.0 |
HCatalog 3.1.3 |
emrfs, emr-ddb, emr-goodies, emr-kinesis, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hadoop-yarn-timeline-server, hcatalog-client, hcatalog-server, hcatalog-webhcat-server, hive-client, mariadb-server |
The following table lists the version of HCatalog included in the latest release of the Amazon EMR 5.x series, along with the components that Amazon EMR installs with HCatalog.
For the version of components installed with HCatalog in this release, see Release 5.36.2 Component Versions.
Amazon EMR Release Label | HCatalog Version | Components Installed With HCatalog |
---|---|---|
emr-5.36.2 |
HCatalog 2.3.9 |
emrfs, emr-ddb, emr-goodies, emr-kinesis, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hadoop-yarn-timeline-server, hcatalog-client, hcatalog-server, hcatalog-webhcat-server, hive-client, mariadb-server |