Amazon EMR 6.13.0 - Hive release notes - Amazon EMR
Hive changes
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Amazon EMR 6.13.0 - Hive release notes

Amazon EMR 6.13.0 - Hive changes

Type Description

Improvement

Upgrade Python Scripts to Support Python3

Improvement

HIVE-27097: Improve the retry strategy for MetaStore client and server

Bug Fix

HIVE-21778: CBO: “Struct is not null” gets evaluated as nullable always causing filter miss in the query

Bug Fix

HIVE-21009: Adding ability for user to set bind user

Bug Fix

HIVE-22661: Compaction fails on non bucketed table with data loaded inpath

Bug Fix

HIVE-19718: Adding partitions in bulk also fetches table for each partition

Bug Fix

HIVE-22173: Query with multiple lateral views hangs during compilation

Bug Fix

HIVE-27088: Incorrect results when inner and outer joins with post join filters are merged

Bug Fix

HIVE-21935: Hive Vectorization : degraded performance with vectorize UDF

Bug Fix

HIVE-25299: Casting timestamp to numeric data types is incorrect for non-UTC timezones

Bug Fix

HIVE-24626: LLAP: reader threads could be starvated if all IO elevator threads are busy to enqueue to another readers with full queue

Bug Fix

HIVE-27029: hive query fails with Filesystem closed error, Rework done for HIVE-26352

Bug Fix

HIVE-26352: Tez queue access check fails with GSS Exception on Compaction

Bug Fix

HIVE-24590: Operation logging still leaks log4j appenders

Bug Fix

HIVE-24552: Possible HMS connections leak or accumulation in loadDynamicPartitions

Bug Fix

HIVE-27069: Incorrect results with bucket map join

Bug Fix

HIVE-27344: Add a null check in RecordReaderImpl#close

Bug Fix

HIVE-27439: Support space in Decimal

Bug Fix

HIVE-27267: Incorrect results when doing bucket map join on decimal bucketed column with subquery

Bug Fix

HIVE-21986: HiveServer Web UI: Setting the Strict-Transport-Security in default response header

Bug Fix

HIVE-22148: S3A delegation tokens are not added in the job config of the Compactor.

Bug Fix

HIVE-22622: Hive allows to create a struct with duplicate attribute names

Bug Fix

HIVE-22008: LIKE Operator should match multi-line input

Bug Fix

HIVE-23144: LLAP: Let QueryTracker cleanup on serviceStop

Bug Fix

HIVE-22391: NPE while checking Hive query results cache

Bug Fix

HIVE-23305: NullPointerException in LlapTaskSchedulerService addNode due to race condition

Bug Fix

HIVE-22178: Parquet FilterPredicate throws CastException after SchemaEvolution

Bug Fix

HIVE-21517: Fix AggregateStatsCache

Bug Fix

HIVE-21825: Improve client error msg when Active/Passive HA is enabled

Bug Fix

HIVE-23389: FilterMergeRule can lead to AssertionError

Bug Fix

HIVE-22767: Beeline doesn’t parse semicolons in comments properly

Bug Fix

HIVE-22996: BasicStats parsing should check proactively for null or empty string

Bug Fix

HIVE-22808: HiveRelFieldTrimmer does not handle HiveTableFunctionScan

Bug Fix

HIVE-22437: LLAP Metadata cache NPE on locking metadata.

Bug Fix

HIVE-22606: AvroSerde logs avro.schema.literal under INFO level

Bug Fix

HIVE-22713: Constant propagation shouldn’t be done for Join-Fil(*)-RS structure

Bug Fix

HIVE-21624: LLAP: Cpu metrics at thread level is broken

Bug Fix

HIVE-22815: reduce the unnecessary file system object creation in MROutput

Bug Fix

HIVE-23060: Query failing with error “Grouping sets expression is not in GROUP BY key. Error encountered near token”

Bug Fix

HIVE-22236: Fail to create View selecting View containing NOT IN subquery

Bug Fix

HIVE-19886: Logs may be directed to 2 files if —hiveconf hive.log.file is used

Bug Fix

HIVE-20620: manifest collisions when inserting into bucketed sorted MM tables with dynamic partitioning

Bug Fix

HIVE-14557: Nullpointer When both SkewJoin and Mapjoin Enabled

Bug Fix

HIVE-20471: issues getting the default database path

Bug Fix

HIVE-20598: Fix typos in HiveAlgorithmsUtil calculations

Bug Fix

HIVE-14737: Problem accessing /logs in a Kerberized Hive Server 2 Web UI

Bug Fix

HIVE-20733: GenericUDFOPEqualNS may not use = in plan descriptions

Bug Fix

HIVE-20848: After setting UpdateInputAccessTimeHook query fail with Table Not Found.

Bug Fix

HIVE-18929: The method humanReadableInt in HiveStringUtils.java has a race condition.

Bug Fix

HIVE-20841: LLAP: Make dynamic ports configurable

Bug Fix

HIVE-20930: VectorCoalesce in FILTER mode doesn’t take effect

Bug Fix

HIVE-21007: Semi join + Union can lead to wrong plans

Bug Fix

HIVE-21074: Hive bucketed table query pruning does not work for IS NOT NULL condition

Bug Fix

HIVE-21223: CachedStore returns null partition when partition does not exist

Bug Fix

HIVE-19625: Potential NPE and hiding actual exception in Hive#copyFiles

Bug Fix

HIVE-17020: Aggressive RS dedup can incorrectly remove OP tree branch

Bug Fix

HIVE-20168: ReduceSinkOperator Logging Hidden

Bug Fix

HIVE-20879: Using null in a projection expression leads to CastException

Bug Fix

HIVE-20888: TxnHandler: sort() called on immutable lists

Bug Fix

HIVE-19948: HiveCli is not splitting the command by semicolon properly if quotes are inside the string

Bug Fix

HIVE-20621: GetOperationStatus called in resultset.next causing incremental slowness

Bug Fix

HIVE-20854: Sensible Defaults: Hive’s Zookeeper heartbeat interval is 20 minutes, change to 2

Bug Fix

HIVE-20330: HCatLoader cannot handle multiple InputJobInfo objects for a job with multiple inputs

Bug Fix

HIVE-20787: MapJoinBytesTableContainer dummyRow case doesn’t handle reuse

Bug Fix

HIVE-20331: Query with union all, lateral view and Join fails with “cannot find parent in the child operator”

Bug Fix

HIVE-19968: UDF exception is not throw out

Bug Fix

HIVE-20410: aborted Insert Overwrite on transactional table causes “Not enough history available for…” error

Bug Fix

HIVE-20059: Hive streaming should try shade prefix unconditionally on exception

Bug Fix

HIVE-19424: NPE In MetaDataFormatters

Bug Fix

HIVE-20355: Clean up parameter of HiveConnection.setSchema

Bug Fix

HIVE-20858: Serializer is not correctly initialized with configuration in Utilities.createEmptyBuckets

Bug Fix

HIVE-20424: schematool shall not pollute beeline history

Bug Fix

HIVE-20338: LLAP: Force synthetic file-id for filesystems which have HDFS protocol impls with POSIX mutation semantics

Bug Fix

HIVE-11708: Logical operators raises ClassCastExceptions with NULL

Bug Fix

HIVE-21082: In HPL/SQL, declare statement does not support variable of type character

Bug Fix

HIVE-16690: Configure Tez cartesian product edge based on LLAP cluster size

Bug Fix

HIVE-21296: Dropping varchar partition throw exception

Bug Fix

HIVE-14516: OrcInputFormat.SplitGenerator.callInternal

Bug Fix

HIVE-20981: streaming/AbstractRecordWriter leaks HeapMemoryMonitor

Bug Fix

HIVE-20043: HiveServer2: SessionState has a static sync block around an AtomicBoolean

Bug Fix

HIVE-20191: PreCommit patch application doesn’t fail if patch is empty

Bug Fix

HIVE-20400: create table should always use a fully qualified path to avoid potential FS ambiguity

Bug Fix

Add null check for skewedInfo before accessing skewed columns