hive.git
2 days agoHIVE-26529: Iceberg: Fix VectorizedSupport support for DECIMAL_64 in HiveIcebergInput... master
Ayush Saxena [Fri, 30 Sep 2022 09:17:30 +0000 (14:47 +0530)] 
HIVE-26529: Iceberg: Fix VectorizedSupport support for DECIMAL_64 in HiveIcebergInputFormat. (#3607). (Ayush Saxena, reviewed by Adam Szita)

4 days agoHIVE-25621: Alter table partition compact/concatenate commands should send HivePrivil...
Sai Hemanth Gantasala [Wed, 28 Sep 2022 01:25:05 +0000 (18:25 -0700)] 
HIVE-25621: Alter table partition compact/concatenate commands should send HivePrivilegeObjects for Authz (Sai Hemanth Gantasala, reviewed by Zhihua Deng)

Closes #2731

4 days agoHIVE-26551: Support CREATE TABLE LIKE FILE for ORC (#3611). (zhangbutao, reviewed...
Butao Zhang [Tue, 27 Sep 2022 23:04:35 +0000 (07:04 +0800)] 
HIVE-26551: Support CREATE TABLE LIKE FILE for ORC (#3611). (zhangbutao,  reviewed by John Sherman, Ayush Saxena)

4 days agoHive Security - Upgrade Apache Log4j to 2.18.0 due to critical CVEs (#3624)
Daniel (Hongdan) Zhu [Tue, 27 Sep 2022 13:19:31 +0000 (06:19 -0700)] 
Hive Security - Upgrade Apache Log4j to 2.18.0 due to critical CVEs (#3624)

Co-authored-by: Hongdan Zhu <danielzhu@cloudera.com>
4 days agoHIVE-26566: Upgrade H2 database version to 2.1.214 (Naveen Gangam) (#3622)
Naveen Gangam [Tue, 27 Sep 2022 13:15:16 +0000 (09:15 -0400)] 
HIVE-26566: Upgrade H2 database version to 2.1.214 (Naveen Gangam) (#3622)

5 days agoHIVE-22316: Avoid hostname resolution in LlapInputFormat (#3619)
Dmitriy Fingerman [Mon, 26 Sep 2022 21:44:51 +0000 (17:44 -0400)] 
HIVE-22316: Avoid hostname resolution in LlapInputFormat (#3619)

Contributed-by: Dmitriy Fingerman <dfingerman@cloudera.com>
6 days agoHIVE-26554: Upgrade Iceberg dependency to 0.14.1 (#3613) (Adam Szita, reviewed by...
Adam Szita [Mon, 26 Sep 2022 07:46:29 +0000 (09:46 +0200)] 
HIVE-26554: Upgrade Iceberg dependency to 0.14.1 (#3613) (Adam Szita, reviewed by Ayush Saxena)

6 days agoHIVE-26495 : MSCK repair perf issue HMSChecker ThreadPool threads are blocked at...
Naresh P R [Mon, 26 Sep 2022 05:12:19 +0000 (22:12 -0700)] 
HIVE-26495 : MSCK repair perf issue HMSChecker ThreadPool threads are blocked at fs.listStatus (#3549). (Naresh P R, reviewed by Ayush Saxena)

8 days agoHIVE-14514: Cloning writerOptions when creating delete event writers in OrcRecordUpda...
Dmitriy Fingerman [Fri, 23 Sep 2022 22:25:59 +0000 (18:25 -0400)] 
HIVE-14514: Cloning writerOptions when creating delete event writers in OrcRecordUpdater. (#3610). (Dmitriy Fingerman, reviewed by Ayush Saxena)

9 days agoHIVE-26549: WebHCat servers fails to start due to authentication filter configuration...
wzg547228197 [Tue, 20 Sep 2022 16:41:10 +0000 (00:41 +0800)] 
HIVE-26549: WebHCat servers fails to start due to authentication filter configuration (Zhiguo Wu reviewed by Stamatis Zampetakis)

Closes #3609

9 days agoHIVE-25848: Empty result for structs in point lookup optimization with vectorization...
ghanko [Thu, 22 Sep 2022 11:51:47 +0000 (13:51 +0200)] 
HIVE-25848: Empty result for structs in point lookup optimization with vectorization on (#3592) (Gergely Hanko, reviewed by Alessandro Solimando and Adam Szita)

10 days agoHIVE-26404: HMS memory leak when compaction cleaner fails to remove obsolete files...
Stamatis Zampetakis [Fri, 5 Aug 2022 16:59:41 +0000 (19:59 +0300)] 
HIVE-26404: HMS memory leak when compaction cleaner fails to remove obsolete files (Stamatis Zampetakis reviewed by Denys Kuzmenko)

Closes #3514

11 days agoHIVE-26536: Enable 'hive.acid.truncate.usebase' by default (#3598). (Sourabh Badhya...
Sourabh Badhya [Tue, 20 Sep 2022 17:30:54 +0000 (23:00 +0530)] 
HIVE-26536: Enable 'hive.acid.truncate.usebase' by default (#3598). (Sourabh Badhya, reviewed by László Végh and Ayush Saxena)

11 days agoHIVE-26532: Remove logger from critical path in VectorMapJoinInnerLongOperator::proce...
rbalamohan [Tue, 20 Sep 2022 17:21:31 +0000 (22:51 +0530)] 
HIVE-26532: Remove logger from critical path in VectorMapJoinInnerLongOperator::processBatch (#3594). (Rajesh Balamohan, reviewed by Ayush Saxena)

12 days agoHIVE-26541: NPE when starting WebHCat Service (Zhiguo Wu reviewed by Stamatis Zampetakis)
Zhiguo Wu [Tue, 23 Aug 2022 06:36:06 +0000 (14:36 +0800)] 
HIVE-26541: NPE when starting WebHCat Service (Zhiguo Wu reviewed by Stamatis Zampetakis)

Closes #3543

12 days agoHIVE-26504: User is not able to drop the table after rename (Laszlo Vegh, reviewed...
veghlaci05 [Mon, 19 Sep 2022 12:06:39 +0000 (14:06 +0200)] 
HIVE-26504: User is not able to drop the table after rename (Laszlo Vegh, reviewed by Denys Kuzmenko, Sourabh Badhya)

Closes #3557

13 days agoHIVE-26471: Add new metric for Pooled compaction. (#3521) (Laszlo Vegh, reviewed...
veghlaci05 [Mon, 19 Sep 2022 07:45:01 +0000 (09:45 +0200)] 
HIVE-26471: Add new metric for Pooled compaction. (#3521) (Laszlo Vegh, reviewed by Zsolt Miskolczi and Laszlo Pinter)

2 weeks agoHIVE-26461: Add CI build check for macOS (Stamatis Zampetakis reviewed by Ayush Saxena)
Stamatis Zampetakis [Wed, 10 Aug 2022 09:53:07 +0000 (12:53 +0300)] 
HIVE-26461: Add CI build check for macOS (Stamatis Zampetakis reviewed by Ayush Saxena)

Closes #3512

2 weeks agoHIVE-26277: NPEs and rounding issues in ColumnStatsAggregator classes (Alessandro...
Alessandro Solimando [Fri, 13 May 2022 15:29:30 +0000 (17:29 +0200)] 
HIVE-26277: NPEs and rounding issues in ColumnStatsAggregator classes (Alessandro Solimando reviewed by Stamatis Zampetakis)

1. Add and invoke checkStatisticsList to prevent NPEs in aggregators;
they all rely on a non-empty list of statistics.
2. Cast integers to double in divisions to make computations more
accurate and avoid rounding issues.
3. Align loggers names to match the class they are in and avoid
misleading log messages.
4. Add documentation for ndvtuner based on current understanding of how
it should work.

Closes #3339

Move (and complete) ndvTuner documentation from tests to production classes

2 weeks agoHIVE-26521: Iceberg: Raise exception when running delete/update statements on V1...
László Pintér [Fri, 16 Sep 2022 13:37:59 +0000 (15:37 +0200)] 
HIVE-26521: Iceberg: Raise exception when running delete/update statements on V1 tables (#3579) (Laszlo Pinter, reviewed by Adam Szita)

2 weeks agoHIVE-26496: Improvement to the fetch operator to scan only delete_delta folders conta...
Dmitriy Fingerman [Fri, 16 Sep 2022 09:00:07 +0000 (05:00 -0400)] 
HIVE-26496: Improvement to the fetch operator to scan only delete_delta folders containing transactions relevant to the current split (Dmitriy Fingerman, reviewed by Denys Kuzmenko, Laszlo Bodor)

Closes #3559

2 weeks agoHIVE-26535: Iceberg: Support adding parquet compression type via Table properties...
Ayush Saxena [Thu, 15 Sep 2022 14:15:35 +0000 (19:45 +0530)] 
HIVE-26535: Iceberg: Support adding parquet compression type via Table properties. (#3597). (Ayush Saxena, reviewed by Adam Szita)

2 weeks agoHIVE-26488: Fix NPE in DDLSemanticAnalyzerFactory during compilation. (#3538). (Ayush...
Ayush Saxena [Wed, 14 Sep 2022 19:41:15 +0000 (01:11 +0530)] 
HIVE-26488: Fix NPE in DDLSemanticAnalyzerFactory during compilation. (#3538). (Ayush Saxena, reviewed by Stamatis Zampetakis)

2 weeks agoHIVE-26525: Update llap-server python scripts to be compatible with python 3 (Simhadr...
SimhadriGovindappa [Wed, 14 Sep 2022 11:10:36 +0000 (16:40 +0530)] 
HIVE-26525: Update llap-server python scripts to be compatible with python 3 (Simhadri Govindappa, reviewed by Denys Kuzmenko)

Closes #3584

2 weeks agoHIVE-26507 (addendum): Do not allow hive to iceberg migration if source table contain...
László Pintér [Tue, 13 Sep 2022 18:07:51 +0000 (20:07 +0200)] 
HIVE-26507 (addendum): Do not allow hive to iceberg migration if source table contains CHAR or VARCHAR columns (#3593)

2 weeks agoHIVE-26534: GROUPING() function errors out due to case-sensitivity of function name...
Soumyakanti Das [Tue, 13 Sep 2022 17:36:39 +0000 (23:06 +0530)] 
HIVE-26534: GROUPING() function errors out due to case-sensitivity of function name (Soumyakanti Das, reviewed by Krisztian Kasa, Ayush Saxena)

2 weeks agoHIVE-26482: Add test to check names after compaction on partition (#3532) (Zsolt...
InvisibleProgrammer [Tue, 13 Sep 2022 07:32:59 +0000 (09:32 +0200)] 
HIVE-26482: Add test to check names after compaction on partition (#3532) (Zsolt Miskolczi, reviewed by Karen Coppage, Laszlo Pinter, Laszlo Vegh)

2 weeks agoHIVE-24933: Replication fails for transactional tables having same name as dropped...
jhungund [Tue, 13 Sep 2022 03:45:27 +0000 (09:15 +0530)] 
HIVE-24933: Replication fails for transactional tables having same name as dropped external tables. (Janardhan Hungund, reviewed by Teddy Choi)

Summary of the change:
While setting up the tasks during the repl-load phase of the replication, delay the access to
table metadata until the task execution. This will avoid inconsistent metadata access during
task creation.

Root Cause Analysis:

Background:
During the incremental load phase of replication, all event logs are processed sequentially.
Multiple tasks are spawned/created during the processing of each event.
All the spawned tasks are subsequently, executed sequantially.

Scenario of the issue:
The issue is seen in the following scenario:
1. An external table(Eg. T1) created, is replicated, to target cluster during earlier replication cycles.
2. This external table is dropped.
3. An new managed table with the same name (T1) is recreated.
4. The subsequent repl-load phase fails.

Root cause:
1. The above mentioned operations (table drop and recreation) are propogated to the target cluster
   via event logs during the subsequent incremental phase of replication.
2. We create DDL tasks to drop the external table for drop-table event.
3. We also create new tasks to create new managed tables.
4. Some additional events are logged which create tasks to load the newly created table.
5. During the creation of these load-table tasks, we try to access metadata corresponding to the new table.
   During normal scenario of a fresh table creation, the metadata store will not have data correspoding to the new table (yet to be created).
   However, in this scenario, the old table still exists and hence, we end up using the metadata corrsesponding to old table(external).
   We try to use this metadata to create the load tasks for the new table.
   During the exeuciton of these load tasks, which execute after the drop and recreate tasks, we find that the metadata set in the
   task context is stale and is inconsistent with the newly created table. Hence, the error.

Fix:
Do not access the table metadata during the task creation phase for table-load.
Instead, access the metadata during the task execution. By that time,
the metadata is updated to the latest state  with the previously executed tasks.

Change-Id: I79ed804617dcdadb51f961a933f4023ac0b6f509

2 weeks agoHIVE-26498: Implement MV maintenance with Iceberg sources using full rebuild (Kriszti...
Krisztian Kasa [Mon, 12 Sep 2022 16:06:51 +0000 (18:06 +0200)] 
HIVE-26498: Implement MV maintenance with Iceberg sources using full rebuild (Krisztian Kasa, reviewed by Laszlo Pinter)

2 weeks agoHIVE-26519: Iceberg: Add support for CTLT queries. (#3577). (Ayush Saxena, reviewed...
Ayush Saxena [Mon, 12 Sep 2022 09:14:23 +0000 (14:44 +0530)] 
HIVE-26519: Iceberg: Add support for CTLT queries. (#3577). (Ayush Saxena, reviewed by Laszlo Pinter)

3 weeks agoHIVE-26490: Iceberg: Residual expression is constructed for the task from multiple...
rbalamohan [Sun, 11 Sep 2022 00:24:30 +0000 (05:54 +0530)] 
HIVE-26490: Iceberg: Residual expression is constructed for the task from multiple places causing CPU burn (#3574)

3 weeks agoHIVE-26468: Replace FlatBuffers artefact from com.github.davidmoten with artefact...
Sylwester Lachiewicz [Sat, 10 Sep 2022 17:24:17 +0000 (19:24 +0200)] 
HIVE-26468: Replace FlatBuffers artefact from com.github.davidmoten with artefact from Google (#3517). (Sylwester Lachiewicz, reviewed by Ayush Saxena)

3 weeks agoHIVE-26443: Add priority queueing to compaction (Laszlo Vegh, reviewed by Denys Kuzme...
veghlaci05 [Thu, 8 Sep 2022 11:23:12 +0000 (13:23 +0200)] 
HIVE-26443: Add priority queueing to compaction (Laszlo Vegh, reviewed by Denys Kuzmenko, Karen Coppage)

Closes #3513

3 weeks agoHIVE-26512: ST_GeometryProcessing is incorrectly registered as function. (#3580)...
Ayush Saxena [Thu, 8 Sep 2022 07:39:44 +0000 (13:09 +0530)] 
HIVE-26512: ST_GeometryProcessing is incorrectly registered as function. (#3580). (Ayush Saxena, reviewed by Zhihua Deng and Csaba Ringhofer)

3 weeks agoHIVE-26507: Do not allow hive to iceberg migration if source table contains CHAR...
László Pintér [Wed, 7 Sep 2022 10:58:38 +0000 (12:58 +0200)] 
HIVE-26507: Do not allow hive to iceberg migration if source table contains CHAR or VARCHAR columns (#3570) (Laszlo Pinter, reviewed by Adam Szita)

3 weeks agoHIVE-26253: Upgrade postgresql to 42.4.1 due to security issues (#3554) (Hongdan...
Daniel (Hongdan) Zhu [Wed, 7 Sep 2022 10:34:14 +0000 (03:34 -0700)] 
HIVE-26253: Upgrade postgresql to 42.4.1 due to security issues (#3554) (Hongdan Zhu, reviewed by Zhihua Deng)

3 weeks agoHIVE-26500: Improve TestHiveMetastore (#3556) (Laszlo Bodor reviewed by Ayush Saxena)
Bodor Laszlo [Wed, 7 Sep 2022 08:43:22 +0000 (10:43 +0200)] 
HIVE-26500: Improve TestHiveMetastore (#3556) (Laszlo Bodor reviewed by Ayush Saxena)

4 weeks agoHIVE-26510: Minor compaction creates empty delta files when no prior delta file exist...
Sourabh Badhya [Fri, 2 Sep 2022 19:04:11 +0000 (00:34 +0530)] 
HIVE-26510: Minor compaction creates empty delta files when no prior delta file exists (#3568). (Sourabh Badhya, reviewed by Denys Kuzmenko and Ayush Saxena)

4 weeks agoHIVE-26511: Fix NoClassDefFoundError in HMS for HBaseConfiguration. (#3569). (Ayush...
Ayush Saxena [Fri, 2 Sep 2022 10:32:15 +0000 (16:02 +0530)] 
HIVE-26511: Fix NoClassDefFoundError in HMS for HBaseConfiguration. (#3569). (Ayush Saxena, reviewed by Zhihua Deng and Istvan Toth)

4 weeks agoHIVE-26474: Enable converting insert-only tables to full ACID tables (Simhadri Govind...
SimhadriGovindappa [Thu, 1 Sep 2022 10:52:52 +0000 (16:22 +0530)] 
HIVE-26474: Enable converting insert-only tables to full ACID tables (Simhadri Govindappa, reviewed by Denys Kuzmenko)

Closes #3550

4 weeks agoHIVE-26480: Improve SYS.COMPACTIONS and SYS.TRANSACTIONS views (Laszlo Vegh, reviewed...
veghlaci05 [Wed, 31 Aug 2022 09:15:53 +0000 (11:15 +0200)] 
HIVE-26480: Improve SYS.COMPACTIONS and SYS.TRANSACTIONS views (Laszlo Vegh, reviewed by Denys Kuzmenko)

Closes #3529

4 weeks agoHIVE-26506: HiveIcebergVectorizedRecordReader doesn't set the selected array (#3558...
Adam Szita [Wed, 31 Aug 2022 08:59:09 +0000 (10:59 +0200)] 
HIVE-26506: HiveIcebergVectorizedRecordReader doesn't set the selected array (#3558) (Adam Szita, reviewed by Laszlo Pinter)

4 weeks agoHIVE-26481: Cleaner fails with FileNotFoundException (Kirti Ruge, reviewed by Ayush...
rkirtir [Wed, 31 Aug 2022 07:33:43 +0000 (13:03 +0530)] 
HIVE-26481: Cleaner fails with FileNotFoundException (Kirti Ruge, reviewed by Ayush Saxena, Denys Kuzmenko)

Closes #3531

4 weeks agoHIVE-26476: map ORCFILE to ORC while creating an iceberg table (#3525) (Laszlo Pinter...
László Pintér [Tue, 30 Aug 2022 12:51:31 +0000 (14:51 +0200)] 
HIVE-26476: map ORCFILE to ORC while creating an iceberg table (#3525) (Laszlo Pinter, reviewed by Adam Szita)

4 weeks agoHIVE-26479: Add ability to set parameters for query-based compaction (Sourabh Badhya...
Sourabh Badhya [Tue, 30 Aug 2022 07:14:09 +0000 (12:44 +0530)] 
HIVE-26479: Add ability to set parameters for query-based compaction (Sourabh Badhya, reviewed by Denys Kuzmenko)

Closes #3528

4 weeks agoHIVE-22193: Graceful shutdown HiveServer2(addendum) (#3530)
dengzh [Tue, 30 Aug 2022 01:06:33 +0000 (09:06 +0800)] 
HIVE-22193: Graceful shutdown HiveServer2(addendum) (#3530)

5 weeks agoFix flaky test TestJdbcWithMiniHS2 testHttpRetryOnServerIdleTimeout (#3547) (Zhihua...
dengzh [Fri, 26 Aug 2022 12:19:46 +0000 (20:19 +0800)] 
Fix flaky test TestJdbcWithMiniHS2 testHttpRetryOnServerIdleTimeout (#3547) (Zhihua Deng, reviewed by Ayush Saxena)

5 weeks agoHIVE-26487: Auto-compaction may hang or skip some of the eligible items (Denys Kuzmen...
Denys Kuzmenko [Fri, 26 Aug 2022 07:56:25 +0000 (09:56 +0200)] 
HIVE-26487: Auto-compaction may hang or skip some of the eligible items (Denys Kuzmenko, reviewed by Karen Coppage)

Closes #3537

5 weeks agoHIVE-26294: Allow substr to take bigint params (Steve Carlin, reviewed by Krisztian...
scarlin-cloudera [Tue, 23 Aug 2022 16:25:22 +0000 (09:25 -0700)] 
HIVE-26294: Allow substr to take bigint params (Steve Carlin, reviewed by Krisztian Kasa)

5 weeks agoHIVE-26472: Allocate new writeIds during re-compilation (John Sherman, reviewed by... 3435/head
John Sherman [Tue, 23 Aug 2022 10:31:52 +0000 (03:31 -0700)] 
HIVE-26472: Allocate new writeIds during re-compilation (John Sherman, reviewed by Denys Kuzmenko)

5 weeks agoHIVE-26407: Do not compute statistics if the compaction fails (Zsolt Miskolczi, revie...
InvisibleProgrammer [Tue, 23 Aug 2022 07:53:32 +0000 (09:53 +0200)] 
HIVE-26407: Do not compute statistics if the compaction fails (Zsolt Miskolczi, reviewed by Denys Kuzmenko)

Closes #3489

5 weeks agoHIVE-26363: converting replLogger time format from epoch to UTC (#3541)
Rakshith C [Mon, 22 Aug 2022 08:45:18 +0000 (14:15 +0530)] 
HIVE-26363: converting replLogger time format from epoch to UTC (#3541)

HIVE-26363: converting replLogger time format from epoch to readable UTC (Rakshith Chandraiah, reviewed by Teddy Choi)

5 weeks agoHIVE-26483: Use DDL_NO_LOCK when running iceberg CTAS query (#3533) (Laszlo Pinter...
László Pintér [Mon, 22 Aug 2022 07:01:34 +0000 (09:01 +0200)] 
HIVE-26483: Use DDL_NO_LOCK when running iceberg CTAS query (#3533) (Laszlo Pinter, reviewed by Denys Kuzmenko)

6 weeks agoHIVE-26478: Explicitly set Content-Type in QueryProfileServlet (#3527)
yigress [Fri, 19 Aug 2022 21:05:21 +0000 (14:05 -0700)] 
HIVE-26478: Explicitly set Content-Type in QueryProfileServlet (#3527)

6 weeks agoHIVE-26415 : Add epoch time in the information_schema.scheduled_executions view ...
shreenidhiSaigaonkar [Fri, 19 Aug 2022 03:19:31 +0000 (08:49 +0530)] 
HIVE-26415 : Add epoch time in the information_schema.scheduled_executions view (#3467)

HIVE-26415 : Add epoch time in the information_schema.scheduled_executions view (Shreenidhi Saigaonkar, reviewed by Teddy Choi)

6 weeks agoHIVE-26248: Add data connector authorization on HMS server-side (#3312)
Butao Zhang [Fri, 19 Aug 2022 01:52:13 +0000 (09:52 +0800)] 
HIVE-26248: Add data connector authorization on HMS server-side (#3312)

* HIVE-26248: Add data connector authorization on HMS server-side

* Pass oldDC object in getInputHObjs()

* Address review comment: Remove empty line and handle exception

* Use Assert.fail() to handle UT exception

* Do not create connector repeatedly

6 weeks agoHIVE-26446: HiveProtoLoggingHook fails to populate TablesWritten field for partitione...
SimhadriGovindappa [Wed, 17 Aug 2022 08:09:41 +0000 (13:39 +0530)] 
HIVE-26446: HiveProtoLoggingHook fails to populate TablesWritten field for partitioned tables (Simhadri Govindappa, reviewed by Denys Kuzmenko)

Closes #3499

6 weeks agoHIVE-26466: NullPointerException on HiveQueryLifeTimeHook:checkAndRollbackCTAS (Butao...
Butao Zhang [Tue, 16 Aug 2022 10:13:05 +0000 (18:13 +0800)] 
HIVE-26466: NullPointerException on HiveQueryLifeTimeHook:checkAndRollbackCTAS (Butao Zhang, reviewed by Denys Kuzmenko)

Closes #3515

6 weeks agoHIVE-26246: Filter out results 'show connectors' on HMS client-side (#3304)
Butao Zhang [Mon, 15 Aug 2022 22:12:54 +0000 (06:12 +0800)] 
HIVE-26246: Filter out results 'show connectors' on HMS client-side (#3304)

6 weeks agoHIVE-26196: Integrate Sonar analysis for master branch and PRs (Alessandro Solimando... CDH-7.1.7.1000
Alessandro Solimando [Thu, 28 Apr 2022 10:20:06 +0000 (12:20 +0200)] 
HIVE-26196: Integrate Sonar analysis for master branch and PRs (Alessandro Solimando, reviewed by Stamatis Zampetakis, Zoltan Haindrich)

Closes #3254

6 weeks agoHIVE-26458: Add explicit dependency to commons-dbcp2 in hive-exec module (Stamatis...
Stamatis Zampetakis [Fri, 5 Aug 2022 17:05:55 +0000 (20:05 +0300)] 
HIVE-26458: Add explicit dependency to commons-dbcp2 in hive-exec module (Stamatis Zampetakis, reviewed by Ayush Saxena)

Closes #3510

6 weeks agoHIVE-26460: Upgrade Iceberg dependency to 0.14.0 (#3511) (Adam Szita, reviewed by...
Adam Szita [Mon, 15 Aug 2022 12:43:38 +0000 (14:43 +0200)] 
HIVE-26460: Upgrade Iceberg dependency to 0.14.0 (#3511) (Adam Szita, reviewed by Laszlo Pinter)

7 weeks agoHIVE-24483: aarch64 Support: Bump protobuf version to 3.21.4 (#3498). (Ayush Saxena...
Ayush Saxena [Thu, 11 Aug 2022 05:29:25 +0000 (10:59 +0530)] 
HIVE-24483: aarch64 Support: Bump protobuf version to 3.21.4 (#3498). (Ayush Saxena, reviewed by Stamatis Zampetakis and  Sylwester Lachiewicz)

7 weeks agoHIVE-26438: Remove unnecessary optimization in canHandleQbForCbo (Abhay Chennagiri...
Abhay Chennagiri [Sat, 30 Jul 2022 00:25:08 +0000 (17:25 -0700)] 
HIVE-26438: Remove unnecessary optimization in canHandleQbForCbo (Abhay Chennagiri reviewed by John Sherman, Stamatis Zampetakis)

Closes #3487

7 weeks agoHIVE-22193: Graceful shutdown HiveServer2 (#3386) (Zhihua Deng, reviewed by Naveen...
dengzh [Wed, 10 Aug 2022 09:39:51 +0000 (17:39 +0800)] 
HIVE-22193: Graceful shutdown HiveServer2 (#3386) (Zhihua Deng, reviewed by Naveen Gangam)

7 weeks agoHIVE-26192: JDBC data connector queries occur exception at cbo stage (#3260)
Butao Zhang [Wed, 10 Aug 2022 04:06:19 +0000 (12:06 +0800)] 
HIVE-26192: JDBC data connector queries occur exception at cbo stage (#3260)

7 weeks agoHIVE-26115: LLAP cache utilization for Iceberg Parquet files (#3480) (Adam Szita...
Adam Szita [Mon, 8 Aug 2022 12:42:16 +0000 (14:42 +0200)] 
HIVE-26115: LLAP cache utilization for Iceberg Parquet files (#3480) (Adam Szita, reviewed by Laszlo Pinter)

7 weeks agoHIVE-26452: NPE when converting join to mapjoin and join column referenced more than...
Krisztian Kasa [Mon, 8 Aug 2022 06:30:47 +0000 (08:30 +0200)] 
HIVE-26452: NPE when converting join to mapjoin and join column referenced more than once (Krisztian Kasa, reviewed by Ayush Saxena, Aman Sinha)

7 weeks agoHIVE-26402: HiveSchemaTool does not honor metastore-site.xml (#3449) (Zhihua Deng...
dengzh [Mon, 8 Aug 2022 01:40:35 +0000 (09:40 +0800)] 
HIVE-26402: HiveSchemaTool does not honor metastore-site.xml (#3449) (Zhihua Deng,  reviewed by Naveen Gangam)

8 weeks agoHIVE-26447 (addendum): Fix orc_map_key_repeating.q.out location (#3509)
John Sherman [Sat, 6 Aug 2022 18:39:29 +0000 (11:39 -0700)] 
HIVE-26447 (addendum): Fix orc_map_key_repeating.q.out location (#3509)

8 weeks agoHIVE-26447: Vectorization: wrong results when filter on repeating map key orc table...
yigress [Fri, 5 Aug 2022 18:52:45 +0000 (11:52 -0700)] 
HIVE-26447: Vectorization: wrong results when filter on repeating map key orc table (#3492)

8 weeks agoHIVE-26448: Improve UnsignedInt128.setV*() (#3501)
Jiaan Geng [Fri, 5 Aug 2022 18:08:22 +0000 (02:08 +0800)] 
HIVE-26448: Improve UnsignedInt128.setV*() (#3501)

8 weeks agoHIVE-22417: Remove stringifyException from MetaStore (#3478) (David Mollitor reviewed...
belugabehr [Fri, 5 Aug 2022 15:25:48 +0000 (11:25 -0400)] 
HIVE-22417: Remove stringifyException from MetaStore (#3478) (David Mollitor reviewed by Stamatis Zampetakis)

8 weeks agoHIVE-26450: Use a more lightweight Oracle image (#3502) (Laszlo Bodor reviewed by...
Bodor Laszlo [Fri, 5 Aug 2022 14:43:32 +0000 (16:43 +0200)] 
HIVE-26450: Use a more lightweight Oracle image (#3502) (Laszlo Bodor reviewed by Stamatis Zampetakis)

8 weeks agoHIVE-26439: Skip collecting Kafka delegation tokens if PLAINTEXT is set (#3488) ...
Yu-Wen [Fri, 5 Aug 2022 02:42:08 +0000 (10:42 +0800)] 
HIVE-26439: Skip collecting Kafka delegation tokens if PLAINTEXT is set (#3488) (Yu-Wen Lai, reviewed by  Laszlo Bodor, Zhihua Deng)

8 weeks agoHIVE-26433: StorageHandler authorization doesn't work with "METASTORE" db type (Denys...
Denys Kuzmenko [Thu, 4 Aug 2022 07:57:20 +0000 (09:57 +0200)] 
HIVE-26433: StorageHandler authorization doesn't work with "METASTORE" db type (Denys Kuzmenko, reviewed by Sai Hemanth Gantasala)

Closes #3482

8 weeks agoHIVE-26444: Use tez.local.mode.without.network for unit tests (#3491) (Laszlo Bodor...
Bodor Laszlo [Wed, 3 Aug 2022 20:02:48 +0000 (22:02 +0200)] 
HIVE-26444: Use tez.local.mode.without.network for unit tests (#3491) (Laszlo Bodor reviewed by Ayush Saxena, Stamatis Zampetakis)

8 weeks agoHIVE-26414: Aborted/Cancelled CTAS operations must initiate cleanup of uncommitted...
Sourabh Badhya [Wed, 3 Aug 2022 07:50:50 +0000 (13:20 +0530)] 
HIVE-26414: Aborted/Cancelled CTAS operations must initiate cleanup of uncommitted data (Sourabh Badhya, reviewed by Denys Kuzmenko)

Closes #3457

8 weeks agoHIVE-24484: Upgrade Hadoop to 3.3.1 And Tez to 0.10.2 (#3279). (Ayush Saxena, reviewe...
Ayush Saxena [Wed, 3 Aug 2022 05:32:02 +0000 (22:32 -0700)] 
HIVE-24484: Upgrade Hadoop to 3.3.1 And Tez to 0.10.2 (#3279). (Ayush Saxena, reviewed by Laszlo Bodor, Zoltan Haindrich and Steve Loughran)

2 months agoHIVE-26440: Duplicate hive-standalone-metastore-server dependency in QFile module...
Stamatis Zampetakis [Mon, 1 Aug 2022 12:47:10 +0000 (15:47 +0300)] 
HIVE-26440: Duplicate hive-standalone-metastore-server dependency in QFile module (Stamatis Zampetakis reviewed by Ayush Saxena)

Closes #3490

2 months agoHIVE-26350: IndexOutOfBoundsException when generating splits for external JDBC table...
Stamatis Zampetakis [Wed, 22 Jun 2022 16:42:56 +0000 (18:42 +0200)] 
HIVE-26350: IndexOutOfBoundsException when generating splits for external JDBC table with partition column (Stamatis Zampetakis reviewed by Krisztian Kasa, Aman Sinha)

1. Introduce new API DatabaseAccessor#getColumnTypes to:
* allow fetching column types from the database;
* align with the code using DatabaseAccessor#getColumnNames.
2. Use the new API to find the type of the partition column in
JdbcInputFormat since information is not propagated correctly to
LIST_COLUMN_TYPES and leads to IOBE.
3. Some refactoring in GenericJdbcDatabaseAccessor to avoid duplicate
code with the introduction of the new API.
4. Add test reproducing the IOBE problem, and tests for the new API.
5. Adapt existing tests based on the changes.

Closes #3470

2 months agoHIVE-26425: Skip SSL cert verification for downloading JWKS in HS2 (#3473)
Yu-Wen [Tue, 2 Aug 2022 00:41:09 +0000 (08:41 +0800)] 
HIVE-26425: Skip SSL cert verification for downloading JWKS in HS2 (#3473)

2 months agoHIVE-26412: Create interface to fetch available slots and add the default implementat...
Adesh Kumar Rao [Mon, 1 Aug 2022 11:15:44 +0000 (16:45 +0530)] 
HIVE-26412: Create interface to fetch available slots and add the default implementation (Adesh Rao, reviewed by Laszlo Bodor, Nikhil Gupta, Sankar Hariappan))

Signed-off-by: Sankar Hariappan <sankarh@apache.org>
Closes (#3456)

2 months agoHIVE-26429: Enable X locking for CTAS by default (Simhadri Govindappa, reviewed by...
SimhadriGovindappa [Fri, 29 Jul 2022 10:44:09 +0000 (16:14 +0530)] 
HIVE-26429: Enable X locking for CTAS by default (Simhadri Govindappa, reviewed by Denys Kuzmenko)

Closes #3475

2 months agoHIVE-26428: Limit usage of LLAP BPWrapper to threads of IO threadpools (Adam Szita...
Adam Szita [Fri, 29 Jul 2022 09:54:31 +0000 (11:54 +0200)] 
HIVE-26428: Limit usage of LLAP BPWrapper to threads of IO threadpools (Adam Szita, reviewed by Laszlo Pinter)

2 months agoHIVE-26421: HMSClient atler_table_req() is called twice when running an alter operati...
László Pintér [Fri, 29 Jul 2022 08:57:57 +0000 (10:57 +0200)] 
HIVE-26421: HMSClient atler_table_req() is called twice when running an alter operation on iceberg table (#3469) (Laszlo Pinter, reviewed by Adam Szita)

2 months agoHIVE-26426: StringIndexOutOfBoundsException in CalcitePlanner#canCBOHandleAst (Abhay... 3439/head
Abhay Chennagiri [Sat, 23 Jul 2022 02:14:30 +0000 (19:14 -0700)] 
HIVE-26426: StringIndexOutOfBoundsException in CalcitePlanner#canCBOHandleAst (Abhay Chennagiri reviewed by John Sherman, Stamatis Zampetakis)

Closes #3474

2 months agoHIVE-26288: NullPointerException in CompactionTxnHandler.markFailed (Zsolt Miskolczi...
InvisibleProgrammer [Wed, 27 Jul 2022 12:17:51 +0000 (14:17 +0200)] 
HIVE-26288: NullPointerException in CompactionTxnHandler.markFailed (Zsolt Miskolczi, reviewed by Denys Kuzmenko, Karen Coppage)

Closes #3451

2 months agoHIVE-26408: Vectorization: Fix deallocation of scratch columns, don't reuse a child...
Bodor Laszlo [Tue, 26 Jul 2022 06:40:35 +0000 (08:40 +0200)] 
HIVE-26408: Vectorization: Fix deallocation of scratch columns, don't reuse a child ConstantVectorExpression as an output (#3452) (Laszlo Bodor reviewed by Ayush Saxena)

2 months agoHIVE-26419: Use a different pool for DataNucleus' secondary connection factory (Yu...
Yu-Wen [Mon, 25 Jul 2022 10:16:13 +0000 (03:16 -0700)] 
HIVE-26419: Use a different pool for DataNucleus' secondary connection factory (Yu-Wen Lai, reviewed by Denys Kuzmenko)

Closes #3466

2 months agoHIVE-26423: Make commons-pool2 an explicit dependency (and upgrade to 2.11.1) (#3472...
John Sherman [Sat, 23 Jul 2022 11:09:12 +0000 (04:09 -0700)] 
HIVE-26423: Make commons-pool2 an explicit dependency (and upgrade to 2.11.1) (#3472). (John Sherman, reviewed by Ayush Saxena)

2 months agoHIVE-26417: Iceberg integration: disable update and merge iceberg table when split...
Krisztian Kasa [Fri, 22 Jul 2022 11:09:27 +0000 (13:09 +0200)] 
HIVE-26417: Iceberg integration: disable update and merge iceberg table when split update is off (Krisztian Kasa, reviewed by Peter Vary)

2 months agoHIVE-26375: Invalid materialized view after rebuild if source table was compacted...
Krisztian Kasa [Fri, 22 Jul 2022 10:18:27 +0000 (12:18 +0200)] 
HIVE-26375: Invalid materialized view after rebuild if source table was compacted (Krisztian Kasa, reviewed by Aman Sinha, Laszlo Pinter)

2 months agoHIVE-26411 Fix TestReplicationMetricCollector flakiness (Gergely Hanko, reviewed...
ghanko [Fri, 22 Jul 2022 08:15:27 +0000 (10:15 +0200)] 
HIVE-26411 Fix TestReplicationMetricCollector flakiness (Gergely Hanko, reviewed by Krisztian Kasa)

2 months agoHIVE-26416: AcidUtils.isRawFormatFile() throws InvalidProtocolBufferException for...
Denys Kuzmenko [Fri, 22 Jul 2022 07:43:09 +0000 (09:43 +0200)] 
HIVE-26416: AcidUtils.isRawFormatFile() throws InvalidProtocolBufferException for non-ORC file (Denys Kuzmenko, reviewed by Ayush Saxena)

Closes #3460

2 months agoHIVE-26396: Trunc function does not honour the scale for constant decimal data type...
SimhadriGovindappa [Fri, 22 Jul 2022 07:32:54 +0000 (13:02 +0530)] 
HIVE-26396: Trunc function does not honour the scale for constant decimal data type (Simhadri Govindappa, reviewed by Denys Kuzmenko)

Closes #3463

2 months agoHIVE-26409: Assign NO_TXN operation type to a table in global locks for scheduled...
Sourabh Badhya [Thu, 21 Jul 2022 11:55:18 +0000 (17:25 +0530)] 
HIVE-26409: Assign NO_TXN operation type to a table in global locks for scheduled queries (Sourabh Badhya, reviewed by Denys Kuzmenko)

Closes #3454

2 months agoHIVE-26397: Honour Iceberg sort orders when writing a table. (#3445) (Laszlo Pinter...
László Pintér [Thu, 21 Jul 2022 11:23:43 +0000 (13:23 +0200)] 
HIVE-26397: Honour Iceberg sort orders when writing a table. (#3445) (Laszlo Pinter, reviewed by Adam Szita and Peter Vary)

2 months agoHIVE-26418: Stop packaging hive-standalone-metastore-server*-tests.jar (John Sherman...
John Sherman [Thu, 21 Jul 2022 04:16:29 +0000 (21:16 -0700)] 
HIVE-26418: Stop packaging hive-standalone-metastore-server*-tests.jar (John Sherman, reviewed by Krisztian Kasa)

2 months agoHIVE-26388: ClassCastException when there is non string type column in source table...
Ayush Saxena [Wed, 20 Jul 2022 15:40:57 +0000 (21:10 +0530)] 
HIVE-26388: ClassCastException when there is non string type column in source table of CTAS query. (#3438). (Ayush Saxena, reviewed by Denys Kuzmenko)