配置单元解释计划不显示分区

iaqfqrcu 于 2021-06-26 发布在 Hive

关注(0)|答案(1)|浏览(401)

我有一个表，其中包含251m记录和大小是2.5gb。我在 predicate 中的两列上创建了一个分区。但是解释计划没有显示它正在读取分区，即使我已经分区了。通过选择from partition列，我将插入到另一个表中。
我在 predicate 中提到条件有什么特别的顺序吗？我应该如何提高绩效。

explain
  SELECT
              '123'                                                                         AS run_session_id
            , tbl1.transaction_id
            , tbl1.src_transaction_id
            , tbl1.transaction_created_epoch_time
            , tbl1.currency
            , tbl1.event_type
            , tbl1.event_sub_type
            , tbl1.estimated_total_cost
            , tbl1.actual_total_cost
            , tbl1.tfc_export_created_epoch_time
            , tbl1.authorizer
            , tbl1.acquirer
            , tbl1.processor
            , tbl1.company_code
            , tbl1.country_of_account
            , tbl1.merchant_id
            , tbl1.client_id
            , tbl1.ft_id
            , tbl1.transaction_created_date
            , tbl1.event_pst_time
            , tbl1.extract_id_seq
            , tbl1.src_type
            , ROW_NUMBER() OVER(PARTITION by tbl1.transaction_id ORDER BY tbl1.event_pst_time DESC)   AS seq_num       -- while writing back to the pfit events table, write each event so that event_pst_time populates in right way

          FROM db.xx_events tbl1                                --<hiveFinalDB>--                           -- DB variables wont work, so need to change the DB accrodingly for testing and PROD deployment
          WHERE id_seq     >= 215
             AND id_seq   <= 275
            AND vent        in('SPT','PNR','PNE','PNER','ACT','NTE');

现在如何提高性能。分隔柱为（id\ seq，vent）

Hive hadoop-partitioning

来源：https://stackoverflow.com/questions/44712384/hive-explain-plan-not-showing-partition

1条答案

按热度按时间

p8ekf7hl1#

explain dependency select ... ####演示

create table mytable (i int) 
partitioned by (dt date)
;

alter table mytable add 
    partition (dt=date '2017-06-18')
    partition (dt=date '2017-06-19')
    partition (dt=date '2017-06-20')
    partition (dt=date '2017-06-21')
    partition (dt=date '2017-06-22')
;

explain dependency 
select  *
from    mytable
where   dt >= date '2017-06-20'
;

+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
|                                                                                                                            Explain                                                                                                                            |
+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| {"input_tables":[{"tablename":"local_db@mytable","tabletype":"MANAGED_TABLE"}],"input_partitions":[{"partitionName":"local_db@mytable@dt=2017-06-20"},{"partitionName":"local_db@mytable@dt=2017-06-21"},{"partitionName":"local_db@mytable@dt=2017-06-22"}]} |
+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

“输入分区”：[
{“分区名称”：local_db@mytable@dt=2017-06-20}，{“分区名称”：local_db@mytable@dt=2017-06-21}，{“分区名称”：local_db@mytable@dt=2017-06-22"}]}

赞(0）回复(0）举报 2021-06-26

我来回答

配置单元解释计划不显示分区

1条答案

相关问题

热门标签

最新问答