org.apache.hadoop.hive.ql.metadata.Table.getSkewedColNames()方法的使用及代码示例

x33g5p2x  于2022-01-29 转载在 其他  
字(7.2k)|赞(0)|评价(0)|浏览(171)

本文整理了Java中org.apache.hadoop.hive.ql.metadata.Table.getSkewedColNames()方法的一些代码示例，展示了Table.getSkewedColNames()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Table.getSkewedColNames()方法的具体详情如下：
包路径：org.apache.hadoop.hive.ql.metadata.Table
类名称：Table
方法名：getSkewedColNames

Table.getSkewedColNames介绍

暂无

代码示例

代码示例来源：origin: apache/hive

  1. /**
  2.  * Retrieve skewed column name for a table.
  3.  * @param alias table alias
  4.  * @return
  5.  */
  6. public List<String> getSkewedColumnNames(String alias) {
  7.  List<String> skewedColNames = null;
  8.  if (null != qbm &&
  9.    null != qbm.getAliasToTable() &&
  10.      qbm.getAliasToTable().size() > 0) {
  11.   Table tbl = getMetaData().getTableForAlias(alias);
  12.   skewedColNames = tbl.getSkewedColNames();
  13.  }
  14.  return skewedColNames;
  15. }

代码示例来源：origin: apache/drill

  1. /**
  2.  * Retrieve skewed column name for a table.
  3.  * @param alias table alias
  4.  * @return
  5.  */
  6. public List<String> getSkewedColumnNames(String alias) {
  7.  List<String> skewedColNames = null;
  8.  if (null != qbm &&
  9.    null != qbm.getAliasToTable() &&
  10.      qbm.getAliasToTable().size() > 0) {
  11.   Table tbl = getMetaData().getTableForAlias(alias);
  12.   skewedColNames = tbl.getSkewedColNames();
  13.  }
  14.  return skewedColNames;
  15. }

代码示例来源：origin: apache/hive

  1. tableScanOp == null ? null : tableScanOp.getConf().getTableMetadata();
  2. skewedColumns =
  3.  table == null ? null : table.getSkewedColNames();

代码示例来源：origin: apache/hive

  1. /**
  2.  * Handle alter table <name> not stored as directories
  3.  *
  4.  * @param tableName
  5.  * @param tab
  6.  * @throws SemanticException
  7.  */
  8. private void handleAlterTableDisableStoredAsDirs(String tableName, Table tab)
  9.   throws SemanticException {
  10. List<String> skewedColNames = tab.getSkewedColNames();
  11.  List<List<String>> skewedColValues = tab.getSkewedColValues();
  12.  if ((skewedColNames == null) || (skewedColNames.size() == 0) || (skewedColValues == null)
  13.    || (skewedColValues.size() == 0)) {
  14.   throw new SemanticException(ErrorMsg.ALTER_TBL_STOREDASDIR_NOT_SKEWED.getMsg(tableName));
  15.  }
  16.  AlterTableDesc alterTblDesc = new AlterTableDesc(tableName, false,
  17.    skewedColNames, skewedColValues);
  18.  alterTblDesc.setStoredAsSubDirectories(false);
  19.  rootTasks.add(TaskFactory.get(new DDLWork(getInputs(), getOutputs(),
  20.    alterTblDesc)));
  21. }

代码示例来源：origin: apache/drill

  1. tableScanOp == null ? null : tableScanOp.getConf().getTableMetadata();
  2. skewedColumns =
  3.  table == null ? null : table.getSkewedColNames();

代码示例来源：origin: apache/drill

  1. /**
  2.  * Handle alter table <name> not stored as directories
  3.  *
  4.  * @param tableName
  5.  * @param tab
  6.  * @throws SemanticException
  7.  */
  8. private void handleAlterTableDisableStoredAsDirs(String tableName, Table tab)
  9.   throws SemanticException {
  10. List<String> skewedColNames = tab.getSkewedColNames();
  11.  List<List<String>> skewedColValues = tab.getSkewedColValues();
  12.  if ((skewedColNames == null) || (skewedColNames.size() == 0) || (skewedColValues == null)
  13.    || (skewedColValues.size() == 0)) {
  14.   throw new SemanticException(ErrorMsg.ALTER_TBL_STOREDASDIR_NOT_SKEWED.getMsg(tableName));
  15.  }
  16.  AlterTableDesc alterTblDesc = new AlterTableDesc(tableName, false,
  17.    skewedColNames, skewedColValues);
  18.  alterTblDesc.setStoredAsSubDirectories(false);
  19.  rootTasks.add(TaskFactory.get(new DDLWork(getInputs(), getOutputs(),
  20.    alterTblDesc), conf));
  21. }

代码示例来源：origin: apache/drill

  1. newTblPartLoc = tblObj.getPath();
  2. lbCtx = constructListBucketingCtx(tblObj.getSkewedColNames(), tblObj.getSkewedColValues(),
  3.   tblObj.getSkewedColValueLocationMaps(), tblObj.isStoredAsSubDirectories(), conf);

代码示例来源：origin: apache/hive

  1. newTblPartLoc = tblObj.getPath();
  2. lbCtx = constructListBucketingCtx(tblObj.getSkewedColNames(), tblObj.getSkewedColValues(),
  3.   tblObj.getSkewedColValueLocationMaps(), tblObj.isStoredAsSubDirectories());

代码示例来源：origin: apache/hive

  1. bucketCols = table.getBucketCols();
  2. inputFormatClass = table.getInputFormatClass();
  3. lbCtx = constructListBucketingCtx(table.getSkewedColNames(), table.getSkewedColValues(),
  4.   table.getSkewedColValueLocationMaps(), table.isStoredAsSubDirectories());
  5. isListBucketed = table.isStoredAsSubDirectories();
  6. listBucketColNames = table.getSkewedColNames();

代码示例来源：origin: apache/drill

  1. bucketCols = table.getBucketCols();
  2. inputFormatClass = table.getInputFormatClass();
  3. lbCtx = constructListBucketingCtx(table.getSkewedColNames(), table.getSkewedColValues(),
  4.   table.getSkewedColValueLocationMaps(), table.isStoredAsSubDirectories(), conf);
  5. isListBucketed = table.isStoredAsSubDirectories();
  6. listBucketColNames = table.getSkewedColNames();

代码示例来源：origin: apache/drill

  1. destTableId++;
  2. lbCtx = constructListBucketingCtx(dest_tab.getSkewedColNames(),
  3.   dest_tab.getSkewedColValues(), dest_tab.getSkewedColValueLocationMaps(),
  4.   dest_tab.isStoredAsSubDirectories(), conf);

代码示例来源：origin: apache/hive

  1. destTableId++;
  2. lbCtx = constructListBucketingCtx(destinationTable.getSkewedColNames(),
  3.   destinationTable.getSkewedColValues(), destinationTable.getSkewedColValueLocationMaps(),
  4.   destinationTable.isStoredAsSubDirectories());

代码示例来源：origin: com.facebook.presto.hive/hive-apache

  1. /**
  2.  * Retrieve skewed column name for a table.
  3.  * @param alias table alias
  4.  * @return
  5.  */
  6. public List<String> getSkewedColumnNames(String alias) {
  7.  List<String> skewedColNames = null;
  8.  if (null != qbm &&
  9.    null != qbm.getAliasToTable() &&
  10.      qbm.getAliasToTable().size() > 0) {
  11.   Table tbl = getMetaData().getTableForAlias(alias);
  12.   skewedColNames = tbl.getSkewedColNames();
  13.  }
  14.  return skewedColNames;
  15. }

代码示例来源：origin: com.facebook.presto.hive/hive-apache

  1. table = getTable(parseContext, reduceSinkOp, tableScanOpsForJoin);
  2. skewedColumns =
  3.  table == null ? null : table.getSkewedColNames();

代码示例来源：origin: com.facebook.presto.hive/hive-apache

  1. /**
  2.  * Handle alter table <name> not stored as directories
  3.  *
  4.  * @param tableName
  5.  * @param tab
  6.  * @throws SemanticException
  7.  */
  8. private void handleAlterTableDisableStoredAsDirs(String tableName, Table tab)
  9.   throws SemanticException {
  10. List<String> skewedColNames = tab.getSkewedColNames();
  11.  List<List<String>> skewedColValues = tab.getSkewedColValues();
  12.  if ((skewedColNames == null) || (skewedColNames.size() == 0) || (skewedColValues == null)
  13.    || (skewedColValues.size() == 0)) {
  14.   throw new SemanticException(ErrorMsg.ALTER_TBL_STOREDASDIR_NOT_SKEWED.getMsg(tableName));
  15.  }
  16.  AlterTableDesc alterTblDesc = new AlterTableDesc(tableName, false,
  17.    skewedColNames, skewedColValues);
  18.  alterTblDesc.setStoredAsSubDirectories(false);
  19.  rootTasks.add(TaskFactory.get(new DDLWork(getInputs(), getOutputs(),
  20.    alterTblDesc), conf));
  21. }

代码示例来源：origin: apache/lens

  1. xskewinfo.getColNames().addAll(tbl.getSkewedColNames());
  2. for (List<String> value : tbl.getSkewedColValues()) {
  3.  XSkewColList colVallist = new XSkewColList();

代码示例来源：origin: org.apache.lens/lens-cube

  1. xskewinfo.getColNames().addAll(tbl.getSkewedColNames());
  2. for (List<String> value : tbl.getSkewedColValues()) {
  3.  XSkewColList colVallist = new XSkewColList();

代码示例来源：origin: com.facebook.presto.hive/hive-apache

  1. newTblPartLoc = tblObj.getPath();
  2. lbCtx = constructListBucketingCtx(tblObj.getSkewedColNames(), tblObj.getSkewedColValues(),
  3.   tblObj.getSkewedColValueLocationMaps(), tblObj.isStoredAsSubDirectories(), conf);

代码示例来源：origin: com.facebook.presto.hive/hive-apache

  1. bucketCols = table.getBucketCols();
  2. inputFormatClass = table.getInputFormatClass();
  3. lbCtx = constructListBucketingCtx(table.getSkewedColNames(), table.getSkewedColValues(),
  4.   table.getSkewedColValueLocationMaps(), table.isStoredAsSubDirectories(), conf);
  5. isListBucketed = table.isStoredAsSubDirectories();
  6. listBucketColNames = table.getSkewedColNames();

代码示例来源：origin: com.facebook.presto.hive/hive-apache

  1. destTableId++;
  2. lbCtx = constructListBucketingCtx(dest_tab.getSkewedColNames(),
  3.   dest_tab.getSkewedColValues(), dest_tab.getSkewedColValueLocationMaps(),
  4.   dest_tab.isStoredAsSubDirectories(), conf);

内容来源于网络，如有侵权，请联系作者删除！

Table

相关文章

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多

    Table类方法

    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com