org.apache.hadoop.hive.ql.metadata.Table.getMetadata()方法的使用及代码示例

x33g5p2x  于2022-01-29 转载在 其他  
字(8.2k)|赞(0)|评价(0)|浏览(209)

本文整理了Java中org.apache.hadoop.hive.ql.metadata.Table.getMetadata()方法的一些代码示例,展示了Table.getMetadata()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Table.getMetadata()方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.metadata.Table
类名称:Table
方法名:getMetadata

Table.getMetadata介绍

暂无

代码示例

代码示例来源:origin: apache/incubator-gobblin

  1. public Properties getTableMetadata() {
  2. return this.hivePartition.getTable().getMetadata();
  3. }

代码示例来源:origin: apache/nifi

  1. @Override
  2. public AbstractSerDe createSerde() throws SerializationError {
  3. try {
  4. Properties tableProps = table.getMetadata();
  5. tableProps.setProperty(serdeConstants.LIST_COLUMNS, Joiner.on(",").join(inputColumns));
  6. tableProps.setProperty(serdeConstants.LIST_COLUMN_TYPES, Joiner.on(":").join(inputTypes));
  7. NiFiRecordSerDe serde = new NiFiRecordSerDe(recordReader, log);
  8. SerDeUtils.initializeSerDe(serde, conf, tableProps, null);
  9. this.serde = serde;
  10. return serde;
  11. } catch (SerDeException e) {
  12. throw new SerializationError("Error initializing serde " + NiFiRecordSerDe.class.getName(), e);
  13. }
  14. }

代码示例来源:origin: apache/hive

  1. @Override
  2. public LazySimpleSerDe createSerde() throws SerializationError {
  3. try {
  4. Properties tableProps = table.getMetadata();
  5. tableProps.setProperty(serdeConstants.LIST_COLUMNS, Joiner.on(",").join(inputColumns));
  6. tableProps.setProperty(serdeConstants.LIST_COLUMN_TYPES, Joiner.on(":").join(inputTypes));
  7. tableProps.setProperty(serdeConstants.FIELD_DELIM, String.valueOf(fieldDelimiter));
  8. tableProps.setProperty(serdeConstants.COLLECTION_DELIM, String.valueOf(collectionDelimiter));
  9. tableProps.setProperty(serdeConstants.MAPKEY_DELIM, String.valueOf(mapKeyDelimiter));
  10. LazySimpleSerDe serde = new LazySimpleSerDe();
  11. SerDeUtils.initializeSerDe(serde, conf, tableProps, null);
  12. this.serde = serde;
  13. return serde;
  14. } catch (SerDeException e) {
  15. throw new SerializationError("Error initializing serde", e);
  16. }
  17. }
  18. }

代码示例来源:origin: apache/hive

  1. private boolean isSchemaEvolutionEnabled(Table tbl) {
  2. boolean isAcid = AcidUtils.isTablePropertyTransactional(tbl.getMetadata());
  3. if (isAcid || HiveConf.getBoolVar(conf, ConfVars.HIVE_SCHEMA_EVOLUTION)) {
  4. return true;
  5. }
  6. return false;
  7. }

代码示例来源:origin: apache/hive

  1. /**
  2. * Creates JsonSerDe
  3. *
  4. * @throws SerializationError if serde could not be initialized
  5. */
  6. @Override
  7. public JsonSerDe createSerde() throws SerializationError {
  8. try {
  9. Properties tableProps = table.getMetadata();
  10. tableProps.setProperty(serdeConstants.LIST_COLUMNS, Joiner.on(",").join(inputColumns));
  11. tableProps.setProperty(serdeConstants.LIST_COLUMN_TYPES, Joiner.on(":").join(inputTypes));
  12. JsonSerDe serde = new JsonSerDe();
  13. SerDeUtils.initializeSerDe(serde, conf, tableProps, null);
  14. this.serde = serde;
  15. return serde;
  16. } catch (SerDeException e) {
  17. throw new SerializationError("Error initializing serde " + JsonSerDe.class.getName(), e);
  18. }
  19. }

代码示例来源:origin: apache/drill

  1. private boolean isSchemaEvolutionEnabled(Table tbl) {
  2. boolean isAcid = AcidUtils.isTablePropertyTransactional(tbl.getMetadata());
  3. if (isAcid || HiveConf.getBoolVar(conf, ConfVars.HIVE_SCHEMA_EVOLUTION)) {
  4. return true;
  5. }
  6. return false;
  7. }

代码示例来源:origin: apache/hive

  1. /**
  2. * Creates RegexSerDe
  3. *
  4. * @throws SerializationError if serde could not be initialized
  5. */
  6. @Override
  7. public RegexSerDe createSerde() throws SerializationError {
  8. try {
  9. Properties tableProps = table.getMetadata();
  10. tableProps.setProperty(RegexSerDe.INPUT_REGEX, regex);
  11. tableProps.setProperty(serdeConstants.LIST_COLUMNS, Joiner.on(",").join(inputColumns));
  12. tableProps.setProperty(serdeConstants.LIST_COLUMN_TYPES, Joiner.on(":").join(inputTypes));
  13. final String columnComments = tableProps.getProperty("columns.comments");
  14. if (columnComments != null) {
  15. List<String> comments = Lists.newArrayList(Splitter.on('\0').split(columnComments));
  16. int commentsSize = comments.size();
  17. for (int i = 0; i < inputColumns.size() - commentsSize; i++) {
  18. comments.add("");
  19. }
  20. tableProps.setProperty("columns.comments", Joiner.on('\0').join(comments));
  21. }
  22. RegexSerDe serde = new RegexSerDe();
  23. SerDeUtils.initializeSerDe(serde, conf, tableProps, null);
  24. this.serde = serde;
  25. return serde;
  26. } catch (SerDeException e) {
  27. throw new SerializationError("Error initializing serde " + RegexSerDe.class.getName(), e);
  28. }
  29. }

代码示例来源:origin: apache/hive

  1. public static TableDesc getTableDesc(Table tbl) {
  2. Properties props = tbl.getMetadata();
  3. props.put(serdeConstants.SERIALIZATION_LIB, tbl.getDeserializer().getClass().getName());
  4. return (new TableDesc(tbl.getInputFormatClass(), tbl
  5. .getOutputFormatClass(), props));
  6. }

代码示例来源:origin: apache/drill

  1. public static TableDesc getTableDesc(Table tbl) {
  2. Properties props = tbl.getMetadata();
  3. props.put(serdeConstants.SERIALIZATION_LIB, tbl.getDeserializer().getClass().getName());
  4. return (new TableDesc(tbl.getInputFormatClass(), tbl
  5. .getOutputFormatClass(), props));
  6. }

代码示例来源:origin: org.apache.hive/hive-streaming

  1. @Override
  2. public LazySimpleSerDe createSerde() throws SerializationError {
  3. try {
  4. Properties tableProps = table.getMetadata();
  5. tableProps.setProperty(serdeConstants.LIST_COLUMNS, Joiner.on(",").join(inputColumns));
  6. tableProps.setProperty(serdeConstants.LIST_COLUMN_TYPES, Joiner.on(":").join(inputTypes));
  7. tableProps.setProperty(serdeConstants.FIELD_DELIM, String.valueOf(fieldDelimiter));
  8. tableProps.setProperty(serdeConstants.COLLECTION_DELIM, String.valueOf(collectionDelimiter));
  9. tableProps.setProperty(serdeConstants.MAPKEY_DELIM, String.valueOf(mapKeyDelimiter));
  10. LazySimpleSerDe serde = new LazySimpleSerDe();
  11. SerDeUtils.initializeSerDe(serde, conf, tableProps, null);
  12. this.serde = serde;
  13. return serde;
  14. } catch (SerDeException e) {
  15. throw new SerializationError("Error initializing serde", e);
  16. }
  17. }
  18. }

代码示例来源:origin: org.apache.hive/hive-streaming

  1. /**
  2. * Creates JsonSerDe
  3. *
  4. * @throws SerializationError if serde could not be initialized
  5. */
  6. @Override
  7. public JsonSerDe createSerde() throws SerializationError {
  8. try {
  9. Properties tableProps = table.getMetadata();
  10. tableProps.setProperty(serdeConstants.LIST_COLUMNS, Joiner.on(",").join(inputColumns));
  11. tableProps.setProperty(serdeConstants.LIST_COLUMN_TYPES, Joiner.on(":").join(inputTypes));
  12. JsonSerDe serde = new JsonSerDe();
  13. SerDeUtils.initializeSerDe(serde, conf, tableProps, null);
  14. this.serde = serde;
  15. return serde;
  16. } catch (SerDeException e) {
  17. throw new SerializationError("Error initializing serde " + JsonSerDe.class.getName(), e);
  18. }
  19. }

代码示例来源:origin: org.apache.hive/hive-streaming

  1. /**
  2. * Creates RegexSerDe
  3. *
  4. * @throws SerializationError if serde could not be initialized
  5. */
  6. @Override
  7. public RegexSerDe createSerde() throws SerializationError {
  8. try {
  9. Properties tableProps = table.getMetadata();
  10. tableProps.setProperty(RegexSerDe.INPUT_REGEX, regex);
  11. tableProps.setProperty(serdeConstants.LIST_COLUMNS, Joiner.on(",").join(inputColumns));
  12. tableProps.setProperty(serdeConstants.LIST_COLUMN_TYPES, Joiner.on(":").join(inputTypes));
  13. final String columnComments = tableProps.getProperty("columns.comments");
  14. if (columnComments != null) {
  15. List<String> comments = Lists.newArrayList(Splitter.on('\0').split(columnComments));
  16. int commentsSize = comments.size();
  17. for (int i = 0; i < inputColumns.size() - commentsSize; i++) {
  18. comments.add("");
  19. }
  20. tableProps.setProperty("columns.comments", Joiner.on('\0').join(comments));
  21. }
  22. RegexSerDe serde = new RegexSerDe();
  23. SerDeUtils.initializeSerDe(serde, conf, tableProps, null);
  24. this.serde = serde;
  25. return serde;
  26. } catch (SerDeException e) {
  27. throw new SerializationError("Error initializing serde " + RegexSerDe.class.getName(), e);
  28. }
  29. }

代码示例来源:origin: com.facebook.presto.hive/hive-apache

  1. public static TableDesc getTableDesc(Table tbl) {
  2. Properties props = tbl.getMetadata();
  3. props.put(serdeConstants.SERIALIZATION_LIB, tbl.getDeserializer().getClass().getName());
  4. return (new TableDesc(tbl.getInputFormatClass(), tbl
  5. .getOutputFormatClass(), props));
  6. }

代码示例来源:origin: apache/tajo

  1. options.remove("EXTERNAL");
  2. Properties properties = table.getMetadata();
  3. if (properties != null) {

代码示例来源:origin: io.snappydata/snappydata-core

  1. try {
  2. Table table = getTableOrFail(schema, tableName);
  3. Properties metadata = table.getMetadata();
  4. String tblDataSourcePath = getDataSourcePath(metadata);
  5. String driverClass = metadata.getProperty("driver");
  6. try {
  7. Table table = getTableOrFail(schema, tableName);
  8. Properties metadata = table.getMetadata();
  9. String compressionCodec = value == null ? Constant.DEFAULT_CODEC() : value.toString();
  10. String tableType = ExternalTableType.getTableType(table);
  11. Properties metadata = table.getMetadata();
  12. String tblDataSourcePath = getDataSourcePath(metadata);
  13. String driverClass = metadata.getProperty("driver");

相关文章

Table类方法