来自包含双引号的命令行的配置单元查询

taor4pac 于 2021-06-03 发布在 Hadoop

关注(0)|答案(2)|浏览(310)

如何使用hive-e“query”语法编写以下查询。查询本身包含双引号和%的原因。

create external table tmp2(logdate string, time string, computername string, clientip string, uri string, qs string, localfile string, status string, referer string, w3status string, sc_bytes string, cs_bytes string, w3wpbytes string, cs_username string, cs_user_agent string, time_local string, timetakenms string, sc_substatus string, s_sitename string, s_ip string, s_port string, RequestsPerSecond string, s_proxy string, cs_version string, c_protocol string, cs_method string, cs_Host string, EndRequest_UTC string, date_local string, CPU_Utilization string, cs_Cookie string, BeginRequest_UTC string) ROW FORMAT SERDE
    'org.apache.hadoop.hive.contrib.serde2.RegexSerDe'
                   WITH SERDEPROPERTIES (
                   "input.regex" ="([0-9-]+) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) (\".*\"|[^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) (\".*\"|[^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) (\".*\"|[^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([0-9-]+ [0-9:.]+) ([^ ]*) ([^ ]*) (\".*\"|[^ ]*) ([0-9-]+ [0-9:.]+)",
                   "output.format.string"="%1$s %2$s %3$s %4$s %5$s %6$s %7$s %8$s %9$s %10$s %11$s %12$s %13$s %14$s %15$s %16$s %17$s %18$s %19$s %20$s %21$s %22$s %23$s %24$s %25$s %26$s %27$s %28$s %29$s %30$s %31$s %32$s")

hadoop Hive regex

来源：https://stackoverflow.com/questions/18736703/hive-query-from-command-line-containing-double-quotes

2条答案

按热度按时间

qjp7pelc1#

这将完全取决于你是如何发送到Hive。只要从命令行运行它，就必须遵循双引号的标准转义规则。如果双引号中有引号，则必须用反斜杠转义。同样，你必须用另一个反斜杠来逃避反斜杠。
另外，一定要在引号中避开回车符。
如果我们把你的例子简化为：

create external table tmp2(logdate string, time string) ROW FORMAT SERDE
'org.apache.hadoop.hive.contrib.serde2.RegexSerDe'
WITH SERDEPROPERTIES (
    "input.regex" = "(\".*\"|[^ ]*) (\".*\"|[^ ]*)",
    "output.format.string"="%1$s %2$s")

然后您应该能够从命令行运行它，如下所示：

hive -e "create external table tmp2(logdate string, time string) ROW FORMAT SERDE \
'org.apache.hadoop.hive.contrib.serde2.RegexSerDe' \
WITH SERDEPROPERTIES ( \
    \"input.regex\" = \"(\\\".*\\\"|[^ ]*) (\\\".*\\\"|[^ ]*)\", \
    \"output.format.string\"=\"%1$s %2$s\")"

我建议你在发帖前把问题简化一下。有时候简化的行为会帮你解决问题。

赞(0）回复(0）举报 2021-06-03

2guxujil2#

你需要用三个反斜杠

赞(0）回复(0）举报 2021-06-03