从开始 Spark-2.4+: 我们可以用 array_union 使 names,other_names 将列合并到一个数组中。
那么 explode 要创建的列 name 列。
我们不需要 union all 两个表/Dataframe Example: ```
df=spark.createDataFrame([("1","Alice","Sarah;Tom"),("2","Bob","Jane;Micheal;Ben"),("3","Lizzie","John")],["id","name","other_names"])

from pyspark.sql.functions import *

df.withColumn("new",array_union(array(col("name")),split(col("other_names"),";"))).
select("id",explode("new").alias("name")).
show()

+---+-------+

| id| name|

+---+-------+

| 1| Alice|

| 1| Sarah|

| 1| Tom|

| 2| Bob|

| 2| Jane|

| 2|Micheal|

| 2| Ben|

| 3| Lizzie|

| 3| John|

+---+-------+

要将csv字符串拆分为行，可以进行横向连接并使用 split() 以及 explode() :

select t.id, n.other_name
from mytable t
lateral view explode(split(t.other_names, ';')) n as other_name

如果还需要主名称：

select id, name from mytable
union all
select t.id, n.other_name
from mytable t
lateral view explode(split(t.other_names, ';')) n as other_name