让我们用window函数和内置的PySparkDataFrame函数来做这件事，window在计算上可能非常昂贵，特别是对于大数据集，所以也许可以为你的方法寻找一种更好的方法。不要忘记将data和df替换为实际的data和DataFrame

from pyspark.sql import SparkSession
from pyspark.sql.window import Window
from pyspark.sql.functions import col, sum as _sum

spark = SparkSession.builder.getOrCreate()

data = [("Car","Red"), ("Car","Red"), ("Car","Blue"), ("Truck","Red"), 
        ("Truck","Blue"), ("Truck","Yellow"), ("SUV","Blue"), 
        ("SUV","Blue"), ("Car","Blue"), ("Car","Yellow")]

df = spark.createDataFrame(data, ["Model", "Color"])

window_model = Window.partitionBy('Model')

df = df.withColumn('Red', _sum((col('Color') == 'Red').cast('int')).over(window_model))
df = df.withColumn('Blue', _sum((col('Color') == 'Blue').cast('int')).over(window_model))
df = df.withColumn('Yellow', _sum((col('Color') == 'Yellow').cast('int')).over(window_model))

df.show()

如果您不关心保留原始顺序，可以使用一行程序完成：

data = [("Car","Red"), ("Car","Red"), ("Car","Blue"), ("Truck","Red"), 
        ("Truck","Blue"), ("Truck","Yellow"), ("SUV","Blue"), 
        ("SUV","Blue"), ("Car","Blue"), ("Car","Yellow")]

df = spark.createDataFrame(data, ["Model", "Color"])

df.join(df.groupBy("Model").pivot("Color").count().fillna(0), on='Model').show()

# +-----+------+----+---+------+
# |Model| Color|Blue|Red|Yellow|
# +-----+------+----+---+------+
# |  SUV|  Blue|   2|  0|     0|
# |  SUV|  Blue|   2|  0|     0|
# |  Car|   Red|   2|  2|     1|
# |  Car|   Red|   2|  2|     1|
# |  Car|  Blue|   2|  2|     1|
# |  Car|  Blue|   2|  2|     1|
# |  Car|Yellow|   2|  2|     1|
# |Truck|   Red|   1|  1|     1|
# |Truck|  Blue|   1|  1|     1|
# |Truck|Yellow|   1|  1|     1|
# +-----+------+----+---+------+

如果您关心顺序，它仍然可以作为一行程序完成：

import pyspark.sql.functions as F

df.withColumn("_id", F.monotonically_increasing_id())\
    .join(df.groupBy("Model").pivot("Color").count().fillna(0), on='Model')\
    .orderBy("_id").drop("_id").show()

# +-----+------+----+---+------+
# |Model| Color|Blue|Red|Yellow|
# +-----+------+----+---+------+
# |  Car|   Red|   2|  2|     1|
# |  Car|   Red|   2|  2|     1|
# |  Car|  Blue|   2|  2|     1|
# |Truck|   Red|   1|  1|     1|
# |Truck|  Blue|   1|  1|     1|
# |Truck|Yellow|   1|  1|     1|
# |  SUV|  Blue|   2|  0|     0|
# |  SUV|  Blue|   2|  0|     0|
# |  Car|  Blue|   2|  2|     1|
# |  Car|Yellow|   2|  2|     1|
# +-----+------+----+---+------+