pyspark-将异类数组json数组转换为sparkDataframe并将其展平

gtlvzcf8  于 2021-05-29  发布在  Spark
关注(0)|答案(0)|浏览(222)

我将流式数据作为json数组输入,并希望使用python将其展平为sparkDataframe中的一行。
以下是json数据的外观:

{

"event": [

{

"name": "QuizAnswer",

"count": 1

}

],

"custom": {

"dimensions": [

{

"title": "Are you:"

},

{

"question_id": "5965"

},

{

"option_id": "19029"

},

{

"option_title": "Non-binary"

},

{

"item": "Non-binary"

},

{

"tab_index": "3"

},

{

"tab_count": "4"

},

{

"tab_initial_index": "4"

},

{

"page": "home"

},

{

"environment": "testing"

},

{

"page_count": "0"

},

{

"widget_version": "2.2.44"

},

{

"session_count": "1"

},

{

"quiz_settings_id": "1020"

},

{

"quiz_session": "6e5a3b5c-9961-4c1b-a2af-3374bbeccede"

},

{

"shopify_customer_id": "noid"

},

{

"cart_token": ""

},

{

"app_version": "2.2.44"

},

{

"shop_name": "safety-valve.myshopify.com"

}

],

"metrics": []

}

}

}

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题