Spark Dataframe Maximum Column Count

2019-02-22 06:42发布

问题:

What is the maximum column count of spark Dataframe? I tried getting it from data frame documentation but unable to find it.

回答1:

From the architectural perspective, they are scalable, so there should not be any limit on the column count, but it can give rise to uneven load on the nodes & may affect the overall performance of your transformations.