I have to get the datatype and do a case match and convert it to some required format. But the usage of org.apache.spark.ml.linalg.VectorUDT
is showing VectorUDT
is private
. Also I specifically need to use org.apache.spark.ml.linalg.VectorUDT
and not org.apache.spark.mllib.linalg.VectorUDT
. Can someone suggest how to go about this?
相关问题
- How to maintain order of key-value in DataFrame sa
- Spark on Yarn Container Failure
- In Spark Streaming how to process old data and del
- Filter from Cassandra table by RDD values
- Set *both* elements and initial capacity of std::v
相关文章
- Livy Server: return a dataframe as JSON?
- How do I get characters common to two vectors in C
- How can I unpack (destructure) elements from a vec
- SQL query Frequency Distribution matrix for produc
- How to filter rows for a specific aggregate with s
- How to name file when saveAsTextFile in spark?
- Spark save(write) parquet only one file
- Could you give me any clue Why 'Cannot call me
For
org.apache.spark.ml.linalg
types you should specify schema usingorg.apache.spark.ml.linalg.SQLDataTypes
which provide singleton instances of the privateUDT
types:MatrixType
for matrices (org.apache.spark.ml.linalg.Matrix
).VectorType
for vectors (org.apache.spark.ml.linalg.Vector
).