I'm using Spark-Java.
I need to know If there is any diffrence (performance etc) between the following write to Hadoop methods:
ds.write().mode(mode).format("orc").save(path);
Or
ds.write().mode(mode).orc(path);
Thanks.
I'm using Spark-Java.
I need to know If there is any diffrence (performance etc) between the following write to Hadoop methods:
ds.write().mode(mode).format("orc").save(path);
Or
ds.write().mode(mode).orc(path);
Thanks.
There is no difference
orc(path)
is simply a shortcut method forformat("orc").save(path)
Same applies for
.json(path)
andcsv(path)
with the defaultwrite(path)
with no format being Parquet