0 bookmark(s) - Sort by: Date ↓ / Title /
usersDF.write.format("orc") .option("orc.bloom.filter.columns", "favorite_color") .option("orc.dictionary.key.threshold", "1.0") .option("orc.column.encoding.direct", "name") .save("users_with_options.orc") Find full example code at "examples/src/main/scala/org/apache/spark/examples/sql/SQLDataSourceExample.scala" in the Spark repo
// set Parquet file block size and page size values int blockSize = 256 * 1024 * 1024; int pageSize = 64 * 1024;
First / Previous / Next / Last
/ Page 1 of 0