SemanticScuttle - klotz.me

klotz: compression* + hadoop*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. compression - Zip support in Apache Spark - Stack Overflow

   2017-02-08 Tags: spark, zip, compression, hadoop by klotz
2. Reading Compressed Data With Spark Using Unknown File Extensions - Mutable Ideas

   val conf = new SparkConf()
   
   // Custom Codec that process .gz.tmp extensions as a common Gzip format
   conf.set("spark.hadoop.io.compression.codecs", "smx.ananke.spark.util.codecs.TmpGzipCodec")
   
   val sc = new SparkContext(conf)
   
   val data = sc.textFile("s3n://my-data-bucket/2015/09/21/13/*")

   2017-05-24 Tags: spark, compression, hadoop by klotz
3. August 2013 HUG: Compression Options in Hadoop - A Tale of Tradeoffs

   2015-02-02 Tags: hadoop, compression, yahoo by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0