SemanticScuttle - klotz.me

klotz: gzip*

Bookmarks on this page are managed by an admin user.

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. Compression-based document similarity vs ngrams

   2023-07-22 Tags: compression, document, similarity, lz4, gzip, ngram by klotz
2. [CORE] [SPARK-6593] Provide option for HadoopRDD to skip corrupted files by tigerquoll · Pull Request #5250 · apache/spark

   sc.parallelize(fs.listStatus(...).map(_.getPath.toString)).map { pathStr =>
   val path = new Path(pathStr)
   val in = new GZIPInputStream(fs.open(path))
   try {
   in.read()
   } catch {
   case e: ZipException => fs.delete(path, false)
   } finally {
   in.close()
   }
   }

   2017-06-05 Tags: spark, gzip, error by klotz
3. Spark job to read gzip files, ignoring corrupted files

   2017-05-23 Tags: spark, gzip, hadoop by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0