SemanticScuttle - klotz.me

klotz: hadoop*

The open source, distributed, parallel computation framework developed by Doug Cutting and Mike Cafarella and based on functional programming operations Map and Reduce, as described in the Google MapReduce paper.

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

41. How to Use Spark Transformations Efficiently for MapReduce-like Jobs – FINRA Technology

    2017-03-08 Tags: spark, reducebykey, groupbykey, hashpartitioner, repartitionandsortwithinpartitions, hadoop by klotz
42. Hive Optimizations with Indexes, Bloom-Filters and Statistics – Technology Snippets by Jörn Franke

    2017-03-08 Tags: orc, optimization, bloom filter, index, hadoop by klotz
43. Managing Spark Partitions with Coalesce and Repartition

    2017-03-06 Tags: spark, partitioning, coalesce, data, hadoop by klotz
44. Kubernetes: Using Spark and Zeppelin to process big data on Kubernetes 1.2

    2017-02-24 Tags: spark, kubernetes, zeppelin, hadoop, production engineering by klotz
45. How-to: Do Data Quality Checks using Apache Spark DataFrames - Cloudera Engineering Blog

    2017-02-23 Tags: spark, hadoop, data quality, cloudera, test by klotz
46. How-to: Convert Existing Data into Parquet - Cloudera Engineering Blog

    // set Parquet file block size and page size values
    int blockSize = 256 * 1024 * 1024;
    int pageSize = 64 * 1024;
     

    2017-02-15 Tags: parquet, avro, cloudera, hadoop by klotz
47. java - MapReduce Avro Output is Creating Text File Instead - Stack Overflow

    job.setOutputFormatClass(AvroKeyOutputFormat.class);
    AvroKeyOutputFormat.setOutputPath(job, new Path(args 1 » ));

    2017-02-14 Tags: hadoop, mapreduce, avro, java, stackoverflow by klotz
48. Spark Avro write RDD to multiple directories by key - Stack Overflow

    2017-02-14 Tags: spark, avro, avrowrapper, partitioning, hadoop by klotz
49. Microsoft OLAP Blog by Hilmar Buchta: Hive file format comparison

    2017-02-13 Tags: hadoop, avro, orc, parquet, comparison, performance by klotz
50. spark/LogQuery.scala at master · apache/spark

    2017-02-13 Tags: spark, apache, log, scala, hadoop, parsing by klotz

Top of the page

First / Previous / Next / Last / Page 5 of 0