SemanticScuttle - klotz.me

Tags: spark* + scala*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. ScalaApacheAccessLogParser/AccessLogParser.scala at master · alvinj/ScalaApacheAccessLogParser · GitHub

   2021-04-01 Tags: clf, apache, log, parse, spark, scala, alvin alexander by klotz
2. Migration Guide: SQL, Datasets and DataFrame - Spark 3.0.1 Documentation

   2021-01-28 Tags: spark, spark 3.0, scala, python, migration, hadoop by klotz
3. Working with Spark ArrayType columns - MungingData

   2020-11-20 Tags: spark, scala, array by klotz
4. Adding line numbers when parsing many CSV files with Spark - Stack Overflow

   monotonically_increasing_id

   2020-05-26 Tags: spark, python, scala, data quality, line numbers by klotz
5. “Improving the scalability of a Spark pipeline for conversion attribution”

   2019-07-26 Tags: spark, etl, performance, scala, pinterest by klotz
6. “Automated Data Quality Testing at Scale using Apache Spark”

   2019-06-30 Tags: spark, data quality, validation, amazon, deequ, foss, scala by klotz
7. Spark, Scala - How to get Top 3 value from each group of two column in dataframe - Stack Overflow

   df.withColumn("rank", rank().over(Window.partitionBy("Dept_id").orderBy($"salary".desc)))
   .filter($"rank" <= 3)
   .drop("rank")

   2019-06-24 Tags: spark, scala, dataframe, top n, window, rank by klotz
8. Spark UDFs, how to write them and some gotchas? – achilleus – Medium

   2019-04-25 Tags: spark, udf, scala by klotz
9. GitHub - qubole/sparklens: Qubole Sparklens tool for performance tuning Apache Spark

   2019-01-29 Tags: spark, sparklens, performance analysis, qubole, performance, foss, scala by klotz
10. Apache Spark : Python vs. Scala

    2018-05-15 Tags: spark, python, scala, comparison by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0