SemanticScuttle - klotz.me

klotz: spark* + dataframe* + group*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. sql - get TopN of all groups after group by using Spark DataFrame - Stack Overflow

   mport org.apache.spark.sql.expressions.Window
   import org.apache.spark.sql.functions.{rank, desc}
   
   val n: Int = ???
   
   // Window definition
   val w = Window.partitionBy($"user").orderBy(desc("rating"))
   
   // Filter
   df.withColumn("rank", rank.over(w)).where($"rank" <= n)

   2019-06-10 Tags: spark, topn, group, dataframe by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0