• Home
• com.github.panhongan
• scala-utils
• 0.0.4
• source code
• RDDUtil.scala

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

com.github.panhongan.util.spark.RDDUtil.scala Maven / Gradle / Ivy

package com.github.panhongan.util.spark

import org.apache.spark.rdd.RDD
import com.github.panhongan.util.collection.CollectionUtil

object RDDUtil {
  
  def distinct(rdd : RDD[String]) : RDD[String] = {
    rdd.mapPartitions(CollectionUtil.distinct _).distinct()
  }
  
}