• Home
• org.spark-project
• spark-core_2.9.2
• 0.7.0
• source code
• GlommedRDD.scala

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

spark.rdd.GlommedRDD.scala Maven / Gradle / Ivy

package spark.rdd

import spark.{RDD, Partition, TaskContext}

private[spark] class GlommedRDD[T: ClassManifest](prev: RDD[T])
  extends RDD[Array[T]](prev) {

  override def getPartitions: Array[Partition] = firstParent[T].partitions

  override def compute(split: Partition, context: TaskContext) =
    Array(firstParent[T].iterator(split, context).toArray).iterator
}