com.xpatterns.spark.core.scala.XPatternsScalaSparkJob.scala Maven / Gradle / Ivy

Go to download

Show more of this group Show more artifacts with this name
Show all versions of xpatterns-spark-api Show documentation

The API for Spark-API. Contains the SparkJob interface that must be extended in order to run jobs on the server.

There is a newer version: 4.0.0-cm5-spark131-cdh541

package com.xpatterns.spark.core.scala

import api.SparkJobValidation
import com.typesafe.config.Config
import org.apache.spark.SparkContext

/**
 * Created by radum on 10.04.2014.
 */
trait XPatternsScalaSparkJob {

  def runJob(sc: SparkContext, jobConfig: Config): java.io.Serializable;

  def validate(sc: SparkContext, config: Config): SparkJobValidation;
}