All Downloads are FREE. Search and download functionalities are using the official Maven repository.

org.apache.spark.streaming.package.scala Maven / Gradle / Ivy

The newest version!
/*
 * Licensed to the Apache Software Foundation (ASF) under one or more
 * contributor license agreements.  See the NOTICE file distributed with
 * this work for additional information regarding copyright ownership.
 * The ASF licenses this file to You under the Apache License, Version 2.0
 * (the "License"); you may not use this file except in compliance with
 * the License.  You may obtain a copy of the License at
 *
 *    http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */

package org.apache.spark

/**
 * Spark Streaming functionality. [[org.apache.spark.streaming.StreamingContext]] serves as the main
 * entry point to Spark Streaming, while [[org.apache.spark.streaming.dstream.DStream]] is the data
 * type representing a continuous sequence of RDDs, representing a continuous stream of data.
 *
 * In addition, [[org.apache.spark.streaming.dstream.PairDStreamFunctions]] contains operations
 * available only on DStreams
 * of key-value pairs, such as `groupByKey` and `reduceByKey`. These operations are automatically
 * available on any DStream of the right type (e.g. DStream[(Int, Int)] through implicit
 * conversions.
 *
 * For the Java API of Spark Streaming, take a look at the
 * [[org.apache.spark.streaming.api.java.JavaStreamingContext]] which serves as the entry point, and
 * the [[org.apache.spark.streaming.api.java.JavaDStream]] and the
 * [[org.apache.spark.streaming.api.java.JavaPairDStream]] which have the DStream functionality.
 */
package object streaming {
  // For package docs only
}




© 2015 - 2024 Weber Informatics LLC | Privacy Policy