com.datatorrent.stram.engine.package-info Maven / Gradle / Ivy

Go to download

Show more of this group Show more artifacts with this name
Show all versions of apex-engine Show documentation

There is a newer version: 3.7.0

/**
 * Licensed to the Apache Software Foundation (ASF) under one
 * or more contributor license agreements.  See the NOTICE file
 * distributed with this work for additional information
 * regarding copyright ownership.  The ASF licenses this file
 * to you under the Apache License, Version 2.0 (the
 * "License"); you may not use this file except in compliance
 * with the License.  You may obtain a copy of the License at
 *
 *   http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing,
 * software distributed under the License is distributed on an
 * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
 * KIND, either express or implied.  See the License for the
 * specific language governing permissions and limitations
 * under the License.
 */
/**
 * Execution layer for data operators, tuple processing, serialization, streams, window boundaries etc.
 * 

 * 

 * The streaming platform would take care of the following for you
(TBD, add "How it will")

 * - Standard partitioning (round robin, sticky key). You can add  your own partitioning.

 * - End of window statistics collection in terms of number of tuples, bandwidth, I/O etc

 * - Ensuring the the emitted tuple reaches the downstream operators

 * - Queueing tuples and retaining them till all future downstream operators have consumed it

 * 

 * 

 * There are pre-defined library operators that you can use: see ...

 * Examples are in the following packages

    

      Algorithmic: A set of algorithmic operators
      Input-Output: A set of operators for Input-Output from Hadoop. Consists of adapters to various message buses
      Log Collection: A set of operators for log collection
      Arithmetic: A set of arithmetic operators
      Stream: A set of operators for stream operations
      Testbench: A set of operators for testing your dag, operators 
      Utilities: A set of utility classes
    
 * 

 *
 */

package com.datatorrent.stram.engine;