• Home
• org.apache.beam
• beam-examples-java-twitter
• 2.40.0
• source code
• README.md

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

org.apache.beam.examples.twitterstreamgenerator.README.md Maven / Gradle / Ivy

# Twitter Connector

This directory contains an example pipelines for how to perform continues stream of data from twitter streaming api ( or any other 3rd party API ). This include:


  
Splitable Dofn
  — A simple example of implementation of splittable dofn on an unbounded source with a simple incrementing watermarking logic.
  
Connection Management
  — The streaming pipeline example makes sure that only one Twitter connection is active at a time for a configuration.
  
  
Terminating pipeline by time or elements
  — The streaming pipeline keeps track of time and data collecting so far and terminated when the limit specified in passed.
  


## Requirements

- Java 8
- Twitter developer app account and streaming credentials.
- Direct runner or Flink runner.

This section describes what is needed to get the example up and running.

- Gradle preparation
- Local execution