org.apache.ignite.stream.twitter

Class TwitterStreamer<K,V>

java.lang.Object

org.apache.ignite.stream.StreamAdapter<String,K,V>

org.apache.ignite.stream.twitter.TwitterStreamer<K,V>

public class TwitterStreamer<K,V>
extends StreamAdapter<String,K,V>

Streamer that consumes from a Twitter Streaming API and feeds transformed key-value pairs, by default , into an IgniteDataStreamer instance.

This streamer uses https://dev.twitter.com/streaming API and supports Public API, User Streams, Site Streams and Firehose.

This Streamer features:

• Supports OAuth1 authentication scheme.
  BasicAuth not supported by Streaming API https://dev.twitter.com/streaming/overview/connecting
• Provide all params in apiParams map. https://dev.twitter.com/streaming/overview/request-parameters

Field Summary

Fields

Modifier and Type	Field and Description
protected IgniteLogger	log Logger.

Fields inherited from class org.apache.ignite.stream.StreamAdapter

ignite

Constructor Summary

Constructors

Constructor and Description
TwitterStreamer(OAuthSettings oAuthSettings)

Method Summary

Modifier and Type	Method and Description
protected com.twitter.hbc.core.Client	buildClient(BlockingQueue<String> tweetQueue, com.twitter.hbc.core.HttpHosts hosts, com.twitter.hbc.core.endpoint.StreamingEndpoint endpoint)
protected com.twitter.hbc.core.Client	getClient(BlockingQueue<String> tweetQueue)
void	setApiParams(Map<String,String> apiParams) Sets API Params.
void	setBufferCapacity(Integer bufferCapacity) Sets Buffer capacity.
void	setEndpointUrl(String endpointUrl) Sets Endpoint URL.
void	setThreadsCount(int threadsCount) Sets Threads count.
void	start() Starts streamer.
void	stop() Stops streamer.
protected void	validateConfig() Validates config at start.

Methods inherited from class org.apache.ignite.stream.StreamAdapter

addMessage, getIgnite, getMultipleTupleExtractor, getSingleTupleExtractor, getStreamer, getTupleExtractor, setIgnite, setMultipleTupleExtractor, setSingleTupleExtractor, setStreamer, setTupleExtractor

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

protected IgniteLogger log

Logger.

Constructor Detail

TwitterStreamer

public TwitterStreamer(OAuthSettings oAuthSettings)

Parameters:

oAuthSettings - OAuth Settings

Method Detail

start

public void start()

Starts streamer.

stop

public void stop()

Stops streamer.

validateConfig

protected void validateConfig()

Validates config at start.

getClient

protected com.twitter.hbc.core.Client getClient(BlockingQueue<String> tweetQueue)

Parameters:

tweetQueue - Tweet queue.

Returns:

Client.

buildClient

protected com.twitter.hbc.core.Client buildClient(BlockingQueue<String> tweetQueue,
                                                  com.twitter.hbc.core.HttpHosts hosts,
                                                  com.twitter.hbc.core.endpoint.StreamingEndpoint endpoint)

Parameters:

tweetQueue - tweet Queue.

hosts - Hostes.

endpoint - Endpoint.

Returns:

Client.

setApiParams

public void setApiParams(Map<String,String> apiParams)

Sets API Params.

Parameters:

apiParams - API Params.

setEndpointUrl

public void setEndpointUrl(String endpointUrl)

Sets Endpoint URL.

Parameters:

endpointUrl - Endpoint URL.

setBufferCapacity

public void setBufferCapacity(Integer bufferCapacity)

Sets Buffer capacity.

Parameters:

bufferCapacity - Buffer capacity.

setThreadsCount

public void setThreadsCount(int threadsCount)

Sets Threads count.

Parameters:

threadsCount - Threads count.