path = hdfs://localhost:8020/tweetįlume-env.sh - I have commented all the export, FLUME_CLSSPATH - In simple nothing is accessing from this file.

Some corrections to my list of files mentioned in my question(nf,flume-env.sh,twitter4j.properties).

I have added the below jar files to /usr/lib/flume-ng/lib/ directory.

I have removed the below 3 jar files from /usr/lib/flume-ng/lib/ directory.

I can stream the twitter data successfully now. I have gone through below steps and resolved the issue. = 100 flume-env.shĮxport twitter4j.streamBaseURL= Enviroment variables can be set here.Įxport JAVA_HOME=/usr/java/jdk1.7.0_67-clouderaĮxport CLASSPATH=$CLASSPATH:/FLUME_HOME/lib/* Note that the Flume conf directory is always included in the classpath.įLUME_CLASSPATH= “/usr/lib/flume-ng/lib/twitter4j-core-3.0.3.jar”įLUME_CLASSPATH=“/usr/lib/flume-ng/lib/twitter4j-media-support-3.0.3.jar”įLUME_CLASSPATH=“/usr/lib/flume-ng/lib/twitter4j-stream-3.0.3.jar”įLUME_CLASSPATH=“/usr/lib/flume-ng/lib/” twitter4j.properties

= hadoop, big data, analytics, bigdata, cloudera, data science, data scientiest, business intelligence, mapreduce, data warehouse, data warehousing, mahout, hbase, nosql, newsql, businessintelligence, cloudcomputing : ()Ljava/util/Map Īt (TwitterStreamImpl.java:735)Īt .(HttpClientWrapper.java:43)Īt twitter4j.TwitterStreamImpl.(TwitterStreamImpl.java:59)Īt twitter4j.TwitterStreamFactory.(TwitterStreamFactory.java:40)Īt .nfigure(TwitterSource.java:97)Īt .nfigure(Configurables.java:41)Īt .AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:326)Īt .AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:97)Īt .PollingPropertiesFileConfigurationProvider$n(PollingPropertiesFileConfigurationProvider.java:140)Īt $RunnableAdapter.call(Executors.java:471)Īt .runAndReset(FutureTask.java:304)Īt $ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)Īt $n(ScheduledThreadPoolExecutor.java:293)Īt .runWorker(ThreadPoolExecutor.java:1145)Īt $n(ThreadPoolExecutor.java:615)Īt (Thread.java:745) nf flume-ng agent -n TwitterAgent -Dtwitter4j.streamBaseURL= -c conf -f /usr/lib/flume-ng/conf/nf Error Messageġ9/01/11 13:29:35 INFO node.AbstractConfigurationProvider: Created channel MemChannelġ9/01/11 13:29:35 INFO source.DefaultSourceFactory: Creating instance of source Twitter, type .TwitterSourceġ9/01/11 13:29:35 ERROR node.PollingPropertiesFileConfigurationProvider: Unhandled error Also the heath care organizations can utilize the results of this research and improve their strategies to benefit the society.Please see the details below and help me in solving the bin]$. This study can benefit the people suffering from diabetes by making them aware about diet, lifestyle and precautionary measures required to manage their condition in a better way. Each individual tweet is scored based on a scale from -5 to +5, where a score having value less than zero indicates a negative sentiment a zero indicates a neutral sentiment, and a score which has a value greater than zero indicates a positive sentiment.

By using Apache Hive, the tweets are transferred from the text file to a table and are analysed by comparing the sentiments expressed in the tweets with the AFINN dictionary. This paper endeavours to perform Sentiment Analysis by extracting tweets related to diabetes domain from via Apache Flume and store them in JSON format. Sentiment Analysis on these tweets can be performed to analyse their opinion. People express their feelings by posting tweets related to various topics and products. Twitter is a social media platform used by millions of people around the world.

Flume twitter