About an example using kafka, spark-streaming, mongodb and twitter

Hi everyone, in my process of mastering scala and big data technologies, i am learning how to integrate apache kafka, spark-streaming, mongodb and twitter. The idea is simple, a producer process trying to push json tweets from twitter within a kafka topic and another spark-streaming process trying to pull data from that topic and storing…

Advertisement

About twitter and real time data

This is a draft about my next task, periodically ask Twitter with twitter4j api relevant things, for example, my timeline and trending topics to begin with. I am going to create a web service and then integrate that functionality with a topic rabbitmq  using  spring integration and a websocket managed by a controller, so I can display…