Time Series Insights using Twitter

By for May 9, 2017

Report Abuse
Analyzing data streams in real-time is a problem that a lot of businesses can relate to. In this fast paced digital era, enterprises depend on insights from Operational Technology like real-time times series analysis to detect changes, monitor, and/or control physical devices, processes, and events in the enterprise.. This tutorial lets you stream data from Twitter using Key Words of your choice including #hashtags and @mentions and use Microsoft's Time Series Insights to monitor those keywords.
> **Note:** If you have already deployed this solution, click [here](https://start.cortanaintelligence.com/Deployments?type=twittertimeseriesinsights) to view your deployment. > **Estimated Daily Cost:** [$12.45](https://azure.github.io/Azure-CortanaIntelligence-SolutionAuthoringWorkspace/solution-prices#time-series-insights-using-twitter) ### Estimated Provisioning Time: 15 Minutes [![Solution Diagram](https://caqsres.blob.core.windows.net/twittertimeseriesinsights/twittertimeseriesinsights.jpg)](https://stgni3fvvugftv5s.blob.core.windows.net/twittertimeseriesinsights/twittertimeseriesinsights.jpg) This solution sets up the infrastructure in the diagram above. The various steps are as follows: * Setting up an Azure WebJob to collect Twitter data based on user specified keywords. * Pumping ingested tweets into Azure Event Hub which can accept millions of events per second. * Processing incoming tweets with an Azure Stream Analytics job that stores the raw data in Azure Blob Storage and Azure SQL Database. * The Stream Analytics job calls an Azure Machine Learning web service to determine the sentiment of each tweet. * Visualizing real-time metrics about inferred sentiment using Time Series Insights for Operational Technology real-time monitoring and Power BI for Information Technology reporting and analysis. ## Prerequisites To run the TwitterClient web job, you will need: 1. A [Twitter account](https://twitter.com/login) 2. A [Twitter application](https://apps.twitter.com) 3. Twitter's Streaming API OAuth credentials - On the Twitter application page, click on the *Keys and Access Tokens* tab - *Consumer Key (API Key)* and *Consumer Secret (API Secret)* can be found under **Application Settings** section - Under **Your Access Token** section, click on *Create my access token* to obtain both *Access Token* and *Access Token Secret* More details on Twitter's Streaming API OAuth access token can be found [here](https://dev.twitter.com/oauth/overview/application-owner-access-tokens). ## Disclaimer ©2017 Microsoft Corporation. All rights reserved. This information is provided "as-is" and may change without notice. Microsoft makes no warranties, express or implied, with respect to the information provided here. Third party data was used to generate the Solution. You are responsible for respecting the rights of others, including procuring and complying with relevant licenses in order to create similar datasets.