- Monitor public sentiment on historical events via Twitter.
- Automate data storage in MongoDB and Postgres for analysis.
- Receive real-time notifications on sentiment scores in Slack.
Trigger the workflow daily at a specified time using a cron job. Extract tweets containing the hashtag #OnThisDay from Twitter. Insert extracted tweets into MongoDB for storage. Analyze tweet sentiment using Google Cloud Natural Language. Set sentiment scores and magnitudes for further processing. Store relevant data in Postgres for structured querying. Send notifications to Slack if sentiment criteria are met.
- 1Import the ETL pipeline workflow template.
- 2Configure Twitter API credentials for tweet extraction.
- 3Set up MongoDB and Postgres credentials for data storage.
- 4Adjust the cron job settings as needed for scheduling.
- 5Customize Slack channel settings for notifications.