Technology Consulting Firm

Collecting multinational social media insights utilizing an NLP Platform.

Allata assembled a team of experts to develop a Natural Language Processing & Understanding (NLP & NLU) platform for multiple languages, enabling accurate insights for Social Network Analysis.

Services

Technology & Cloud

Industry

High Tech

A man demonstrating strategic innovation with a tablet displaying global graphs.

OUTCOMES

Actionable insights for analyzing digital marketing and social networks.
Custom dashboard for easy access and interpretation of KPIs and metrics.
Utilizes an NLP pipeline to ensure strict data life cycle practices and traceability.
Multiple language support, including Spanish, Portuguese, and Italian.
A scalable and adaptable solution for future expansions.

tools & technology

Apache Superset
AWS Services (EMR, S3, Step and Lambda Functions, AWS Glue, RDS MySQL, etc.)
Brandwatch API
Social Media APIs (i.e. TW API)
Python
Redis Cache (Superset)
NLP Models
Spark ML – LDA
Pytorch – Translate
TextBlob – Polarity & Subjectivity
Spacy: TF-IDF, NER, Lemmatizer, Autoencoders

The Challenge

Multinational Digital Marketing and Social Network Insights

Our client’s global operations are spread across ten offices in five countries, and they use a closed enterprise suite called Brandwatch, to analyze digital marketing and social networks. It provides them with good insights and metrics for the English language by periodically crawling several social networks, blogs, and other websites in search of keywords.

However, Brandwatch does not perform at the same level of accuracy when switching to other languages, such as Spanish, Portuguese, or Italian. From a large set of Brandwatch features, our customer remains focused on its NLP (Natural Language Processing) capabilities and insights discovery. Since they provide global services to their multinational customers, they wanted to find a way to support this type of analysis in a multi-language setting.

Even though the client is not a small company –they have more than 500 employees and its own IT department–, they were struggling to develop a custom solution to generate insights beyond the existing Brandwatch limitations.

The Solution

Natural Language Processing Platform

After analyzing the requirements and agreeing on a proposed implementation, Allata quickly assembled a team composed of a Data Architect, a Data Engineer, and a Data Scientist to implement a Natural Language Processing & Understanding (NLP & NLU) platform for multiple languages. This platform has the capacity to reveal a more accurate set of insights on Social Network Analysis, based on extracted data from Brandwatch plus other data sources such as Social Networks, blog sites, forums, newspapers, etc.

KPIs and metrics stored in a database are useless for an analyst without a flexible Dashboard for rendering infocharts, so our team also implemented and deployed a custom dashboard based on the open-source BI tool Superset. The multi-user and auto-scalable UI was a containerized solution on AWS ECS.

Data Lineage

The data flows over a comprehensive NLP pipeline, with every step following strict data life cycle practices: labeling and storing data and resulting KPIs in aggregated and raw formats. This enables traceability, which allows our customer to rebase the historical data with different business rules and threshold configurations, for even more accurate insights.

The Results

Actionable insights

The implemented solution allows the client to interpret and understand the impact of each of their campaigns on the LATAM Spanish-speaking market, making use of Artificial Intelligence for Natural Language Understanding.

Also, the solution was designed to easily support new languages, making it readily expansible.