Introduction to Big Data

Azure Data Fundamentals

Bachelor of Technology - BTech

Master of Arts - MA

High School Diploma

Senior Analyst

- Modernised the company's proprietary online ed-tech application by migrating their architecture from a LAMP software bundle to a leading-edge, purely Python-based tech stack, leveraging latest libraries and frameworks including Django, VADER, SciKit, etc., along with a NoSQL database.
- Designed, trained and deployed 4 Machine Learning (ML) models as an initiative to enhance the customer experience:
    1. Meeting transcript generation — Speech-to-text conversion for live meetings, involving tonal detection and pitch distinction.
    2. Text summarisation and note-making — Extraction of key highlights from video transcripts through keyword detection and text ranking.
    3. Machine Translation — Diversification of accessibility through translation of recorded videos in nearly 10 common languages.
    4. Feedback Analysis — Use of Sentiment Analysis and Intent Detection for prioritisation and analysis of consumer feedback.

Software Intern

- Worked on a comprehensive Business Intelligence & Analytics project for a market leader in the Oil & Gas/City Gas Distribution (CGD) sector spanning multiple functions including supply chain, customer acquisition, corporate finance, operations and management, sales and marketing, human resources, etc. The project boosted operational efficiency, diagnosed major bottlenecks, enabled high-accuracy financial reporting, forecasted and mitigated losses, and automated laborious manual processes.
- Built and optimised end-to-end ETL pipelines with PySpark on Databricks and Azure Data Factory, leveraging its distributed computing capabilities to build a lightning-fast 2TB data warehouse adhering to industry best practices. This centralized data hub empowered data-driven decision-making across all departments.
- Navigated the complexities of managing 15+ source data systems (including SAP, MongoDB, MySQL, SCADA, etc.) for the development of performant OLAP data models including multi-dimension

Associate Consultant

Data Engineer | Python | PySpark | Azure —
I converge innovation, insight & finesse to methodically build data pipelines

hashnode

devto

Know about Shreyan Das's work experience, education, bootcamps, certifications, and much more. Shreyan Das

Shreyan Das

Data Engineer | Python | PySpark | Azure — I converge innovation, insight & finesse to methodically build data pipelines