Stock Market Kafka Real-Time Project
In this project, you will execute an End-To-End Data Engineering Project on Real-Time Stock Market Data using Kafka using different technologies such as Python, AWS, Apache Kafka, Glue, Athena, and SQL.
About Me
Data Enthusiast
I am a graduate student from Northeastern University, Boston with a Master of Science in Information Systems. With 4+ years of Data Engineering / Analytical experience. I am proficient in optimizing database performance, automating ETL workflows, and implementing scalable solutions. My journey in the realm of data is fueled by a curiosity to transform raw information into meaningful insights. Beyond the lines of code, I advocate for simplicity and clarity in design. Always eager to explore new technological horizons, I am on a continuous quest for knowledge and innovation. Let's build a data-driven future together.
Work Experience
Unlocking the power of data involves intricate steps before it becomes a valuable asset. From shaping raw information to architecting seamless data flows, I specialize in the nuanced craft of transforming data into actionable insights.
Intact Insurnace Specialty Solutions
IT Intern- Data Engineer
September 2023 - December 2023
IT Intern- Data Engineer
June 2022 - September 2022
BNP Paribas India Solutions Private Limited
ETL Engineer
June 2018 - June 2021
Technical Skills
Programming: SQL, Python [NumPy, Pandas, Scikit-learn, BeautifulSoup], Java, Unix Shell, HTML, CSS Databases: Oracle 11g, MS SQL Server, Neo4j, Postgres, BigQuery, MySQL, Azure, Snowflake ETL/Analytics: Alteryx, Talend, Informatica, AB INITIO, SSIS, Tableau, Microsoft PowerBI, AWS, GCP Applications: JIRA, CA Workload Automation AE[Autosys], PUTTY, Control-M, GitHub, MS Office
Projects
Embark on a journey through my portfolio where each project unfolds as a testament to my passion for leveraging cutting-edge technologies, intricate problem-solving, and a creative approach to deliver impactful solutions in the dynamic realm of data engineering and analytics.
Iowa Liquor Sales Data Analysis
This an end-to-end data engineering and analysis project using tools like Alteryx and Talend for data profiling, data transformation, and data integration to load it in Azure SQL database.
Spotify Data Pipeline End-To-End Python Data Engineering Project
This project focuses on creating an end-to-end data engineering pipeline for extracting, transforming, and loading (ETL) Spotify data. The pipeline integrates with the Spotify API, utilizes AWS Lambda for data extraction, employs transformation functions, and stores the processed data in Snowflake. The automation of data extraction and loading processes enhances efficiency and enables seamless analytics.