Bachelor's degree

Data Engineer 2

Associate Engineer

- Optimizations of various Apache spark data pipelines to reduce the running time by almost 25 percent.
- Building Analytics dashboards to give insights on the customer data built on top of complex data metrics.
- Workded on building anaytics Api to get the exposure of backend engineer.
- Leading snowflake data migration from Redshift to Snowflake

Software Engineer I

Developed an end-to-end streaming Dataflow pipeline in Apache Beam to load data from
On-prem Kafka to BigQuery, leveraging ASN-1 Encryption with Java-native Interface.
● Created Serverless Cloud Functions in Python to serve load CSV data into Cloud SQL.
● Extended CICD.Developed many python utilities to automate the manual processes.
● Experienced in building pipelines for different file formats ( JSON, XML, AVRO).
● Lead a team which was working on Real Time Data Pipeline in the Absence of team lead
and represented the team to the client.
● Developed a framework for Aggregators using SQL to ingest data into BQ tables with no
bugs and 100 percent correctness of data and no redundancy.
● Optimized the aggregation sql scripts to bring down the running time from several hours to
seconds.
● Developed a unix script to get export data from the BigQuery and store data into different
locations like SFTP server and GCS
● Developed factory Airflow dag code which generates multiple d

Data Engineer

Senior Data Engineer

Senior Data Engineer at Helpshift

Know about Ganesh Ingale’s work experience, education, bootcamps, certifications, and much more. Ganesh Ingale