Atharva Patil

Senior Data Engineer | ETL/ELT | AWS & GCP

Bio

Role: Senior Data Engineer

Experience:
• Design, build, and operate scalable ETL/ELT pipelines on AWS and GCP
• Orchestrate workflows using Airflow / Cloud Composer
• Develop transformation layers using dbt
• Build batch and streaming pipelines using Kafka and Spark
• Implement lakehouse architectures with Apache Iceberg
• Deliver analytics layers on BigQuery and Snowflake
• Lead pipeline architecture, migrations, and performance optimization efforts

Core Skills:
ETL/ELT • PySpark • Apache Spark • Airflow • dbt • Kafka • AWS • GCP • Iceberg • BigQuery • Snowflake

Can Help With:
• Data pipeline & lakehouse architecture design
• Cloud and legacy-to-modern data migrations
• Spark performance & cost optimization
• Data engineering interview prep (SQL, PySpark, system design)

Recent Answers

Software Development

How to get ISO 27001?


Atharva Patil

Senior Data Engineer | ETL/ELT | AWS & GCP

The importance of 27001 or any certifications whatsoever is to demonstrate that your firm meets the compliance standards and follows a structured risk based approach to protect sensitive information. This builds trusts with clients provides them assurance and that they can rely on the service being provided by your firm. This also often becomes a requirement in the contracts. The ISO certification provided by accredited firms like BSI is considered very good. Consultants like (Big 4) can help you with the preparation but the certification must come from an accredited body.

Contact on Clarity

$

1.67

/min


Schedule a Call
Send Message

Stats

1

Answers

0

Calls

Areas of Expertise

Software DevelopmentBig DataSoftware EngineeringPythonC#SQLC++Amazon Web Services (AWS)System Design