AWS Data Engineer

Main Duties & Responsibilities :-

• Architect and maintain scalable storage solutions using AWS S3 and Apache Iceberg to manage high-volume, transactional data in a data lake environment.
• Design and deploy robust data processing pipelines using AWS EMR or Glue with PySpark for large-scale data transformation. 
• Follow rigorous software engineering practices, including Git-based version control, CI/CD, and peer code reviews. 

Basic Qualification :-

• Implement and manage complex, automated data workflows using Apache Airflow (MWAA).
• Build centralized data catalogs via AWS Glue Catalog and enable high-speed interactive querying using AWS Athena. 
• Apply advanced Data Modeling (Star Schema, Snowflake) and manage the end-to-end data journey from Raw to Processed zones. 
• Bachelor’s or master’s degree in computer science, Information Technology, Data Engineering, or a related quant.

Basic Qualification:-

• Bachelor’s or master’s degree in computer science, Information Technology, Data Engineering, or a related quantitative field. 

Knowledge and Experience :-

Minimum 3 years experience 

• Expert proficiency in PySpark for distributed data processing. 
• Deep hands-on experience with core AWS services (S3, EMR, Glue, Athena). 
• Experience building and scheduling DAGs in Apache Airflow. 
• Advanced knowledge of OLAP modeling techniques and Data Lake design patterns (Medallion architecture). 
• Strong skills in Python, SQL, and source control management (Git). 

Skills:-

•  Proficiency in Terraform for automated resource provisioning. 
• Experience building deployment pipelines using GitLab CI/CD.
• AWS Certified Data Engineer – Associate or AWS Certified Data Analytics – Specialty.