Aws Data Engineer
Remote, India
54 applied
Full-time
5-12 yrs
Posted on: Sep 21, 2024
No of Positions: 2
Skills
Aws Services
Sql
Star Schema Modeling
Git
Gitlab Ci/cd
Kinesis
Aws Glue
Data Bricks
Pyspark
About the Role:
We're seeking experienced AWS Data Engineers to join our team and contribute to the development and maintenance of our cloud-based data infrastructure. As a key member of our team, you will play a pivotal role in designing, building, and optimizing data pipelines and solutions on the AWS platform.
Responsibilities:
Design, develop, and maintain data pipelines and ETL processes using AWS services like PySpark, Glue, S3, and Terraform.
Collaborate with data scientists and analysts to understand their data requirements and translate them into technical specifications.
Develop and optimize data ingestion, transformation, and storage solutions on the AWS platform.
Ensure data quality, consistency, and security throughout the data lifecycle.
Troubleshoot and resolve data-related issues.
Contribute to the automation and optimization of data workflows.
Required Skills:
5+ years of experience in data engineering.
3+ years of experience with PySpark, Glue, S3, and Terraform.
Strong experience working with AWS technologies.
Strong problem-solving skills, algorithmic skills, and data structures.
Excellent oral and written communication skills.
Optional Skills:
Experience with AWS EMR, Redshift, Kinesis, and Athena.
Knowledge of data warehousing and data modeling concepts.
Experience with cloud-native technologies and DevOps practices.
Qualifications:
Intermediate to Senior level experience in AWS data engineering.
Bachelor's degree in Computer Science, Engineering, or a related field.
Strong analytical and problem-solving skills.
Excellent communication and interpersonal skills.
Ability to work independently and as part of a team.