
Overview
Job Overview:
We are seeking a skilled Data Engineer proficient in AWS technologies to join our dynamic team. The ideal candidate will play a key role in designing, implementing, and maintaining data solutions utilizing cloud-based services. They will be responsible for leveraging AWS and Azure tools such as Glue, Redshift, S3, Lambda Function, Athena, CloudWatch, Azure Data Factory, Azure Synapse Analytics, Azure Blob Storage, Azure Functions, Azure Data Explorer, Azure Monitor, Azure Virtual Machines, and Azure Active Directory.
Responsibilities:
- Design, develop, and maintain scalable and efficient data pipelines using AWS Glue or Azure Data Factory to extract, transform, and load data from various sources.
- Implement data storage solutions using AWS S3 or Azure Blob Storage, ensuring data accessibility, security, and reliability.
- Utilize AWS Redshift or Azure Synapse Analytics to design and optimize data warehouses for analytics and reporting purposes.
- Develop server less data processing workflows using AWS Lambda Functions or Azure Functions for automation and efficiency.
- Create and optimize queries for data analysis and exploration using AWS Athena or Azure Data Explorer.
- Monitor and manage data pipelines, databases, and infrastructure using AWS Cloud Watch or Azure Monitor for performance, availability, and security.
- Collaborate with cross-functional teams to understand data requirements and provide data-driven solutions aligned with business objectives.
- Implement and manage identity and access controls using AWS IAM or Azure Active Directory for secure data handling.
Requirements:
- Bachelor's degree in Computer Science, Information Systems, or related field. (Master's degree preferred)
- Proven experience as a Data Engineer with expertise in AWS and Azure cloud platforms.
- Proficiency in working with AWS services such as Glue, Redshift, S3, Lambda Function, Athena, Cloud Watch, EC2, IAM, and their Azure equivalents.
- Strong programming skills in languages such as Python, Java, or Scala.
- Experience in designing, building, and optimizing data pipelines and architectures.
- Understanding of data warehousing concepts and database technologies.
- Ability to troubleshoot and resolve data-related issues effectively.
- Excellent communication skills and the ability to collaborate within a team environment.
Preferred Skills:
- Certification in AWS and/or Azure cloud services.
- Familiarity with other cloud platforms and their data-related services.
- Knowledge of data governance, compliance, and best practices.
- Experience with DevOps practices in a data engineering context.
Benefits:
- Competitive salary and comprehensive benefits package
- Opportunities for career growth and professional development
- Collaborative and innovative work environment
- Flexible work hours and remote work options
Experience: 3-5 Years
Note: The mentioned responsibilities, requirements, and preferences serve as a guide and may not encompass all possible tasks related to the position. The job description may evolve based on business needs and advancements in cloud technologies.
Job Types: Full-time, Permanent
Pay: ₹444,751.47 - ₹1,663,502.56 per year
Benefits:
- Health insurance
- Provident Fund
Schedule:
- Day shift
- Monday to Friday
Ability to commute/relocate:
- Mumbai, Maharashtra: Reliably commute or planning to relocate before starting work (Required)
Application Question(s):
- What is your current Annual CTC in INR Lacs?
- What is your notice period in terms of days?
Experience:
- AWS Data Engineer: 3 years (Required)
Work Location: In person