Chennai, Tamil Nadu, India
Space Exploration & Research, Information Technology
Full-Time
Proclink
Overview
Job Description : AWS Data Engineer
We are seeking a skilled AWS Data Engineer with expertise in various AWS services.
The ideal candidate will have hands-on experience with Lambda, Glue, SNS, SQS, Step Functions, PySpark, Python, Athena, CloudWatch, S3, and more.
The successful candidate should also have working experience with various data file formats such as JSON, XML, CSV, Parquet.
Proficiency in SQL, and visualization tool experience with Looker or Power :
(ref:hirist.tech)
We are seeking a skilled AWS Data Engineer with expertise in various AWS services.
The ideal candidate will have hands-on experience with Lambda, Glue, SNS, SQS, Step Functions, PySpark, Python, Athena, CloudWatch, S3, and more.
The successful candidate should also have working experience with various data file formats such as JSON, XML, CSV, Parquet.
Proficiency in SQL, and visualization tool experience with Looker or Power :
- Develop and maintain robust data pipelines using AWS Glue for efficient ETL processes.
- Implement serverless computing solutions with AWS Lambda to automate tasks and processes.
- Utilize SNS and SQS for efficient messaging and event-driven architecture.
- Design and orchestrate data workflows using AWS Step Functions.
- Leverage PySpark, Python, and SQL for data processing, analysis, and transformation.
- Implement and optimize queries using AWS Athena for efficient querying of large datasets.
- Monitor and manage resources and applications using AWS CloudWatch.
- Manage data storage and retrieval using AWS S3.
- Work with various data file formats, including JSON, XML, CSV, TSV, Parquet, and execute SQL queries as needed.
- Utilize visualization tools such as Looker or Power BI for effective data representation.
- Build end-to-end data pipelines, from conception to implementation, ensuring scalability and efficiency.
- Hands-on experience with CI/CD tools such as Jenkins, GitLab/Github, Jira, Confluence, and other related tools.
- Experience working with Delta Lake for efficient version control and data :
- 8+ years' experience as a Data Engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales).
- Proven experience as a Data Engineer with a strong focus on AWS services.
- Proficiency in Python, PySpark, SQL, and AWS services for data processing and analysis.
- Hands-on experience with AWS Lambda, Glue, SNS, SQS, Step Functions, Athena, CloudWatch, and S3.
- Practical experience working with JSON, XML, CSV, TSV, Parquet file formats.
- Experience with visualization tools such as Looker or Power BI is a significant plus.
- Good understanding of serverless architecture and event-driven design.
- Hands-on experience with CI/CD tools, including Jenkins, GitLab/Github, Jira, Confluence, and other related tools.
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and the ability to present results to non-technical audiences.
- Knowledge of business intelligence and analytical tools, technologies, and techniques.
- Experience with Terraform is a plus.
(ref:hirist.tech)
Similar Jobs
View All
1 Day ago
Lead Python Developer
Information Technology
- 8 - 12 Yrs
- Anywhere in India/Multiple Locations
My Client is revolutionizing the hospitality industry by transforming how businesses manage their finances through cutting-edge Accounts Payable automation. Our mission? To eliminate manual work from business expenses and empower operators with real-...
1 Day ago
Business Analyst I, DeviceOS
Information Technology
- Chennai, Tamil Nadu, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionAmazon is looking for a data-savvy professional to crea...
1 Day ago
IT Support Mgr II
Information Technology
- Chennai, Tamil Nadu, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionAre you passionate about helping people solve IT proble...
1 Day ago
EverestDX - Senior Python Developer
Information Technology
- Chennai, Tamil Nadu, India
Job Title : Sr. Python DeveloperJob Location : Hyderabad Type : Full : 8+ Period : Immediate to 15 days joiners are highly : Design, develop, and maintain scalable Python applications and AI-powered solutions. Collaborate with cross-functional tea...
1 Day ago
.NET Application Developer
Information Technology
- Chennai, Tamil Nadu, India
🌟 We're Hiring: .NET Application Developer! 🌟We are looking for a skilled .NET Application Developer with at least 5 years of experience to join our dynamic team. The ideal candidate will have a strong background in developing robust applications us...
1 Day ago
Full Stack Developer - Node.js/React.js
Information Technology
- Chennai, Tamil Nadu, India
Designation : Full Stack Developer( React.js+ Node.js)Job Location : PrabhadeviJob Day & Timing : Mon - Fri , 9 AM -6 PMJob Description Perform hands-on computer program improvement, counting composing code and unit tests, doing verification of co...
1 Day ago
Sr. Test Engineer - QA Job
Information Technology
- Chennai, Tamil Nadu, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
1 Day ago
QA Engineer
Information Technology
- Chennai, Tamil Nadu, India
Flowserve is a world-leading manufacturer and aftermarket service provider of comprehensive flow control systems. Join a company whose people are committed to building a more sustainable future to make the world better for everyone. With 16,000+ emp...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in