Pune, Maharashtra, India
Telecommunications
Full-Time
Lemongrass Consulting
Overview
Vacancy No
VN1081
Business Unit
EMEA
Job Location
India
Employment Type
Full Time
Job Details and Responsibilities
We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.
Key Responsibilities:
Design and Development:
Key Responsibilities:
Design and Development:
- Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
- Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
- Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
- Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
- Develop and optimize data processing jobs using Spark Scala.
- Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
- Ensure data quality and integrity through rigorous testing and validation.
- Perform data extraction from SAP or ERP systems when necessary.
- Monitor and optimize the performance of data pipelines and ETL processes.
- Implement best practices for data management, including data governance, security, and compliance.
- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Collaborate with cross-functional teams to design and implement data solutions that meet business needs.
- Document technical solutions, processes, and workflows.
- Maintain and troubleshoot existing ETL pipelines and data integrations.
Qualifications
Education:
- Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.
- 7+ years of experience as a Data Engineer or in a similar role.
- Proven experience with cloud platforms: AWS, Azure, and GCP.
- Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
- Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
- Experience in building and managing data lakes and data warehouses.
- Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
- Experience with data extraction from SAP or ERP systems is a plus.
- Strong experience with Spark and Scala for data processing.
Skills:
- Strong programming skills in Python, Java, or Scala.
- Proficient in SQL and query optimization techniques.
- Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.
- Knowledge of data governance, security, and compliance best practices.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Experience with other data tools and technologies such as Apache Spark, or Hadoop.
- Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).
- Experience with CI/CD pipelines and DevOps practices for data engineering
- Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.
- Remote Working: Lemongrass always has been and always will offer 100% remote work
- Flexibility: Work where and when you like most of the time
- Training: A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful
- State of the art tech: An opportunity to learn and run the latest industry standard tools
- Team: Colleagues who will challenge you giving the chance to learn from them and them from you
About Lemongrass
Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.
Similar Jobs
View All
3 Hours ago
Data Analyst (Marathi Speakers)
AI & Machine Learning Advancement
- 1 - 1 Yrs
- India, Pune
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data...
1 Day ago
Lead DevOps Engineer
Information Technology
- 6 - 10 Yrs
- Bangalore
We’re Hiring: Lead DevOps Engineer
Location: On-site – Full time - Bangalore , India
Experience: 6–10 Years | Full-Time.
Are you passionate about cloud infrastructure, automation, and building scalable systems? Join our team as a Lead DevOps Eng...
1 Day ago
Java Developer
Information Technology
- 3 - 5 Yrs
- Bangalore, Gurgaon / Gurugram
We're Hiring: Java Developers!
Are you a passionate Java developer looking for your next big opportunity? Join our dynamic team and contribute to exciting projects that make an impact! We're looking for experienced Java developers to help us innov...
1 Day ago
Business Analyst Job
Information Technology
- Ahmedabad, Gujarat, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
1 Day ago
Senior Software Engineer (SQL and AWS.)
Information Technology
- Ahmedabad, Gujarat, India
FactSet creates flexible, open data and software solutions for over 200,000 investment professionals worldwide, providing instant access to financial data and analytics that investors use to make crucial decisions.At FactSet, our values are the foun...
1 Day ago
Senior Software Engineer_Java_Springboot
Information Technology
- Ahmedabad, Gujarat, India
About Lowe’sLowe’s Companies, Inc. (NYSE: LOW) is a FORTUNE® 50 home improvement company serving approximately 16 million customer transactions a week in the United States. With total fiscal year 2024 sales of more than $83 billion, Lowe’s operates ...
1 Day ago
Automation (Python and Selenium) Tester - Immediate
Information Technology
- Ahmedabad, Gujarat, India
We are seeking a proactive and detail-oriented Automation Tester with 1–2 years of hands-on experience in Python and Selenium to join our QA team. The ideal candidate will be responsible for designing, developing, and executing automated tests to en...
1 Day ago
REFU Drive - IT System Administrator
Information Technology
- Ahmedabad, Gujarat, India
Title : IT System Administrator.Location : Pune.OverviewREFU Drive India is looking for a hands-on IT System Administrator to manage our local IT infrastructure and provide on-site support for our team.This role covers a broad range of IT topics inc...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in