Gurugram, Haryana, India
Information Technology
Full-Time
Egen
Overview
Job Overview:
We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery
- Implement and enforce data quality checks, validation rules, and monitoring
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL
- Document pipeline designs, data flow diagrams, and operational support procedures
- 4–6 years of hands-on experience in Python for backend or data engineering projects
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.)
- Solid understanding of data pipeline architecture, data integration, and transformation techniques
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.)
- Experience working with Snowflake cloud data platform
- Hands-on knowledge of Databricks for big data processing and analytics
- Familiarity with Azure Data Factory (ADF) and other Azure data engineering tools
Similar Jobs
View All
1 Day ago
Embedded Software Engineer - C/C++ Programming
Information Technology
- Hyderabad, Telangana, India
Digantara is a leading Space Surveillance and Intelligence company focused on ensuring orbital safety and sustainability.With expertise in space-based detection, tracking, identification, and monitoring, Digantara provides comprehensive domain aware...
1 Day ago
Senior Full Stack Developer - IoT / Enterprise Platform
Information Technology
- Hyderabad, Telangana, India
Job Title: Senior Full Stack Developer - IoT / Enterprise PlatformGrade - D1Introduction to roleAre you ready to make a difference at AstraZeneca, a global leader in biopharmaceuticals? Join our dynamic IT team where innovation meets impact. We offe...
1 Day ago
Interesting Job Opportunity: Automation Test Engineer - Python
Information Technology
- Hyderabad, Telangana, India
We are seeking an experienced and motivated Python Device Test Automation Engineer to join our Quality Engineering team.The ideal candidate will have strong expertise in scripting with Python and working with modern test automation frameworks and to...
1 Day ago
Oracle PL/SQL Developer
Information Technology
- Hyderabad, Telangana, India
3+ years of experience in Implementation, Development, and Support projects related to Oracle PL/SQL-based Enterprise Applications. In-depth knowledge of Oracle PL/SQL programming, including functions, procedures, triggers, packages, and performan...
1 Day ago
LoanIQ Java Developer/Consultant Specialist
Information Technology
- Hyderabad, Telangana, India
Job DescriptionSome careers shine brighter than others.If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new ...
1 Day ago
eMedEvents - Senior Software Tester - Manual & Automation Testing
Information Technology
- Hyderabad, Telangana, India
Job Title : Senior Software Tester.Location : Hyderabad.Department : Quality Assurance.Job Type : Full-Time.Job SummaryWe seek a highly skilled and experienced Senior Software Tester with a strong background in automation and manual testing.The idea...
1 Day ago
Senior AI Engineer (Remote)
Information Technology
- Hyderabad, Telangana, India
At Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company where product innovation and mature software engineering are embedded in our core DNA. Our core values of Respect, Fairness, Growt...
1 Day ago
Chryselys - Data Engineer - Python/ETL
Information Technology
- Hyderabad, Telangana, India
We're looking for talented and experienced Data Engineering Professionals to join our growing team in Hyderabad! We have multiple openings for individuals with a strong background in data engineering, ready to contribute to innovative projects in a ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in