Data Engineer/Architect

Overview

Position: Data Engineer / Data Architect
Location: Pune / Hyderabad
Employment Type: Full-Time / Contract
Overall Experience: 5-15+ years

Job Summary:

We are seeking an experienced Data Engineer / Architect with strong expertise in PySpark development to join our team. The ideal candidate will have hands-on experience in designing, developing, and maintaining ETL pipelines, particularly in GCP, and a deep understanding of cloud-based architectures and data engineering processes. If you are passionate about building scalable, reliable, and high-performance data solutions, we would love to hear from you!

Responsibilities:

• Design, develop, and maintain DataStage ETL jobs according to business specifications.
• Optimize existing ETL processes for performance improvements and efficiency.
• Develop and manage PySpark scripts to process large datasets efficiently.
• Architect and build scalable, reliable, and cloud-based data engineering solutions using GCP (Google Cloud Platform).
• Collaborate with cross-functional teams to implement and support QlikSense Dashboards, with hands-on experience in QlikSense development and dashboard design.
• Utilize tools like Apache Airflow, Cloud Composer, and Data Flow to automate and orchestrate data workflows.
• Stay up-to-date with emerging trends and technologies in software development and data engineering.
• Apply Agile practices and methodologies to ensure timely delivery and high-quality solutions.
• Work with Marketing Technology (MarTech) platforms such as Tealium, Lytics, and other Customer Data Platforms (CDPs) to integrate data across systems.

Key Skills:

• 8+ years of hands-on experience in cloud application architecture, creating scalable and reliable software systems.
• 8+ years of experience working with Google Cloud Platform (GCP), including BigQuery, ETL tools, and cloud-native services.
• Expertise in PySpark for data processing.
• Experience with ETL processes, automation, and data orchestration using Apache Airflow, Cloud Composer, and Data Flow.
• Strong understanding of DataStage and experience developing ETL jobs.
• Knowledge of MarTech tools like Tealium, Lytics, or any other Customer Data Platforms (CDPs).
• Experience in the end-to-end design, development, implementation, and support of large-scale QlikSense Dashboards.
• Proficient in Python for data engineering tasks.

Desirable Skills:

• Experience working with SEO, Ads, Visualization, or Reporting (not mandatory, but a plus).
• Familiarity with Agile practices and ability to adapt to fast-paced, dynamic work environments.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related fields.
• 14-15+ years of overall experience in Data Engineering or Data Architecture roles, with a focus on cloud platforms and big data technologies.

Job Type: Full-time

Pay: ₹500,000.00 - ₹2,000,000.00 per year

Application Question(s):

• Total years of relevant experience?
• Current Location?
• Current CTC?
• Expected CTC?
• Notice Period in days ?
• Please rate your English communication skills out of 10 (1 is lowest and 10 is highest)
• Are you ok to work from office ?
• Please mention your technical skills relevant for this job role

Work Location: In person