Senior Data Engineer

Job Title: Lead Data Engineer / Associate Architect

Location: Hyderabad (Hybrid)

Experience: 8–12+ years

Key Skills: Python, SQL, Snowflake (Mandatory)

Job Summary

We are seeking a seasoned Lead Data Engineer / Associate Architect to design and implement scalable, high-performance data solutions. This role requires deep expertise in data architecture, cloud platforms, ETL/ELT pipelines, and big data technologies. You'll collaborate across teams to build modern data infrastructure supporting analytics, AI, and ML initiatives.

Key Responsibilities

• Data Architecture: Design scalable, resilient architectures for analytics and AI/ML workloads.
• Pipeline Development: Build and manage robust ETL/ELT pipelines for data ingestion, transformation, and storage.
• Cloud & Big Data: Architect solutions using Snowflake, Redshift, BigQuery, or Databricks on AWS, Azure, or GCP.
• Database Optimization: Optimize performance via indexing, query tuning, and efficient data storage (SQL & NoSQL).
• Governance & Security: Ensure compliance, data quality, metadata management, and secure access.
• Collaboration: Partner with engineers, analysts, and stakeholders to deliver scalable, business-aligned solutions.
• Innovation: Evaluate and adopt emerging technologies to enhance data engineering practices.

Required Qualifications

• Education: Bachelor’s/Master’s in Computer Science, Data Engineering, or related field.
• Experience: 8–12+ years in data engineering and architecture.
• Cloud: Proficient in AWS data services; Azure/GCP experience is a plus.
• Big Data: Hands-on with Hadoop, Spark, Kafka, etc.
• Databases: Advanced SQL skills; experience with NoSQL and columnar stores (PostgreSQL, MongoDB, Cassandra, Snowflake).
• Programming: Expert in Python (mandatory); Scala/Java is a plus.
• ETL Tools: Proficient in Airflow, Talend, DBT, or Informatica.
• AI/ML Support (Preferred): Exposure to data architectures enabling AI/ML development and deployment.