Senior Data Engineer

Overview

We are hiring for the Role of Remote: Senior Data Engineer with Data Bricks, AWS & AWS Glue Experience. Remote: Senior Data Engineer with Data Bricks, AWS & AWS Glue Experience Video Interview Job Summary: We are seeking a highly skilled and motivated Senior Data Engineer with hands-on experience in Databricks, Amazon Web Services (AWS), and AWS Glue. The ideal candidate will play a key role in designing, building, and maintaining scalable data pipelines and solutions that support our data analytics and business intelligence efforts. Key Responsibilities: Design, develop, and maintain large-scale data processing systems using Databricks and Apache Spark. Build ETL pipelines using AWS Glue, Lambda, and Step Functions for ingesting, transforming, and integrating data from diverse sources. Manage data workflows and ensure data quality, performance, and reliability across platforms. Collaborate with data scientists, analysts, and business stakeholders to understand requirements and translate them into scalable data solutions. Optimize and monitor data pipelines for performance, scalability, and cost-efficiency. Implement and manage data storage solutions using Amazon S3, Redshift, Lake Formation, and other AWS services. Apply best practices for data governance, security, and compliance. Automate repetitive tasks and contribute to CI/CD for data pipeline deployments. Maintain documentation for data architecture, processes, and workflows. Required Qualifications: Bachelor's or Master’s degree in Computer Science, Engineering, Information Systems, or related field. 8-10+ years of experience in Data Engineering or a similar role. Strong 5+ yrs. expertise in Databricks and Spark (PySpark or Scala). Proven experience with AWS services, especially Glue, S3, Lambda, Redshift, Step Functions, and CloudWatch. Proficient in writing complex SQL queries and data transformations. Experience with data modeling, schema design, and data lake architectures. Strong understanding of data security, IAM roles, and best practices in cloud environments. Preferred Qualifications: Experience with Airflow, Kafka, or other orchestration/streaming tools. Knowledge of Delta Lake, Unity Catalog, and Lakehouse architecture. Familiarity with Terraform, CloudFormation, or other Infrastructure-as-Code tools. AWS certification (e.g., AWS Certified Data Analytics – Specialty or Solutions Architect).

Job Type: Full-time

Pay: ₹1,800,000.00 - ₹1,900,000.00 per year

Schedule:

• Day shift

Work Location: Remote