Pune, Maharashtra, India
Information Technology
Full-Time
Revalsys Technologies
Overview
Title : Data Engineer
About The Role
We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in Databricks, Python, and SQL.
Key Responsibilities
Core Technologies :
About The Role
We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in Databricks, Python, and SQL.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks (PySpark) on Azure/AWS/GCP.
- Develop clean, reusable, and performant Python code for data ingestion, transformation, and quality checks.
- Write efficient and optimized SQL queries for querying structured and semi-structured data.
- Work with stakeholders to understand data requirements and implement end-to-end data workflows.
- Perform data profiling, validation, and ensure data quality and integrity.
- Optimize data pipelines for performance, reliability, and integrate data from various sources APIs, flat files, databases, cloud storage e.g., S3, ADLS.
- Build and maintain delta tables using Delta Lake format for ACID-compliant streaming and batch pipelines.
- Work with Databricks Workflows to orchestrate pipelines and scheduled jobs.
- Collaborate with DevOps and cloud teams to ensure secure, scalable, and compliant infrastructure.
Core Technologies :
- Databricks Spark on Databricks, Delta Lake, Unity Catalog
- Python with strong knowledge of PySpark
- SQL Advanced level joins, window functions, CTEs, & Orchestration :
- Databricks Workflows / Jobs
- Airflow, Azure Data Factory, or similar orchestration tools
- Auto Loader, Structured Streaming Platforms Any one or more :
- Azure Databricks on Azure, ADLS, ADF, Synapse
- AWS Databricks on AWS, S3, Glue, Redshift
- GCP Dataproc, BigQuery, GCS
- Experience working with Delta Lake, Parquet, Avro
- Understanding of dimensional modeling, data lakes, and lakehouse & Version Control :
- CI/CD pipelines for Databricks via Git, Azure DevOps, or Jenkins
- Logging, debugging, and monitoring with tools like Datadog, Prometheus, or Cloud-native tools
- Knowledge of MLflow, Feature Store, or MLOps workflows
- Experience with REST APIs, JSON, and data ingestion from 3rd-party services
- Familiarity with DBT Data Build Tool or Great Expectations for data quality
- Strong analytical, problem-solving, and debugging skills
- Clear communication and documentation skills
- Ability to work independently and within cross-functional teams
- Agile/Scrum working experience
Similar Jobs
View All
18 Hours ago
Principal Engineer - UI/UX
Information Technology
- 6 - 11 Yrs
- Mumbai (All Areas)
looking for a technically savvy and experienced Principal Engineer to take up front-end development efforts. You will design and develop elegant interfaces that exceed client expectations in terms of value and benefit. You will collaborate on scalabi...
18 Hours ago
Principal Engineer - Beckend
Information Technology
- 7 - 11 Yrs
- Mumbai (All Areas)
Principal Engineer - Backend
Mumbai, Maharashtra, India | Product Engineering | Full-time
We are looking for a technically savvy and experienced senior developer to lead development efforts. You will help the team grow in size and skills, optim...
18 Hours ago
Principal Engineer - DevOps/DBA
Information Technology
- 7 - 11 Yrs
- Mumbai (All Areas)
we are looking for a technically savvy and passionate Principal DevOps Engineer or Senior Database Administrator to cater to the development and operations efforts in product. You will choose and deploy tools and technologies to build and support a r...
20 Hours ago
C++ Developer | 5 - 8 Years
Information Technology
- 30 - 45 INR - Yearly
- 5 - 12 Yrs
- Pune
About the Client:
The company has been a global leader in delivering cutting-edge in-flight entertainment and connectivity (IFEC) solutions for over 40 years.
About the Role:
Title:
SDE 3 C++ - 5 to 8 Years
SDE 4 C++ - 8 to 13 Years
...
1 Day ago
Software Engineer II - Java, Python, AWS, Pyspark, DPL
Finance & Banking
- Bangalore, Karnataka, India
hackajob is collaborating with J.P. Morgan to connect them with exceptional tech professionals for this role.Organization DescriptionOur Consumer & Community Banking division serves our Chase customers through a range of financial services, includin...
1 Day ago
Lead Software Engineer- Devportal Node fullstack
Finance & Banking
- Bangalore, Karnataka, India
Reference 25000GPGResponsibilities In-depth knowledge of UI development with React JS, Java script, Type script including its core principles and workflows. Expertise on backend development with Node Js and framework nest JS Familiarity with version...
1 Day ago
QA Engineer (Manual & Automation) in Delhi, Faridabad, Gurgaon, Noida (Hybrid)
Finance & Banking
- Bangalore, Karnataka, India
We are looking for a talented 'QA engineer (automation + manual)' to join our team at AppQuarterz Technologies! As a 'QA engineer', you will play a crucial role in ensuring the quality and performance of our software products.Key Responsibilities D...
1 Day ago
Software Engineer III - Infrastructure
Finance & Banking
- Bangalore, Karnataka, India
hackajob is collaborating with J.P. Morgan to connect them with exceptional tech professionals for this role.Job DescriptionEmpowering projects with innovative technical solutions, our team excels in optimizing data and systems at scale while ensuri...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in