Hyderabad, Telangana, India
Information Technology
Full-Time
Etelligens Technologies
Overview
Job Description
We are seeking a skilled Data Engineer with hands-on experience in Azure Data Factory, DataBricks, ETL pipelines, and strong Python/Spark scripting skills. The ideal candidate should have a solid background in data integration, migration, and data warehouse concepts, with the ability to manage and support end-to-end data engineering solutions in a modern Azure environment.
Key Responsibilities
(ref:hirist.tech)
We are seeking a skilled Data Engineer with hands-on experience in Azure Data Factory, DataBricks, ETL pipelines, and strong Python/Spark scripting skills. The ideal candidate should have a solid background in data integration, migration, and data warehouse concepts, with the ability to manage and support end-to-end data engineering solutions in a modern Azure environment.
Key Responsibilities
- Design, develop, and implement ETL solutions using Azure Data Factory and DataBricks.
- Write scalable and reusable Python and Spark scripts for data processing, cleansing, and transformation.
- Perform data cleansing and migration from diverse sources to target systems.
- Collaborate with stakeholders to understand requirements and convert them into technical
- Code using PySpark or Pysense within DataBricks to enable advanced analytics solutions.
- Work extensively with SQL Server and other RDBMS systems, writing efficient SQL, T-SQL, and PL/SQL queries and stored procedures.
- Support, troubleshoot, and maintain data pipelines and workflows.
- Participate in all phases of software development lifecycle including unit testing, integration
- Contribute to the modernization of data platforms and analytics tools on Azure.
- Ensure data quality and integrity across all pipelines and systems.
- 5 - 8 years of experience in delivering end-to-end ETL projects using SSIS or similar tools.
- Minimum 1.5 - 2 years of experience in Azure Data Factory.
- 1+ year of experience in Python and Spark scripting.
- Proficiency in SQL/T-SQL/PL-SQL, stored procedures, and database performance tuning.
- Good understanding of Data Warehousing (DWH) concepts.
- Knowledge of modern Azure ecosystem, including Azure Data Lake, Blob Storage, and Synapse (preferred).
- Experience with DataBricks, especially PySpark or Pysense (advantageous).
- Hands-on experience in data cleansing, transformation, and migration projects.
- Ability to work independently and within a team environment.
- Microsoft Certified : Azure Data Engineer Associate
- Databricks Certified Data : B. Tech / BCA / MCA (Computer Science)
(ref:hirist.tech)
Similar Jobs
View All
1 Day ago
Program Manager
Information Technology
- 15 - 18 Yrs
- Gurgaon / Gurugram
We’re Hiring | Program Manager
Location: Gurugram, India
Domain: Program Management | Digital Systems | Java/.NET | Agile | Fintech/Supply Chain
Are you a strategic thinker with deep experience in program management of digital products? We’re lo...
1 Day ago
Technical Fullstack Architect - Node.js
Information Technology
- 50,00,000 - 60,00,000 INR - Annual
- 12 - 18 Yrs
- Hyderabad
About the Role:
We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
1 Day ago
Principal Engineer - Fullstack
Information Technology
- 30,00,000 - 40,00,000 INR - Annual
- 8 - 12 Yrs
- Mumbai
Looking for candidate who is enthusiastic to work in a Startup environment and build things from Scratch individually
Candidate has past experience in scalable consumer facing applications managing latency and traffic FullStack Individual Contribu...
1 Day ago
Asst. Manager / Dy. Manager – Talent Acquisition
Automotive
- 4,00,000 - 8,00,000 INR - Yearly
- 4 - 8 Yrs
- West Bengal
We are looking for dynamic and experienced professionals for the Talent Acquisition team at our Kharagpur Plant location. The incumbent will be responsible for managing the full-cycle recruitment process for both technical and functional roles across...
1 Day ago
Software Developer
Cybersecurity & Privacy
- 2 - 5 Yrs
- Gujarat, Maharashtra
Summary role description:
Hiring for a Solution Architect – Databricks for global technology consulting and system integration firm specializing in data engineering, AI and ML.
Company description:
Our client is a US-headquartere...
2 Days ago
Axis My India - Data Analyst - Python/Pandas
Pharmaceuticals
- Hyderabad, Telangana, India
About The CompanyAxis My India is Indias foremost Consumer Data Intelligence Company, which in partnership with Google is building a single-stop People Empowerment Platform, the a app, that aims to change peoples awareness, accessibility, and utiliz...
2 Days ago
Data Engineer
Pharmaceuticals
- Hyderabad, Telangana, India
Job Title - Data EngineerAbout TazapayTazapay is a cross border payment service provider. They offer local collections via local payment methods, virtual accounts and cards in over 70 markets. The merchant does not need to create local entities anyw...
2 Days ago
Master Data Analyst – Application Support
Pharmaceuticals
- Hyderabad, Telangana, India
About Inchcape Shipping ServicesAt Inchcape, our vision is to have a connected world, in which our customers trade successfully and make better decisions in every port, everywhere. We use technology and our global network to help our partners connec...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in