Information Technology
Full-Time
MagellanicCloud
Overview
Responsibilities
- Design, develop, and maintain scalable and efficient ETL pipelines using Azure Data Factory (ADF).
- Leverage PySpark and Databricks to process and transform large datasets.
- Build and optimize data models and data warehouse solutions on Azure.
- Write complex SQL queries for data extraction, manipulation, and analysis.
- Implement data quality checks and monitoring to ensure data accuracy and reliability.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver robust data solutions.
- Troubleshoot and resolve data pipeline issues and performance bottlenecks.
- Stay up-to-date with the latest advancements in data engineering technologies and best practices.
- Contribute to the development and maintenance of data engineering standards and Skills :
- Strong proficiency in PySpark for large-scale data processing.
- Extensive experience with Microsoft Azure cloud services.
- Hands-on expertise in building ETL pipelines using Azure Data Factory (ADF).
- Proven experience with Databricks for data engineering and analytics.
- Solid understanding of ETL (Extract, Transform, Load) concepts and methodologies.
- Excellent SQL skills for data querying and :
- Bachelor's degree in Engineering (B.) or Bachelor of Technology (B.Tech) in Computer Science, Information Technology, or a related field
Similar Jobs
View All
2 Days ago
Python Developer
Information Technology
- Bangalore, Karnataka, India
We are looking for a highly skilled Python Developer to join our team in building and optimizing advanced AI/ML frameworks. As a Python Developer in our AI/ML team, you will be responsible for creating, implementing, and scaling innovative machine le...
2 Days ago
Web Developer
Information Technology
- 400000 - 400000 Indian Rupee - Yearly
- Bangalore, Karnataka, India
C#.NET Web Developer Location: On-site | Type:Experienced, In-Office Full-time, Permanent Required Experience: Min-2years and Max-3years CTC: ₹4LPASantronix is a team driven by passion for excellence in software srevices. We are looking forward to...
2 Days ago
LLM AI Engineer
Information Technology
- Bangalore, Karnataka, India
Summary Gainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large La...
2 Days ago
Product Security Engineer
Information Technology
- 3 - 6 Yrs
- Noida
Role: Product Security Engineer
Experience: 3+ Years
Location: Noida
Job Description:
Security Specialist in areas of Security Vulnerability Assessment & Penetration Testing. Responsible for periodic assessment and implementation of remediation...
2 Days ago
Sr. DevOps Engineer
Information Technology
- 7 - 12 Yrs
- Mumbai
ComUnus is hiring for Sr. DevOps Engineer
No Of Position : 3
Exp. Req : 7+ Yrs
Work Location : Mumbai (Vikhroli)
Max NP : Immediate Joiners are preferred
Must Have Skills : AWS
Key Responsibilities:
1. 7+ years of Hands-On experience as De...
3 Days ago
Java FullStack developer
Information Technology
- Bangalore, Karnataka, India
Urgent opening for Java FullStack developer (Java+React)Job Title: Full Stack Developer (Java+ ReactJS)Experience: 5 – 10 YearsSalary: Up to 38 LPALocation: RemoteNotice Period:immediate to 15 days(take candidate who are in serving notice period only...
3 Days ago
Senior Data Analyst
Information Technology
- Bangalore, Karnataka, India
As a Data Analyst, you should be able to propose creative solutions to develop/solve a business problem. Should be able to recommend design and develop state-of-the-art data-driven analysis using statistical; understating of advanced analytics method...
3 Days ago
Refrigeration & Energy Systems - Data Analytics Engineer
Information Technology
- Bangalore, Karnataka, India
Join Energy Recovery and Help Build a Sustainable Future At Energy Recovery, we build products that help limit global temperature rise, reduce carbon emissions, provide safe drinking water for millions of people, and bring efficiency and sustainabil...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in