Ganganagar, Rajasthan, India
Information Technology
Full-Time
Arting Digital
Overview
Posting title : Lead Data Engineer (Databricks)
Experience : 7+ Years
Location : Pune/ Ahmedabad
Work mode : Hybrid
Primary skills : Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team Lead
Qualification : Any Technical Degree
Roles & Responsibilities
Experience : 7+ Years
Location : Pune/ Ahmedabad
Work mode : Hybrid
Primary skills : Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team Lead
Qualification : Any Technical Degree
Roles & Responsibilities
- Lead the design, development, and optimization of data solutions using Databricks, ensuring they are scalable, efficient, and secure.
- Collaborate with cross-functional teams to gather and analyse data requirements, translating them into robust data architectures and solutions.
- Develop and maintain ETL pipelines, leveraging Databricks and integrating with Azure Data Factory as needed.
- Implement machine learning models and advanced analytics solutions, incorporating Generative AI to drive innovation.
- Ensure data quality, governance, and security practices are adhered to, maintaining the integrity and reliability of data solutions.
- Provide technical leadership and mentorship to junior engineers, fostering an environment of learning and growth.
- Stay updated on the latest trends and advancements in data engineering, Databricks, Generative AI, and Azure Data Factory to continually enhance team Qualifications :
- Bachelors or masters degree in computer science, Information Technology, or a related field.
- 7+ to 10 years of experience in data engineering, with a focus on Databricks.
- Proven expertise in building and optimizing data solutions using Databricks and integrating with Azure Data Factory/AWS Glue.
- Proficiency in SQL and programming languages such as Python or Scala.
- Strong understanding of data modelling, ETL processes, and Data Warehousing/Data Lakehouse concepts.
- Familiarity with cloud platforms, particularly Azure, and containerization technologies such as Docker.
- Excellent analytical, problem-solving, and communication skills.
- Demonstrated leadership ability with experience mentoring and guiding junior team members.
- Experience with Generative AI technologies and their applications.
- Familiarity with other cloud platforms, such as AWS or GCP.
- Knowledge of data governance frameworks and tools.
Similar Jobs
View All
1 Day ago
Onsurity - Web Developer - Frontend Technologies
Information Technology
Role OverviewWere looking for a Web Developer with a marketing mindset - someone whos equally comfortable building landing pages as they are integrating tools and optimizing performance.Youll work closely with the marketing and tech teams to build a...
1 Day ago
Senior Network Operations Engineer
Information Technology
Job DescriptionIn this role you will: Identifying actionable incidents using a monitoring system, strong analytical problem-solving skills to mitigate network events/incidents, and following up on routine root cause analysis (RCA), coordinating with...
1 Day ago
Senior Data Analyst (Fixed term 24 months)
Information Technology
V ABB pomáháme průmyslovým odvětvím být o krok napřed. U nás je pokrok samozřejmostí - pro vás, váš tým i celý svět. Jako světová jednička na trhu vám poskytneme to, co potřebujete, abyste toho dosáhli. Nebude to vždy snadné, růst vyžaduje odvahu. A...
1 Day ago
Senior Network Operations Engineer
Information Technology
Job DescriptionIn this role you will: Identifying actionable incidents using a monitoring system, strong analytical problem-solving skills to mitigate network events/incidents, and following up on routine root cause analysis (RCA), coordinating with...
1 Day ago
Azure Databricks/Senior Business Analyst
Information Technology
Job DescriptionSome careers shine brighter than others.If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new ...
1 Day ago
Fusion Practices - SQL Developer - Data Warehousing
Information Technology
About The RoleFusion Practices is looking for a highly skilled SQL Developer with large-scale data warehouse environments.ResponsibilitiesThe ideal candidate will bring strong expertise in Microsoft SQL Server, Power BI, along with hands-on exposure...
1 Day ago
Senior Network Operations Engineer
Information Technology
Job DescriptionIn this role you will: Identifying actionable incidents using a monitoring system, strong analytical problem-solving skills to mitigate network events/incidents, and following up on routine root cause analysis (RCA), coordinating with...
1 Day ago
Python Data Analyst (Projects-Based Internship)
Information Technology
Python Data Analyst (Projects-Based Internship) Are you ready to kickstart your data analytics journey with hands-on, real-world projects? 🚀 We are offering a 1-Month Python Data Analyst Internship where students and freshers will gain industry-leve...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in