Free cookie consent management tool by TermsFeed Senior Data Engineer- Databricks | Antal Tech Jobs
Back to Jobs
3 Days ago

Senior Data Engineer- Databricks

decor
Ganganagar, Rajasthan, India
Information Technology
Full-Time
AuxoAI

Overview

Role Summary

AuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 6-10 years of prior experience in data engineering, with a strong background in Databricks. This role offers an exciting opportunity to work on diverse projects, collaborating with cross-functional teams to design, build, and optimize data pipelines and infrastructure.

Responsibilities

  • Designing, building, and operating scalable on-premises or cloud data architecture
  • Analyzing business requirements and translating them into technical specifications
  • Design, develop, and implement data engineering solutions using Databricks on cloud platforms (AWS, Azure)
  • Design, develop, and maintain scalable data pipelines and ETL processes
  • Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learning initiatives.
  • Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness
  • Implement data governance and security best practices to ensure compliance and data integrity
  • Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring
  • Stay abreast of emerging technologies and industry trends, recommending innovative solutions to enhance data engineering capabilities.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Overall 6-10 years of prior experience in data engineering, with a focus on designing and building data pipelines
  • 6+ years experience in Databricks and Spark in at least two end-to-end data engineering implementations
  • Comprehensive understanding of the Databricks products and ecosystem
  • Strong programming skills in languages such as Python, Scala, or SQL.
  • Experience with data modeling, ETL processes, and data warehousing concepts.
  • Familiarity with containerization technologies orchestration tools is a plus.
Share job
Similar Jobs
View All
1 Day ago
Onsurity - Web Developer - Frontend Technologies
Information Technology
Role OverviewWere looking for a Web Developer with a marketing mindset - someone whos equally comfortable building landing pages as they are integrating tools and optimizing performance.Youll work closely with the marketing and tech teams to build a...
decor
1 Day ago
Senior Network Operations Engineer
Information Technology
Job DescriptionIn this role you will: Identifying actionable incidents using a monitoring system, strong analytical problem-solving skills to mitigate network events/incidents, and following up on routine root cause analysis (RCA), coordinating with...
decor
1 Day ago
Senior Data Analyst (Fixed term 24 months)
Information Technology
V ABB pomáháme průmyslovým odvětvím být o krok napřed. U nás je pokrok samozřejmostí - pro vás, váš tým i celý svět. Jako světová jednička na trhu vám poskytneme to, co potřebujete, abyste toho dosáhli. Nebude to vždy snadné, růst vyžaduje odvahu. A...
decor
1 Day ago
Senior Network Operations Engineer
Information Technology
Job DescriptionIn this role you will: Identifying actionable incidents using a monitoring system, strong analytical problem-solving skills to mitigate network events/incidents, and following up on routine root cause analysis (RCA), coordinating with...
decor
1 Day ago
Azure Databricks/Senior Business Analyst
Information Technology
Job DescriptionSome careers shine brighter than others.If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new ...
decor
1 Day ago
Fusion Practices - SQL Developer - Data Warehousing
Information Technology
About The RoleFusion Practices is looking for a highly skilled SQL Developer with large-scale data warehouse environments.ResponsibilitiesThe ideal candidate will bring strong expertise in Microsoft SQL Server, Power BI, along with hands-on exposure...
decor
1 Day ago
Senior Network Operations Engineer
Information Technology
Job DescriptionIn this role you will: Identifying actionable incidents using a monitoring system, strong analytical problem-solving skills to mitigate network events/incidents, and following up on routine root cause analysis (RCA), coordinating with...
decor
1 Day ago
Python Data Analyst (Projects-Based Internship)
Information Technology
Python Data Analyst (Projects-Based Internship) Are you ready to kickstart your data analytics journey with hands-on, real-world projects? 🚀 We are offering a 1-Month Python Data Analyst Internship where students and freshers will gain industry-leve...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media