Information Technology
Full-Time
AuxoAI
Overview
Job Description
- Designing, building, and operating scalable on-premises or cloud data architecture
- Analyzing business requirements and translating them into technical specifications
- Design, develop, and implement data engineering solutions using Databricks on cloud platforms (AWS, Azure)
- Design, develop, and maintain scalable data pipelines and ETL processes
- Collaborate with data scientists and analysts to understand data requirements and implement solutions
- Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness
- Implement data governance and security best practices to ensure compliance and data integrity
- Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring
- Stay abreast of emerging technologies and industry trends, recommending innovative solutions to enhance data engineering capabilities.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Overall 6- 10 years of prior experience in data engineering, with a focus on designing and building data pipelines
- 5+ years experience in Databricks and Spark in at least two end-to-end data engineering implementations
- Comprehensive understanding of the Databricks products and ecosystem
- Strong programming skills in languages such as Python, Scala, or SQL.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Familiarity with containerization technologies orchestration tools is a plus.
Similar Jobs
View All
1 Day ago
Automation DevOps Engineer / Senior Consultant Specialist
Information Technology
About the job:Key responsibilities: 1 - Work closely with product and delivery teams to support BAU and project deliveries. 2 - Collaborate with architects to plan and design effective technical solutions. 3 - Manage compliance and address vulnerab...
1 Day ago
Software Engineer – Enterprise Switching
Information Technology
About the job:Key responsibilities: 1. Contribute your talents to Cisco's Switching technology, the networking equipment of choice for large enterprises. 2. Develop and integrate products used by leading enterprises worldwide. 3. Collaborate with...
1 Day ago
VAYUZ Technologies - Java Developer - Microservices Architecture
Information Technology
Job DescriptionKey Responsibilities : Design, develop, and maintain Java-based microservices solutions. Build and integrate services leveraging Kafka for real-time event streaming. Participate in solution design discussions, ensuring scalable and...
1 Day ago
Consultant Technical Lead - MSSQL DBA Admin & Public Cloud Expert
Information Technology
Reference 25000HEOResponsibilitiesWe are seeking a highly skilled Cloud Developer & Support Engineer to design, develop, and support our cloud-based products and infrastructure. The ideal candidate will have deep technical expertise in AWS and Azure...
1 Day ago
Senior Software Engineer
Information Technology
About the job:Key responsibilities: 1. Develop and integrate products used by leading enterprises worldwide. 2. Work on the IOS XE OS, the backbone of many enterprise devices. 3. Collaborate with a vibrant technical community and learn from domai...
1 Day ago
XTEN-AV - Full Stack Developer - Python/Django
Information Technology
Full Stack DeveloperLocation : NoidaCompany : XTEN-AVAbout XTEN-AVXTEN-AV is a leading professional AV design platform that leverages AI to automate AV drawings and documentation. Our platform empowers AV designers, integrators, and manufacturers to...
1 Day ago
Customer Crisis Business Analyst
Information Technology
Amex GBT is a place where colleagues find inspiration in travel as a force for good and – through their work – can make an impact on our industry. We’re here to help our colleagues achieve success and offer an inclusive and collaborative culture whe...
1 Day ago
Senior Manager, DevOps Engineer
Information Technology
Job DescriptionSenior Manager, DevOps EngineerThe Opportunity Based in Hyderabad, join a global healthcare biopharma company and be part of a 130- year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achi...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in