Bangalore, Karnataka, India
Information Technology
Full-Time
Ai Palette
Overview
Responsibilities
- Lead a team of data engineers specialising in data engineering, providing technical guidance, mentoring, and performance feedback.
- Optimise and automate processes for regularly refreshing the world's largest consumer data lake, purpose-built for CPG.
- Drive higher levels of automation and faster process (TAT) for weekly, monthly, and quarterly refresh processes.
- Drive initiatives for ongoing improvements in the quality and completeness of data on the platform
- Design, develop, and maintain spark data pipelines, ensuring efficient and timely data acquisition from various sources.
- Develop and enforce data engineering best practices, standards, and processes.
- Identify and resolve issues related to data engineering, such as handling complex data structures, mitigating bottlenecks, and addressing scale issues.
- Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and develop scalable data engineering solutions.
- Collaborate with stakeholders to define data engineering project requirements, timelines, and deliverables.
- Perform data extraction, transformation, and loading (ETL) tasks to convert raw data into usable formats for downstream analysis and processing.
- Monitor data pipeline performance and implement mechanisms to ensure the reliability and scalability of data pipelines.
- Stay up to date with the latest trends and advancements in data engineering techniques and related technologies.
- Bachelor's or master's degree in computer science, data engineering, or a related field.
- Proven experience (8+ years) working as a data engineer, with a specialisation in data engineering.
- Strong programming skills in languages such as Python, Java, and Spark Pipelines.
- Proficiency in SQL and database technologies (e.g., PostgreSQL, MySQL, or Oracle) for data storage and retrieval.
- Familiarity with cloud platforms (e.g., AWS, Azure, or Google Cloud) and related data services for scalable and reliable data crawling.
- Knowledge of data modeling, data warehousing, and ETL processes.
- Experience with data warehouses such as Snowflake, Redshift, Elastic Search
- Strong analytical and problem-solving skills, with a focus on data quality and accuracy.
- Excellent leadership and team management abilities, with a proven track record of leading data engineering teams.
- Effective communication and collaboration skills, with the ability to explain complex technical concepts to non-technical stakeholders
Similar Jobs
View All
4 Hours ago
Senior Vice President of Engineering
Information Technology
- 12 - 16 Yrs
- India
We are hiring a Senior Vice President (SVP) of Engineering for a high-growth, innovation-led cybersecurity company specializing in AI-powered security solutions. The company secures over 500 million+ devices, is backed by top-tier investors, and is t...
23 Hours ago
Senior Database Admin - SQL
Pharmaceuticals
- 7 - 12 Yrs
- Gurgaon / Gurugram
Job Summary
We are seeking an experienced Database Administrator to join our Shared Services IT team. In this role, you will design, implement, and maintain data management systems, ensuring security, compliance, and optimal performance. This posi...
23 Hours ago
Oracle cloud Functional Lead
Information Technology
- 30,00,000 - 35,00,000 INR - Annual
- 8 - 15 Yrs
- Bangalore, Chennai
We’re Hiring | Oracle Functional Consultant - Finance
Location: Chennai/ Bangalore, India
Domain: Finance
Responsibilities: ...
1 Day ago
Head of Product Engineering
Information Technology
- 8 - 12 Yrs
- Mumbai (All Areas)
Role Overview
We are seeking a visionary and hands-on Head of Product Engineering to lead and scale the product engineering function. This role involves full ownership of delivering a cutting-edge AI security product, ensuring it is scalable, secu...
1 Day ago
FP&A Analyst
Information Technology
- 12,00,000 - 15,00,000 INR - Annual
- 3 - 5 Yrs
- Bangalore
Key Responsibilities
Lead the planning and analysis cycle by building, updating, and refining quarterly and annual operating plans (AOP) across all geographies.
Conduct regular variance analysis (MIS) to explain actuals versus plan, identifyi...
1 Day ago
AWS/Azure Software Engineer
Information Technology
- 9 - 13 Yrs
- Chennai
Software Engineer III
Good Communication is mandatory
Shift :2:00 PM -11:00 PM
Yrs Of Exp : 9-13
Location : Chennai (Work from office )
Budget : 1.9 Lac Per month
Notice period - Maximum 20 days
EDUCATION - Bachelor's Degree or e...
1 Day ago
Tech Lead
Information Technology
- 6 - 10 Yrs
- Mumbai
Job Profile
Position: Tech Lead / Engineering Manager
Location: Mumbai
Qualification: Master’s in Computer Science, Engineering, or related technical discipline
Key Responsibilities
• Lead and manage a cross-functional team of Flutter,...
1 Day ago
Senior Software Engineer I
Information Technology
- Bangalore, Karnataka, India
This job is with Elsevier, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Would you like to be part of a team that delivers high-quality s...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in