Bangalore, Karnataka, India
Information Technology
Full-Time
Lyxel&Flamingo (L&F)
Overview
Key Responsibilities
- Develop, maintain, and optimize robust data ingestion and ETL/ELT pipelines using Python on the Databricks platform.
- Work collaboratively with the architecture team to align implementation with long-term data strategies.
- Leverage Delta Lake for data storage optimization and performance tuning.
- Utilize Prometheus for monitoring the health and performance of data pipelines and services.
- Ensure quality, reliability, and scalability of the data platform across multiple domains and use cases.
- Drive automation and reusability in data processing pipelines to reduce manual overhead.
- Participate in code reviews, peer programming, and continuous improvement efforts.
- Ensure adherence to best practices in coding, security, and documentation.
- Engage in team standups and collaborative sessions in the office 3 days a Skills :
- 5+ years of professional experience in Python development, primarily in data engineering use cases.
- Strong experience working with Databricks and Delta Lake.
- Proficient in SQL, data manipulation, and working with large-scale structured and semi-structured datasets.
- Hands-on experience with monitoring tools like Prometheus.
- Solid understanding of modern data architecture, especially around data lakes and distributed processing.
- Deep understanding of scalable system design, performance optimization, and best coding practices.
- Familiarity with CI/CD workflows and Git-based version Skills :
- Experience with Spark (especially PySpark).
- Exposure to other monitoring tools like Grafana, ELK stack, etc.
- Knowledge of cloud platforms such as AWS, Azure, or GCP.
- Understanding of data governance and security practices in enterprise Skills :
- Strong analytical and problem-solving skills.
- Excellent verbal and written communication.
- Ability to collaborate effectively across globally distributed teams.
- Proactive, self-motivated, and innovative mindset
Similar Jobs
View All
1 Day ago
Java Full Stack Developer
Information Technology
- Bangalore, Karnataka, India
Primary Skill - Java, Springboot, Angular, React.js Responsibilities: Lead and mentor a team of Java & Springboot Developers in the design, development, and maintenance of applications. Work with business stakeholders and technical teams to gather...
1 Day ago
Python Developer, Analyst, Firm Risk Management
Information Technology
- Bangalore, Karnataka, India
Morgan StanleyPython Developer - AnalystProfile DescriptionWe’re seeking someone to join our team as (Analyst - Python Developer) in (Credit Risk) division.Firm Risk ManagementIn the Firm Risk Management division, we advise businesses across the Fir...
1 Day ago
Junior SQL Developer/Software Integration Specialist
Information Technology
- Bangalore, Karnataka, India
Position : Junior SQL Developer / Software Integration SpecialistLocation : MumbaiExperience : Fresher or 1 Year of Relevant ExperienceJob Type : Full-timeDepartment : IT / DevelopmentKey skills : Sybase Power Builder/PB 6.5 /POWER BUILDERJob Overvi...
1 Day ago
Agile Coach
Information Technology
- Bangalore, Karnataka, India
Job PurposeResponsible to ensure a successful Agile adoption within the organization and thereby within the scrum teams and within the different organization disciplines. Lead the way to better deliver done-high-quality products, through continuous ...
1 Day ago
AWS Admin And AWS Architect
Information Technology
- Bangalore, Karnataka, India
Primary skills:Technology->IOT Platform->AWS IOT A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to get to the heart of customer issues, diagnose problem areas, design innovative solutions and fa...
1 Day ago
Machine Learning Engineer - Data Modeling
Information Technology
- Bangalore, Karnataka, India
Role : Machine Learning and AI EngineerExp : 4+ YearsType : HybridLocation : Bangalore We are looking for a skilled Mid-Level AI Engineer with extensive experience in building full-stack AI solutions. The ideal candidate will have a strong foundat...
1 Day ago
Interesting Job Opportunity: Target Integration - Principal Software Engineer - Node.js/Python
Information Technology
- Chennai, Tamil Nadu, India
Key Responsibilities Drive the end-to-end architecture, design, and implementation of robust, scalable, and secure software systems. Define technical standards, frameworks, and best practices, ensuring delivery excellence. Collaborate with stakeh...
1 Day ago
Ratnam Solutions - Senior Python Full Stack Developer - Django/React.js
Information Technology
- Chennai, Tamil Nadu, India
About The CompanyFounded in 2009, Ratnam Solutions Private Limited is a global technology provider specializing in web and product development services. With a track record of delivering scalable digital solutions across industries, we emphasize qua...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in