Free cookie consent management tool by TermsFeed Senior Data Engineer | Antal Tech Jobs
Back to Jobs
3 Days ago

Senior Data Engineer

decor
Pune, MH, India
Information Technology
Other
Luxoft

Overview

Project description

Provide End to End Development solution to one of the largest investment banking products by scaling up the latest technology stack by adopting the cloud based services under Client Life Cycle Management area

Responsibilities

Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.

Constructing infrastructure for efficient ETL processes from various sources and storage systems.

Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.

Leading the implementation of algorithms and prototypes to transform raw data into useful information.

Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI/ML transformations.

Creating innovative data validation methods and data analysis tools.

Ensuring compliance with data governance and security policies.

Interpreting data trends and patterns to establish operational alerts.

Developing analytical tools, programs, and reporting mechanisms.

Conducting complex data analysis and presenting results effectively.

Preparing data for prescriptive and predictive modeling.

Continuously exploring opportunities to enhance data quality and reliability.

Applying strong programming and problem-solving skills to develop scalable solutions.

Skills

Must have

10+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.

High proficiency in Scala/Java and Spark for applied large-scale data processing.

Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.

Solid understanding of batch and streaming data processing techniques.

Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.

Expert-level ability to write complex, optimized SQL queries across extensive data volumes.

Experience with RDBMS and OLAP databases like MySQL, Redshift.

Familiarity with Agile methodologies.

Obsession for service observability, instrumentation, monitoring, and alerting.

Knowledge or experience in architectural best practices for building data lakes.

Nice to have

Passion for testing strategy, problem-solving, and continuous learning.

Willingness to acquire new skills and knowledge.

Possess a product/engineering mindset to drive impactful data solutions.

Experience working in distributed environments with global teams.

Other

Languages

English: C2 Proficient

Seniority

Senior


Pune, India

Req. VR-123368

Data Platform Engineering

BCM Industry

09/06/2026

Req. VR-123368

Share job
Similar Jobs
View All
1 Day ago
Senior Associate - Business Analyst
Information Technology
  • Pune, MH, India
Job Description Job purpose The Business Analyst will play a critical role in supporting private equity operations by bridging business, data, and technology teams. With strong exposure to fund data lifecycle and reporting processes, the role focuses...
decor
1 Day ago
Data Scientist
Information Technology
  • Pune, MH, India
Job Description: The Airbus India Innovation Centre (AIC) is at the forefront of the company’s digital transformation, particularly within the Innovation and Engineering departments. As we move towards Industrialisation of AI, the department focuses ...
decor
1 Day ago
Senior Mobile Android Developer-Assistant Vice President
Information Technology
  • Pune, MH, India
Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your c...
decor
1 Day ago
Business Analyst
Information Technology
  • Pune, MH, India
Job Description Business Advisors shape the vision with the client, understand the needs of the users/stakeholders, carry out an elicitation of processes, data and capabilities and derive the target processes and the business requ...
decor
1 Day ago
Business Analyst
Information Technology
  • Pune, MH, India
Job Summary:We are seeking a motivated and detail-oriented Business Analyst to join our team. The ideal candidate will assist in gathering and analyzing business requirements, identifying process improvements, and supporting project implementation....
decor
1 Day ago
Software Engineer III - AI/ML, Prompt Engineer
Information Technology
  • Pune, MH, India
JOB DESCRIPTION You are a strategic thinker passionate about building prompt-driven, production-grade AI that measurably improves risk and control outcomes across enterprise workflows. You have found the right team. As a Prompt Engineering & Applie...
decor
1 Day ago
Lead Software Engineer
Information Technology
  • Pune, MH, India
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be ab...
decor
1 Day ago
Lead ML & AI Engineer
Information Technology
  • Pune, MH, India
What's the role?: The HERE NDS Technologies team is looking for a Lead AI/ML Engineer to drive NDS mapping systems. You will lead the design and development of production-grade machine learning models, pipelines, and services that power NDS HD Live ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media