Pune, Maharashtra, India
Information Technology
Full-Time
Aumni
Overview
Position Summary
We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines, data lakes, and data marts that enable efficient data processing, transformation, and analytics. The ideal candidate has strong experience with PySpark, Microsoft Azure Fabric, and modern data engineering tools.
Key Responsibilities
Data Engineering:
BE BOLD
We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines, data lakes, and data marts that enable efficient data processing, transformation, and analytics. The ideal candidate has strong experience with PySpark, Microsoft Azure Fabric, and modern data engineering tools.
Key Responsibilities
Data Engineering:
- Design, develop, and maintain data pipelines using PySpark and modern orchestration tools (Airflow, Prefect, or Dagster).
- Manage large volumes of structured/unstructured data across multiple sources and formats.
- Implement robust ELT processes, transformations, and mappings to ensure data quality and consistency.
- Build and optimize data marts and analytical layers to support BI and advanced analytics.
- Work with Microsoft Azure Fabric and related Azure services (Data Factory, Synapse, Data Lake, Power BI).
- Ensure scalability, reliability, and security of the data platform following best practices.
- Collaborate with analysts, data scientists, and stakeholders to deliver high-quality solutions.
- Monitor, troubleshoot, and optimize pipeline performance.
- Document data workflows and architecture for cross-team visibility.
- Fine-tune and customize LLMs (OpenAI, Hugging Face, LLaMA) for business use cases.
- Build and maintain data pipelines for ML training, evaluation, and monitoring.
- Deploy models in containerized environments (Docker) and manage lifecycle using MLOps best practices (MLflow, DVC).
- Integrate AI capabilities into products in collaboration with engineering teams.
- Evaluate model performance, latency, and cost in production environments.
- The person should hold a Bachelor’s or Master’s degree in Computer Science.
- The person must have strong proficiency with PySpark and distributed data processing frameworks.
- The person should have experience with data pipeline orchestration tools (e.g., Airflow, Prefect, Dagster).
- The person should be experienced in working with Microsoft Azure Fabric and the Azure ecosystem (Data Factory, Synapse, Data Lake, Power BI).
- The person should be proficient in SQL and comfortable working with relational and non-relational databases.
- The person should have a solid understanding of data modeling, data warehousing, and ELT principles.
- The person must have strong coding skills in Python and familiarity with version control systems (Git).
- The person should have knowledge of data governance, security, and compliance frameworks.
- The person should be familiar with streaming data frameworks (Kafka, Event Hubs).
- 4+ years in Data Engineering or ML/Data Science roles.
- Hands-on experience with LLMs, NLP models, or foundational model APIs.
- Experience with ML libraries (Transformers, LangChain, scikit-learn, Pandas).
- Familiarity with containerized deployment (Docker) and scalable ML infrastructure.
- Experience with vector databases (Pinecone, Weaviate, Qdrant).
- Knowledge of model-serving frameworks (FastAPI, Triton, Ray Serve).
- Exposure to GPU infrastructure for distributed model training.
- Experience with CI/CD, automated testing, and infrastructure as code.
- Aumni, established in 2016, is a Software Services Company that partners with Product companies to build and manage their dedicated teams in India.
- So, while you are working for a services company, you are working within a product team and growing with them.
- These are not projects but product development, and we have long term (open ended) contracts with our clients. When our clients sign up with us, they are looking at a multi-year relationship. Most of our clients have been with 6,8,9 years.
- We do not move people across client teams and there is no concept of bench.
- At Aumni, we believe in quality work, and we truly believe that Indian talent is at par with global talent from US or Europe.
- We are 350+ and growing
- Our award winning culture reminds us of our engineering days.
- Medical insurance (including Parents), Life and disability insurance
- 24 leaves + 10 public holidays + leaves for Hospitalisation, maternity, paternity and bereavement.
- On site Gym, TT, Carrom, Foosball and Pool
- Hybrid work culture
- Fitness group / rewards
- Aumni Premier League, Aumni's Got Talent, Friday Socials, Annual parties, treks.
BE BOLD
- Dare to innovate, challenge the norm and take ownership. Growth comes from courage.
- Act with integrity and transparency - in every task, every decision and every interaction.
- Respect people, embrace diversity and support our culture of empathy and high collaboration.
- Bring your authentic self to work. Have fun working, celebrate individuality and create space for everyone to thrive.
Similar Jobs
View All
13 Hours ago
Python Developer
Information Technology
- 3 - 6 Yrs
- Bangalore
Job Title: Senior Backend Engineer
Location: Bangalore | In-Office | Full-time
Experience: 3–6 Years
Working Days: 5.5 Days (5 Days WFO + Alternate Saturdays WFH)
Job Description
We are seeking a Senior Backend Engineer to design and devel...
18 Hours ago
Senior Principal Software Engineer (Analytics)
Digital Transformation & Innovation
- 15 - 25 Yrs
- Bangalore
About the Role -
As a member of the development group, you will become part of a team that develops and maintains one of companys software products developed using Ruby and React, built as a multi-tenant SaaS solution on all Cloud Platforms like AWS...
2 Days ago
Associate Manager, Data Engineer
Information Technology
- Pune, Maharashtra, India
Job DescriptionAssociate Manager, Data EngineerThe Opportunity Based in Hyderabad, join a global healthcare biopharma company and be part of a 130-year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achi...
2 Days ago
UI Developer
Information Technology
- Pune, Maharashtra, India
Develop and maintain responsive user interfaces using HTML5, CSS3, Bootstrap, and SASS. Write clean, modular, and maintainable CSS with proper media queries and layout techniques. Build dynamic, component-based interfaces using AngularJS (or Angula...
2 Days ago
Technical Project Manager II - Data
Information Technology
- Pune, Maharashtra, India
Role DescriptionJob Title: Technical Project ManagerWe are looking for a Technical Project Manager to lead the end-to-end execution of data projects. The ideal candidate will manage data migration and application projects focused on hyperscale cloud...
2 Days ago
TC - MENA Technology - Full stack developer - Staff
Information Technology
- Pune, Maharashtra, India
At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even ...
2 Days ago
Python Developer
Information Technology
- Pune, Maharashtra, India
Job Profile:- We are building cutting-edge agentic AI voicebots that redefine conversational intelligence. As a Python Developer, you will leverage your expertise in Python, MongoDB, Redis, and scalable architecture to design and implement highly ...
2 Days ago
Application Developer
Information Technology
- Pune, Maharashtra, India
Software Engineer – I (Flutter / Android) Ebani Tech Private Limited Who Are We Ebani Advertising has been crafting impactful marketing solutions for over 25 years, partnering with globally recognized brands such as GE, Dell, Genpact, UNICEF, and...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in