Data Engineer

Job Summary

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines, data solutions, data lakes, and data marts that enable efficient data processing, transformation, and analytics. The ideal candidate will have strong experience with PySpark, Microsoft Azure Fabric, and modern data engineering practices and tools. You will play a key role in managing raw data, creating transformations and mappings, building data marts, and ensuring the overall reliability and performance of our data platform.

Responsibilities

• Design, develop, and maintain data pipelines using PySpark and other modern data processing frameworks.
• Manage large volumes of structured and unstructured data across multiple sources and formats. Implement robust ELT processes, data transformations, and mappings to ensure data quality, consistency, and usability.
• Create and optimize data marts and analytical layers to support business intelligence and advanced analytics.
• Work with Microsoft Azure Fabric and related Azure services (e.g., Azure Data Factory, Synapse, Data Lake, Power BI) for data integration and management.
• Ensure the scalability, reliability, and security of the data platform in line with best practices. Collaborate closely with data scientists, analysts, and business stakeholders to understand requirements and deliver high-quality data solutions.
• Monitor, troubleshoot, and optimize performance of pipelines and data workflows.
• Document data processes, transformations, and architecture for cross-team visibility.
  
  

Required Qualifications

• Bachelorʼs or Masterʼs degree in Computer Science, Data Engineering, Information Systems, or related field.
• Proven experience as a Data Engineer or similar role in data-driven organizations.
• Strong proficiency with PySpark (or similar) and distributed data processing.
• Experience with data pipelines and orchestration tools (e.g., Airflow, Prefect, or Dagster).
• Experience working with Microsoft Azure Fabric (or similar) and related Azure ecosystem tools (e.g., Data Factory, Synapse, Data Lake, SQL Database, Power BI).
• Solid understanding of data modeling, data warehousing, and ELT principles.
• Proficiency in SQL and working with relational and non-relational databases.
• Familiarity with cloud-based data architectures and modern data lakehouse concepts.
• Strong problem-solving skills and ability to work with cross-functional teams.
• Excellent communication and documentation abilities.
• Strong coding skills in Python Knowledge of data governance, security, and compliance frameworks. Exposure to streaming data frameworks (e.g., Kafka, Event Hubs).
• Hands-on experience with data cataloging tools and metadata management.
  
  

About Aumni Techworks

Aumni Techworks, established in 2016, is a Software Services Company that partners with Product companies to build and manage their dedicated teams in India. So, while you are working for a services company, you are working within a product team and growing with them.

We do not take on projects, and we have long-term (open-ended) contracts with our clients. When our clients sign up with us, they are looking at a multi-year relationship.

For e.g. Some of the clients we signed up with 8 or 6 years, are still with us.

We do not move people across client teams and there is no concept of bench.

At Aumni, we believe in quality work, and we truly believe that Indian talent is at par with someone in NY, London or Germany.

350+ and growing

Benefits Of Working At Aumni Techworks

• Our award-winning culture reminds us of our engineering days.
• Medical insurance (including Parents), Life and Disability insurance.
• 24 leaves + 10 public holidays + leaves for Hospitalization, maternity, paternity and bereavement.
• On site Gym, TT, Carrom, Foosball and Pool table.
• Hybrid work culture