Sr. Data Engineer

Overview

Role: Sr Data Engineer Experience: 5+ Years Industry: Exposure to manufacturing, energy, supply chain or similar Location: Remote Mandatory Skills: Azure Data Bricks or Equivalent, Power BI, Python, SQL Other Skills: Spark, Pandas, Airflow, Azure Data Factory, or equivalent), PostgreSQL, MS SQL Server, NoSQL (MongoDB, etc.), S3, Delta Lake, Snowflake, Redshift, Big Query, Prometheus, Grafana, ELK, etc. We are seeking a Senior Data Engineer to join our digital transformation team at a leading chemical manufacturing plant in India. The ideal candidate will be responsible for independently designing, developing, and deploying scalable data infrastructure to support analytics, optimization, and AI-driven use cases in a low-tech maturity environment. You will own the data architecture end-to-end, work closely with data scientists, full stack engineers, and operations teams, and be a driving force in creating a robust Industry 4.0-ready data backbone. Responsibilities: 1. Data Architecture & Infrastructure (40%) • Design and implement a scalable, secure, and future-ready data architecture from scratch. • Lead the selection, configuration, and deployment of data lakes, warehouses (e.g., AWS Redshift, Azure Synapse), and ETL/ELT pipelines. • Establish robust data ingestion pipelines from PLCs, DCS systems, SAP, Excel files, and third-party APIs. • Ensure data quality, governance, lineage, and metadata management. 2. Data Engineering & Tooling (30%) • Build and maintain modular, reusable ETL/ELT pipelines using Python, SQL, Apache Airflow, or equivalent. • Set up real-time and batch processing capabilities using tools such as Kafka, Spark, or Azure Data Factory. • Deploy and maintain scalable data storage solutions and optimize query performance. 3. Collaboration & Enablement (20%) • Work closely with Data Scientists to provision clean, structured data for ML/analytics use cases. • Support Full Stack Engineers in delivering data-driven applications. • Educate and onboard non-technical users and plant engineers to leverage dashboards and reporting tools. 4. Strategy & Leadership (10%) • Translate business problems into scalable data engineering solutions. • Guide the digital transformation roadmap and ensure alignment with plant operations and management. • Mentor junior data engineers or analysts and define best practices for the team. Required Skills: 1. B.Tech/ M.Tech in Computer Science, Data Engineering, or equivalent field. 2. 5+ years in data engineering, with 2+ years in an industrial/operations-heavy environment (manufacturing, energy, supply chain, etc.) 3. Proven experience independently architecting and deploying data platforms in greenfield or brownfield digital environments. 4. Excellent communication skills – ability to interface with plant engineers, business leaders, and technical teams alike. 5. Comfortable working in ambiguous, high-stakes environments with evolving goals. Good-to-Have: 1. Experience working with low maturity data environments — familiarity with manual logs, Excel-based systems, or legacy SAP setups. 2. Exposure to OT systems (PLC, SCADA, DCS) and IoT device integration. 3. Knowledge of data mesh, data contracts, or microservice-based data flows. 4. Experience with CI/CD pipelines for data applications (GitHub Actions, Azure DevOps).

Job Types: Full-time, Contractual / Temporary
Contract length: 6-12 months

Pay: Up to ₹120,000.00 per month

Work Location: Remote