Overview
Job Title: Azure Data Engineer with Palantir Foundry Expertise
Location: Noida/Gurgaon/Hyderabad/Bangalore/Pune
Experience Level: 7+ years (Data Engineering), 2+ years (Palantir Foundry)
Role Overview:
We are looking for a highly skilled Azure Data Engineer with hands-on expertise in Palantir Foundry to support critical data integration and application development initiatives. The ideal candidate will have a strong foundation in Python, SQL, PySpark, and Azure services, along with proven experience in working across data pipelines, ontologies, and security configurations within the Palantir ecosystem. This role requires both technical acumen and strong communication skills to engage with cross-functional stakeholders, especially in the Oil & Gas engineering context.
Key Responsibilities: Azure Data Engineering:
- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, SQL, and PySpark.
- Ensure data quality, integrity, and governance in Azure-based data platforms.
- Collaborate with Product Managers and Engineering teams to support business needs using data-driven insights.
- Data Integration: Build and manage pipelines; perform Python-based transformations; integrate varied source systems using code, repositories, and connections.
- Model Integration: Work with business logic, templated analyses, and report models to operationalize analytics.
- Ontology Management: Define object types, relationships, permissions, object views, and custom functions.
- Application Development: Build and manage Foundry applications using Workshop, Writeback, Advanced Actions, and interface customization.
- Security & Governance: Implement data foundation principles; manage access control, restricted views, and ensure data protection compliance.
- Perform ingestion, transformation, and validation within Palantir and maintain seamless integration with Azure services.
- Strong proficiency in Python, SQL, and PySpark
- Expert in Azure Databricks, Azure Data Factory, Azure Data Lake
- Palantir Foundry hands-on experience, with ability to demonstrate skills during interviews
- Palantir-specific capabilities:
- Foundry Certifications: Data Engineering & Foundational
- Pipeline Builder, Ontology Manager, Object Explorer
- Mesa language (Palantir?s proprietary language)
- Time Series Data handling
- Working knowledge of Equipment & Sensor data in the Oil & Gas domain
- Strong communication and interpersonal skills
- Ability to work independently and drive conversations with Product Managers and Engineers
- Comfortable acting as a voice of authority in cross-functional technical discussions
- Proven ability to operate and support complex data platforms in a production environment
Nice to Have:
- Experience working with AI/ML models integrated in Foundry
- Exposure to AIP (Azure Information Protection) or related security tools
- Experience in Operating & Support functions across hybrid Azure-Palantir environments