Sr Specialist Data Engineer (Palantir Foundry)

Job Description:

We are seeking a highly motivated and skilled Palantir Full Stack Developer to join

our team. The ideal candidate will have expertise in Python, Azure Data Engineering,

and Java, with a strong background in designing, building, and maintaining scalable

data pipelines and integrations within the Palantir ecosystem. This role will involve

working with cross-functional teams to deliver data-driven solutions that enable

actionable insights and support critical business objectives.

Key Responsibilities:

1 Data Engineering and Integration:

• Design, develop, and optimize scalable data pipelines and ETL processes
• using Palantir Foundry for data integration, transformation, and creating
  
  

data models to support analytics and business use cases.

• Build and manage APIs and microservices using Python and Java to
  
  

integrate data across systems and manage data processing and

application logic.

• Data Modeling and Architecture:
• Design and implement robust, scalable, and efficient data models in
  
  

Palantir Foundry.

• Collaborate with data architects to define data governance, data lineage,
  
  

and data quality standards.

• Develop and maintain reusable pipelines and templates for data
  
  

transformation and enrichment.

• Azure Cloud Expertise:
• Utilize Azure Synapse, Azure Data Lake, and Azure Storage for data
  
  

storage and processing.

• Implement secure and efficient data workflows on Azure, ensuring
  
  

compliance with organizational and regulatory policies.

• Monitor and troubleshoot Azure data pipelines for performance
  
  

optimization.

• Programming and Automation:
• Write clean, maintainable, and efficient code in Python and Java for data
  
  

processing, automation, and integration tasks.

• Develop scripts to automate repetitive tasks and improve overall system
  
  

efficiency.

• Hands on Experience on Snowflake in writing procedures / functions,
  
  

Snowpipe, Data Pipelines, Data Transformation.

• Collaboration and Stakeholder Engagement:
• Work closely with data scientists, analysts, and business stakeholders to
  
  

understand data requirements and deliver actionable insights.

• Provide technical support and training on Palantir Foundry to internal
  
  

teams.

• Participate in Agile development processes and collaborate with DevOps
  
  

teams to ensure seamless deployment.

• Performance Monitoring and Optimization:
• Monitor data pipelines and applications for reliability, scalability, and
  
  

performance.

• Implement best practices for error handling, logging, and alerting to
  
  

ensure system stability.

• Required Skills and Qualifications:
• Technical Expertise:
• Proficiency in Palantir Foundry for data integration, modeling, and
  
  

pipeline development.

• Strong programming skills in Python and Java.
• Hands-on experience with Azure Data Engineering tools (e.g., Azure
• Data Factory, Databricks, Synapse, Data Lake, etc.).
• Solid understanding of data structures, algorithms, and software
  
  

engineering principles.

• Data Engineering Skills:
• Experience in building and optimizing ETL/ELT pipelines for large-scale
  
  

data processing.

• Proficiency in SQL for data querying and transformation.
• Familiarity with data governance, data lineage, and data security
  
  

practices.

• Cloud Expertise:
• Strong knowledge of Azure cloud services and infrastructure for data
  
  

engineering.

• Experience with CI/CD pipelines, containerization (e.g., Docker), and
  
  

orchestration tools (e.g., Kubernetes).

• Problem Solving and Collaboration:
• Excellent problem-solving skills and ability to troubleshoot complex issues
  
  

in data systems.

• Strong communication skills to collaborate effectively with technical and
  
  

non-technical stakeholders.

• Preferred Qualifications:
• Certification in Palantir or Microsoft Azure Data Engineering or related cloud
  
  

certifications.

• Experience in working in Agile/Scrum environments.