Software Engineer, Distributed Systems & AI Infrastructure

Overview

Omara Technologies is building a Data + AI platform for highly regulated institutions - where failure carries real consequences. We serve population-scale welfare systems, regulated fintech, and biotechnology operations - environments that demand correctness over convenience.

Our platform is deployed within state government agencies to prevent fraud, optimize last-mile delivery, and automate clerical workloads at scale.

The Team

We're a small team from Yale, UPenn, IIT, and the University of Sydney. We value technical rigor, ownership, and the ability to ship production infrastructure under pressure.

What You'll Build

Interpretable AI systems. You'll fine-tune and deploy models where every prediction must be explainable to auditors, regulators, and end users.

MLOps for high-stakes environments. You'll own the full model lifecycle: training pipelines, evaluation frameworks, versioning, and deployment.

Permissions and access control. You'll design fine-grained authorization and multi-tenant isolation for government-scale deployments.

Edge-native infrastructure. You'll architect systems that survive unreliable networks using robust sync, conflict resolution, and offline-first workflows (local LLMs, vLLM/TGI optimization).

Audit-grade data pipelines. You'll implement strict chain-of-custody: immutable logs, evidence-grade trails, and time-ordered event histories that hold up under sovereign-scale scrutiny.

Technical Requirements

• Deep understanding of OS internals, networking, and distributed systems (consensus protocols, CRDTs, or event-sourcing). .
  
• Hands-on experience with LLM quantization, evaluation frameworks, and production-grade inference optimization.
  
• Proficiency in Rust/Go, Kubernetes (K3s for edge), and specialized data stores (ClickHouse, Pinecone/Weaviate).
  
• Strong fundamentals in CS, statistics, or physics.
  

Who You Are

• An owner. You move from ambiguity to specification without a roadmap. You own the uptime, security, and reliability of what you build.
• A polyglot. You're comfortable across the stack - ML-adjacent work, backend infrastructure, high-fidelity UI, mobile interfaces.
• Resilient. You prefer the simplest system that works, then make it bulletproof. You thrive in high-intensity, early-stage environments.
  

How to Apply

Email hr@omaratechnologies.com or apply via Wellfound. Include your GitHub or technical portfolio and a brief note on the most complex system you've owned in production.