Position Overview
Job Position: Principal Backend Engineer
Experience: 12+ Years
Work Mode: Remote (Full-Time) - Minimum 4-hour overlap with US time zones
ROLE OVERVIEW
We are seeking a Principal Backend Engineer to own the scalability, reliability, and architectural evolution of an AI platform as it transitions from a prototype to a production-grade platform. This is a high-impact, high-ownership role at the intersection of distributed systems engineering and applied AI.
KEY RESPONSIBILITIES
β Platform Architecture & Scalability: Own end-to-end backend architecture for the AI platform; design for multi-tenant, high-throughput extraction workloads
β Extraction Pipeline Engineering: Architect and evolve AI pipelines, define pipeline abstractions, registry patterns, and execution strategies that balance accuracy, latency, and LLM API cost.
β Multi-Provider LLM Abstraction: Enhance and harden the unified LLM provider layer ; implement multi-key round-robin pooling...