Senior AI Engineer

Senior AI Engineer

Ruby Labs is a leading tech company creating and operating innovative consumer products across health, education, and entertainment. We are looking for a passionate Senior AI Engineer to join our remote team and drive the future of consumer-led products.

About the Role

This is a high-ownership role where you will be responsible for the end-to-end delivery of major AI features, ensuring the production stability of our AI systems, and conducting data-driven experimentation. You will work with a modern tech stack including Next.js, TypeScript, Node.js, and Redis, collaborating closely with product, growth, data, and billing teams. A key focus will be on building agentic, tool-using AI systems, defining clean tool contracts, and orchestrating AI interactions with internal services. You will operate within an AI engineering squad, providing senior technical leadership and driving engineering quality.

Key Responsibilities

• Take complete ownership and deliver major AI engineering features within agreed timelines.
• Own AI output quality, structure, and predictability across all user-facing AI interactions.
• Design, implement, and maintain output-type-based AI systems, including segmentation, routing, and enforcement.
• Ensure consistent output structure and formatting across different Large Language Models (LLMs) for the same request type.
• Integrate and orchestrate multiple LLM providers via OpenRouter, managing model selection, fallback strategies, and cost optimizations.
• Design and orchestrate tool-using and agentic AI workflows, defining clean tool contracts, function-calling interfaces, and reliable AI-to-system integrations.
• Build and maintain complex, multi-step LLM workflows, including with orchestration frameworks such as LangChain or LlamaIndex.
• Design and manage production prompt systems with dynamic prompting, context injection, and conditional logic.
• Own the deployment and release of LLM experiments, prompt management, and evaluation pipelines using tools like Langfuse.
• Run A/B tests across models, analyze results, and present data-driven impact assessments of AI features and experiments.
• Monitor AI system metrics, quality signals, latency, and release health using observability tools.
• Deep-debug complex LLM chains, identifying bottlenecks and optimizing for cost, latency, and context-window usage.
• Build output-scoring systems to root-cause hallucinations and logic errors.
• Write clean, scalable, and maintainable TypeScript code across the Next.js and Node.js stack.
• Build reliable backend logic for AI systems with strong error handling and predictable behavior.
• Ensure high code quality through testing, code reviews, and clear engineering standards.
• Monitor, troubleshoot, and improve production performance, reliability, and system health.
• Drive maintainability and technical quality through solid architecture and disciplined release practices.

Requirements

• 6+ years of backend/full-stack software engineering experience, including production-grade TypeScript/Node.js.
• 2+ years of experience building AI/LLM systems in production.
• Deep hands-on experience working with LLM APIs (OpenAI, Anthropic, or similar) in production environments.
• Experience with Agentic AI, multi-agent orchestration, tool-based workflows, and/or Retrieval-Augmented Generation (RAG) pipelines.
• Experience with LLM observability tools such as Langfuse, LangSmith, or similar platforms.
• Experience with AI gateways and model routing solutions, such as OpenRouter or equivalent.
• Solid understanding of Redis and relational databases, such as PostgreSQL.
• Exceptional ownership mindset and personal responsibility for engineering quality and delivery.

Nice to Have

• Experience with AI-centered development tools.
• Familiarity with evaluation frameworks, including LLM-as-a-judge.
• Experience working in high-pressure startup environments.
• Experience with MCP (Model Context Protocol).
• Experience with edge and serverless runtimes.
• Experience with payments, billing, and checkout flows.
• Practical experience fine-tuning models.
• Working proficiency in Python for data science or AI tooling.

Location

Ruby Labs operates within the CET (Central European Time) zone. Applicants from any country are welcome to apply as long as they are located within approximately ± 4 hours of CET to ensure optimal collaboration.

What We Offer

• Remote Work Environment: Work from anywhere with a focus on work-life balance.
• Unlimited PTO: Enjoy unlimited paid time off.
• Paid National Holidays: Paid time off for national holidays.
• Company-provided MacBook: Top-notch Apple MacBooks provided.
• Flexible Independent Contractor Agreement: Benefit from flexibility, autonomy, tax advantages, and networking opportunities.