Software Engineer — RL Environments & Infrastructure

Company Overview

Collinear.ai is a pioneering company that develops reinforcement-learning environments and infrastructure for advanced AI labs. They create high-fidelity recreations of complex software products such as Kubernetes, GitHub, Datadog, Stripe, and Linear, equipped with APIs, task definitions, and automated grading systems to allow AI agents to perform tasks and be evaluated on their performance.

Job Summary

The Software Engineer in RL Environments & Infrastructure at Collinear.ai will be pivotal in building the environment platform that enables the training and evaluation of advanced AI agents. This role will involve designing and scaling infrastructure, developing data pipelines, and engineering high-fidelity environments that help push the boundaries of AI capabilities.

Responsibilities

• Build the environment platform: Design and scale shared infrastructure for orchestration, sandboxing, observability, and continuous integration/continuous deployment (CI/CD).
• Own data and evaluation pipelines: Create pipelines that convert agent runs into clean, gradable signals including task generation, trajectory capture, automated grading, and failure analysis.
• Engineer high-fidelity environments: Accurately replicate user experiences, APIs, and edge-case behaviors of real-world products and expose them via OpenAPI to enable programmatic operations.
• Design rigorous grading systems: Develop an automated grading and reward layer, analyze model performance, and iterate on tasks to ensure they are rigorous and fair.
• Ship across the stack and infrastructure: Engage in tasks involving frontend, backend, containerization (Docker), registries (Azure Container Registry), Kubernetes, and CI/CD processes.

Qualifications

• Education: Bachelor’s degree in Computer Science, Engineering, or a related field.
• Experience: 3+ years of experience in building and scaling production systems, infrastructure, or full-stack applications.
• Technical Skills:
  • Proficiency in Python and/or TypeScript/React.
  • Knowledge of REST/API design and experience with Docker and Git-based workflows.
  • Experience in building data pipelines and distributed systems.
• Soft Skills:
  • Strong systems thinking with an ability to streamline workflows into scalable solutions.
  • Intuition for understanding AI agent behaviors and detecting model limitations.
  • High standards for reliability in tools and systems developed.

Preferred Skills

• Experience with scaling distributed systems and orchestration.
• Familiarity with Terraform, Infrastructure as Code (IaC), and observability tools.
• Knowledge of secure and sandboxed code-execution environments.
• Exposure to large language models (LLMs), AI agents, reinforcement learning (RL), or evaluation tooling.
• Contributions to open-source projects.

Experience

A minimum of 3 years of relevant experience in building and optimizing production systems.

Environment

This position is a full-time role based in Bengaluru. The work setting is likely dynamic and collaborative, requiring the ability to manage various tasks across the tech stack with high ownership and minimal process constraints.

Salary

Salary details have not been provided.

Growth Opportunities

Potential career advancement opportunities are likely available within a small, senior team where individual contributions directly impact the company's objectives.

Benefits

No specific benefits have been outlined; further details may be provided during the application process.