HumanBit Logo

Senior AI Agent Engineer | Scrabble & Jigsaw

Posted on 06-10-2026

Job Description

Senior AI Agent Engineer

Company Overview

Not specified.

Job Summary

We are seeking an experienced engineer to design and build secure, production-grade AI agents that seamlessly integrate with business systems. The role involves developing agents capable of retrieving trusted information, utilizing tools, and supporting human-approved workflows. The successful candidate will contribute to advancing AI capabilities within the organization, ensuring robust, safe, and efficient AI operations in production environments.

Responsibilities

  • Build and operate the AI-agent runtime, ensuring reliable and scalable performance.
  • Design coordinator and specialist-agent workflows to optimize task execution and collaboration.
  • Create typed and versioned tool registries for consistent and maintainable integrations.
  • Integrate agents with backend services and data sources to enable comprehensive data access.
  • Implement conversation state management and purpose-bound memory to support contextual interactions.
  • Develop Retrieval-Augmented Generation (RAG) ingestion, retrieval, provenance, and citation systems.
  • Implement deterministic authorization and policy controls outside the AI models to enforce security and compliance.
  • Incorporate human confirmation steps for actions with significant impact.
  • Build evaluation suites and automated release gates to ensure quality and safety.
  • Establish observability, latency, and cost controls for operational efficiency.
  • Implement feature flags, kill switches, and graceful degradation mechanisms.
  • Support security reviews, production deployment, and incident response procedures.
  • Own canary releases, rollback procedures, and maintain operational runbooks for smooth deployment and maintenance.

Qualifications

  • Strong Python engineering experience with expertise in async Python, FastAPI, Pydantic, SQLAlchemy, and Alembic.
  • Proven production experience with LangGraph, OpenAI Agents SDK, or comparable agent frameworks.
  • Deep understanding of Retrieval-Augmented Generation (RAG), embeddings, vector databases (e.g., pgvector), and source-grounded generation.
  • Hands-on experience with PostgreSQL, Redis, and queue-based asynchronous background processing.
  • Knowledge of REST APIs, Server-Sent Events, and distributed system fundamentals such as idempotency, retries, and timeouts.
  • Experience with model-provider integration platforms like OpenAI, AWS Bedrock.
  • Skills in model routing, fallbacks, context management, and prompt versioning.
  • Ability to manage token, latency, and cost controls effectively.
  • Proficiency in OAuth2, JWT, JWKS, and service-to-service authentication.
  • Expertise in PII minimization, encryption, secrets management, and least-privilege access.
  • Experience with Docker and cloud deployments, preferably on AWS.
  • Familiarity with OpenTelemetry, structured logging, metrics, tracing, and alerting.
  • Strong background in automated testing using pytest and managing integration-test environments.

Preferred Skills

  • Experience in AI safety and evaluation, including regression testing, deterministic evaluation, and prompt-injection testing.
  • Familiarity with tools such as DeepEval, RAGAS, Promptfoo or equivalent.
  • Knowledge of adversarial and multilingual testing.
  • Experience in regulated or high-trust domains is advantageous.
  • Ability to design evaluation datasets and deployment gates.
  • Understanding that model tool selection is distinct from authorization.

Experience

  • 7+ years of software engineering experience.
  • 2+ years building generative AI or large language model (LLM) systems.
  • Proven track record of deploying tool-using or RAG-based AI applications to production.
  • Strong background in backend and distributed systems fundamentals.
  • Experience in moving AI products from prototype to monitored production environments.

Environment

  • The role involves working in a collaborative, fast-paced environment.
  • Likely involves remote, in-office, or hybrid work settings.
  • Requires adherence to security protocols and incident response procedures.
  • Focus on high-trust, regulated domains may involve additional compliance and security considerations.

Salary

Not specified.

GrowthOpportunities

Not specified.

Benefits

Not specified.

Powered by
HumanBit Logo