Postman
AI Engineer, Internship - Summer 2026 - Applications Open Now
Stipend not disclosedBerkeley, California, United States; San Francisco, California, United States0-1 yrsApply by 23 Sept 2026
Overview
Postman is the world’s leading API platform, used by more than 45 million+ developers and 500,000 organizations, including 98% of the Fortune 500. Postman is helping developers and professionals across the globe build the API-first world by simplifying each step of the API lifecycle and streamlining collaboration-enabling users to create better APIs, faster. The company is headquartered in San Francisco and has offic
What you'll do
- Benchmarks & Evaluation Contribute to APIFlow-Bench , our open-source benchmark for real API-development work: design and review benchmark tasks and their mock API environments, extend the evaluation harness and task-generation pipeline in Python, and help maintain the public multi-model leaderboard with statistical confidence intervals.
- Help build a new action-level AI safety benchmark: instead of grading what a model says, it scores what an agent actually does inside a simulated enterprise API environment.
- You’ll work on scenario design, threat modeling (prompt injection, data exfiltration, permission overreach), and auditable evaluation design.
- Model Training & Efficiency Fine-tune open-weight models for tool calling and agentic tasks (SFT, distillation, and RL) using PyTorch and the open-source training ecosystem, on both managed training platforms and self-managed cloud GPUs.
- Design and run experiments with rigor: evaluate every training run on our benchmarks, support ablation studies and error analysis, track experiments, and report results honestly, including cost.
- Evaluate ultra-low-bit quantized models for on-device use: extend our quantized vs. full-precision benchmark comparisons and analyze where and why they diverge.
- Agent Systems & Engineering Practice Help build the next generation of Postman’s in-product AI agent (Agent Mode): a deliberately minimal agent architecture that calls LLM APIs directly (tool loops, multi-step execution, checkpointing), primarily in TypeScript.
- No prior TypeScript is required; strong Python fundamentals transfer quickly.
Who can apply
- Experience building LLM agents (tool calling, multi-step loops) or LLM evaluation harnesses/benchmarks, and reporting results with statistical rigor.
- A track record of shipping real software end-to-end: APIs and services, CLIs, Docker, CI/CD, cloud; public code on GitHub is a big plus.
- Interest or experience in AI safety and robustness: red-teaming, prompt injection, agent security, fairness, or interpretability.
- Exposure to model-efficiency work: quantization, low-bit inference, or serving optimization.
- Evidence of rigor and initiative: publications, technical blog posts, ablation studies, or self-driven side projects with quantified results.
- Fluency with AI coding tools (Claude Code, Cursor, Codex) to ship fast while still deeply understanding the systems you build.
- In addition to Postman's pay-on-performance philosophy, and a flexible schedule working with a fun, collaborative team, Postman offers a comprehensive set of benefits, including full medical coverage, flexible PTO, wellness reimbursement, and a monthly lunch stipend.
- Along with that, our wellness programs will help you stay in the best of your physical and mental health.
Skills
TypeScriptPythonGoDockerPyTorchLLMRAG