C
AI Research Scientist
Actively Hiring
Full-time $120k - $200k Posted about 2 months ago
Responsibilities
- check_circle Lead applied research on LLMs, AI agents, evaluation systems, and educational AI.
- check_circle Develop research prototypes that apply frontier AI-agent methods to K–12 teaching and learning workflows.
- check_circle Design rigorous evaluation frameworks for AI tutoring, grading, lesson generation, classroom agents, and other educational use cases.
- check_circle Build benchmarks and datasets that measure long-horizon agent behavior, feedback-driven learning, reliability, safety, and instructional quality.
- check_circle Study how agents perform in realistic educational environments involving rubrics, standards, student work, teacher feedback, classroom context, and multi-step workflows.
- check_circle Design experiments to measure model behavior, diagnose failures, compare approaches, and improve system performance.
- check_circle Collaborate with engineering and product teams to turn promising research into production-ready features.
- check_circle Publish research papers, technical reports, benchmarks, datasets, or open-source tools that establish Colleague AI as a thought leader in AI for education.
- check_circle Stay current with advances in LLMs, agentic AI, retrieval-augmented generation, evaluation methods, synthetic data, AI safety, and learning sciences.
- check_circle Help establish internal best practices for model evaluation, experimentation, monitoring, and continuous improvement.
- check_circle Ph.D. in Computer Science, Machine Learning, Artificial Intelligence, Natural Language Processing, Data Science, Learning Sciences, Educational Technology, or a related technical field.
- check_circle Strong research background in machine learning, deep learning, NLP, large language models, AI agents, or human-AI interaction.
- check_circle Experience optimizing model performance in production or production-like environments.
- check_circle Strong programming skills in Python and experience with ML frameworks such as PyTorch, TensorFlow, JAX, or similar.
- check_circle Experience designing experiments, evaluation frameworks, benchmarks, or datasets.
- check_circle Strong understanding of model validation, statistical analysis, error analysis, and empirical research methods.
- check_circle Ability to move between open-ended research questions and practical implementation.
- check_circle Clear technical writing skills, with the ability to produce papers, reports, documentation, and research narratives.
- check_circle Strong collaboration skills and interest in working with engineers, product teams, educators, and school partners.
Preferred qualifications
- Publications in top-tier AI, ML, NLP, HCI, learning analytics, or education technology venues.
- Experience with LLM agents, tool-using agents, multi-agent systems, autonomous workflows, or long-horizon agent evaluation.
- Experience with educational AI, intelligent tutoring systems, automated feedback, grading, curriculum generation, or classroom technology.
- Experience building benchmark environments, simulation environments, evaluation harnesses, or reproducible research systems.
- Experience with retrieval-augmented generation, fine-tuning, synthetic data generation, data annotation, or model adaptation.
- Experience evaluating AI systems for safety, reliability, fairness, privacy, or age-appropriate behavior.
- Experience deploying research into production or working in a startup environment.
- Familiarity with K–12 education standards, classroom workflows, LMS/SIS systems, or teacher-facing software is a plus.
- A brief statement of interest describing your relevant research interests, technical experience, and motivation for joining Colleague AI.
- Evidence of qualifications, such as a portfolio of prior work, selected publications, GitHub repositories, technical writing, demos, or deployed systems.
- A current CV.
Benefits
- check_circle 401(k)
- check_circle Health insurance
- check_circle Paid time off
- check_circle Parental leave
- check_circle Vision insurance
Tags & Focus Areas
Fulltime Ai Generative Ai