Blog

How to build a general purpose LLM evaluator: Lessons from our literature review

How to build a general purpose LLM evaluator: Lessons from our literature review

Andrei
January 16, 2025
Inferring the Overseer: Insights from the AISI Research Sprint

Inferring the Overseer: Insights from the AISI Research Sprint

Henry
December 18, 2024

Latest posts

How to build a general purpose LLM evaluator: Lessons from our literature review

How to build a general purpose LLM evaluator: Lessons from our literature review

Andrei
January 16, 2025
Inferring the Overseer: Insights from the AISI Research Sprint

Inferring the Overseer: Insights from the AISI Research Sprint

Henry
December 18, 2024
Aligning AI with AI-Assisted Human Feedback

Aligning AI with AI-Assisted Human Feedback

Maurice
December 12, 2024
Evaluating our Evaluator: Early Results

Evaluating our Evaluator: Early Results

Nina
December 3, 2024
Training an LLM-as-a-Judge with Synthetic Data

Training an LLM-as-a-Judge with Synthetic Data

Andrei
November 25, 2024
Judge or Jury: What’s the right approach for LLM evaluation?

Judge or Jury: What’s the right approach for LLM evaluation?

Maurice
November 19, 2024
LLM Evaluation Tooling - A Review

LLM Evaluation Tooling - A Review

Josh
November 12, 2024
LLM Judges as Reward Models

LLM Judges as Reward Models

Henry
October 31, 2024
Selecting a training objective for an AI evaluator (SFT vs. DPO vs. RPO)

Selecting a training objective for an AI evaluator (SFT vs. DPO vs. RPO)

Andrei
October 22, 2024