Engineering Blog

Indexing, ranking, evaluation and everything harder than it looks.
// ENGINEERING BLOG

How the assistant is built

Notes from the team on indexing, ranking, evaluation and the parts that are harder than they look.

Incremental Indexing at Repository Scale

The first index of a million-line repository takes four minutes. Every index after it follows your saves. Here is what…

Why the Second Suggestion Was the One You Wanted

For three months our acceptance rate was stuck. The completions were right; the order was wrong. Fixing the order moved…

Evaluating a Code Assistant Honestly

Every assistant claims a benchmark. Most benchmarks measure the benchmark. This is the evaluation set we use internally and why…

Shipping Pull Request Review Without Annoying Anyone

An automated reviewer that comments on everything is a reviewer nobody reads. The whole design problem is deciding what to…

Forty Languages Is Not Forty Grammars

Adding a language takes us about three weeks, and almost none of it is parsing. Here is where the time…