3260 papers • 126 benchmarks • 313 datasets
Annotated code search is the retrieval of code snippets paired with brief descriptions of their intent using natural language queries.
(Image credit: Papersgraph)
These leaderboards are used to track progress in annotated-code-search-11
Use these libraries to find annotated-code-search-11 models and implementations
No subtasks available.
ERRANT, a grammatical ERRor ANnotation Toolkit designed to automatically extract edits from parallel original and corrected sentences and classify them according to a new, dataset-agnostic, rule-based framework, which facilitates error type evaluation at different levels of granularity.
A domain-specific retrieval model for code annotated with a natural language description is created that yields significantly more relevant search results compared to state-of-the-art code retrieval methods that do not use descriptions.
Adding a benchmark result helps the community track progress.