preprint open access

A Near Neighbour Is Not a Native Feature: What Nearest-Neighbour Novelty Detection Owes to the Space It Measures In, Why the Case For and Against Pretrained Features Turns on Benchmark and Baseline More Than on Where the Features Came From, and the Comparison That Would Separate Scoring Rule From Representation

Abstract

Life of Research

A novelty detector is trained on normal data and asked to flag whatever is unlike it. Since 2020 two positions have competed over how such a detector should be built. One holds that the decisive ingredient is a feature space borrowed from a network pretrained on a large external corpus, after which a nearest-neighbour distance is enough, and that self-supervised or reconstruction-based detectors trained only on the normal data are outclassed. The other holds that detectors trained in-domain, such as autoencoders whose novelty score combines the reconstructions of an input's nearest latent neighbours with the distance to them, are competitive without any pretrained network and transfer to domains, such as radio-telescope spectrograms, that look nothing like natural photographs. In this analysis the author reviews and synthesises published results to show that the two positions are answering a question neither benchmark design isolates. A published comparison of two detectors almost always changes at least three things at once: the space in which distance is measured, the rule that turns distance into a score, and the kind of novelty the benchmark plants, while a fourth factor, the evaluation (metric, baseline implementation, hyperparameter selection), decides which of the three gets the credit. On one industrial benchmark, published image-level results for detectors that all use ImageNet features and a distance or density score range from 75.0 to 99.1 AUROC, a spread several times larger than the 3.3-point margin by which the nearest-latent-neighbour autoencoder beats its own re-implementation of the pretrained baseline. On one natural-image benchmark, supervised ImageNet features with a simple density score are reported at 80.0, 86.2 and 92.5 AUROC by three groups. Off the pretraining distribution the verdict flips with the dataset: in one seven-dataset medical study a plain autoencoder beats frozen ImageNet features on two datasets and loses by up to 36 points elsewhere, and an autoencoder whose residual is measured in pretrained feature space beats both on most. The paper consolidates nineteen published results in a table and a figure, states a procedure for crediting a novelty-detection gain to a representation's origin rather than to the scoring rule or the evaluation, and names the studies that would settle what remains open.

Pranay Mahendrakar, AI specialist

About the author

Pranay Mahendrakar is an ai specialist and large language model engineer based in Bengaluru, India. He builds production artificial intelligence systems and publishes open-access research on how those systems fail. See all 166 papers by Pranay Mahendrakar, or his ORCID record.

Questions about this paper

Who wrote "A Near Neighbour Is Not a Native Feature"?

Pranay Mahendrakar wrote "A Near Neighbour Is Not a Native Feature: What Nearest-Neighbour Novelty Detection Owes to the Space It Measures In, Why the Case For and Against Pretrained Features Turns on Benchmark and Baseline More Than on Where the Features Came From, and the Comparison That Would Separate Scoring Rule From Representation", published 21 Nov 2026. Pranay Mahendrakar is an Indian AI specialist and LLM engineer based in Bengaluru, India. He is the Managing Director of SonyTech, Nodal Coordinator at IIRS-ISRO, and an instructor at Tutorials Point. His work covers large language models, natural language processing, computer vision and retrieval-augmented generation. He publishes open-access research papers and is the author of three books: Just AI With Pranay, Multiverse of AI and It's Me LLM.

Is "A Near Neighbour Is Not a Native Feature" free to read?

Yes. "A Near Neighbour Is Not a Native Feature" by Pranay Mahendrakar is open access under a Creative Commons Attribution 4.0 licence, with the full PDF available from Zenodo at https://doi.org/10.5281/zenodo.24408406. There is no paywall and no account required.

How do I cite "A Near Neighbour Is Not a Native Feature"?

Cite the DOI: Mahendrakar, P. (2026). A Near Neighbour Is Not a Native Feature: What Nearest-Neighbour Novelty Detection Owes to the Space It Measures In, Why the Case For and Against Pretrained Features Turns on Benchmark and Baseline More Than on Where the Features Came From, and the Comparison That Would Separate Scoring Rule From Representation. Zenodo. https://doi.org/10.5281/zenodo.24408406 A BibTeX entry is provided on this page.

Related research by Pranay Mahendrakar

← All papers by Pranay Mahendrakar