Multimorbidity Content-Based Medical Image Retrieval and Disease Recognition Using Multi-Label Proxy Metric Learning (with Yunyan Xing, Ben Meyer, Mehrtash Harandi and Zongyuan Ge)

This paper shows how to do content-based retrieval on medical images where each image can have many simultaneous diagnoses (multimorbidity), by contrast to standard metric learning methods that assume a single class per sample. A multi-label proxy-based metric learning framework learns a single embedding in which images sharing any subset of labels are pulled together in a structured way, supporting both retrieval of similar cases and direct multi-label disease recognition on the same embedding.

[IEEE Access 2023 paper]