Login
- Document type:
- Konferenzbeitrag
- Author(s):
- Conjeti, S.; Paschali, M.; Roy, A. Guha; Navab, N.
- Title:
- Deep Hashing for Large-Scale Medical Image Retrieval
- Abstract:
- Adoption of content-based image retrieval systems (CBIR) requires efficient indexing of the data contents in order to respond to visual queries without explicitly relying on textual keywords. Searching for similar data is closely related to the fundamental problem of nearest neighbor search. Exhaustive comparison of a query across the database is infeasible in large-scale retrieval as it is computationally expensive. Towards this, we propose scalable image retrieval techniques that employing hashing to learn semantics-preserving binary codes for indexing and retrieval. We leverage deep learning for end-to-end learning of hash-codes that are tailored for retrieval in large-scale medical image databases. Developing medical image CBIR systems is particularly challenging due to variability in image acquisition (contrast agents, protocol variations), anatomical variability, high-dimensionality of the data etc. We recently introduced Deep Residual Hashing (DRH) and Deep Multiple Instance Hashing (DMIH) which are deep hashing methods for medical image retrieval. DRH uses residual networks that terminate in dedicated binarization layers that generate hash-codes. It was trained with a multi-class variant of neighborhood component analysis (NCA) with dedicated losses such as quantization and bit-balance to improve hash code quality. DMIH extends DRH to a scenario of multiple instance learning by introduction of the multiple-instance pooling layer that aggregates representations from across member instances within a bag of samples. The aforementioned deep hashing methods were exhaustively validated and their fidelity was demonstrated on scenarios of retrieval on highly heterogeneous databases with significant population variability such as cardiopulmonary chest X-rays, breast mammography and breast histology, with highly competitive retrieval time (< 100 ms).
- Keywords:
- BVM,Deep Learning,Hashing,Retrieval,Multiple Instance Learning,published
- Book / Congress title:
- Bildverarbeitung für die Medizin 2018 - Algorithmen - Systeme - Anwendungen. Proceedings des Workshops vom 11. bis 13. März 2018 in Erlangen
- Year:
- 2018
- Pages:
- 35
BibTeX