PhD Studentship: PhD Opportunity Title An efficient medical Vision Language Models (VLM) for medical applications [Artificial Intelligence, Computer Vision, Medical Imaging, Digital Healthcare]

Project Description:

Large Language Models (LLMs) like GPT-4 have demonstrated remarkable abilities in a variety of healthcare tasks, including diagnosis, patient management, and treatment planning. Specialized models like Med-PaLM 2 also provides advanced capabilities in processing and understanding medical language. However, despite these advancements, these models still face considerable limitations in the healthcare domain, particularly in tasks such as medical visual question answering (VQA) for disease diagnosis and understanding. This challenge is largely due to the diversity of medical data modalities, the intricacy of medical reports. While vision language models VLMs (LLaVA-med) have made progress in addressing these challenges, the high resource requirements highlight a pressing need to develop techniques that optimize their efficiency, making the model viable for real-time clinical applications with limited resources.

This project aims to develop an efficient Vision-Language Model (VLM) specifically designed for medical applications that not only enhances diagnostic accuracy but also addresses the substantial resource demands currently hindering LM implementation in healthcare settings. The model will focus on integrating domain-specific medical knowledge to reduce the computational cost while maintaining high performance in tasks such as medical image interpretation and clinical decision-making. By addressing both the computational efficiency challenges and the need for accurate multimodal processing, this project will provide a significant step forward in enabling the use of advanced AI in clinical practice, improving patient outcomes while conserving valuable medical resources.

The studentship will be awarded on the basis of merit for 3.5 years of full-time study to commence as soon as possible.

International applicants need to be aware that you will have to cover the cost of your student visa, healthcare surcharge and other costs of moving to the UK to do a PhD.

Advert information