Postdoctoral Researcher of Multi-Modal Large Language Model for Medical Image Analysis

Position Overview

Contract Type: Fixed-term, two-year contract 

Project description

Project title

Multi-Modal Large Language Model for Medical Image Analysis

Research period

2 years

Abstract

The proposed research project aims to develop a novel multi-modal large language model (MLLM) for automated medical image analysis (MIA) tasks, such as inspection and segmentation. By leveraging the power of large language models and integrating them with visual information, this project seeks to create a unified framework that can understand and generate human-like text while simultaneously processing and analyzing medical images. The model will be trained on a diverse dataset of medical images and corresponding prompts, enabling it to automatically label and analyze images based on the provided textual information. This approach has the potential to revolutionize the field of medical image analysis by improving efficiency, accuracy, and accessibility. The successful completion of this project will contribute to the development of advanced tools for medical professionals, assisting them in diagnosis, treatment planning, and patient care. The research will involve data collection and preprocessing, model architecture design, pre-training and fine-tuning, evaluation and benchmarking, and model optimization and deployment. The expected outcomes include a novel MLLM architecture, improved performance in MIA tasks, and publications in high-impact conferences and journals. This project aims to bridge the gap between LLM and MIA, opening up new avenues for research and practical applications in the healthcare domain. 

About Postdoctoral Programme

The postdoctoral programs at XJTLU are jointly run by the XJTLU Technology Transfer Centre Co., Ltd. (XTTC) Postdoctoral Work Station (based at XJTLU) and a cooperating Mobile Station (normally a Chinese state university).

XTTC is a specialized platform of Xi'an Jiaotong-Liverpool University that focuses on transferring and transforming scientific and technological achievements, incubating scientific and technological projects, and promoting industry-university-research cooperation. It utilizes the high-quality international scientific research resources and environment of XJTLU and its partner universities, following a development strategy of "innovation-driven, value creation, and collaborative development" to advance technological innovation through integrating domestic and foreign research resources, exploring core industrial technologies, and providing support.

In March 2017, XTTC was accredited by the National Postdoctoral Management Office as a branch station of the postdoctoral workstation in Suzhou Industrial Park. It is currently recruiting exceptional doctoral candidates from society.

RESPONSIBILITIES

• Conduct research: Design and execute experiments, collect and analyze data, and interpret results to advance the understanding of related research areas.
• Collaborate with team members: Work closely with faculty members, research staff, and other postdoctoral researchers to foster interdisciplinary collaboration and knowledge sharing.
• Publication and dissemination: Prepare research manuscripts for publication in high-impact scientific journals and present findings at conferences and seminars.
• Grant proposal development: Assist in the development of grant proposals, including conducting literature reviews, preparing research plans, and contributing to budget justifications.
• Stay updated with research advances: Keep abreast of the latest research developments in the field and contribute to the intellectual environment of the research group through active participation in discussions and journal clubs.
• Compliance and safety: Ensure adherence to ethical guidelines, safety protocols, and regulatory requirements in all aspects of research activities.

PERSONAL ATTRIBUTES 

• Initiative: applicants should demonstrate a proactive and self-driven approach to work and should take the initiative to identify research opportunities, propose new ideas, and seek solutions to research challenges;
• Collaboration: The ability to communicate effectively, listen actively, and contribute constructively to group discussions is essential for successful collaboration;
• Resilience: applicants should demonstrate resilience and perseverance, maintaining a positive attitude and adaptability in the face of setbacks or unexpected outcomes;
• Ethical conduct: applicants should adhere to ethical guidelines, promote responsible research practices, and ensure the safety and well-being of themselves and others in the research environment.

These personal attributes, combined with the required qualifications and expertise, contribute to the overall effectiveness and success of postdoctoral researchers in pursuit of advancing knowledge and making significant contributions to their respective fields. 

ESSENTIAL QUALIFICATIONS/EXPERIENCES 

• PhD Graduation;
• Strong background in deep learning, machine learning, statistics and related disciplines.
• Have strong research and innovation abilities, and be able to engage in full-time postdoctoral research work;
• Excellent written and oral communication skills in English. Being able to adapt to an all-English academic environment;
• Track record of collaborative research, including experience working in interdisciplinary teams;
• Prior experience in grant proposal development and writing is desirable;
• Commitment to maintaining a safe and inclusive research environment;
• Other conditions should comply with the relevant regulations of the National Postdoctoral Management Committee.

CITIZENSHIP AND VISA REGULATIONS

The employee will sign a labour contract with the XJTLU Technology Transfer Centre Co., Ltd (XTTC) and employment at XTTC is regulated by Chinese Labour Laws, and must comply with the regulations of the provincial government. These regulations stipulate who is eligible for legal employment with regard to obtaining work permits and visas.  

CAREER DEVELOPMENT

• Professional development training is provided.
• Upon completion of the postdoctoral programme, the postdoctoral researcher with a “Distinction” assessment result may be hired for normal academic positions at XJTLU.

RESEARCH FUNDING SUPPORT 

In addition to general funding programs open to all researchers, the post-doctoral researchers will have access to additional funding opportunities that are specifically targeted for post-doctoral researchers, including but not limited to the National Funding Program for Postdoctoral Researchers, China Postdoctoral Science Fund, Academic Exchange Programs, Provincial Funding Program, etc.

COMPENSATION & BENEFITS

SALARY and BENEFITS:  We offer a competitive salary and benefits package commensurate with qualifications and experience. The initial appointment will be for a fixed term of 2 years.

1. Salary (Basic and Performance-based): ¥600-700K over the two years’ post-doc candidacy;
2. Additional subsidy from the local government: The current standard is ¥ 7, 500 per month (up to two years);
3. Allowance for reallocation: ¥ 300K (for those who work in Suzhou after successful post-doc completion);
4. Commercial insurance: international insurance plans customized for XJTLU staff and family members;
5. Paid holidays: 

• • Statutory Holidays (11 days)
  • Annual Leave (36 days)
  • Family Matters Leave
  • Paid Sick Leave
  • Marriage Leave
  • Paternity Leave
  • Parental Leave
  • Etc.

6. Working visa and residence permit in China: XJTLU sponsors working visas and residence permits in China for the staff.

HOW TO APPLY 

Interested applicants are required to specify their research area, identify a potential supervisor and submit the application with the following files,

• Cover letter, English curriculum vitae, including country of citizenship and highest degree level
• Academic achievements documentation, please highlight the publications as first author or corresponding author, funded research projects, patents, awards and engagement in other research activities in recent three years

For specific inquiries relating to the position, please email Dr. Jionglong Su (jionglong.su@xjtlu.edu.cn) or Dr. Jia Meng (jia.meng@xjtlu.edu.cn).