Large Multimodal Model for Oral and Maxillofacial Reconstructive Surgery at the University of Hong Kong

jing

Facial surgery

In June 2024, a pioneering surgical feat was accomplished by Professor Richard Y. Su and Dr. Jane J. Pu of The University of Hong Kong’s Faculty of Dentistry, in collaboration with United Imaging Intelligence (UII). Utilizing the uAI MERITS platform (Metaverse Ecosystem for Robotic Intervention, Therapy, and Surgery), powered by a large multimodal model for medicine, the team successfully performed an AI-assisted oral and maxillofacial reconstructive surgery.

The procedure was a transformative breakthrough for a patient who had suffered partial mandible loss due to cancer. It involved intricate steps such as transplanting a free fibular flap from the patient’s lower leg—comprising bone and soft tissue—to reconstruct the mandible and restore normal function and aesthetics. Simultaneously, dental implants were integrated into the transplanted bone, facilitating restoration of masticatory function and facial structure.

Historically, maxillofacial reconstructive surgeries have been beset by challenges stemming from complex anatomical structures and stringent aesthetic and functional demands. Crucial to overcoming these hurdles in the recent surgery was the precise localization of perforator vessels within the soft tissue—a task traditionally reliant on surgeons’ expertise and auxiliary tools like ultrasound, known for their limitations in accuracy and efficiency.

The integration of AI technologies, particularly a large multimodal model trained on diverse medical images, marked a paradigm shift in surgical precision. This innovative approach enabled precise preoperative vessel segmentation and real-time intraoperative dynamic visual tracking, significantly enhancing surgical efficiency and accuracy.

During the operation, the UII Discover – Runoff CTA system played a pivotal role by rapidly generating a comprehensive 3D model of the patient’s lower limb arteries, bones, and skin. This advanced system intelligently identified and highlighted perforator vessels, streamlining preoperative planning and optimizing surgical outcomes.

Professor Su emphasized the significance of these technological advancements at the International Society for Oral and Maxillofacial Rehabilitation Conference in Hong Kong. The successful completion of multiple surgeries using the uAI MERITS platform underscores its potential in advancing medical practice. Notably, the latest surgical milestone included the innovative use of the anterolateral thigh flap technique, further expanding the platform’s capabilities.

James J. Xia, M.D., Ph.D., Chief Medical Officer at United Imaging Intelligence, highlighted the ongoing collaboration with medical professionals to explore additional clinical applications of AI technology. He expressed confidence in leveraging large multimodal models to pioneer new possibilities in medicine, promising continued innovation for physicians and patients globally.

This achievement not only signifies a leap forward in oral and maxillofacial reconstructive surgery but also highlights the transformative potential of AI-driven medical technologies in enhancing patient care and surgical outcomes.

Related topics:

Leave a Comment