ChatGPT makes waves again, big model + XR replaces human doctors?

Original source: Metaverse

Author: Bai Yujie

Image source: Generated by Unbounded AI

Since the emergence of ChatGPT, it has caused quite a stir in various industries~

However, the successive opening of many large models has meant that ChatGPT is no longer “top of the list”. Just when users were excitedly experiencing the large domestic models, an article titled “ChatGPT successfully diagnosed a 4-year-old boy with a strange disease, beating 17 doctors” The news quickly attracted attention.

**Things started three years ago. **

During the COVID-19 epidemic, 4-year-old Alex received a trampoline from his mother Courtney. Soon after, Alex began to suffer from physical pain and had to rely on painkillers every day to “sustain his life.”

At first, Alex began to grind his teeth, but during the treatment, Courtney discovered that Alex had not grown taller for a long time, and even the development of his left and right feet seemed a bit unbalanced - his right foot walked in front, and his left foot was dragged along.

At the same time, Alex developed more complications: the neurologist said Alex suffered from migraines; the otolaryngologist diagnosed Alex with sinusitis; the physical therapist thought Alex might have cerebellobulbar plana…

Courtney took him to see 17 doctors in 3 years, but all doctors could not determine the cause.

It wasn’t until Courtney signed up for ChatGPT with the attitude of giving it a try and uploaded Alex’s condition that she finally got the correct diagnosis.

**In fact, after the emergence of the “Battle of Hundreds of Models” phenomenon this year, AI+ medical care is no longer a new thing. **

When we enter “medical model” into a search engine and search, tens of millions of web pages will pop up.

**The major technology companies have already laid out their plans in the direction of large-scale medical models. **

On July 31, Google released its first large-scale general medical model - Med-PaLM M. This model is a multi-modal generative model jointly created by Google Research and DeepMind. It understands clinical language, imaging, and genomics. .

In 14 test tasks, Med-PaLM M performed well. What is particularly noteworthy is that in 246 real chest X-rays, in up to 40.50% of cases, the reports generated by Med-PaLM M were more frequently used by clinicians. It has been widely adopted, which provides a solid foundation for its clinical application.

**In addition, the exploration of large-scale medical models in China is also in full swing. **

Major manufacturers such as Tencent, Baidu, Huawei, Alibaba, SenseTime and iFlytek have emerged in the field of large medical models, releasing Tencent Medical Large Model, Wenxin Biocomputing Large Model, Pangu Drug Molecular Large Model, Tongyi Qian Question big model, medical big model factory and Spark cognitive big model; these big models have penetrated into every corner of smart medical treatment, smart diagnosis and treatment, medical question and answer, medical knowledge graph, medical report generation, personalized rehabilitation plan generation, etc., rapidly promoting business Implemented.

**In addition to large models, major domestic and foreign technology giants are also deploying in XR medical care. **

Previously, many news reports were about the contribution of XR to medical research and medical training. However, with the continuous updating and iteration of technology, AR/VR/MR also have a place to be used in clinical practice.

**On August 31, Pixee Medical announced that the world’s first shoulder implant surgery using the (MR) Shoulder+ product was successfully completed. **

Pixee Medical, a company developing enhanced surgical guidance technology, announced that surgeons successfully completed the world’s first shoulder implant surgery using Pixee Medical’s cutting-edge mixed reality (MR) Shoulder+ product.

Shoulder+ is a navigation tool that uses MR glasses to provide surgeons with precise, real-time information about the 3D positioning of the implant during surgery. This information is superimposed on the patient’s field of view, allowing surgeons to see through the skin to bone, improving surgical precision. This product helps reduce the risk of complications such as implant misalignment and revision surgery.

Currently, the Shoulder+ system has obtained the CE mark and is awaiting FDA 510(k) clearance.

**This means it has met the standards set by the European Union and the United States for medical devices. **

**At the same time, a new study published in the journal Frontiers in Virtual Reality found that VR meditation is an effective way to relieve anxiety and fatigue related to cancer patients. **

Researchers at the Immunotherapy Center (ITC) randomly assigned participants to a VR meditation group or a control group: The VR meditation group received 10-minute VR meditation sessions twice a week for four weeks; the control group did not receive any VR meditation sessions. .

At the end of the study, the VR meditation group reported significantly lower levels of anxiety, stress, and fatigue than the control group, as well as significantly higher levels of relaxation and well-being.

Comparison of relaxation and overall health scores before and after VR

When it comes to the advancement of technology in the medical field, it is often positive news or information. In fact, it does provide many beneficial effects: ChatGPT and XR medical technology have played a role in diagnosis, surgical navigation, patient management, etc. important role.

**However, while we are excited about the potential brought by technology, we must also realize that technology can never completely replace the role of human doctors. **

Advances in technology can provide more accurate, efficient and convenient medical services: large medical models can provide patients with instant medical consultation and auxiliary diagnosis, and XR technology can enhance the accuracy and visualization of surgical navigation. These technologies lead to better medical experiences and outcomes, shortening the time to diagnosis and treatment.

However, the World Health Organization issued a statement on May 16; calling on users to be cautious in using large-scale language model tools generated by artificial intelligence: “Although health information can be easily obtained with the help of such tools, it can even be used in areas with insufficient resources. Regions can improve diagnostic capabilities, but the risks must be carefully examined when using them.”

Although AI can provide accurate medical knowledge and assisted diagnosis, it may ignore the individual differences and unique circumstances of patients. Each patient’s physical condition, lifestyle, genetic makeup and other factors are unique, and it’s difficult for AI to take these differences into account.

**This also means that AI may give treatment recommendations that are inconsistent with the patient’s actual condition. **

**In addition, although technology can provide information and assistance, it cannot replicate the human communication and emotional connection between doctors and patients. **Doctors not only possess professional knowledge and skills, but are also able to build trusting relationships with patients and provide emotional support and understanding. They are able to listen to the patient’s description of the condition, understand the patient’s needs, and combine medical knowledge with the patient’s unique situation to develop the best treatment plan. Physicians are also able to use moral and ethical judgment to make the best choices when faced with complex medical decisions.

**Thus, we should view technology not as a replacement for human doctors, but as a powerful tool and resource for the medical team. The combination of **technology and human doctors can achieve the best results in medical treatment. With the assistance of technology, doctors can diagnose and treat more accurately and provide better medical care. Doctors’ humanistic care and emotional support can provide patients with physical and psychological care, creating a more comprehensive medical experience. Therefore, advances in technology in the medical field need to be combined with the care and expertise of human doctors to achieve optimal medical outcomes.

Reference article:

1、Virtual Reality Meditation Shows Promise in Reducing Cancer-Related Anxiety, Stress, and Fatigue

2、World’s First Shoulder Surgery Using Mixed Reality

3. After seeking medical treatment for 3 years to no avail, ChatGPT diagnosed the cause of the disease in a 4-year-old boy, and large models began to enter the medical field.

4. Tsinghua alumni have made meritorious deeds! Google releases its first large-scale general medical model, 14 tasks SOTA

5. WHO: Use large language models generated by artificial intelligence with caution