(2024) 17:16 | Zhiping Paul Wang, Priyanka Bhandary, Yizhou Wang, Jason H. Moore
This study evaluates the capabilities of GPT-4 in generating text, tables, and diagrams for biomedical review papers. The researchers used two cancer research papers as benchmarks to assess GPT-4's performance in summarizing key points, generating review content, projecting future research directions, and creating tables and figures. The results show that GPT-4 can effectively summarize and synthesize information from a large number of references, generating text content with high semantic similarity to the original review paper. However, it struggles with generating precise and accurate tables and figures, and there are concerns about potential plagiarism when using references. The study also highlights the need for enhanced functionalities in ChatGPT to better meet the needs of the scientific community, including improved document processing, deeper understanding of complex biomedical concepts, and more refined diagram creation. The authors suggest that further development and ethical considerations are necessary to ensure the responsible use of AI in scientific publishing.This study evaluates the capabilities of GPT-4 in generating text, tables, and diagrams for biomedical review papers. The researchers used two cancer research papers as benchmarks to assess GPT-4's performance in summarizing key points, generating review content, projecting future research directions, and creating tables and figures. The results show that GPT-4 can effectively summarize and synthesize information from a large number of references, generating text content with high semantic similarity to the original review paper. However, it struggles with generating precise and accurate tables and figures, and there are concerns about potential plagiarism when using references. The study also highlights the need for enhanced functionalities in ChatGPT to better meet the needs of the scientific community, including improved document processing, deeper understanding of complex biomedical concepts, and more refined diagram creation. The authors suggest that further development and ethical considerations are necessary to ensure the responsible use of AI in scientific publishing.