ChatGPT's Role in Gerontology Research

Abstract

Background: ChatGPT and other ChatBots have emerged as tools for interacting with information in manners resembling natural human speech. Consequently, the technology is used across various disciplines, including business, education, and even in biomedical sciences. There is a need to better understand how ChatGPT can be used to advance gerontology research. Therefore, we evaluated ChatGPT responses to questions on specific topics in gerontology research, and brainstormed recommendations for its use in the field.

Methods: We conducted semi-structured brainstorming sessions to identify uses of ChatGPT in gerontology research. We divided a team of multidisciplinary researchers into four topical groups: a) gero-clinical science, b) basic geroscience, c) informatics as it relates to electronic health records (EHR), and d) gero-technology. Each group prompted ChatGPT on a theory-, methods-, and interpretation-based question and rated responses for accuracy and completeness based on standardized scales.

Results: ChatGPT responses were rated by all groups as generally accurate. However, the completeness of responses was rated lower, except by members of the informatics group, who rated responses as highly comprehensive.

Conclusions: ChatGPT accurately depicts some major concepts in gerontological research. However, researchers have an important role in critically appraising the completeness of its responses. Having a single generalized resource like ChatGPT may help summarize the preponderance of evidence in the field to identify gaps in knowledge and promote cross-disciplinary collaboration.

PDF link here

2 Likes

I really liking using https://www.asklongevitygpt.com/ and copilot for poking around areas of interest. So far have not seen a big difference between the 2 but leaning towards copilot

Someone posted this one the other day and I’ll be trying it out tomorrow.

https://www.undermind.ai/accounts/register/

This matches my experience, especially with medical questions. The answers may be incomplete and sometimes wrong. Asking the questions “Are you sure?,” “Did you check all data sources” or pointing out obvious errors or incompleteness may sometimes bring better responses. But, even with this technique I still don’t fully trust the answers.

After ChatGPT provides a final answer I commonly state “Show your sources of data.” If I don’t trust one of the sources I state “Eliminate data from the (so and so source) in your answer.”

I find AI systems helpful as a starting position, but you need to check the original sources to find out what the situation is for certainty. At times the AI can be completely wrong.