A guide for social science journal editors on easing into open science DOI Creative Commons
Priya Silverstein, Colin Elman, Amanda Kay Montoya

et al.

Research Integrity and Peer Review, Journal Year: 2024, Volume and Issue: 9(1)

Published: Feb. 16, 2024

Journal editors have a large amount of power to advance open science in their respective fields by incentivising and mandating policies practices at journals. The Data PASS Editors Discussion Interface (JEDI, an online community for social journal editors: www.dpjedi.org ) has collated several resources on embedding editing ( www.dpjedi.org/resources ). However, it can be overwhelming as editor new know where start. For this reason, we created guide how get started with science. outlines steps that take implement within journal, goes through the what, why, how, worries each policy practice. This manuscript introduces summarizes (full guide: https://doi.org/10.31219/osf.io/hstcx

Language: Английский

ChatGPT: Vision and challenges DOI Creative Commons
Sukhpal Singh Gill, Rupinder Kaur

Internet of Things and Cyber-Physical Systems, Journal Year: 2023, Volume and Issue: 3, P. 262 - 271

Published: Jan. 1, 2023

Artificial intelligence (AI) and machine learning have changed the nature of scientific inquiry in recent years. Of these, development virtual assistants has accelerated greatly past few years, with ChatGPT becoming a prominent AI language model. In this study, we examine foundations, vision, research challenges ChatGPT. This article investigates into background technology behind it, as well its popular applications. Moreover, discuss advantages bringing everything together through Internet Things (IoT). Further, speculate on future by considering various possibilities for study development, such energy-efficiency, cybersecurity, enhancing applicability to additional technologies (Robotics Computer Vision), strengthening human-AI communications, bridging technological gap. Finally, important ethics current trends

Language: Английский

Citations

157

ChatGPT in healthcare: A taxonomy and systematic review DOI Creative Commons
Jianning Li, Amin Dada, Behrus Puladi

et al.

Computer Methods and Programs in Biomedicine, Journal Year: 2024, Volume and Issue: 245, P. 108013 - 108013

Published: Jan. 21, 2024

The recent release of ChatGPT, a chat bot research project/product natural language processing (NLP) by OpenAI, stirs up sensation among both the general public and medical professionals, amassing phenomenally large user base in short time. This is typical example 'productization' cutting-edge technologies, which allows without technical background to gain firsthand experience artificial intelligence (AI), similar AI hype created AlphaGo (DeepMind Technologies, UK) self-driving cars (Google, Tesla, etc.). However, it crucial, especially for healthcare researchers, remain prudent amidst hype. work provides systematic review existing publications on use ChatGPT healthcare, elucidating 'status quo' applications, readers, professionals as well NLP scientists. biomedical literature database PubMed used retrieve published works this topic using keyword 'ChatGPT'. An inclusion criterion taxonomy are further proposed filter search results categorize selected publications, respectively. It found through that current has achieved only moderate or 'passing' performance variety tests, unreliable actual clinical deployment, since not intended applications design. We conclude specialized models trained (bio)medical datasets still represent right direction pursue critical applications.

Language: Английский

Citations

157

Harnessing the Power of ChatGPT for Automating Systematic Review Process: Methodology, Case Study, Limitations, and Future Directions DOI Creative Commons
Ahmad Alshami, Moustafa Elsayed, Eslam Ali

et al.

Systems, Journal Year: 2023, Volume and Issue: 11(7), P. 351 - 351

Published: July 9, 2023

Systematic reviews (SR) are crucial in synthesizing and analyzing existing scientific literature to inform evidence-based decision-making. However, traditional SR methods often have limitations, including a lack of automation decision support, resulting time-consuming error-prone reviews. To address these limitations drive the field forward, we harness power revolutionary language model, ChatGPT, which has demonstrated remarkable capabilities various writing tasks. By utilizing ChatGPT’s natural processing abilities, our objective is automate streamline steps involved SR, explicitly focusing on search, screening, data extraction, content analysis. Therefore, methodology comprises four modules: (1) Preparation Boolean research terms article collection, (2) Abstract screening articles categorization, (3) Full-text filtering information (4) Content analysis identify trends, challenges, gaps, proposed solutions. Throughout each step, focus been providing quantitative analyses strengthen robustness review process. illustrate practical application method, chosen topic IoT applications water wastewater management quality monitoring due its critical importance dearth comprehensive this field. The findings demonstrate potential ChatGPT bridging gap between AI models, enhanced efficiency reliability processes. Notably, exhibits exceptional performance categorizing relevant articles, leading significant time effort savings. Our assessment reveals following: overall accuracy for discarding classification 88%, F-1 scores 91% respectively, compared expert assessments. suitability extraction. Overall, contributes valuable insights empowering researchers conduct more reliable while advancing knowledge decision-making across domains.

Language: Английский

Citations

107

Impact of AI assistance on student agency DOI Creative Commons
Ali Darvishi, Hassan Khosravi, Shazia Sadiq

et al.

Computers & Education, Journal Year: 2023, Volume and Issue: 210, P. 104967 - 104967

Published: Dec. 1, 2023

AI-powered learning technologies are increasingly being used to automate and scaffold activities (e.g., personalised reminders for completing tasks, automated real-time feedback improving writing, or recommendations when what study). While the prevailing view is that these generally have a positive effect on student learning, their impact students' agency ability self-regulate under-explored. Do students learn from regular, detailed provided by AI systems, will they continue exhibit similar behaviour in absence of assistance? Or do instead rely assistance without it? To contribute filling this research gap, we conducted randomised controlled experiment explored context peer feedback. With 1625 across 10 courses, an was using review. During initial four-week period, were guided features utilised techniques such as rule-based suggestion detection, semantic similarity, comparison with previous comments made reviewer enhance submissions if deemed insufficiently general nature. Over following four weeks, divided into different groups: control (AI) received prompts, (NR) no (SR) self-monitoring checklists place (SAI) had access both prompts checklists. Results suggest tended rather than assistance. If removed, self-regulated strategies could help gap but not effective also showed hybrid human-AI approaches complement more its own. We conclude discussing broader benefits, challenges implications relying relation world where learn, live work AI.

Language: Английский

Citations

107

An exploratory survey about using ChatGPT in education, healthcare, and research DOI Creative Commons
Mohammad Hosseini, Catherine A. Gao, David Liebovitz

et al.

PLoS ONE, Journal Year: 2023, Volume and Issue: 18(10), P. e0292216 - e0292216

Published: Oct. 5, 2023

Objective ChatGPT is the first large language model (LLM) to reach a large, mainstream audience. Its rapid adoption and exploration by population at has sparked wide range of discussions regarding its acceptable optimal integration in different areas. In hybrid (virtual in-person) panel discussion event, we examined various perspectives use education, research, healthcare. Materials methods We surveyed in-person online attendees using an audience interaction platform (Slido). quantitatively analyzed received responses on questions about contexts. compared pairwise categorical groups with Fisher’s Exact. Furthermore, used qualitative analyze code discussions. Results 420 from estimated 844 participants (response rate 49.7%). Only 40% had tried ChatGPT. More trainees faculty. Those who were more interested it wider contexts going forwards. Of three discussed contexts, greatest uncertainty was shown education. Pros cons raised during for this technology Discussion There around uses healthcare, still much acceptability uses. respondents roles (trainee vs faculty staff). needed explore perceptions LLMs such as vital sectors healthcare research. Given involved risks unforeseen challenges, taking thoughtful measured approach would reduce likelihood harm.

Language: Английский

Citations

104

The ethics of disclosing the use of artificial intelligence tools in writing scholarly manuscripts DOI Creative Commons
Mohammad Hosseini, David B. Resnik, Kristi Holmes

et al.

Research Ethics, Journal Year: 2023, Volume and Issue: 19(4), P. 449 - 465

Published: June 15, 2023

In this article, we discuss ethical issues related to using and disclosing artificial intelligence (AI) tools, such as ChatGPT other systems based on large language models (LLMs), write or edit scholarly manuscripts. Some journals,

Language: Английский

Citations

87

The Potential and Concerns of Using AI in Scientific Research: ChatGPT Performance Evaluation DOI Creative Commons
Zuheir N. Khlaif, Allam Mousa, Muayad K. Hattab

et al.

JMIR Medical Education, Journal Year: 2023, Volume and Issue: 9, P. e47049 - e47049

Published: July 21, 2023

Background Artificial intelligence (AI) has many applications in various aspects of our daily life, including health, criminal, education, civil, business, and liability law. One aspect AI that gained significant attention is natural language processing (NLP), which refers to the ability computers understand generate human language. Objective This study aims examine potential for, concerns of, using scientific research. For this purpose, high-impact research articles were generated by analyzing quality reports ChatGPT assessing application’s impact on framework, data analysis, literature review. The also explored around ownership integrity when AI-generated text. Methods A total 4 ChatGPT, thereafter evaluated 23 reviewers. researchers developed an evaluation form assess generated. Additionally, 50 abstracts their was evaluated. subjected ANOVA thematic analysis analyze qualitative provided Results When detailed prompts providing context study, would high-quality could be published journals. However, had a minor developing framework analysis. primary area needing improvement development Moreover, reviewers expressed Nonetheless, strong increase productivity can used academic writing. Conclusions text improve articles. findings suggest decision makers should focus more methodology part research, includes design, tools, depth, draw theoretical practical implications, thereby establishing revolution era AI. implications different fields such as medical education deliver materials develop basic competencies for both medicine students faculty members.

Language: Английский

Citations

81

Guidance for Authors, Peer Reviewers, and Editors on Use of AI, Language Models, and Chatbots DOI Open Access
Annette Flanagin,

Jacob Kendall-Taylor,

Kirsten Bibbins‐Domingo

et al.

JAMA, Journal Year: 2023, Volume and Issue: 330(8), P. 702 - 702

Published: July 27, 2023

Nonhuman “Authors” and Implications for the Integrity of Scientific Publication Medical Knowledge

Language: Английский

Citations

75

Artificial intelligence to support publishing and peer review: A summary and review DOI Creative Commons
Kayvan Kousha, Mike Thelwall

Learned Publishing, Journal Year: 2023, Volume and Issue: 37(1), P. 4 - 12

Published: Aug. 8, 2023

Abstract Technology is being developed to support the peer review processes of journals, conferences, funders, universities, and national research evaluations. This literature software summary discusses partial or complete automation several publishing‐related tasks: suggesting appropriate journals for an article, providing quality control submitted papers, finding suitable reviewers papers grant proposals, reviewing, evaluation. It also attempts estimate article from text scores as well post‐publication but not bibliometric data. The existing examples working technology show that useful helping find there good evidence it can sometimes help with initial manuscripts. Much other supporting publishing editorial work exists used, without published academic evaluations its efficacy. value artificial intelligence (AI) reviewing has been clearly demonstrated yet, however. Finally, whilst theoretically have assessment, yet widely enough available be a practical source systematic automation.

Language: Английский

Citations

64

An exploratory survey about using ChatGPT in education, healthcare, and research DOI Creative Commons
Mohammad Hosseini, Catherine A. Gao, David Liebovitz

et al.

medRxiv (Cold Spring Harbor Laboratory), Journal Year: 2023, Volume and Issue: unknown

Published: April 3, 2023

Objective ChatGPT is the first large language model (LLM) to reach a large, mainstream audience. Its rapid adoption and exploration by population at has sparked wide range of discussions regarding its acceptable optimal integration in different areas. In hybrid (virtual in-person) panel discussion event, we examined various perspectives use education, research, healthcare. Materials Methods We surveyed in-person online attendees using an audience interaction platform (Slido). quantitatively analyzed received responses on questions about contexts. compared pairwise categorical groups with Fisher's Exact. Furthermore, used qualitative methods analyze code discussions. Results 420 from estimated 844 participants (response rate 49.7%). Only 40% had tried ChatGPT. More trainees faculty. Those who were more interested it wider contexts going forwards. Of three discussed contexts, greatest uncertainty was shown education. Pros cons raised during for this technology Discussion There around uses healthcare, still much acceptability uses. respondents roles (trainee vs faculty staff). needed explore perceptions LLMs such as vital sectors healthcare research. Given involved risks unforeseen challenges, taking thoughtful measured approach would reduce likelihood harm.

Language: Английский

Citations

62