Investigation of Response Aggregation Methods in Divergent Thinking Assessments

The Journal of Creative Behavior, Год журнала: 2024, Номер unknown

Опубликована: Дек. 24, 2024

ABSTRACT Divergent thinking (DT) ability is widely regarded as a central cognitive capacity underlying creativity, but its assessment challenged by the fact that DT tasks yield variable number of responses. Various approaches for scoring have been proposed, which differ in how responses are evaluated and aggregated within task. The present study aimed to identify methods maximize psychometric quality while also reducing confounding effect fluency. We compared traditional (summative average scoring) more recent such snapshot well top‐ max‐scoring. further explored moderating role task complexity metacognitive abilities. A sample 300 participants was recruited via Prolific. Reliability evidence assessed terms internal consistency, concurrent criterion validity correlations with real‐life creative behavior, self‐beliefs, openness. Findings confirm alternative aggregation reduce tends increase function included three minimal requirement decent reliability evidence. Convergent highest max‐scoring when using medium ideas.

Язык: Английский

---

A meta-perspective on the creative metacognition framework. Reply to comments on “A systematic framework of creative metacognition”

Physics of Life Reviews, Год журнала: 2024, Номер 50, С. 66 - 71

Опубликована: Июнь 19, 2024

Язык: Английский

---

The ACT‐ON Ideas Framework: A Contingency Perspective on Creative Self‐Regulation

The Journal of Creative Behavior, Год журнала: 2025, Номер 59(1)

Опубликована: Фев. 1, 2025

ABSTRACT Creative action is idiosyncratic. Not only do creators differ in their approaches to creative work, but endeavors complexity, scale, and level of difficulty, meaning that the self‐regulation strategies people use manage themselves ideas from ideation implementation may differ. More specifically, work devote determined by demands inherent certain forms activity people's capacities control thoughts, emotions, behaviors meet those demands. Yet, current theoretical frameworks have not explicitly delineated role self‐regulatory determinants contingencies make it easier or more challenging for actualize ideas. To end, we present Actualization Contingencies Tendencies Operable New Ideas (ACT‐ON Ideas) framework, which outlines factors influence imposed as well propensities enact during idea implementation. We argue activities are influenced (a) external such qualities, task demands, environment, (b) internal tendencies dispositions, metacognitive abilities, self‐beliefs, behavioral inertia previous efforts process.

Язык: Английский

---

Metacognition and motivation in creativity: examining the roles of self-efficacy and values as cues for metacognitive judgments

Metacognition and Learning, Год журнала: 2025, Номер 20(1)

Опубликована: Апрель 24, 2025

Язык: Английский

---

Scoring German Alternate Uses Items Applying Large Language Models

Journal of Intelligence, Год журнала: 2025, Номер 13(6), С. 64 - 64

Опубликована: Май 29, 2025

The alternate uses task (AUT) is the most popular measure when it comes to assessment of creative potential. Since their implementation, AUT responses have been rated by humans, which a laborious and requires considerable resources. Large language models (LLMs) shown promising performance in automatically scoring English as well other languages, but not clear method works best for German data. Therefore, we investigated different LLMs automated responses. We compiled data across five research groups including ~50,000 15 objects from eight lab online survey studies (including ~2300 participants) examine generalizability datasets conditions. Following pre-registered analysis plan, compared two fine-tuned, multilingual LLM-based approaches [Cross-Lingual Alternate Uses Scoring (CLAUS) Open Creativity with Artificial Intelligence (OCSAI)] Generative Pre-trained Transformer (GPT-4) (a) original (b) translated English. found that scorings were substantially correlated human ratings, higher relationships OCSAI followed GPT-4 CLAUS. Response translation, however, had no consistent positive effect. discuss results items derive recommendations future directions.

Язык: Английский

---

Investigation of Response Aggregation Methods in Divergent Thinking Assessments

Опубликована: Июль 27, 2024

Divergent thinking (DT) ability is widely regarded as a central cognitive capacity underlying creativity. The scoring of DT performance, however, challenging since tasks yield variable number responses with varying levels creative quality. Over the years, many different approaches for have been proposed, which differ in how single are evaluated and response scores aggregated within task. present study aimed to identify methods that maximize psychometric quality while also reducing confounding effect fluency. We compared traditional summative average more recent such snapshot well top- max-scoring numbers top/max responses. further explored potential moderating role task complexity metacognitive abilities. A diverse sample 300 participants was recruited via Prolific. Reliability evidence assessed terms internal consistency, concurrent criterion validity correlations real-life behavior, self-beliefs, openness experience. Findings confirm alternative aggregation effectively reduce fluency observed scoring. tends increase function included three minimal requirement decent reliability evidence. Convergent highest when using medium about ideas.

Язык: Английский

---

Determinants of Creative Metacognitive Monitoring: Creativity, Personality, and Task-Related Predictors of Self-Assessed Creativity at Performance- and Response-Level

Опубликована: Сен. 3, 2024

The assessment of one's own cognitive processes during creative endeavors, known as metacognitive monitoring (CMC-M), can manifest in various ways. These include appraising task-related operations and performance (i.e., the level), well evaluating ideas generated response level). outcomes this evaluation serve a crucial regulatory function, they determine how process is managed, specifically influencing decision to persist or discontinue efforts. So far, investigations into CMC-M have predominantly concentrated on predicting accuracy ideas, but less about what determines level self-assessments (including over- underestimation) beyond underlying performance. In fact, it was suggested that skills may be more closely intertwined with other factors, such personality. To address these issues, we conducted an online study (N = 425) explores determinants task terms ability (divergent thinking), real-life creativity (creative activities achievements), core personality traits (intellect, openness, narcissism), surface characteristics self-efficacy, personal identity, self-concept), factors (motivation prior experience). We discuss findings context recently proposed systematic framework metacognition (Lebuda & Benedek, 2023).

Язык: Английский

---

Integrating visible thinking and design thinking strategies to improve creativity and growth mindsets

Educational Technology Research and Development, Год журнала: 2024, Номер unknown

Опубликована: Ноя. 11, 2024

Язык: Английский

---

How Do Famous Artists Write about Their Metacognition, Self-Regulation and Creative Problem-Solving?

Thinking Skills and Creativity, Год журнала: 2024, Номер 54, С. 101688 - 101688

Опубликована: Ноя. 12, 2024

Язык: Английский

---

Conceptual promises and mechanistic challenges of the creative metacognition framework: Comment on “A systematic framework of creative metacognition” by Izabela Lebuda and Mathias Benedek

Physics of Life Reviews, Год журнала: 2023, Номер 47, С. 273 - 275

Опубликована: Ноя. 14, 2023

Язык: Английский

---