The effect of using guided questions and collaborative groups for complex problem solving on performance and attitude in a web-enhanced learning environment
Authors: John M. Keller
Venue:  (2005)

Considering the popularity of Web-based instruction (WBI), the research on instructional design and pedagogy for WBI is limited. Specifically, further research on developing learning strategies to improve interaction, cognitive engagement, and motivation for WBI is needed. To enhance complex problem solving in WBI, this study used collaborative groups and guided questions in a hybrid web-enhanced learning environment in which students attended class face-to-face and online. A Problem-Based Learning (PBL) approach was used to design a complex problem scenario for the students. PBL uses authentic, complex problems as the impetus for learning and fosters the acquisition of both disciplinary knowledge and problem-solving skills (Edens, 2000; Flynn Klein, 2001; Levin, 1995). The participants were pre-service teachers enrolled in an introductory educational technology course in the College of Education at a large university in the southeastern United States. Students voluntarily participated in the study as an optional part of class activities. The study was designed as a 2 &times; 2 factorial design. The independent variables used were collaborative groups (presence vs. absence), and guided questions (present vs. absent). The dependent variables of this study were (a) learning outcomes that were determined by measuring students' final products with scoring rubrics, (b) learning processes that were evaluated by observation and review of discussion board postings, and (c) attitudes toward problem solving that were measured by questionnaires and the Instructional Material Motivation Survey (IMMS). Students were engaged in solving a scenario for three weeks and participated in both classroom and online discussion activities. A mixed method study design was applied, which combined an experimental study and qualitative data analysis that included interviews, discussion board message analysis, and observations.The result of this experimental study showed that the students working individually with guided questions (IQ) significantly outperformed the other treatment groups. It appeared that guided questions were an effective learning strategy for solving complex problems. There were no significant differences for problem-solving attitude among the four groups. The high mean score and the analysis of interviews suggested a ceiling effect for their problem solving attitude. The result from the discussion board message analysis showed a positive relationship between a high level of group discussion engagement and the problem solving outcome. The study implied that, in order for students to gain the full benefits from collaborative group work, the group discussion process should be moderated, especially when students are novice learners in problem solving. Additionally, using guided questions was effective when students worked individually and used the questions as a guideline or checklist. Findings from this study will inform future research efforts on collaborative learning and complex problem solving in web-enhanced educational environments.