The Development of Problem Solving Capabilities in Pre-service Technology Teacher Education

Article

The Development of Problem Solving Capabilities in Pre-service Technology Teacher Education

Enhancing the problem solving capabilities of students and employees has become a national educational issue. The Commission on Pre-College Education in Mathematics, Science and Technology (1983) declared that "problem-solving skills, and scientific and technological literacy -- [are] the thinking tools that allow us to understand the technological world around us" (p. v). More recent reports that have focused on entry-level workplace skills by Carnevale, Gainer, and Meltzer (1990) and United States Department of Labor (1991) [SCANS Report] also under score the importance of developing students' problem solving abilities. As a result of this decade of emphasis on problem solving, efforts to enhance the capabilities of students to solve problems have reached most disciplines and most educational levels ( Birch, 1986 ; Bransford, Goin, Hasselbring, Kinzer, Sherwood, & Williams, 1986 ; Kulm, 1990 ; Lombard, Konicek, & Schultz, 1985 ; Thomas & Englund, 1990 ).

In technology education, teaching through problem solving methodology has become a central focus of instructional activity ( Waetjen, 1989 ). It follows, therefore, that teachers need to be adept at using problem solving strategies in their classrooms and laboratories. Several recent studies highlight this need. Barnes (1987) concluded that problem solving should be a key descriptor for defining technology and a curricular organizer for the study of technology. Householder and Boser (1991) reported that an emphasis on problem solving instructional strategies was a key ingredient in assessing the effective implementation of pre-service technology teacher education programs. In addition, research by Horath (1990) and by Householder and Boser pointed to the need for graduates of technology teacher education programs to use problem solving strategies in their classrooms and laboratories and to teach problem solving skills. In spite of the need to implement effective problem solving instruction in pre-service technology teacher education, there is no generally accepted framework to guide curriculum development or assessment procedures.

Background Ideas

One difficulty in investigating problem solving behavior is the many usages of the phrase “problem solving”. McCormick (1990) noted that, depending on the context, “problem solving” may mean: (a) a teaching method that encourages active learning, (b) a generic ability to deal with problem situations, (c) a method used in such subjects as mathematics or science, or (d) an empirical investigation. Additionally, Gagne (1985) used the term problem solving to describe a higher-order intellectual ability and a way of learning.

All of these usages have implications within technology teacher education. Problem solving is clearly seen as a teaching method with links back to experiential learning. Problem solving may also be viewed as a way of learning that generates new insights and useful thinking processes for the learner ( Gagne, 1985 ). Further, the scientific method of hypothesis generating and testing is certainly at the heart of technological problem solving. In this study, because of the implications for teacher education, "problem solving" was limited to two usages. First, "technological problem solving" refers to the systematic way of investigating a situation and implementing solutions. Second, the "problem solving approach" is used to describe a teaching method that encourages the development of new insights and useful thinking processes through active investigative learning.

Technological Problem Solving
Technological problem solving processes have been greatly influenced by the work of Dewey and Polya ( Savage and Sterry, 1991 ). Dewey (1910) described a five step iterative process of problem solving that comprised: (a) felt difficulty, (b) clarification of the problem, (c) identification of possible solutions, (d) testing the suggested solutions, and (e) verification of the results. Polya (1957) proposed a heuristic process for solving problems in mathematics that provided a mental guideline for action. The steps in Polya's heuristic included: (a) understanding the problem, (b) devising a plan, (c) carrying out the plan, and (d) looking back -- checking the results and evaluating the solution.

Two additional influences on technological problem solving have been the scientific method and the idea of creative problem solving. de Bono (1990) postulated that the concept of the "hypothesis", which formally sanctions creativity and imagination, has been "the" idea that has powered rapid scientific and technological change. Wallas (1926) described the creative problem solving process as involving four phases: (a) preparation, (b) incubation, (c) illumination, and (d) verification. More recently, DeVore, Horton, and Lawson (1989) built upon the work of Wallas and added two additional phases: motivation and manipulation.

These approaches have formed the basis for many models of problem solving that have been applied in technology education. Some of these models retain the simple linear approach, such as the IDEAL model of Bransford and Stein (1984) , while others, such as Barnes, Wiatt, and Bowen (1990) and Hutchinson (1987) , have proposed more complex circular or spiral models with evaluation components built into each phase.

Problem Solving As An Instructional Approach
The problem solving approach immerses students in active, investigative learning ( Sellwood, 1989 ). Through participation in a series of practical problem solving activities that may involve designing, modeling, and testing of technological solutions it is assumed that the learner will acquire both technical knowledge and higher-order cognitive skills. Gagne (1985) stressed the importance of experiential learning and noted that abstract concepts must be built upon concrete situations in order to "operationalize" (p. 103) declarative knowledge. Andre (1986) emphasized that the importance of problem solving methods lies in the degree of information processing required of the learner. In identifying problems, searching for solutions, and presenting results, the learner has multiple opportunities to encode and accommodate new knowledge.

Preparation To Teach Problem Solving
No research was found that related training in problem solving methods to pre-service technology teacher education. However, Diaber (1988) noted many common instructional elements among "investigative delivery systems" (p. 166) such as problem solving, inquiry teaching, discovery learning, and critical thinking. Given the commonalities, research in these related areas may provide useful insights to teacher educators.

A meta-analysis of inquiry teaching studies in science education by Sweitzer and Anderson (1983) reported that effective teacher preparation procedures included: (a) systematic observation of inquiry practices; (b) micro-teaching; and (c) feedback, in which supervisory conferences were combined with videotaped observations. More recently, Hutchinson (1989) found that pre-service teachers who participated in an inquiry-oriented seminar assumed more active teaching and learning roles than those teachers who participated in a traditional seminar setting. Fernandes (1988) , who compared the effects of explicit and implicit teaching of a Polya's (1957) heuristic model of mathematical problem-solving, reported that both approaches significantly enhanced the problem solving performance of pre-service teachers. However, only explicit instruction resulted in the conscious use of the heuristic. Fernandes concluded that in order to teach problem solving teachers must be competent problem solvers who are aware of the methods and processes that they employ.

These studies support the idea that changes in ways of preparing teachers will result in changes in classroom performance. Moreover, as Wright (1990) stated, being a competent technological problem solver is, by itself, insufficient preparation to teach problem solving skills. Pedagogical skills and practices that foster students' problem solving abilities must be taught to prospective teachers.

Purpose Of The Study

Although a host of implications for instruction have been offered from the research on problem solving in various domains, relatively few studies have addressed the need to prepare teachers to teach higher-order thinking skills such as problem solving. Little is known about the experiences in which pre-service technology education teachers should participate in order to acquire the skills needed to be competent technological problem solvers and to use problem solving effectively as an instructional methodology in the secondary school classroom or laboratory. The purpose of this study was to develop a validated inventory of instructional procedures, techniques, and assessment methods that may be used by the profession as a framework for curriculum development and for the assessment of program effectiveness in the development of problem solving capabilities in pre-service technology teacher education programs.

Research Questions

Two sets of instructional practices were investigated: (a) procedures recommended to acquire the skills needed to be competent technological problem solvers, and (b) procedures that facilitate the use of problem solving teaching methods in the secondary school classroom or laboratory. Each of the two sets of instructional practices was organized into three parts: (a) procedures recommended to develop the problem solving capabilities, (b) instructional techniques for putting the procedures in place, and (c) methods for assessment of program effectiveness in delivering the procedures. Specifically, the following research questions were used to guide the study:

Are leading practitioners and advocates of problem solving instruction within the field of technology education in agreement with leading educators and psychologists who are not in the field of technology education as to which procedures are effective in the development of problem solving capabilities?
What procedures are recommended to develop the technological problem solving capabilities of prospective teachers during pre-service technology teacher education programs?
What instructional techniques are appropriate for the delivery of the procedures recommended to develop the technological problem solving capabilities of prospective teachers?
How may the effectiveness of the procedures recommended to develop the technological problem solving capabilities of prospective teachers be assessed?
What procedures should be included in pre-service technology teacher education programs to assist teachers in using a problem solving methodology?
What instructional techniques provide an effective means for delivering the procedures designed to assist teachers in using a problem solving methodology?
How may the effectiveness of the procedures recommended to assist prospective teachers in using a problem solving methodology be assessed in pre-service technology teacher education programs?

Procedures

Perceptions of effective instruction were solicited from two selected panels of experts in problem solving. One panel was comprised of technology teacher educators (TECH) who were identified as leading practitioners or advocates of problem solving instruction (n = 10). These panel members were identified from the a group of 22 leading technology teacher educators who previously served as Delphi panelists in the study by Householder and Boser (1991) . The selection of TECH panelists was based upon their interest in problem solving as evidenced by (a) recent research, writing, and presentations on problem solving instruction, and (b) rating of the importance of problem solving items in response to a questionnaire conducted by Householder and Boser. The second panel included leading educators and psychologists (EXT) who have published in the area of problem solving and who were not in the field of technology education (n = 9).

There were two reasons for using two panels. First, expertise from outside technology teacher education may broaden the pool of instructional procedures recommended to the profession through this research. Barnes (1987) , who indicated the need to broaden the curricular organizers of technology education, consulted practitioners in several professions outside of technology education. Second, utilizing two panels provided data for comparing the perceptions of the experts within technology education with the recommendations of experts external to the field.

Potential panel members were contacted by telephone to seek their participation in the study and to establish a convenient time to conduct the telephone interview. Depending on the amount of lead time prior to the scheduled interview, a letter confirming the scheduled interview time was either mailed or faxed to the panelist. Enclosed with the confirmation letter was a copy of the telephone interview schedule, a brief orientation to the study, and a listing of pertinent definitions. The interview times ranged from 10 minutes when the respondent had completed the survey in advance of the conversation, to 45 minutes when the items were reviewed and recorded during the discussion.

In semi-structured telephone interviews, panelists were asked to rate the relevance of an inventory of procedures (70 items) synthesized from the literature, to comment on those procedures, and to suggest additional procedures that they considered essential in the development of problem solving capabilities. A 10-point scale was used by panelists to rate the procedures with a rating of 10 indicating that the procedure was absolutely essential. A rating of one implied that the recommendation was not relevant. The 10-point scale was assumed to have yielded interval data ( Nunnally, 1978 ). This scale was selected because of the potential for increased reliability in comparison to scales with fewer intervals ( Nunnally, 1978 ), and also because of its conversational appeal in an interview setting. That is, it is quite common for individuals to be asked to rate objects, ideas, or perceptions on a scale of 1 to 10.

The telephone interview schedule was pilot tested with subjects not included in the research sample. The individuals who comprised the sample for the pilot test were teacher educators who had recently completed doctoral research or who had a record of publication in the area of problem solving instruction.

Descriptive statistics calculated for each of the 70 items included the combined mean score and standard deviation, the mean score and standard deviation by panel, the frequency of rating scores, and measures of kurtosis and skewness. Both the t-test procedure and Wilcoxon's Rank-Sum Test were used to test for significant differences in the responses between the two panels.

Results And Discussion

Of the 70 items rated by panelists, only the instructional methods of “Computer Assisted Instruction” and “Lecture” received mean rating scores of less than 6 on the 10-point scale. Even these instructional techniques were the subject of mitigating comments from panelists as to their appropriate contexts in teaching problem solving. As a group, therefore, the procedures synthesized from the literature have a high degree of relevance for the preparation of pre-service technology education teachers.

Agreement Between Panels
Analysis of the results with both parametric and nonparametric statistical pro- cedures indicated that there was no significant difference in the mean rating scores assigned to the items by the two panels. The overall mean rating score of the 70 items by the TECH panel was 8.07 on the 10-point scale. The mean rating score of the EXT panel was 7.76. The SD for both panels was 1.13. As a result of these findings, the combined mean scores of both panels (n = 19) were used to rank the inventory items.

Developing Technological Problem Solving Capabilities
Recommended Procedures. All 19 items in this section received a mean rating greater than 6 on the 10-point scale. Four procedures that emphasized practice in applying problem solving strategies in realistic contexts and feedback on the use of those strategies received mean ratings of nine or greater. Other highly-rated items recommended that prospective teachers have the opportunity to observe the regular modeling of problem solving behavior and the cognitive modeling of thinking processes involved in solving problems. The panelists' responses are reported in Table 1.

Table 1
Instructional Procedures Recommended To Develop Technological Problem Solving Capabilities

Mean	SD	Recommended Procedure
9.42	0.69	Problem solving strategies are practiced in meaningful contexts
9.32	0.88	Feedback is provided on the use of problem solving strategies
9.24	1.15	Discussion questions emphasize "why and how"
9.05	0.91	Concepts and principles are connected to real world application
9.00	1.66	Problem solving behavior is regularly modeled
8.89	1.07	Alternative problem solutions are explored
8.83	1.04	Realistic problem situations span the range of technological activities
8.63	1.26	Systematic verification processes are used to check results
8.63	1.50	Small group problem solving procedures are analyzed through inter-group discussion
8.42	1.57	Feedback helps teachers interpret their experiences
8.05	1.71	Problem solving thinking processes are regularly modeled through such practices as "talk aloud" methods and self-monitoring questions
8.00	1.83	Learning activities are linked to broad problem situations
8.00	1.87	Techniques and processes central to technological activities are emphasized through extended practice
7.89	2.66	General problem solving strategies (heuristics) are specifically taught
7.79	1.75	Sources of incorrect procedures are confronted
6.83	2.52	Worked-out examples are provided when appropriate
6.79	1.99	Concepts developed through problem solving activities are confirmed in discussion with more experienced persons
6.32	2.31	Prompts, such as checklists, are readily available to guide problem solving performance
6.05	3.13	Initial learning of strategies focuses on the skill rather than content

Teaching Methods. Whereas there was considerable agreement between the panelists as to which procedures promote the development of problem solving abilities, no corresponding consensus developed on which instructional techniques might be used to facilitate those procedures. With the exception of small group problem solving experience, panelists' ratings of the techniques appeared to reflect familiarity with the practices. Members of the TECH panel tended to rate most highly those procedures practiced within the field, such as design-based problem solving, R & D experiences, and innovation activities. EXT panelists considered techniques such as simulation and case study, which are perhaps more widely used in content areas outside of technology education, as appropriate delivery vehicles for the recommended problem solving procedures.

Comments by several panelists emphasized the need to use a variety of instructional techniques. One panel member commented that all of the instructional techniques could be highly relevant in the proper context. Moreover, as a panelist suggested, practice in applying problem solving skills in a variety of instructional settings may facilitate transfer of those skills to novel situations. Variety itself may have implications for the types of activities graduate technology education teachers chose to implement in their classrooms. Panelists ratings of the items in this section are reported in Table 2.

Table 2
Instructional Techniques That Facilitate The Use Of The Procedures Recommended To Develop Technological Problem Solving Capabilities

Mean	SD	Recommended Procedure
9.29	1.10	Small group problem solving experience
8.61	1.42	Individual problem solving experiences
8.50	1.29	Simulation
8.44	1.92	Design-based problem solving
8.19	1.97	Cooperative learning
7.94	2.94	Research and development experience
7.89	2.35	Innovation activity
7.89	2.39	Invention activity
7.41	2.06	Community-based problem solving
7.25	2.29	Enterprise (class models a corporation)
6.71	2.73	Case study
6.53	2.39	Self-instruction through manuals etc.
6.50	2.17	Demonstration
6.44	2.30	Peer teaching
5.50	2.09	Computer assisted instruction (CAI)

Assessment Of Program Effectiveness. Of the eight assessment methods rated by the panelists, only "outcomes from group problem solving activities" had a standard deviation (SD) of 2.00. Although as a group the items are highly rated, the relatively large SD for these assessment methods suggested that there is little agreement among panelists as to the perceived relevance of these methods. Panelists' ratings of these items is presented in Table 3.

Table 3
Methods For The Assessment Of Program Effectiveness In Delivering The Procedures Recommended To Develop Technological Problem Solving Capabilities

Mean	SD	Recommended Assessment Method
8.83	0.78	Outcomes from group problem solving activities
8.39	2.23	Performance samples of a specific problem solving phase
8.11	2.35	Examples of problem solving by the teacher
7.94	2.38	Written or verbal rationales for decisions
7.37	2.26	Structured interviews
7.00	2.27	Holistic scoring (points awarded for each stage of the problem solving process)
6.95	2.06	Informal questioning during instructional activities
6.47	2.30	Teacher self-inventories of their problem solving abilities

The comments on the items run somewhat contrary to the item ratings. Panelists expressed reservations about all but the three most highly ranked items. Several panelists were concerned about the “school smarts” of students. One panel member commented that structured interviews might not be a viable way to get at program effectiveness because “students know which answers are valued by the teacher.” Panelists rankings and comments indicated a need for specific observable measures from which to assess the effectiveness of problem solving capabilities.

Training Teachers To Use Problem Solving Teaching Methods
Procedures That Promote The Use Of Problem Solving Teaching Methods. Ten of the 11 items in this section had a mean rating > 7.89. The limited range of the mean scores and the high mean ratings of the items indicate that the procedures have a high degree of relevance in assisting pre-service technology education teachers in using a problem solving teaching methods. Visual categorization of the procedures suggests that the principal instructional component in promoting the use of the problem solving approach are: (a) practice with multiple forms of feedback, (b) opportunities to regularly observe the modeling of problem solving instruction and the associated cognitive processes, and (c) reflection upon the application of problem solving instruction in the classroom. The tabulated results of the items in this category are presented in Table 4.

Table 4
Instructional Procedures Recommended To Promote The Use Of Problem Solving Teaching Methods

Mean	SD	Recommended Procedure
9.00	1.00	Problem solving theory is specifically linked to classroom practices of teachers.
9.00	1.32	Teachers receive multiple forms of feedback on their use of the problem solving approach (e.g. instructors, videotapes, and supervisory conferences)
9.00	1.49	Problem solving instructional methods are regularly modeled
8.89	1.10	Teachers evaluate their own problem solving strategies and discuss their application to the teaching of children
8.63	1.64	Thinking processes used to facilitate problem solving instruction are regularly modeled through "talk aloud" strategies and self-monitoring questions
8.53	1.68	Teachers participate in the systematic observation of problem solving practices in the classroom and laboratory
8.42	1.61	Steps that comprise the problem solving approach are clearly defined and practiced in a microteaching environment
8.26	2.05	Coaching in the use of problem solving methods is gradually reduced as teacher competence increases
8.22	1.26	Lesson planning accounts for individual differences in students' problem solving abilities such as the confidence and competence of the problem solvers
7.89	2.13	Pre-service problem solving activities are similar to those that teachers will present to their technology education students
6.78	2.23	Teachers predict and visualize the outcomes of lesson planning

Panelists provided extensive comments on the items in this section and typically elaborated upon an item or sought to combine ideas. For example, one panelist highlighted the importance of mediated observation and multiple forms of feedback by stating that, "Any type of feedback can be useful, but it must be articulated feedback with specific suggestions for improvement. Even in looking at a videotape, someone usually has to point out what to watch for."

Teaching Methods. With the exception of lecture and case study, which had mean scores of 5.21 and 6.84 respectively, the mean scores of the other eight instructional techniques fell within a limited range from 7.53 to 9.11 on the 10-point scale. Student teaching was the highest rated technique in this group and the only item with a mean score > 9.00. Panelists' ratings of these items are reported in Table 5.

Table 5
Instructional Techniques For The Implementation Of The Instructional Procedures Recommended To Promote The Use Of Problem Solving Teaching Methods

Mean	SD	Recommended Procedure
9.11	1.37	Student teaching
8.72	1.41	Induction year
8.50	1.46	Simulation
8.39	1.61	Cooperative learning
8.16	1.46	Micro-teaching
8.00	1.56	Demonstration
7.79	1.58	Peer teaching
7.53	2.11	Discussion
6.84	3.07	Case study
5.21	2.59	Lecture

Comments by panel members suggested that choice of technique is not necessarily as critical as factors related to the implementation of the technique, such as frequency of use or appropriate sequencing during the teacher education program. While student teaching was the most highly ranked technique, several panelists commented that this experience would only be useful if the cooperating teachers were carefully selected.

Assessment Of Program Effectiveness. Although there were only five items in this section, a visual examination of the mean responses indicated two groups of assessment methods. The two most highly rated items, systematic observation of teacher performance during student teaching (9.00) and focused interviews (8.21), emphasized a structured approach to assessment. The remaining items relied on more indirect measures or self-report to assess teachers' use of problem solving teaching methods.

The comments of panelists reflected a general skepticism of any form of assessment based on self-report by the learner. Additionally, comments reinforced the need for assessment methods to be based on observed performance that can be checked against established benchmarks. The tabulated responses to the items in this section are presented in Table 6.

Table 6
Methods For The Assessment Of Program Effectiveness In Delivering The Procedures Recommended To Promote The Use Of Problem Solving Methodologies

Mean	SD	Recommended Procedure
9.00	1.37	Systematic observation of teacher performance during student teaching
8.21	1.68	Focused interviews
7.00	1.45	Children's performance during teachers' field experience (student teaching)
6.89	2.60	Journal reports from student teaching
6.79	2.37	Informal questioning during instructional activities

Additional Procedures Suggested By Panelists
Panelists suggested 46 additional procedures which they considered essential for the development of the problem solving capabilities. Combining the individual suggestions resulted in a listing of 25 additional items. A pilot test to validate the relevance of these additional procedures was conducted as an adjunct to this study. On a mailed questionnaire, panelists were asked to rate the additional procedures. The questionnaire format and item rating procedures used in the pilot test were identical to those processes used during the initial interviews. Eighteen of the panelists (94.7%) returned rating sheets. Analysis of the data indicated similarities in skewness, mean rating scores, and standard deviations between the additional procedures and the procedures recommended through the review of literature. Therefore, the additional procedures also appear to be relevant to development of problem solving capabilities. However, because of methodological differences only selected items will be discussed.

Technological Problem Solving. The most highly ranked instructional procedure, 9.11 on the 10-point scale, suggested that "Alternative ways of looking at the problem should be considered in the search for a solution." Although this item appears to be a step in the technological problem solving process, it is also consistent with the information processing concept of looking for a representation of the problem that makes a solution more likely. The modeling of "looking for alternatives" as technical problems are addressed may be a large step in promoting a problem solving thinking approach.

In the assessment section, if "Instructor models problem solving behavior" had been considered among the initial group of inventory items, it would have been the most highly rated item (mean rating = 8.89). Moreover, this was the only assessment method that did not relate program effectiveness in the delivery of problem solving instruction to some measure of learner outcome. Perhaps evidence of instructor modeling of problem solving behaviors is a powerful indicator of program effectiveness.

Training Teachers To Use Problem Solving Teaching Methods. The instructional procedures and techniques suggested in this section tended to elaborate on the more general items recommended in the initial inventory. Many of the items focused on some aspect of observational activity or field experience. However, the two most highly rated methods for the assessment of program effectiveness are clearly different from the items in the initial inventory. One suggested that, "Teachers analyze videotaped segments of their actual teaching or micro-teaching" (mean rating = 7.94), whereas the second item recommended that, "Teachers analyze situations presented on videotape or videodisc in relation to specific program goals" (mean rating = 7.06). The use of these two methods may offer a controlled way to systematically examine program outcomes.

Summary And Conclusions

The inventory of procedures was highly rated by panelists and the increments between adjacent rankings were too small to establish meaningful cut-off points. Therefore no attempt was made to categorize the items within the sections. Clearly, in the correct context, all of the items may contribute synergically to the development of effective problem solving instruction. Given the small mean differences between adjacent rankings in the inventory, instructors and curriculum designers are advised to consider the procedures within each section as a group, and select procedures based on instructional objectives and situational context. Further, as indicated by panelists comments, factors such as the frequency of use and appropriateness of the procedures or techniques at the learners’ current stage of development must obviously be considered.

In general, the ratings and comments by panelists indicated that the development of technological problem solving capabilities was typified by: (a) modeling and practice with feedback in realistic situations, (b) a variety of relevant instructional techniques, and (c) a collection of outcome measures to assess program effectiveness. Additionally, training teachers to use problem solving teaching methods involved: (a) modeling, mediated observation, specific practice with feedback in using problem solving teaching methods, and reflective discussion on the application of these teaching methods; (b) carefully selected field experience sites; and (c) performance based assessment. Specifically, the following conclusions were derived from this study:

The inventory of instructional procedures, techniques, and assessment methods compiled and rated through this research provide a relevant framework for the development of the problem solving capabilities in pre-service technology teacher education.
Procedures and methods advocated by technology teacher educators were not significantly different from those recommended by the EXT panel of authors and educational psychologists. Therefore, it makes sense to utilize the expertise within the field of technology education when designing instruction intended to facilitate problem solving capabilities.
Instructional procedures that characterized the development of technological problem solving capabilities included the: (a) application of problem solving strategies with appropriate feedback in variety of realistic situations, (b) observation of behavioral and cognitive modeling, and (c) development of connections between concepts and applications.
Although "small group problem solving" was the most highly ranked instructional technique for the development of technological problem solving capabilities, panelist considered it appropriate and desirable to employ a variety of techniques.
Methods for the assessment of program effectiveness in delivering technological problem solving instruction included: (a) outcomes from group and individual problem solving activities, (b) performance samples, and (c) self-reports.
Instructional procedures that promote the use of problem solving teaching methods included: (a) the development of linkages between theory and practice, (b) multiple forms of feedback on practice teaching activities, (c) modeling of appropriate methods, and (d) mediated observation of problem solving instruction and reflective discussion on the application of those teaching methods.
Field experience that is conducted in carefully selected sites and that emphasizes problem solving teaching methods was identified as the most effective means of training pre-service teachers to use those teaching methods.
Systematic observation of teachers' performance during student teaching was the most highly rated method for the assessment of program effectiveness in promoting the use of problem solving teaching methods.

Implications For Technology Teacher Education

Technology education teachers need to develop technical expertise, problem solving skills, and the ability to foster the problem solving skills of their students. These abilities will not likely occur by chance. The competencies needed to teach problem solving must be taught to prospective teachers. The inventory of procedures validated in this study may form a useful set of recommendations for practice. These recommendations may serve to guide the selection of instructional practices, the development of curriculum, and the assessment of problem solving instruction in pre-service technology teacher education. Based on appropriate sections of the inventory, checklists may be developed to provide a formative assessment of the problem solving teaching methods used by instructors or to guide specific feedback to practice teachers. Research indicates that changes in ways of preparing teachers will result in changes in classroom performance. The challenge to technology teacher educators is to select and implement the most effective teaching procedures.

Richard Boser is Assistant Professor, Department of Industrial Technology, Illinois State University, Normal, IL.

References Andre, T. (1986). Problem solving and education. In G. D. Phye and T. Andre (Eds.), Cognitive Classroom Learning: Understanding, Thinking, And Problem Solving (pp. 169-204). San Diego, CA: Academic Press.

Barnes, J. L. (1987). An international study of curriculum organizers for the study of technology. Dissertation Abstracts International, 48 , 05A, 1176.

Barnes, J. L., Wiatt, C. & Bowen, M. A. (1990). The NASA/elementary technology education project. The Technology Teacher, 49 (4),13-17.

Birch, W. (1986). Towards a model for problem-based learning. Studies In Higher Education, 11 (1), 73-82.

Bransford, J. D., Goin, L. I., Hasselbring, T. S., Kinzer, C. K., Sherwood, R. D., & Williams, S. M. (1986). Learning with technology: theoretical and empirical perspectives. Peabody Journal Of Education, 64 (1), 5-26.

Bransford, J., & Stein, B. (1984). The Ideal Problem Solver . New York: Freeman.

Carnevale, A. P., Gainer, L. J. & Meltzer, A. S. (1990). Workplace Basics: The Essential Skills Employers Want . San Francisco: Jossey-Bass.

Commission on Pre-College Education in Mathematics, Science and Technology. (1983). Educating Americans For The 21st Century . Washington, DC: National Science Board.

de Bono, E. (1990). The art of creative thinking. Teleconference presentation November 15, 1990, PBS Adult Learning Services.

DeVore, P., Horton, A., & Lawson, R. B. (1989). Creativity, Design And Technology . Worcester, MA: Davis.

Dewey, J. (1910). How We Think . Boston: Heath.