Unpacking a survey – High School Survey of Student Engagement

This post is by Steven Hicks, who is our project specialist at Generation YES. He writes about a recently released 2009 survey – High School Survey of Student Engagement (HSSSE) out of Indiana University. This year, 42,754 high school students participated in the survey. These students where selected from 103 different schools in 27 different states and reflected a cross section of the US population. The study sought to solicit student opinions in three broad areas of engagement: intellectual/academic, social/behavioral, and emotional.

Be sure to watch the video at the end, I found it very interesting that they talked about engagement as a measure of the “relationship” a student has with school, teachers and peers.

Enjoy! – Sylvia

“When we are curious about a child’s words and our responses to those words, the child feels respected. The child IS respected.” – Vivian Gussin Paley

Many schools seek and collect data to help them construct and measure reform efforts in their districts. Typical tools used for education policy analysis are attendance, performance, and achievement data. Data on student perceptions of school — why they go, why they stay (or don’t), and what methods/policies they feel enhance their learning experience are far less common. Unfortunately, student voices are often inferred from quantitative data, which misses the nuances of student motivation and engagement; the omission of student opinion in policy-making results in inadequate, “wishful thinking” policies that inherently prevent students from taking ownership of their learning.

The results for “time on task” questions on the survey may cause concern to those who exclusively view this as a measure of student engagement – 77% of students reported spending five hours or fewer per week on homework. However, when asked about the importance of activities common to adolescents, students overwhelmingly (79%) felt that doing homework was paramount. Students clearly make a distinction between the amount of time spent doing an activity and the importance of the same activities. Combined with the 42% of students who “do not see the value in the work they were being asked to do” and the small percentage (23%) of students who believe that school helps them “solve[ing] real world problems”, it could be inferred that schools should be more concerned with the quality of assigned work and less with traditional “time on task” method of measuring student engagement with the material.

Students were also asked to rate the degree to which various instructional methods excite/engage them. Overwhelmingly, students chose collaborative activities where they are active participants in the learning process as being “some” or “very much” exciting/engaging: “Discussion and Debate” (61%), “Group Projects” (60%), “Presentations” (46%), “Role-Plays” (43%), “Art and Drama Activities” (49%), and “Projects and Lessons Involving Technology” (55%) were all rated very highly by students. Contrast these activities with more independent/passive ones such as “Teacher Lecture” (26%), “Individual Reading” (30%), and “Writing Projects” (30%); it can be noted that “Teacher Lecture” was the least engaging activity with 45% of students saying that it was not at all exciting/engaging to them.

The conclusion of the 2009 HSSSE Survey revealed the same gaps in engagement as previous years. These “engagement gaps” closely mirror the typical gaps in achievement shown by multiple other studies: girls are more engaged than boys, Caucasian and Asian students are more engaged than black or Latino students, wealthier students are more engaged than those on free lunch, etc. The relationship between the achievement and engagement gaps needs to be further studied, however, the results of this survey suggest that gaps in engagement are potentially more addressable than achievement gaps at the school level — simply modifying the quality of assignments and delivery of knowledge may go a long way to increasing performance.

There is plenty of room to debate about why students feel the way they do, or whether they “know what’s best” for themselves; some may even question to what degree schools should be concerned with making content “interesting”. However, we teach students to consider their audience when conveying information — why should they expect less from us?

The full report, this video and more information about the HSSSE can be found here.

The disconnect in science education

Every year, Project Tomorrow administers the annual SpeakUp survey of students, parents, teachers, and administrators. Every year, we hear from U.S. students that they are fascinated by technology, love learning, and want more. Results from the over 300,000 participants in the 2008 survey should be available soon.

While we wait, let’s look at some interesting data from the science questions from 2007.

In the U.S., STEM (science, technology, engineering, and math) is a hot topic these days. Pundits bemoan the lack of basic science literacy, blame American students for apathy, and predict we will be crushed by global competition. But who ever asks students what they are interested in or how best they learn?

In looking at the report, Inspiring the Next Generation of Innovators: Students, Parents and Educators Speak Up about Science Education, you immediately see the glaring inconsistencies in how students learn, what fascinates and excites them, how teachers want to teach, and what’s actually happening in classrooms. What does it mean for the future when less than 40 percent of these students see learning science as important for making informed decisions in the future? How does that square with the same students reporting that they “…are open to learning science and pursuing STEM careers—intrigued by opportunities to participate in hands-on, group-oriented, “fun” experiences, as well as by opportunities to meet with professionals and use professional-level tools.”

It’s obvious that students are experiencing a disconnect. They are interested and intrigued by science — but not in school.

  • Students report that their especially fun or interesting learning experiences using science and math have been hands-on and group-oriented.
  • Students are interested in pursuing careers in STEM fields — when they know about them.
  • When asked about the essential features of their imagined ultimate science classroom, the leading answer for students in grades K-2 and in grades 9-12 was “teachers excited about science”. Students in grades 3-5 were more interested in “fun experiments” (69 percent). Other highly essential features for students in grades 3-12 were “real tools” (standard lab and technology-based tools) and being able to do “real research,” including online research on computers.

Imagine that — students want teachers who are inspired and inspiring, who bring the classroom to life with real world tools and examples. These teachers are out there, students want and need them, but apparently are getting them too rarely.

This disconnect is reflected in the teacher responses as well.

  • Just 25% of teachers say they’re using inquiry-based methods with their students; methods that both educators and researchers argue are essential for the development of scientific literacy.
  • Only 16 percent of teachers reported they are assigning projects that help students develop problem-solving skills.
  • Teachers report that 21st century tools and projects would help — but lack the time and funding to implement them, and feel constrained by mandated curriculum.

But the biggest disconnect is that most K-12 school administrators don’t see this problem. Here’s the percentage of each category that gave a passing grade to their school for preparing students for jobs of the future.

K-12 Administrators: 57%
Teachers: 47%
Parents: 47%
Students: 23%

This perception gap is a crucial indicator that we are not only failing our students in providing the relevant, inquiry-based, hands-on science education they hunger for, but that we are fooling ourselves about it. What’s worse?

Full report (PDF)

Sylvia