Formative findings
Process evaluation indicated that the project was implemented as planned and was well received by the tutors, students, librarians, and faculty throughout the twelve months of implementation. A December 2002 focus group with peer tutors also indicated that the experience was self-empowering. The empowerment had been fostered largely from the amount of control the four peers had over the activities. Even the train-the-trainer peer tutor sessions, which also served as planning sessions, were largely driven by the peer tutors. While the RAHC librarian sometimes led the training part of the meetings, planning sessions were participative and never prescriptive. The students were given much leeway for creating and owning their work. This practice contributed to the pride and ownership the students took in their peer tutor roles.
Teachers commented that they thought their students enjoyed the interactive nature of the peer tutor sessions. Each session typically used examples suggested by the students and included hands-on activities appropriate to the grade level.
Increased MedlinePlus usage
Both qualitative and quantitative indicators showed increased usage of MedlinePlus. The Web Trends software data indicated the increased usage could be attributed to peer tutor activities. Over the course of the project, the software documented increased hits and downloaded pages from the NLM Website with distinct spikes during periods of increased peer training activity (
Figure 2). Frequently accessed topics often were those addressed in the training activities, although the software also identified topics that students researched on their own (such as “Piercings and Tattoos”).
| Figure 2 Med High MedlinePlus usage data, megabytes downloaded (March 2002–March 2003) |
Students' use of MedlinePlus for personal lives and school
The focus group with students in December 2002 provided examples of how students used information for personal and school use. For instance, one student said that her aunt was diagnosed with Parkinson's disease. She and her mother researched the illness on MedlinePlus, so that they could better explain it to the aunt. Another student obtained information for a family friend on a rare disease. For school-related projects, students found that the pictures available through the MedlinePlus tutorials were especially helpful in understanding class content.
The classroom survey with students in January 2003 produced 500 usable responses (23% ninth grader, 23% tenth graders, 21% eleventh graders, 13% twelfth graders, and 20% unknown). Sixty-six percent of the students reported using MedlinePlus outside of a formal training session. Of these students, more than 80% used MedlinePlus for school research projects (Table 3).
| Table 3 Med High end-of-project student survey, selected results |
Survey results indicated that the students educated others in the broader community beyond the school. Of those students reporting use outside of training, approximately 50% cited using MedlinePlus as a referral source for others who needed health information. More than 33% said that they had used MedlinePlus for personal or family health issues. Only 16% accessed Spanish language materials, which was not surprising, because students at Med High used English as their primary language. Most of those who accessed Spanish language materials found MedlinePlus very useful.
When asked to list up to 3 other people with whom they had shared MedlinePlus or MedlinePlus materials, 46% of respondents specified 1 or more contacts, with a total of 429 contacts reported. Each student entry was counted as a contact: a reply of “my mother” or “family members” was counted as one contact, so students reached more than 429 people. Most often, students assisted contacts with personal health concerns of friends or family members (55%). Students also helped others use the resource for school-related projects (43%) and for work-related problems (2%).
Because the pilot project primarily targeted students, outcomes assessment with teachers was less comprehensive and consisted of a focus group and survey of ten HST teachers. Results showed patterns similar to the student survey. All teachers rated MedlinePlus very or somewhat useful. Eight of ten reported using MedlinePlus for information relevant to their own or a family member's health. They had referred others to MedlinePlus for the same reasons. In the final teacher focus group, one teacher with a second job in a hospital had trained staff there to use MedlinePlus, because it was superior to the database purchased by the hospital.
Enhanced student learning
As noted above, survey results indicated that students used MedlinePlus most frequently for school projects; this use was primarily for research reports and, to a lesser extent, for clinical experiences or HOSA-related activities. The majority of students who used MedlinePlus for any school-related work rated it very useful. One group of four girls, who won second place at the national HOSA meet for their obesity awareness project, found most of their information on MedlinePlus.
Of those who used MedlinePlus beyond a training session, 99% were very confident in the quality of the information they found and rated MedlinePlus as useful overall. In interviews, some students reported that they were more focused on schoolwork when using MedlinePlus than when using search engines such as Yahoo and Google, which included more distracting features.
Improved school curriculum
The teachers and school principal reported that the introduction of MedlinePlus at Med High had improved the curriculum at the school. Of the 10 HST teachers trained on the resource and surveyed, 50% had used MedlinePlus to teach students how to conduct research for their class assignments and 50% had used MedlinePlus to help students with their HOSA projects. In interviews, some teachers indicated that MedlinePlus had served as a catalyst for them to incorporate more hands-on exercises and case studies into their classes. For example, 1 HST teacher asked students to research medical vocabulary using MedlinePlus.
According to the principal, HST teachers began implementing research exercises in their ninth-grade courses, making MedlinePlus part of their lesson plans. Prior to the peer tutor project, teachers introduced research projects in the eleventh grade. School librarians reported that some teachers had incorporated more hands-on exercises and case studies into their classes, similar to the techniques they observed in the peer tutor training sessions.
In a focus group interview, HST teachers reported they were now more willing to accept Internet resources in student research papers (a finding corroborated in the student focus groups). They said they trusted the quality of resources found through MedlinePlus.
Empowerment of the peer tutors
The four peer tutors described a variety of skills that they had developed over the course of the project. Through their peer tutor presentations and meetings with UTHSCSA and NLM officials, the peer tutors reported that their public speaking skills had improved and they felt more comfortable talking with adults. They also reported enhanced self-confidence and reinforced leadership skills as a result of the pilot project.
Development of a self-sustaining MedlinePlus training program
The peer tutor project continues, sustained by Med High staff and resources, and is very popular with students. New peer tutors were recruited from the tenth and eleventh grades. Despite a rigorous interview process (applicants had to be nominated by HST teachers and approved by the school principal), more than thirty-four students applied, and fourteen were selected. As one Med High librarian observed, “It is cool to be a peer tutor.”
Enhancement of the library's role in educating students
One of the most interesting and unexpected outcomes of the project has been a change in the relationship of the library staff to the school. In separate interviews, both the Med High lead librarian and the Med High principal confirmed that the library staff had moved beyond their support function to become leaders and active team members in the school curriculum as a result of their participation in this project.
The school librarians also have become more involved with other librarians in the region. They have become active members of a higher education consortium in the LRGV called Valley MedShare. Further, the Med High lead librarian now participates in a statewide task force and has presented to the Texas Association of School Library Administrators about the role of the Med High Library in the school community.
The Texas Library Association (TLA) awarded its Library Project of the Year Award to the Med High Peer Tutor MedlinePlus Pilot Project in April 2003. At the presentation, the project was introduced with this description, “The students and the community became more closely connected to the library. Moreover, the residents of this Lower Rio Grande Valley Community are aware of a valuable medical database that will help them become more literate about their health.”