Low Response Rate and Other Factors Render Academic Health Science Library System Study Ungeneralizable
A Review of:
Folb, B. L., Wessel, C. B., & Czechowski, L. J. (2011). Clinical and academic use of electronic and print books: The Health Sciences Library System e-book study at the University of Pittsburgh. Journal of the Medical Library Association, 99(3), 218-228. doi:10.3163/1536-5050.99.3.009
Ohio, United States of America
Received: 31 Jan. 2012 Accepted: 7 Apr. 2012
2012 Melssen. This is an Open Access article distributed under the terms of the Creative Commons‐Attribution‐Noncommercial‐Share Alike License 2.5 Canada (http://creativecommons.org/licenses/by-nc-sa/2.5/ca/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly attributed, not used for commercial purposes, and, if transformed, the resulting work is redistributed under the same or similar license to this one.
Objective – To determine the factors, barriers and facilitators, preference, and intended use of e-book compared to print book usage by all patrons in a health science library system, which serves a university with health science degree programs and a hospital system.
Design – Two online surveys.
Setting – University of Pittsburgh Health Sciences Library System, which includes the University of Pittsburgh’s six schools of health sciences (medicine, dental medicine, nursing, pharmacy, public health, and rehabilitation) and the University of Pittsburgh Medical Center hospitals and programs.
Subjects – All health sciences library system users, including faculty, researchers, clinicians, residents, fellows, employees, and students.
Methods – Two versions of the survey were deployed in 2009 using Opinio. There were 46 questions for the University of Pittsburgh Medical Center (UPMC) survey and 47 questions for the University of Pittsburgh (Pitt) survey. The surveys were pilot tested by Health Sciences Library System (HSLS) librarians and graduate students in a survey methods class. The survey was edited based on the feedback provided and received institutional review board approval as an exempt study.
A total of 5,292 email addresses were randomly selected by SPSS from a pool of 9,472 UPMC and Pitt patrons registered with a HSLS remote access password; 2,684 patrons from UPMC and 2,608 patrons from Pitt were selected. HSLS librarians were excluded from the survey. Participants were emailed a link to the survey in March of 2009. Three email reminders were sent at five day intervals. Data was collected for 22 days and exported from Opinio to SPSS statistics software. Survey results were analyzed using basic descriptive statistics and cross-tabulations.
Main Results – Of the 5,292 emails sent, 979 surveys were submitted and 871 were completed fully. The 108 partially completed the surveys were analyzed using pair wise deletion. All HSLS user groups were represented and all rated their confidence in computer skills high. The mean age of respondents was 39.9 with the majority of respondents being female.
Of the 871 completed surveys, over half (55.4%) of the respondents reported using HSLS e-books: 66.7% men and 54.9% women. HSLS e-books were used for in-depth reading by 53.4% of men and 36.8% of women. At UPMC, 70% of attending physicians, interns, residents, fellows, and Pitt postdoctoral/fellows use HSLS e-books. The primary use of the e-books was for clinical care, by 75.3% of attending physicians; 86% of interns, residents, and fellows; and 38.9% of nurses. HSLS e-books are also used by 61.8% of respiratory care and physical therapists, 28.6% of administrators, and 56.8% of researchers.
At Pitt, 73% of postdoctoral students or fellows and 64.7% of faculty used HSLS e-books. The primary use of the e-books was to support research. 76.5% of postdoctoral students and fellows and 54.1% of faculty used e-books for this purpose. Only 21.3% of faculty assigned e-books for class readings. Though 14% of undergraduate and 33.5% of medical students responded that they had been assigned readings from e-books, 51% of undergraduates and 62.1% of graduate and medical students used an e-book to complete an assignment.
Over half (65.5%) of respondents saw information about HSLS e-books on the HSLS website and 55.4% of respondents used an HSLS e-book. When using an e-book, 56.6% look up brief, factual information while 41.9% use e-books for in-depth study.
Uses of HSLS e-book search tools were rated: the federated full text search tool was used by 67.2% of respondents and 74.3% of those who use this tool rated it as moderately to extremely useful. Google books and the library catalog were also rated moderately to extremely useful by respondents. The catalog received the lowest rating of the HSLS e-book search tools.
More respondents (95.4%) use the library’s website than come to the physical library (63.8%); however, 66.9% say they use both the website and physical library. Of the 63.8% of respondents who came to one of the HSLS libraries, 67.2% borrowed or used a HSLS print book. When using a book at the library, 23.4% only use print, 14.8% only use e-books, 44.7% use both, and 17.1% use neither. Fewer respondents (46.4%) agreed or completely agreed they could locate an e-book compared to those who agreed or completely agreed they could locate a print book (66.7%).
Nearly half (45.3%) agreed that both HSLS e-books and print books were accessible where they needed to use them; however, only 27.9% agreed or completely agreed that they had time to go to the library and use a print book when they needed it. The closer a respondent worked to the library the more likely they used the physical library. Those also within one block of the library were greater users of HSLS e-books (67% of respondents) than those who worked more than two blocks from the library (52.3% of respondents). When respondents did come to the library, 84.3% used a HSLS print book in the past year and 64.7% used an HSLS e-book. Of the respondents who did not have time to come to the library, 55.3% used a HSLS print book and 55.3% used a HSLS e-book.
When using e-books, respondents preferred such features as printing, saving, and searching over features such as bookmarking, highlighting, and annotating. Respondents also preferred e-books for general reference and pharmaceutical reference, and print books for textbooks and handbooks. A finding of significance is that “those preferring print were more flexible about using e-books than those preferring e-books were about using print” (p. 224).
Conclusion – HSLS e-book use varied depending on the respondent’s role at their institution (e.g., clinical physician, researcher) and type of book (e.g., reference book) they used. The heaviest HSLS e-book users were students, postdoctoral fellows, researchers, and clinical physicians. Respondents who used HSLS e-books most often were also those who used print books most often, and respondents within one block of the library were some of the heaviest HSLS e-book users. Respondents felt that reference and pharmaceutical books were more suitable as e-books. Also of note was that though faculty were not using e-books heavily for assigned readings, students were using HSLS e-books to complete assignments.
The greatest drive to choosing between a print and e-book was the respondent’s information need and which book format was most convenient to access at that time. Respondents were flexible in their use of print books and e-books: respondents “would be willing to use a less preferred format if it were more convenient at the time of need” (p.226). In light of respondents’ flexibility between e-book and print book usage, the authors suggest that collection development librarians could reduce the duplication of book formats.
Regarding awareness of e-books, survey results from this study were comparable to that of other studies. Also, the respondent’s comments indicate that the survey itself prompted e-book awareness: respondents felt that more advertising of e-books should be done. Such responses show that passive advertisement of e-books though the library’s catalog and on the website are not enough. E-books should be advertised during library instructional sessions.
Respondents also prefer Web access to HSLS e-books as well as the HSLS federated e-book search rather than to access HSLS e-books from the library catalog. The authors’ recommendation is to make sure users can easily access e-book catalog records through the Web in order to best facilitate patrons’ use of e-books.
Despite the conclusions that were drawn, there were several limitations of this study. Though the sample size was large enough and all HSLS users were included, the response rate was very low. Bias could be an issue as well: non-response bias as well as an overestimation of the number of HSLS e-book users could be contributing factors to the low response rate. In addition to the small sample size and possible bias, the lack of completed responses (11%) was also a concern. Finally, respondents expressed confusion over how “e-books” were defined in the survey. Because of these issues, results of this survey may not be generalizable to other libraries.
This study offers valuable insights into the e-book and print book usage of health science library system users; however, there are various aspects of the study that are cause for concern. First, there are various writing errors within the study. “UPMC” is never defined in the article; a search on the UPMC Web site followed by a phone call to UPMC was required to determine that UPMC was the “University of Pittsburgh Medical Center.” There is also no consistency in describing “University of Pittsburgh;” it is referred to as either “University” or “Pitt.” There is also inconsistency in the respondent type “physician;” the labels “attending physician,” “clinical physician” and “physician” are used interchangeably.
The methodology of the study is also problematic. The authors do not discuss why there are different number in questions for UPMC and Pitt. The survey questions were also tested on graduate students as opposed to a sample of library users the study was targeting. Perhaps if the questions were tested on such a sample group the issue of confusion over the definition of e-books could have been avoided. Though the authors acknowledge the study’s low response rate, it is of a major concern: the authors estimated that they would have a 25% rate, but only 16.5% of their sample completed the survey. The authors believed that an email cover letter from the director and three email reminders to be enough of an incentive for respondents to complete the survey; however, it clearly was not enough.
A unique feature of this study was the variety of users they surveyed. Though surveying all of these users may provide the institution with a comprehensive view of how e-books are being used, this also causes the study to become ungeneralizable. Few other institutions may have the same user population as Pitt. Also, there is an overwhelming amount of data. It is a challenge to digest this much information in a single article. It would have been beneficial to break this study up over several articles or to only survey one patron population at a time.
Despite these drawbacks, this study does provide valuable data on how different health science patrons use e-books compared to print books. Large academic health center collection development librarians may find this study’s findings beneficial in making their own determinations for e-book vs. print book purchases.
Evidence Based Library and Information Practice (EBLIP) | EBLIP on Twitter