Measuring Use of Licensed Electronic Resources: A Second ...

Measuring Use of Licensed Electronic Resources: A Second ...

Measuring Use of Licensed Electronic Resources: A Second Iteration of the MINES for Libraries Survey on Scholars Portal and Other Resources for the Ontario Council of University Libraries PROVING VALUE IN CHALLENGING TIMES 9TH NORTHUMBRIA INTERNATIONAL CONFERENCE ON PERFORMANCE MEASUREMENT IN LIBRARIES AND INFORMATION SERVICES August 23rd, 2011 Catherine Davidson, York University Dana Thomas, Scholars Portal Martha Kyrillidou, Association of Research Libraries Terry Plum, Simmons College Overview What is MINES for Libraries? Ontario Council for University Libraries & Scholars Portal MINES 2004/05 survey vs 2010-11 SFX as delivery mechanism Practical implications and value Key findings Next steps 2 9th Northumbria Conference, 23rd August 2011 StatsQUAL

A gateway to library assessment tools that describe the role, character, and impact of physical and digital libraries. ARL Statistics LibQUAL+ DigiQUAL MINES for Libraries ClimateQUAL ARL Statistics is a LibQUAL+ is a series of annual rigorously tested Webpublications that based survey that describe the collections, libraries use to solicit, expenditures, staffing, track, understand, and and service activities for act upon users Association of Research opinions of service

Libraries (ARL) member quality. libraries. The DigiQUAL online survey designed for users of digital libraries that measures reliability and trustworthiness of Web sites. DigiQUAL is an adaptation of LibQUAL+ in the digital environment. 3 Measuring the Impact of Networked Electronic Resources (MINES) is an online transactionbased survey that collects data on the purpose of use of electronic resources and the demographics of users. ClimateQUAL : Organizational Climate and Diversity Assessment is an online

survey that measures staff perceptions about: (a) the library's commitment to the principles of diversity, (b) organizational policies and procedures, and (c) staff attitudes. 9th Northumbria Conference, 23rd August 2011 MINES for Libraries .. Is a short web-based survey that intercepts a user as they attempt to access an electronic resource and asks the following: Patron status: faculty, grad, undergrad Affiliation: department Location: in library, on campus, off campus Purpose of use: funded/non-funded research,

teaching, coursework Why they chose: important resource, recommended, reading list 4 9th Northumbria Conference, 23rd August 2011 Ontario Council of University Libraries Institutions FTE Algoma 870 Brock 14,557 Carleton 20,743 Guelph

21,452 Lakehead 7,583 Laurentian 7,630 McMaster Nipissing 5,535 OCAD 3,010 UOIT 5,147 Ottawa 32,230 Queen's

20,751 RMC 1,792 Ryerson 26,841 Toronto 68,334 Trent 5 24,944 7,030 Waterloo 27,674 Western 33,119

Wilfrid Laurier 14,054 Windsor 14,419 York 45,235 Total 402,950 23rd August 2011 9th Northumbria Conference, Scholars Portal 6 9th Northumbria Conference, 23rd August 2011 Why OCUL turned to MINES To capture in-library and remote web usage of the OCUL Libraries eresources

To identify the demographic differences between in-house library users as compared to remote users To identify users purposes for accessing OCULs electronic services To develop an evaluation infrastructure to make studies of patron usage of networked electronic resources routine, robust, and integrated into the decision-making process. 7 9th Northumbria Conference, 23rd August 2011 OCUL MINES 2004 vs 2010 OCUL I : 2004 Randomly selected 2 hour periods each month for a year Mandatory OCUL II: 2010

SFX as delivery mechanism Systematic sampling (every nth) Mandatory and optional versions Additional question: contact pool 8 9th Northumbria Conference, 23rd August 2011 Content Types Being Measured 2004/05 2010/11 ejournals ONLY locally loaded on Scholars Portal ejournals PLUS abstracts and indexes e-books dissertations

library catalogues reference materials institutional repositories other services (e.g. interlibrary loan, Ulrichs, JCR Journal Citation Reports, Refworks) Academic Press American Psychological Association American Chemical Society Berkeley Electronic Press Blackwell Publishing Cambridge University Press Emerald Publishing Elsevier Science (Elsevier Science, Harcourt Health Sciences) IEEE Publication Kluwer Oxford University Press Project MUSE Sage Publications Springer-Verlag Taylor and Francis John Wiley & Sons 9 9th Northumbria Conference, 23rd August 2011 And the responses are in!

A total of 34,776 complete responses were collected across all OCUL institutions by the close of the survey in February, 2011. Mandatory responses Optional responses = 4,255 = 30,521 10 9th Northumbria Conference, 23rd August 2011 Limitation: Variations in SFX as delivery mechanism Institution Uses az list? SFX from OPAC? Google Scholar? Citation linker? bx? BROCK YES

NO YES YES CARLETON NO NO YES YES YES PRIMO?/ Discovery layer? ALGOMA DURHAM GUELPH YES NO

YES YES YES YES LAKEHEAD YES YES YES YES YES NO LAURENTIAN YES YES YES

YES NO NO LAURIER YES NO YES YES YES YES MCMASTER YES YES YES YES

YES NO NIPISSING YES NO YES YES YES NO OCAD YES NO NO YES NO

NO OTTAWA YES NO YES YES NO NO QUEENS NO NO YES YES NO YES

RYERSON YES YES YES YES NO NO TORONTO YES NO YES YES YES NO TRENT

YES NO YES YES NO NO UOIT NO NO YES YES NO NO WATERLOO YES

YES YES YES YES YES WESTERN YES YES YES YES YES NO WINDSOR YES YES

YES YES YES NO YORK NO NO YES YES NO NO RMC 11 9th Northumbria Conference, 23rd August 2011 Practical Implications/Value

What are the implications of running the survey in mandatory and optional modes? How does the use of consortial products compare to that individually-licensed content? What conclusions can be drawn about the efficacy of surveying users via an open-URL resolver? How will MINES fit into the overall assessment program for OCUL? 12 9th Northumbria Conference, 23rd August 2011 Responses by discipline 13 9th Northumbria Conference, 23rd August 2011 Responses by User Status 14 9th Northumbria Conference, 23rd August 2011 Responses by location 15 9th Northumbria Conference, 23rd August 2011

Responses by purpose of use 16 9th Northumbria Conference, 23rd August 2011 MINES: Optional and Mandatory 17 9th Northumbria Conference, 23rd August 2011 Mandatory v. Optional Five Universities Purpose of Use Carleton, Ryerson, Nipissing, UOIT, Western n=6962 mandatory=4255 optional=2707 18 9th Northumbria Conference, 23rd August 2011 Mandatory v. Optional Five Universities Status Carleton, Ryerson, Nipissing, UOIT, Western n=6962 mandatory=4255 optional=2707 19 9th Northumbria Conference, 23rd August 2011

MINES Results TargetURLs Script used to automate parsing of fields from url: ISSN/ISBN Vendor Volume, Issue, Article title Additional fields added, used excel formulae to work in batches: Database Name Item Type (ebook, ejournal, library catalogue) Normalized Vendor Name 20 9th Northumbria Conference, 23rd August 2011 MINES Results Target URLS Once coding is completed, we will be able to investigate numerous questions of interest including: Purpose of use by database Purpose of use by resource type (book, journal) Uses of resource types relative to size of those collections Frequency of use relative to the size of a vendor/publisher collection Uses of resources by patron type and discipline

Others TBD 21 9th Northumbria Conference, 23rd August 2011 Sample Analysis Results Purpose of Use by Database (Local v. OCUL) 22 9th Northumbria Conference, 23rd August 2011 Findings: Comment Code comparison 04/05: - Annoyance with the survey accounts for 20.5% of the total comments and 76.1% of negative comment - n=748 10/11: - Annoyance is 12.8% of the total comments and 41.9% of the negative comments - n=1521 23 9th Northumbria Conference, 23rd August 2011 More research queries to pursue Further research required to arrive at a deeper understanding of issues such as:

the relation between mandatory and optional survey methods informing collection development decisions, understanding the impact of open access, etc. 24 9th Northumbria Conference, 23rd August 2011 Dissemination of findings Library Assessment Conference, October 2010 Northumbria in August 2011 CNI in Dec 2011 ARL Webinar in 2012 Explore other frameworks for demonstrating the value of the library (LibValue work underway) Explore ways to link MINES and ROI work MINES for Libraries in 2015? 25 9th Northumbria Conference, 23rd August 2011 ARL Final Report

Available at http://www.libqual.org/documents/LibQual/publications/MINES_ OCUL2011.pdf 26 9th Northumbria Conference, 23rd August 2011 Thank you Catherine Davidson Associate University Librarian, Collections, York University [email protected] Dana Thomas Evaluation and Assessment Librarian, Scholars Portal [email protected] Martha Kyrillidou Senior Director, Statistics and Service Quality Programs, Association of Research Libraries [email protected] Terry Plum, Assistant Dean, Simmons Graduate School of Library and Information Science [email protected] 27 9th Northumbria Conference, 23rd August 2011

Recently Viewed Presentations

  • GASOVI - nasport.pmf.ni.ac.rs

    GASOVI - nasport.pmf.ni.ac.rs

    OSNOVNI GASNI ZAKONI. BOJL-MARIOTOV ZAKON. Na . konstantnoj temperaturi . zapremina određene količine gasa je obrnuto proporcionalna pritisku pod kojim se gas nalazi odnosno na konstantnoj temperaturi proizvod P i V određene količine gasaje konstantan.
  • Titul prezentace Jméno prezentujícího

    Titul prezentace Jméno prezentujícího

    úřad Jihočeského kraje, OREG, oddělení územního plánování. Informace z úseku územního plánování. Vymezená území MO ČR … § 175 SZ . v těchto územích lze vydat ÚR a povolit stavbu jen se závazným stanoviskem MO ČR, oznámeno do ÚAP a...
  • Einführung in die Europäische Ethnologie

    Einführung in die Europäische Ethnologie

    Einführung in die Europäische Ethnologie WS 2008/09 Prof. Dr. Johannes Moser Bitte beachten Sie, dass in diese Einführungsvorlesung Literatur von verschiedenen Kolleginnen und Kollegen eingearbeitet wurde, die nicht mehr einzeln nachgewiesen werden kann.
  • Effective Study Skills - TheProblemSite.com

    Effective Study Skills - TheProblemSite.com

    Effective Study Skills Marcus Simmons Coordinator - Office of Supportive and Disability Services Itawamba Community College Basic Rationale Contents Note taking Time Management & Organizational Skills Effective Study Skills Taking Exams or Tests Note Taking The Cornell Method The Outline...
  • blue and white 36x48 poster - Confex

    blue and white 36x48 poster - Confex

    Figure 8: False color composite image where the red band assigned to [(band 5 + band 7)/(band 6)], the green band assigned to PCA1, and the blue band assigned to [(band 7+band 9)/(band 8)] Figure 9: Partially digitized 1:9600 scale...
  • Vocabulary Workshop - levittownschools.com

    Vocabulary Workshop - levittownschools.com

    Vocabulary Workshop Unit 1: #'s 1-20 www.vocabularyworkshop.com apparel (n.) clothing, that which serves as dress or decoration Synoynms: attire, garments (v.) to put clothes on, dress up Synonym: deck out Let's apparel our dogs for the party. besiege (v.) to...
  • Evaluation of Benzene Fenceline Monitoring Program in USEPAs

    Evaluation of Benzene Fenceline Monitoring Program in USEPAs

    Evaluation of Benzene Fenceline Monitoring Program in USEPA's Proposed Refinery Sector Rule. BY:Ted Bowie, Carla Kinslow, Steven Ramsey, Shagun Bhat . 142 large (major sources) and 7 small (area source) petroleum refineries in the United States.
  • Access 2012 - wiki.harvard.edu

    Access 2012 - wiki.harvard.edu

    What else is it? A conference organized by the participants . The template for the internationally-attended code4lib. A great place to meet people who care about libraries and technology