488 Matching Annotations
  1. Oct 2020
    1. overall usage, usage by col-lection, and cost per title.

      overall usage, usage by collection cost per title

    Annotators

    1. n addition, the majority of community colleges do not require research during the tenure process. Since research is not required to gain tenure or promotion, there are significantly fewer institutional services and supports for faculty research at community colleges.

      This strikes home. if they'd kept the associate dean of teaching, learning, and assessment, we could have had that support

    2. I say this with no intent to create a sense of rivalry between the two types of institutions;

      needs an editor. no 4 year feels rivalry with us.

    3. This last question is often contingent on whether your college has a department of Institutional Effectiveness or an IRB; BC had no IRB when I began designing the assessment, which made the process of determining how to gain consent to conduct human research for this assessmen

      snort. talk with Terry and Diana who ARE our IRB

    4. library brochure for faculty that our librarians distribute when they attend department meetings in their liaison areas.

      we could try this again

    5. The library is contained on one floor, so we cannot use the easy solution of one quiet and one group study floor; instead, we moved all large tables to the front of the library and called the front half of the library our “hushed-talking zone” where students may talk quietly while studying together. The back half of the library is the “no-talking zone” for completely silent study. To help shift the culture of the library to reflect these two zones, we placed prominent signage at the entrances to each zone, and the librarians regularly walk around the library to check on noise levels. Noise complaints have decreased this semester now that students have a more consistent idea of how to use the library, and students seem much happier now that they have a clear way to tell how they should be using the library.

      Could we do this?

    6. The first was a lack of consistently quiet study space for students in the library and the second was a lack of awareness among faculty of the services they could use at the library.

      we have the same issues

    7. campus’ Assessment Committee as a method for non-academic units on campus to assess their services.

      now this seems like a good idea. Make Curriculum committee into an assessment committee

    8. I added a question to the general student survey related to each of BC’s Institutional Learning Outcomes (ILOs) to help determine whether students perceived that the library had helped them achieve these learning outcomes.

      Arguably more important than actual grades improvement, but something still feels wrong about this

    9. However, when I approached the college about this, the BC Admissions & Records Department cited FERPA concerns and denied my request

      I've been told that doesn't apply within institution. I wonder if this in and of itself is an assessment of the library's situation within the institution

    10. 85% indicated that they had noticed an improvement in their students’ research skills after the orientation.

      nice. But I worry about satisfaction surveys. The library in our head has a lion and a little old lady with round spectacles. We feel good about it, and us in there. Are they assessing the library they're actually in?

    11. The general survey to all BC students shows that 35% of respondents use the library multiple times per week, and over 82% of the respondents indicated that one of their primary reasons for using the library was as a quiet space to do homework,

      will this change after the pandemic? Will the pandemic ever end?

    12. extremely helpful as a tool to prove the sheer volume of BC student presence in the librar

      Was that surprising?<br> Was well-attended valued by administration? by the library staff?

    13. very positively perceived

      Something that Corey was saying about assessments that are self-fulfilling prophesies.

    14. this process was quite simple.

      I'm learning about myself that papers that use opinion vocab turn me off

    15. assessment benchmark.

      I want this so bad!

    16. However, it is colloquially considered part of campus’ Student Services along with non-academic units such as the Writing Lab and the Tutoring Center.

      Why are these non-academic units?

    17. As a result, our library services do not simply orient them to the differences between an academic library and a high school or public library, but introduce them to the library as a concept.

      interesting. counter to my intuition

    18. Historically, library assessments have focused on library collections rather than library services.3 However, an argument can be made that a more effective form of library assessment focuses instead on student usage of library services and the degree to which student library usage relates to academic success

      This is set up as something radical and fighting the establishment, but I don't think that's been the case for a long time. She didn't have to use this rhetoric to make a case.

    19. Although always integral for service- oriented professions, assessment often serves a unique purpose for academic libraries in that it can also show how the library and its services impact student success and the college as a whole

      is this saying we're a service-oriented profession, or we're not? What do they mean by unique?

    20. The results of this study were quite positive, although gaps in service were identified and addressed post-assessment. The library plans to continue assessing its services every three years with this model of assessment.

      Hmmmm. Already grouchy

    21. Library assessment is a well-established necessity for proving a library’s worth to administration.

      I no longer believe this. Administrations make decisions based on feelings about worth and value. They use data to justify their feelings.

    Annotators

    1. Log Analysis Print book collections may be assessed by analyzing transaction logs stored in the library’s online catalog, using a variety of searches, including subject keyword, title and author. A log analysis can also be extremely helpful to identify research trends at the institution or by discipline.

      Just print? It seems like this could create a good picture of how people are using the collection as a whole? Can you filter for searches coming from library computers, classroom computers, non school computers/phones?

    2. OCLC’s WorldShare Collection Evaluation

      are there community colleges of a comparable size that have ponied up?

    3. These include subject bibliographies developed by another library, publisher’s comprehensive offerings, book dealer catalogs, list compiled by professional associations, lists of recently acquired books, and recommended reading lists, to name just a few. Verification studies use list-checking as a means for a group of libraries to compare their collections with a prepared list of titles, which in most cases, is a compilation of the most important works in a specific discipline

      are there standard lists for community colleges?

    4. Rose-Wiles and Irwin 2016)

      read this

    1. link server systems

      a tool that handles the openURL

    2. base URL, which contains the address of the user's institutional link-server, followed by a query string, consisting of key-value pairs serializing a ContextObject. The ContextObject is most often bibliographic data, but as of version 1.0 OpenURL can also include information about the requester, the resource containing the hyperlink, the type of service required, and so forth. For example:

      there's a ton of info wrapped into this thing. how is it permanent?

    3. is often a bibliographic citation or bibliographic record in a database. Examples of these databases include Ovid Technologies,

      so it can apply to gated resources

    4. An OpenURL is similar to a web address, but instead of referring to a physical website, it refers to an article, book, patent, or other resource within a website.

      How does it know whether something is an article, etc. on a website? Is the open part the url itself or does it only point to open resources?

    1. Marxist analysis of OER in higher education cautions against administrators’ attempts to exploit OER for surplus value in the form of increased enrollment, lower teaching costs, and cultural prestige

      mother fucking exactly

    2. A deeper investigation into “open washing,”

      I want to know more about this

    3. qualitative approaches used in OER perception studies could be incorporated more often to center students’ voices. Action research is another approach. According to Sagor, action research, “is a disciplined process of inquiry conducted by and for those taking the action. The primary reason for engaging in action research is to assist the ‘actor’ in improving and/or refining his or her actions” (Sagor, 2000). Action research on OER initiatives would be a welcome addition to the literature, as the method aligns nicely with critical pedagogy.

      What we were taught to do in the 90s

    4. Unlike most OER studies, Bowen, et al. also tested whether or not the OER/hybrid method can lower instructor costs. In their model, the hybrid course would be supervised by tenure-track faculty, with in-person sections led by “teaching assistants” and administrative work handled by a “part-time instructor” (Bowen, et al., 2012, p. 25).

      faculty work parsed out so that consultants do the most creative part and then everyone else gets raisins both from creative work and money

    5. professors, research assistants, and students who regularly review and update content for difficulty

      so cool

    6. Though the authors do not explain why professional development funds were so popular, the implication is that faculty relished the opportunity to share their work and learn from others in a community of practice.

      Faculty just want to live in the world of scholarship and brotherhood and don't care about rent or food. I don't buy it.

    7. One shortcoming of their report is it does not include any information about how Lumen Learning was involved in KOCI, especially with regard to MyOpenMath (MOM), a free, online course management system. It would be helpful to know if KOCI used the free version of MOM or the Lumen-supported version, Lumen OHM. Each option presents distinct cost and maintenance issues, namely vendor fees versus local maintenance expenses.

      how is this connected with faculty labor?

    8. The authors claim this was an even greater motivator than the stipend and they make explicit recommendations for other OER initiatives to allocate funds for conference attendance

      Really? maybe those faculty were well paid already

    9. This is understandable insofar as the focus of most studies is cost savings and student outcomes.

      Unless faculty are seen as workers rather than priests or buskers, their labor will always been seen as volunteer or in service of, and not needing pay

    10. academic freedom and of “corporate interference” since KOCI used Lumen Learning and received funding from the Bill and Melinda Gates Foundation and the Hewlett Foundation (

      this is where I wonder. there's so much about academic freedom that I revere but I can't see the implications. Sort of I do, in the contract stuff recently. the school is making decisions about what to pay faculty, based on what they use to teach

    11. value in adopting OER with Creative Commons licenses.

      the evidence that pedagogy and social justice were considered in the OER effort

    12. found that students’ problem-solving abilities were slightly negatively impacted by the new homework system. The previous commercial system provided hints and tutorials as students completed their homework, whereas the new system simply provided correct/incorrect feedback.

      the commercial system better supported student learning? they can add more because their whole job is to create these materials. faculty are also teaching.

    13. commercial homework system

      I'm so interested in these publisher-generated courses. They're secretly turning faculty into proctors.

    14. remarkable

      these words are getting in my way of appreciating the work in this paper

    15. never specifically mentioned

      ?

    16. But OER need practitioners committed to critical pedagogy to move beyond a free version of the status quo.

      Why? I don't get it.

    17. Their argument is that students use their savings to enroll in more classes

      this is fascinating.

    18. enrollment intensity.

      what is this?

    19. 5,000 in the test group and 11,000 in the control group

      why so uneven?

    20. The results are promising as the percentage of students receiving grades A, A-, and B+ in OER test courses increased dramatically for all three populations (Colvard, et al., 2018, pp. 269-271).

      But why? because in the other classes students weren't buying the books?

    21. They argue that shifting the cost burden away from taxpayers and onto students exacerbates ethnic and racial disparities in educational attainment.

      I'm beginning to feel that classroom copies of textbooks, purchased by the institution are the only option

    22. FWK and VSU students and faculty may have divergent ideas of what’s a fair price for a textbook. At the time of this writing, the FWK website lists most e-textbooks between $25-$30 and most print copies (ebook included) list for $55. This price is much lower than many commercial alternatives, but it is a lot more than free.

      there is an emotional not-evidence-based valuing going on. Students choose to spend money on other things that I might think is useless, like beer or clothes or drugs, but not textbooks. I would LOVE to see one of those behavioral economists take a look at this

    23. They contracted Flat World Knowledge (FWK), then an OER provider, and paid for per-student seat licenses.

      the school paid for the licenses? not the students?

    24. Such opacity is not helpful. For OER to flourish, it is important to name the resources being replaced, and their cost. Readers, especially those considering adopting OER, deserve to know these details to help them make informed decisions at their own institutions.

      Why? were they afraid of retaliation by publishers?

    25. ChemWiki i

      we could talk with Dave Phippen about this?

    26. I am not primarily concerned with how critical pedagogy is used in specific OER textbooks or learning materials. The below studies do not provide such granular detail. Instead, I am analyzing these studies for evidence, or lack thereof, of critical approaches to OER adoption and survey design as it relates to cost and access, pedagogy, and academic labor.

      not looking at how they're using critical pedagogy but whether people are adopting OER with

      cost and access pedagogy academic labor

    27. academic labor required for OER initiatives.

      For some reason this reminds me of the term "emotional labor."

    28. Often, student outcomes are similar across the test and control groups, though some studies present a case for correlation between cost and access and improved student outcomes.

      Outcomes are grades. and they are similar with OED or commercial, but are they good?

    29. social justice issues facing higher ed: cost and access, pedagogical practice, and academic labor

      defined as: cost and access pedagogical practice academic labor

    30. social justice

      Did he define this?

    31. ver 70% of faculty members hold contingent position

      what percent of OER is created by contingent workers?

    32. Eliminating expensive textbooks is a first step toward confronting the contradictions students and faculty face in higher ed

      It needs an equal and opposite: reading is personal power and freedom and choosing what to read is personal power and freedom

    33. If students cannot afford a textbook, they are already oppressed.

      the only power they can experience is rejecting the textbook and reading as a way to get learning

    34. how openness, when disconnected from its political underpinnings, could become as exploitative as the traditional system it had replaced”

      totally agree. It just seems like getting faculty to work for free

    35. For hooks, critical pedagogy means “creating [a] democratic setting where everyone feels a responsibility to contribute” (1994, p. 39). This practice requires a desire to transgress, to empower the oppressed through critical pedagogy: students of color, queer students, poor students.

      a responsibility to contribute asks that the learning has meaning for everyone in the room. Learning outcomes can't generate that meaning and responsibility

    36. ecstatic

      why this word?

    37. banking concept of education,

      I still fall into this

    38. Teachers minimize their authoritative role through a reconciliation of the teacher-student contradiction, “so that both are simultaneously teachers and students”

      this resonates with me so much

    39. Paulo Freire’s Pedagogy of the Oppressed (1968) and bell hooks’s Teaching to Transgress: Education as the Practice of Freedom (1994)

      I really need to read bell hooks

    40. open and critical pedagogy is used to involve and reflect students’ voices.

      I love this

    41. edagogical decisions and are transparent about materials adopted, including relevant software

      why does he use the word transparent?

    42. acknowledges that high priced textbooks are a barrier to learning because many students do not purchase expensive textbooks

      I suspect students also make value judgments--this book is too expensive because that number on the price tag is too high, rather than my financial aid doesn't cover it.

    43. multiple formats and accessible for all learne

      maybe its the sentence construction, but print is part of accessibility, right?

    44. eliminates

      entirely?

    45. positive student outcomes

      Blech.

    46. Beyond sharing resources, higher ed lacks a common OER practice and existing OER practices lack an explicit social justice mission.

      Don't they?

    47. He added retain as the fifth R in 2014. As a practice, creators of any work should retain certain rights.

      I didn't know this. This is fascinating. Does SBCTC know this? Are they teaching this in the course?

    48. Lumen Learning is a company that provides a suite of educational technology products that colleges and universities pay to use; Lumen’s Candela, Waymaker and OHM provide the infrastructure for many instructors teaching with OER. While their products are often less expensive than commercial textbooks and platforms, some argue their business model betrays the ethos of open access initiatives

      Low cost, not free

    49. William and Flora Hewlett Foundation

      I'm interested that that foundation is involved, but I don't see how it is a vested interest.

    50. One critique points out that several of the 5 Rs require access to technology and the requisite skills

      On whose part? the faculty's?

    51. “high quality” OER, which is not surprising since Hewlett, as an OER funder, has a financial stake in OER development.

      Huh? what?

    52. retain, reuse, revise, remix, and redistribute

      this is what I thought it meant

    53. non-commercial learning materials. In 2012, UNESCO refined their definition to include “any type of educational materials that are in the public domain or introduced with an open license” (UNESCO, 2012)

      definitions shifted to emphasis on open license

    54. misunderstood

      sounds like a call to action

    55. Measurables like student outcomes, while important, are too often foregrounded to appeal to administrators and funding organizations.

      are they important though? They feel so anti-learning

    56. Typically, ample attention is paid to a study’s design and methodology but the underlying institutional infrastructure and decision-making process is unexamined.

      good catch!

    57. cost, access, pedagogy, commercialization, and labor.

      cost pedagogy commercialization labor

    58. Open to What? A Critical Evaluation of OER Efficacy Studies

    1. Madeline Kellyis Director of Collections at Western Washington University, Bellingham, WA

      Should I talk with her about community colleges?

    2. Data can be loosely grouped into four categories: collections data, usagedata, user information, and citation data.

      We aren't actually doing this are we?

      collections usage user info citation data-- this one?

    3. Does the assessment goal help betteralign the collection with the institutional mission? Similarly, stakeholders—from users to colleaguesto administrators—must be considered. Who is the assessment for? Who will have to implement anydecisions that are made? Who will need to be convinced to take action?

      I really want to see a story about our collection.

    4. Instead, collections assessment should start with current institutional goals,the problem that needs to be solved, and an answer to the questionwhy?

      should institutional goals be the library or the college? or the general direction of the faculty?

      I would really like to do interviews with faculty about how they use the library and why they don't.

      My sense from Neal and Jeannette is that using our collection is too cumbersome.

    5. Collections can be broken down tolook at categories such as format, subject, or user. The holistic approach, on the other hand,incorporates elements of all formats and users, and generally uses mixed methods, includingquantitative and qualitative metrics. Holistic assessment can provide more well-rounded resultsthan narrower ad hoc approaches, since it attempts to build a high-level, overall view of thecollection.

      Holistic approach seems more my personality, but also seems like more avenues to variation and variability.

    6. Ad hoc assessment, on the other hand, involves conducting one-offassessment projects based on specific, finite needs.

      One-off assessment projects for specific needs. This is what I've been thinking I would do, but we really need the other thing. For the class, maybe I should design the systematic project.

    7. ystematic assessment is helpful fordeveloping a culture of assessment, making strategic decisions, and understanding large or rapidlygrowing collections (particularly in an environment with high staff turnover).

      This is helpful for developing a culture of assessment, and is helpful in an environment with high staff turnover. Sounds good for us.

    8. Systematic assessment entails implementing an ongoing, structuredprogram that follows a regular schedule and set of procedures.

      schedule and procedures

    9. collections assessment, but generally they fall into one of twocategories: systematic or ad hoc.

      how does this map to formative/summative, collection-based/user-based?

    10. There is also the unknowable nature of how collections are used

      unknowable nature. It would be cool to ask how reading stuff from the collection changed a student experienced writing their research paper

    11. Outcomes, by contrast, are harder to quantify—and include student learning, facultyenrichment, research support, and so on. Historically, assessment has been very outputs-based, inpart because outputs are easy to measure, but also because (particularly in the all-print world of therecent past) the size, scope, and use of collections were how academic institutions valued theirlibraries. More recently the focus of institutions and their funding bodies has shifted toward studentand user outcomes, refocusing libraries’assessment efforts on an outcomes-based analysis. So aninstitution spent $60,000 on e-books—what did this actually do for the success of its users? Did ithelp them get a job, graduate more quickly, or complete a research study?

      meaning is now demanded

    12. Outputs are tangible, countable, concrete measures (such as number of circulations orCONTACTGenya O’Garagogara@gmu.eduPublished with license by Taylor & Francis Group, LLC© 2018 Madeline Kelly and Genya O’GaraTHE SERIALS LIBRARIAN2018, VOL. 74, NOS. 1–4, 19–29https://doi.org/10.1080/0361526X.2018.1428453

      Outputs v. outcomes. The outcome of our collection is that faculty use it to create rich learning opportunities for students. Don't think that's happening.

    13. Collections Assessment: Developing Sustainable Programs andProjectsMadeline Kelly and Genya O’Gara

    14. collections assessment was understood to be an organized process for evaluating library collectionsbased on a specific goal or goals.

      definition

    Annotators

    1. FRBR

      What's FRBR? Functional Requirements for Bibliographic Records) is a 1998 recommendation of the International Federation of Library Associations and Institutions (IFLA) to restructure catalog databases to reflect the conceptual structure of information resources.

    2. OCLC Classify

    1. Some of these sources (e.g., Alma’s Community Zone) may not contain ebook subject or subject heading information. My library uses OCLC’s free tool, Classify, to bring in LC class numbers and derive subject information.

      I don't really understand what she's saying. If I use the ebook platform, don't they have subjects? Is she saying that I would have to use Alma to compare the different ebooks and Alma community zone doesn't have subject headings?

    2. I am not sure how to compare print circulations to ebook usage statistics in Alma Analytics.

      I could ask to WACTLC or Wade. I should search in WACTLC emails first. I should read WACTCLC everyday.

    3. One thing often discussed when considering usage of print books versus e-books is whether ebook "circulations" are equivalent or comparable to print book checkouts. Each metric characterizes uses in different ways. For example, an ebook download or full-text access might be registered for each chapter or for an entire book. Depending on your source of usage statistics, it might be difficult to determine whether those uses were by the same person or a different person. How might these multiple uses compare to a single print book checkout for a period of several days?

      ebook chapter requests and investigations might not be comparable to a book check out. You can't tell if multiple chapters are the same person or different people.

    1. Madeline M. Kelly and Stephanie S. Smith.  "Assessing Collections Holistically: A  Behind-the-Scenes Approach" in Assessment Strategies in Technical Services, eds. Kimberley A. Edwards and Michelle Leonard. Chicago, ALA Editions, 2019: 25-63. 2.Peggy Johnson. Fundamentals of Collection Development and Management. Chicago: ALA Editions, 2018: 288 3. Joseph R. Matthews. The Evaluation and Measurement of Library Services. Santa Barbara, CA: Libraries Unlimited, 2018.  4. Amanda Waugh and Mega Subramaniam. "Interview and Focus Group Research" in Research Methods for Librarians and Educators, eds. Ruth V. Small and Marcia A. Mardis. Santa Barbara, CA: Libraries Unlimited, 2018: 37-49. 5. Selena Killick and Frankie Wilson. Putting Library Assessment Data to Work.  London: Facet Publishing, 2019: 31-81. 6. Lynn S. Connaway and Marie L. Radford. Research Methods in Library and Information Science. Santa Barbara, CA: Libraries Unlimited, 2017: 239-249. 7. Johnson, Fundamentals, 304. 7. Rebecca Teasdale. "Survey Research" in Research Methods for Librarians and Educators, eds. Ruth V. Small and Marcia A. Mardis. Santa Barbara, CA: Libraries Unlimited, 2018: 224. 8. Johnson, Fundamentals, 294. 9. Matthews, Evaluation and Measurement, 211. 10. Karen C. Kohn. Collection Evaluation in Academic Libraries.  Lanham, MD: Rowman & Littlefield, 2015. 11. Johnson, Fundamentals. 12. Madeline Kelly and Genya O’Gara. "Collections Assessment: Developing Sustainable Programs and Projects." The Serials Librarian 74, no. 1-4 (2018): 19-29. Further Reading Mike Allen. The SAGE Encyclopedia of Communication Research Methods.  4 vols. Thousands Oaks, CA: SAGE Publications, 2017. Li Chen and Jason Penwell. "Using Alma Analytics to Facilitate the Library Weeding Project." (2019).  Mitchell Dunkley. "Friendly Guides to COUNTER." (2019). Anna Dysart. "Aims and Approaches in Special Collections Assessment." RBM: A Journal of Rare Books, Manuscripts, and Cultural Heritage, 16, no. 2 (2015): 101-112. Tabitha Farney. Using Digital Analytics for Smart Assessment. Chicago: ALA Editions, 2018. Tony Greiner and Bob Cooper.  Analyzing Library Collection Use with Excel. Chicago: ALA Editions, 2007. Peter Hernon, Ellen Altman, and Robert E. Dugan. "Listening To Customers Through Surveys" in Assessing Service Quality: Satisfying the Expectations of Library Customers. Chicago: ALA Editions. (2015): 101-116.  Holly Hibner and Mary Kelly.  Making a Collection Count. Oxford: Chandos Publishing, 2013.  Marcia A. Mardis. "Evaluation of the Collection" in The Collection Program in Schools: Concepts and Practices. Santa Barbara, CA: Libraries Unlimited (2016): 169-186. Amalia Monroe-Gulick, Lea Currie and Corinne Forstot-Burke. "WorldShare Collection Evaluation: A Case Study." Technical Services Quarterly 36, no.1 (2019): 1-17. Oliver Pesch. "Implementing SUSHI and COUNTER: A Primer for Librarians." Serials Librarian 69, no. 2 (2015): 107–125. 

      a lot to read

    2. Library book vendors often provide peer comparison reports or consortial report capabilities

      could I get this from Proquest or Ebsco?

    3. he Research Library Group (RLG) developed a methodology to describe library collections using codes that describe the level at which materials are collected, or should be collected.

      Would this be helpful in a community college setting?

    4. Also, some degree of subject-expertise or experience with the collection may be necessary,

      how do you do this in a community college library?

    5. Core lists or bibliographies are generally easy to obtain—in many cases they may be published on websites of professional organizations

      I didn't know that!

    6. n the case of electronic resources, libraries may even be able to see how long a user has accessed content or where they were on the library website before going to a database.

      really? that would be really interesting!

    7. Some key issues to remember with user-centered data are that the period during which data are gathered, as well as the timing of performing the assessment are critical (Johnson 2018). Also, when employing user-centered assessment techniques, in many cases, it is not possible to use a large enough sample to generalize the results (Teasdale 2018, 224). If you are in an academic library, it may also be required to obtain permission from the Institutional Review Board (IRB) to conduct surveys or focus groups and make sure participants sign consent agreements.
      1. period during which data are gathered and time frame are critical WHY?
      2. User-centered assessment techniques aren't generalizable.
      3. Do we have IRB requirements?
    8. interviews that permit person-to-person interaction

      interviews can be detailed

    9. the person or group conducting the survey should carefully research survey design methods and craft effective questions to obtain meaningful results.

      This has been our problem so far. We just threw ourselves into it--put on a show! style.

    10. Questionnaires

      What's the difference bewteen a questionaire and a survey?

    11. User-Centered Approach
      1. user surveys
    12. USE- OR USER-BASED COLLECTION-BASED Quantitative Quantitative ILL statistics Collection size and growth Circulation statistics Materials budget size and growth In-house use statistics Collection size standards and formulas Document delivery statistics Expenditures by Subject ILL statistics Comparison ratios  E-resources use statistics Content overlap analysis Qualitative Qualitative User opinion surveys (e.g. LibQual+,web-based,email) List checking (e.g., catalogs, bibliographies) User observation Verification studies Focus groups Citation analysis Interviews Direct collection checking Collection mapping (assigning conspectus levels) Commercial products (e.g., OCLC, Bowker, Ulrich's)

      e-resources use stats, user opinion surveys, user observation, focus groups, interviews.

      Collection based: collection size and growth, materials budget size and growth, collection size standards and formulas, content overlap analysis, (what are comparison ratios?) list checking, what are verification studies, direct collection checking collection mapping, commercial products?

    13. It is worth stating that there may be differences between librarians as to whether a particular technique is user-based or collection-based. For example, citation studies can be either depending on whether the library is seeking to understand what the user is doing or making a judgment about the quality of materials in the collection.

      User-based or collection-based can be the same technique, but depending on purpose of study

    14. perspective of usability or how the collection is being utilized

      usability or HOW it's being used

    15. Module 2. Techniques and Tools

    1. Information Literacy General Education Outcome Summary April 1, 2020, revised August 17, 2020

    2. Intensity sub-outcomes - % one sub-outcome assessed at least once”

      This means that the course outcome is only mapped to an IL outcome.

    3. Intensity Gen. Ed. outcome - % all sub-outcomes assessed at least once”

      the number of IL suboutcomes are the 5: Define and articulate a need for information. ; Locate, access and use information from a variety of sources. Identify the basic principles of how information is produced, stored, organized, transmitted and accessed; Critically evaluate information and its sources. Use information, considering the economic, legal, ethical and social issues surrounding its access and use.

      I think I'm beginning to understand something. I always thought of those 5 "suboutcomes" as headings and I thought people would choose from what may be sub sub outcomes. THIS IS THE PROBLEM

    4. ssessed the intensity of

      OMG, we are reaping the wages of sin! People pack gen ed outcomes into their courses to look good in curriculum committee and then don't teach them! Wait, am I being sensationalist or is this true?

    5. enough data to build a significant model.

      I don't know what "a significant model" means.

    6. t may be that prior IL2 classes has low explanatory power because the sampled students have taken so few prior IL2 classes. By comparison, for the Global Awareness (GA) General Education Outcome assessed in 2016 sampled students had comparatively more prior GA classes, and prior classes were found to have a significant impact on score. Even in that case, it took 20 or more prior classes to move the average score from 5.2 to 6.

      20 or more! WHAT?

    7. Of the students sampled, we would expect those taking three or more IL intense classes to score average ratings above those taking fewer than three IL classes only about half the time. In other words, there is no effect at the three-course intensity threshold.

      I would love to have a discussion with teachers in IL intense classes on this finding, esp. part time teachers. Do they even know we have gen ed outcomes?

      Also, ugh. What is going on?

    8. We were unable to find a significant relationship between previous course work and Information Literacy scores in this assessment.

      Possibilities: previous course work doesn't teach the info lit gen ed outcome. previous course work doesn't teach the info lit gen ed outcome WELL.

      I wonder which instructors would raise their hands if we asked who teaches an info lit heavy course?

    9. first worked together to norm a sample of 8 o

      I remember I struggled with every part of the norming. My standards were different from others and I felt pressure to give in and conform. I hated it.

    10. Information Literacy General Education Outcome SummaryApril 1, 2020, revised August 17, 2020

    11. the form of essays, research proposals, bibliographies, poster projects, and written notes for informative speeches. A total of 87 samples were collected and de-identified before being rated by five assessors on meeting two information literacy sub-outcomes.

      A variety of artefacts. 87 sames. What does de-identified mean?

    12. Information literacy is low in the students sampled, and we did not find that prior coursework is related to scores on the assessment.

      This gen ed outcome is not being accomplished. Why? Does it matter?

    Annotators

    1. A few of these disadvantages can be mitigated with thoughtful survey design, but they will likely remain inherent weaknesses of this technique.

      exposes and explores a weakness in the study. I kind of wish they would have said why they are going to do it anyway

    2. . Follow-up phone interviews with regional survey respondents might also be a useful tool to consider.

      explores possibilities rather than saying for sure they'll do x

    3. alue of the library’s physical journal collection to the larger health sciences community, however, is the more compelling question. ILL lending statistics can provide insight into the immediate value of the collection, but the larger question being asked pertains to its long-term value: what role might TML’s physical journal collection have in serving as a research library of record?

      assessing the VALUE of the collection to a particular community

    4. analysis of document delivery statistics is the most direct methodology for gaining insight on the physical journal collection’s value to the institution

      Do I really know what the difference between document delivery and ILL is?

    5. ML’s journals comprise over 60% of the physical collection’s linear footage within the building. With the anticipated library move in the next several years, it will be important to identify the importance of TML’s print journals to VCU’s health sciences community as well as the national and regional health sciences research community, and then plan a weeding project accordingly.

      thank you for the purpose clearly stated in the first sentence

    6. irginia Commonwealth University (

      Virginia Commonwealth University

    7. In five to ten years, TML is slated to move into a new building that will require the majority of its physical collection to be stored elsewhere. VCU Libraries is in the process of securing a permanent storage space to accommodate TML’s impending move, as well as the critical space needs of Cabell Library, which is on the general academic campus. Items from both libraries are currently stored in Cabell Library’s basement and in a temporary storage facility

      the problem

    1. List checking will be the most used collection-based method.

      actual method

    2. oth collection size and growth and materials budget size and growth in tandem with circulation statistics.

      actual project

    3. While we depend mostly on the circulation statistics, they don’t provide the whole story. What happens if the statistics are low, but that isn’t from lack of demand, it could be from lack of available materials. We need to know what the users actually want – and from their own voices. In the past (during the time we were creating the next strategic plan), we had used both user surveys and focus groups successfully. While that was more services-based needs, I believe we can have the same success (or more!) using them for collection-based needs

      describes the thinking; didactic

    4. CollectionHQ.
    5. ser-based and collection-based approaches and a mix of both quantitative and qualitative tools. User-based approaches will include circulation and in-house statistics (quantitative) in addition to user opinion surveys, focus groups, and user observation (qualitative).

      All the stuff: user and collection-based; quantitative and qualitative. circ and in-house, opinion, focus groups, user observation.

    6. The library management team will then use the findings to help justify any budget proceedings needed regarding the children’s collection in the future.

      to get money from funders

    7. Successful

      Is the purpose really to determine if the collection is successful?

    1. Methodology

      begin with user satisfaction survey, then circulation stats and e-metrics. What are emetrics?

    2. WorldCat Collection Analysis

      used to compare your collection to another collection

      Look into Greenglass

    3. he estimate should include how much free access is allowed by each vendor, if any, and what restrictions there are during such a trial period. “Opening day” lists from the library’s wholesaler would be helpful and would likely be free.

      What is this?

    4. H. W. Wilson’s core lists

      HW Wilson's core lists

    5. e would be the additional expense of obtaining external core lists.

      we have to buy shit to get shit done. Oy

    6. Both use/user-based and collection-based approaches will be employed, with measures being mostly quantitative (usage statistics) with two qualitative ones (survey of local residents and checking of collection against core lists).

      summative and formative. qualitative and quantitative. qualitative uses two methods: survey and core lists

    7. measuring the use of the electronic and print collections, analyzing user satisfaction with the collection, placing the results in the context of the 2017 strategic plan, and making recommendations about budget allocations and changes to

      Dang! It's an assessment of everything, with strategic plan and budget, and collection dev. practice and policyd! Ambitious.

    8. e electronic and print collections w

      assessing both print and electronic? Is that do-able?

    9. Assessment of Print and Electronic Collections in a Public Library in Southern Ontario, Canada

    1. Assessment of Biomedical and Science & Engineering collections transferred into accessible storage

    2. Presentation of result

      written report, short ppt, open forum

    3. Usage assessmen

      Circ, in-house use

    4. Methodology

      Uses both collection centered and user centered, with emphasis on user-centered.

      Describes why she won't use certain types of analysis. I like that!

    5. The teamCollections Management Co-ordinator (me)oI oversee the projects transferring the materials into storage and have a detailed knowledge of the workflows and materials involved.oI have access to the Voyager database and experience analyzing circulation & collection data.Collections Management & Planning LibrarianoSupervises my work, has extensive knowledge of the Voyager database and access tothe HK database (HK is the software that runs the ASRS) and In-House Use data.Subject librarian for one of the involved disciplinesoIdeally our Reference Librarian for biology subject areas, who was involved with the ASRS transfers from her collection.Other parties:oThe Assessment Librarian may be involved consultatively to provide existing assessment data and help connect this specific project with his work.oWe may need support from LSIT (Library Systems and Information Technology) in working with the databases.

      describes each person participating and the skills/knowledge they have that will be contributed to project

    6. anbe carried out within current staff time and by using existing resources. Approval will be needed from the supervisors, department heads, and the Associate University Librarians for Collections Management and Client Services and Programs to allocate the staff time required. I expect to spend 4-6 hours per week on this project for approximately 8 weeks, and would not expect my teammates to

      Budget describes time per week. I really like that!

    7. .Timeline

      Nice visual of the timeline. I want to do that.

    8. is project will focus materials in multiple subject areas, under the divisions of Science & Engineering and Biomedical Sciences. Over 200,000 itemsin these collectionshave recently been transferred from open stacks in two large library branches into theASRS storage system. The criteria for transfer included pre-2000 publication datesand low circulation statistics,generally thresholds of either three or five circulations since 2004(which is we began using the Voyager ILS).The majority of materials transferred had zero circulations.

      describes the items that will be examined

    9. Results will be reported to the individuals mentioned as well as Library Administration and the Library staff

      She's going to tell the higher ups, but she doesn't say what she thinks should be done as a result of the project.

    10. changes support or detractfrom the strategic

      assessment directly tied to strategic plan

    11. large academic library with 19 branches and divisions, and over 6.4 million items.1UBC Library serves undergraduate and graduate students, staff, faculty, and community members. The Library has nearly four million annual visits and nearly seven million visits to the Library website

      type of library, size, number of items, who it serves, visits to the website, strategic directions, context of the project

    Annotators

    1. ere is no special budget required;

      Scope seems to be meant to address budget, as well as what will actually get assessed.

    2. his assessment would provide library administration and professional librarians with evidence to support decision making. In addition, faculty members in the Faculty of Arts, as well as members of the Humanities and Social Sciences Library Advisory Board, and the Senate Committee on Libraries are the intended audience of the report resulting from this project

      Looks like the librarian already has an agenda

    3. expressed concerns about this initiative

      can a collection assessment change the hearts and minds?

    4. the administration would like to integrate reference materials into the circulating collection

      I WANT TO DO THIS! and go back to purchasing reference

    5. he print collection of the Humanities and Social Sciences Library, the largest of McGill’s branch libraries, is presently at working capacity. At the same time, the growing student population is in need of additional quiet study and collaborative work spaces.

      quiet study and collaborative spaces

    6. Environment

      Headings include: environment, purpose, audience, scope of the project, timeline, who will be involved, methodology used and why, presentation of results,

    Annotators

    1. Borin, Jacqueline and Hua Yi (2011). Assessing an academic library collection through capacity and usage indicators: testing a multi-dimensional model. Collection Building, 30 (3): 120-125Bucknell, Terry (2012). Garbage In, Gospel Out: twelve reasons why librarians should not accept cost-per-download figures at face value. The Serials Librarian, 63 (2): 192-212.Coombs, Karen A. (2005). Lessons learned fromanalyzing library database usage data. Library Hi Tech, 23 (4), 598-609.Tucker, Cory (2009). Benchmarking usage statistics in collection management decisions for serials. Journal of Electronic Resources Librarianship, 21: 48-6

      should I read these? Especially garbage in, gospel out and benchmarking usage stats!

    2. Sampl

      includes a sample of what the presentation spreadsheet will look like

    3. 360 Counterwebtool

      What's this?

    4. Once this project is complete, the business librarian will utilize the data to conduct a qualitativeassessment by interviewing faculty and conducting focus groups with students in the business college

      sets up a qualitative study to follow quantitative study

    5. user-centered quantitative approach with an analysis of 2011 and 2012 use statistics for e-resources

      say the style of assessment with the exact thing you're going to do

    6. Scop

      Scope includes sample because it's a description of a project, not the final report.

    7. to set up benchmarksfor usage data f

      benchmarks. I would LOVE that for journals, ebooks, and films and reserves. Is it possible to have bench marks for print use?

    8. evaluate e-resources in the business collection using cost and usage datafrom 2011 and 2012to identify the following:core resources,resources with high use, resources with overlapping content, resourceswith lowuseandto determine if there has been an increase in use since the business librarian began consultation hours and lunch hour programs at the College of Business last year.

      uses cost and usage to find core, high use etc and connects the assessment to a new user service

    9. assessmentand analysis of the electronic resources in the business collection purchased on business funds at The Ohio State University Libraries, which includes 60 electronic journals and databases

      what will be included

    10. Environmen

      Headings include: Environment Purpose Audience Scope Timeline Staff involvement Methodology Presentation of results Elements to be included in assessment report

      Title Publisher/platform 2011 price 2012 price DB1-Number of sessions /Number of searches (databases) JR1-Number of full-text article requests (journals) Notes Additional metrics:Total full-text article requests for journal package (includes all titles in package) Cost-per-search (databases) Cost-per-download (journals) Percent change from 2011 to 2012 in searches or downloads Inflation from cost in 2011 to cost in 2012

    Annotators

    1. (I enjoy Rebecca Vnuk's thoughts on weeding)

      What's this? I want to know more!

    1. 1. Donald Perkins. Guidelines for Collection Development. Chicago: American Library Association, 1979. 2. Becky Albitz, Christine Avery, and Diane Zabel. Rethinking Collection Development and Management. Santa Barbara, CA: Libraries Unlimited, 2014. 3. Peggy Johnson. Fundamentals of Collection Development & Management.  Chicago: American Library Association, 2018. 4. Joseph R. Matthews. Evaluation and Measurement of Library Services. Santa Barbara, CA: Libraries Unlimited, 2018. 5. Wayne Disher. Crash Course in Collection Development. Santa Barbara, CA: Libraries Unlimited, 2014.  6. Vicki L. Gregory. Collection Development and Management for 21st Century Library Collections: An Introduction. Chicago: ALA Editions/Neal-Schuman, 2019. Further Reading "Collection Assessment Resources." American Library Association. http://www.ala.org/alcts/resources/collect Peggy Johnson.  Fundamentals of Collection Development & Management.  Chicago: American Library Association, 2018. Qiana Johnson. "Moving from Analysis to Assessment: Strategic Assessment of Library Collections." Journal of Library Administration 56, no. 4 (2016): 488-498. Madeline M. Kelly and Stephanie S. Smith. ”Assessing Collections Holistically: A Behind-the-Scenes Approach,” in Assessment Strategies in Technical Services, eds. Kimberley A. Edwards and Michelle Leonard (Chicago: ALA Editions, 2019): 25-63. Karen C. Kohn. Collection Evaluation in Academic Libraries. Lanham, MD: Rowman & Littlefield, 2015.  Laurel Kristick. “Diversity Literary Awards: A Tool for Assessing an Academic Library’s Collection.” Collection Management 45, no.2 (2020): 151–61. Romany Manuell, Kate McEntee, and Marcus Chester. “The Equity Collection: Analysis and Transformation of the Monash University Design Collection.” Art Libraries Journal 44, no.3 (2019): 119–23. Annabelle Mortensen. “Measuring Diversity in the Collection.” Library Journal 144, no.4 (2019): 28–30. Oya Y. Rieger. “What’s a Collection Anyway?” (2019). https://sr.ithaka.org/wp-content/uploads/2019/06/SR-Issue-Brief-Whats-A-Collection-06062019.pdf

      this is a shitload to read. should I?

    2. typically a written report that describes the collection assessment method and project scope as well as the strengths and weaknesses of the collection.

      written, with emphasis on qualitative narrative and budgetary recommendations

    3. Collection-centered methods include comparing a library’s holdings against core lists, the physical assessment of a collection for age, condition and availability, or comparing the number of titles in a collection with that of another library or a group of libraries, usually peers.

      Collection-centered

      core lists physical assessment of age comparing to peer libraries

    4. Common techniques for user-centered assessment include analyzing circulation statistics and ILL statistics. Qualitative techniques include conducting user surveys and holding focus groups.

      techniques for user-centered (summative) assessment circ ILL user surveys focus groups

    5. A formative approach is collection-centered, and analyzes the contents of a collection for quality and quantity.

      Formative approach is collection-centered. Seems like it should be opposite? Why?

    6. A summative approach focuses on the user or use of a collection, focusing on how materials in a collection are used and by whom

      summative approach focuses on USER or USE

    7. at regular intervals

      make a schedule?

    8. Weaknesses identified as a result of a collection assessment are essential to address, as they indicate where the collections may not be meeting the needs of the library’s user community. In this respect, assessing a library’s collections is as important as evaluating its user services. 

      Given that we have to curtail what we thought were our essential user services, i.e., instruction, assessing collections is the most important. Eek!

    9. Collection assessment can be used as a training method for someone new to the subject or new to the library as a liaison.

      This should be part of what our liaisons do in their area. I should be responsible for training.

    10. Closely related to identifying what may be missing from the current collection is the need to determine what it would take to fill in any deficiencies.

      What it would take to fill deficiencies is where my thinking has failed. And my outreach.

    11. Can an academic library justify retaining resources in existing collections given changing curriculum and research needs?

      G-d's truth. We should check out textbooks and films and scientific articles. And we should have massive teaching and learning collection online.

    12. “The aim of assessment is to determine how well the collection supports the goals, needs, and mission of the library or parent organization. The collection (both locally held materials and those remotely accessed) is assessed in the local context.” (Johnson 2018, 281). Collection evaluation, in contrast, is used to analyze a collection on its own merits or in comparison to another collection.

      collection assessment is local; collection evaluation is on its own merits. That doesn't make sense to me. what is its own merits? Can a collection have merit without a purpose? Maybe an archive? LC?

    13. Collection assessment refers to the range of activities related to determining the quality and utility of library collections or specific collections within a library, given the stated purpose of the collection and needs of the community the library serves.

      definition of collection assessment

    14. collection adheres to objectives as stated in a collection development policy

      Does our collection development policy really apply to our situation? Maybe it's time to review

    15. e Guidelines for Collection Development published by the American Library Association stated that “Every library collection should be established for a definite purpose. The collection may be developed for research, recreation, community service and development, instruction, support of a corporate activity, or a combination of these.” (Perkins 1979, 9).

      Should I read this?