Link to original Google doc

Huda Khan, Astrid Usong, Steven Folsom
December 2022

TABLE OF CONTENTS

GOAL

METHODOLOGY

PARTICIPANTS

SCHEDULE

KEY OUTCOMES

RESULTS SUMMARY

TASKS AND SCREENSHOT REFERENCES

SUMMARY BY PARTICIPANT

NOTES (Huda)

GOAL

We wanted to get participant reactions to our inclusion of Wikidata information directly within the page and through the use of work knowledge panels.   We also wanted to understand which of the Wikidata properties the participants might find useful. 

METHODOLOGY

We sent out a recruitment email to Tracey Snyder, a Cornell music librarian, who forwarded the message to staff and graduate students.   When participants responded, we scheduled a half hour Zoom session with them and sent them the consent form as an attachment.  During the Zoom session, after obtaining verbal consent from the participants, we provided a link to the tasks and links to the prototype.   We began the session with a preliminary question about how participants used the library catalog to look for musical resources and ended the session with some follow up questions.   

PARTICIPANTS

Number

Student or staff

Area of study or work

1

Staff


2

PhD Candidate (fourth year)

Music and sound studies

3

Staff


4

PhD Student (third year)

Music and sound studies

5

Doctoral graduate student (first year)

Composition

SCHEDULE

December 19-22, 2022

KEY OUTCOMES

RESULTS SUMMARY

TASKS AND SCREENSHOT REFERENCES

We shared the following document with the participants with the tasks and questions and links to the prototype.   We are also including the text of the questions and tasks below.  Screenshots from the prototype are included below for documentation.  

TASKS

Preliminary questions

  • If you are a student, what is your year and subject area?
  • How do you normally search for musical scores or recordings using the catalog?

Tasks 

  • You have searched for Vivaldi sonatas in A major and are viewing the result: “Sonata in A major, for violin (or viola) and piano” at this page http://dev-hjk54.library.cornell.edu/catalog/3047471 . Please go to this link.
    • What is the RV number for this musical score? 
    • Are there other catalog numbers visible for this score? 
  • You have searched for “Die Zauberflote” by Mozart and are viewing the result at this page http://dev-hjk54.library.cornell.edu/catalog/10646838 .  Please go to this link. 
    • What is the K number for this musical recording?
    • Who is the librettist?
  • You are looking at the page for “Four sonatas for violin and continuo, op. 5 nos. 1-4 (RV 18, 30, 33, 35)” which is available at this link: http://dev-hjk54.library.cornell.edu/catalog/377609 . Please go to this link. 
    • What is the Fanna number for op. 5. No. 2?
  • You are looking at the page for “Simon Rattle edition” which has works by Stravinsky.  Please go to this link: http://dev-hjk54.library.cornell.edu/catalog/10646929
    • What is the date of the first performance for “Ebony Concerto” which is part of this selection?

Follow up questions

  • Which of these tasks do you currently do when researching or looking for musical resources?  Which of these tasks would you not do? Would you please explain why?
  • “Die Zauberflote” on the page http://dev-hjk54.library.cornell.edu/catalog/10646838 may be known by other languages.  
    • Where, on this page or elsewhere in the catalog, might you want to see titles in other languages for a musical score or recording? How might this information help with searching or viewing musical recordings in the library?
  • Which Wikidata information in the prototype would you find useful while searching for musical recordings or scores in the catalog (for example, catalog codes such as K number or RV number)?  Which information would you not find useful? For both questions, can you please explain why.
  • Were you familiar with the idea of catalog codes (such as Kochel)?  If so, how do you typically use these codes?
  • Would any of these features be useful to you in how you search or do research?  
  • Do you have any suggestions or feedback about any of the features you saw? 


SCREENSHOTS FROM THE PROTOTYPE

Link to Google slides

Figure 1: Top of the page for Task 1.  "Sonata in A major, for violin (or viola) and piano".

Figure 2: Bottom of the page for Task 1.  "Sonata in A major, for violin (or viola) and piano". Shows inclusion of Wikidata information for codes (catalog numbers), opus, tonality, and instrumentation.

Figure 3: Top of the page for "Die Zauberflote" or "The Magic Flute" for Task 2.

Figure 4: Bottom of the page for "Die Zauberflote" or "The Magic Flute" for Task 2. Shows inclusion of Wikidata information for  codes (Kochel catalogue), first performance date, first performance location, and librettist.

Figure 5: Top of the page for "Four sonatas" by Vivaldi for Task 3.

Figure 6: Bottom of the page for "Four sonatas" by Vivaldi for Task 3. Shows "Work info" buttons next to titles in the "Included work" section.

Figure 7: Bottom of the page for "Four sonatas" by Vivaldi for Task 3. Shows how clicking on the second "Work info" button displays a knowledge panel bringing in Wikidata information (codes, opus, tonality, and instrumentation) and information from the author title browse entry.

Figure 8: Top of the page for full author title browse page for "Vivaldi, Antonio, 1678-1741. | Sonatas, op.5 .No. 2" for Task 3.  This page shows the Wikidata information included for codes, opus, tonality, and instrumentation. Clicking on "View full info" in the knowledge panel in Figure 7 leads to this page.

Figure 9: Continuation of the page for full author title browse page for "Vivaldi, Antonio, 1678-1741. | Sonatas, op.5 .No. 2" for Task 3. 

Figure 10: Top of the page for "Simon Rattle edition" with works by Stravinsky for Task 4. 

Figure 11: Continuation of the page for "Simon Rattle edition" for Task 4.  Shows the "Included Work" section" with the knowledge panel for "Stravinksy, Igor, 1882-1971. Ebony Concerto" visible.

Figure 12: Author title browse page for "Stravinsky, Igor, 1882-1971. | Ebony Concerto" for Task 4.  This page shows the inclusion of information from Wikidata for first performance date, first performance location, and instrumentation. Clicking on "View full info" in the knowledge panel shown in Figure 11 leads to this page.


SUMMARY BY PARTICIPANT

In the tables below, we summarize participant behavior and answers to follow up questions. “#” denotes the column for participant number. 

#

Normal search method

Tasks

Comments

1

Cornell library home page.  Type in composer and title or short form.

Completed all but task 3 without prompts.

Task 2 (Die Zauberflote) comments: 

  • Expected to see K number towards beginning.  
  • When looking for librettist, noted Wikidata field not as easy to find.  For opera, librettist important contributor. 

Task 3 (Four sonatas for violin and continue): Prompted to look at included works section. Then, found work info button. 

  • Looking for word “Fanna”.  
  • Once clicked, information made sense and was helpful for doing cross-references. 

Quote: “You do my research for me. That’s marvelous”

Quote: “More information is always better than less” 

2

Youtube.  Don’t normally search catalog for recordings.  Would use title when searching. 

Completed all tasks without additional prompts

Task 1 (Vivaldi sonatas): Found RV but didn’t know what it stood for. 

Task 4 (Stranvinsky): Found information in table of contents first and then quickly found work info button below. 

Easy enough to figure out.  Catalog numbers useful when title isn’t particularly useful.  K number then becomes part of title or alternate title. 

3

Search by title, composers, specific edition, performer (especially for recordings) 

Completed all tasks without prompt except Task 2. 

Task 2 (Die Zauberflote): Saw librettist in contributors and other roles.  Prompted to scroll down and then saw librettist also listed there. 

Quotable/referenceable: Catalog numbers are confusing.  Having laid out all the numbers is illuminating to someone trying to get a handle. 

4

Composer and name of recording, or keyword search

Completed all tasks without additional prompts. 

Work info button solved information overload problem in a way that still makes that information accessible. 

Important to know source May trust transcription of information from CD more than publicly editable database. 

Translations of titles is useful, but unclear how to implement this feature.  

Non-catalog resources: if widely held knowledge, would use Google search.  If more esoteric, may use online encyclopedias such as Grove music or Oxford music online to find information like first performance data or historical information. 

5

Cornell library website using keyword, title, composer

Completed all tasks without additional prompts

If could search by ensemble type and years, that would be a big help. 

Table 1: Summarizing answer to preliminary search question, tasks, and additional comments by participant


#

Tasks realistic

Languages

Wikidata properties

Catalog numbers

Useful features

Suggestions

1

Conceivably do all the tasks, with most basic ones with greater frequency.  Not many patrons ask for first performance information.  Query for librettist possible. 

Don’t expect language to be in traditional library catalog page.  Alternate forms in card catalog for title. Search by uniform title?

Don’t normally look for non-bibliographic info but useful to have.  Catalog codes are bibliographic.  Librettist. 

“Catalog numbers” preferred term.  Used for cross-references.  Kochel put works in chronological order, so useful info.  Also catalogs can include incipits of music with each title and bibliographic info like editions, dates of composition, performance, publication, etc. Useful contextual information to get a handle on the entry. 

First performance location may be useful for focused research.  Thankful information available quickly and reliably. 

Online catalog can be considered as a study guide.

2

Don’t generally work with classical music.  Don’t often use opus numbers/k numbers, etc.  Closest task: looking for book editions, first volume, when published, translation. 

Would expect to find other language titles as close to the German title as possible. Title line or language field.  When assigning to students, would want English title even if original in German.  For self, would want original language title. 

Clearly identified asterisk to indicate source.  Catalog numbers useful.  Tonality and instrumentation helpful.  If cared about history, then historical info also useful. 

Familiar with some nut not all.  Know about K.  Use catalog numbers to distinguish between pieces and understand chronology and grouping. 

Click to get more info allows initial entry to be less info heavy and then info that don’t often need can be visible later. 

K number wasn’t listed as K (said “Kochel” instead). 

3

Don’t need date of first performance.  RV and Fanna numbers may be useful for ordering pieces. Librettist may be useful for cataloging.  Mostly check for different performers of work since people want specific recording.  Contributors list useful. 

Next to the title with a little link. Link between recording and other language titles?  Other forms of this work may be a helpful place to put these other language titles. 

Saw and noted Discogs source first. Unclear if they identified the asterisk as mapping to Wikidata as source. K number very useful. Instrumentation.  Catalog numbers useful.  First performance date is interesting for researcher but not for me. 

Familiar with them.  Useful to determine which piece you are looking for. 

Use Discogs all the time.  Good for modern music and soundscape music.  Think different languages for title would be helpful. 

Discussed the use of the subject line on the item page e.g. clicking on “Sonatas (violin and piano) -> scores and parts”, could see what’s in the catalog, filter by composer, and look for scores. 

4

Would look for catalog numbers as do use library catalog for RV/Opus and other catalog numbers.  Would not look for performance date or expect information would be there.  Do not typically look for librettist in catalog but may use other sources. 

Not sure.  Instinct to look on Mozart info page to look for metadata field with language info.  Possibly look at “other forms of this work”.  (Clicked on “other forms” and looked at language facet).  

Can see Discogs source.  Indefinite wording for “some” of this information.  If the wording had been “this information”, would have looked at the asterisk.  Glanced off the asterisk since the wording was the same as Discogs. Location of recording may be relevant for very specific research question but not otherwise.  Catalog numbers useful for translating between different performance editions.  In manuscripts where names can be inconsistent (e.g. diacritics), would depend on catalog numbers for search.  Tonality may be interesting as some, though not majority, of pieces identified solely through tonality.  Instrumentation info is often inconsistent and would not expect to see this in the library catalog page.  Librettist may be useful if searching for pieces by a specific librettist, otherwise would go to other sources to find this information. 

A given piece may have multiple catalog numbers.  Having a central repository which provides all the catalog numbers for a given piece.  Would search for catalog number they are familiar with.  Tends to be vernacular agreement (agreed upon shorthand) regarding which catalog number to use.

(Covered in other answers)

Contributors list has long strings of info.  “Other contributors” is a partial list followed by “more” link and that feels more user-friendly.  Like the work info button approach, although found it confusing at first since not used to it in the library catalog. 

5

Look more for new music (recent composers) and less older music like Mozart,  Don’t use catalog numbers as much as peers although have looked for alternative catalog numbers. Searched for librettist.  Probably use first performance of work. 

Helpful to see other titles by name or copied down in notes or “other titles” field.  Useful if system search understood the mapping between titles in different languages (i.e. searching for “magic flute” would still direct to “Die Zauberflote”). 

Correctly identified asterisk as corresponding to Wikidata source.  Useful: First performance date, librettist, catalog numbers, first performance location, opus number. Instrumentation is most important piece of information. Tonality is a mixed bag. 

Familiar with K and Bach numbers. Otherwise use infrequently. 

Catalog numbers, first performance date, location, librettist info all useful.  Would use codes to cross-search elsewhere.  Search by dates quite a bit.  Sometimes search by language if performance sung in another language.

Great work!

Table 2: Summarizing answers to follow up questions by participant. 


NOTES (Huda)

Participant One

Grad/Staff:

Preliminary questions

Tasks 

Follow up questions



Participant Two

Preliminary questions

Tasks 

Follow up questions

Easy enough to figure out.  

Those numbers are particularly useful when the title isn’t particularly useful. In those cases, the K number becomes part of the title.  Alternate title. 


Participant Three

Preliminary questions

Tasks 

Follow up questions


Participant Four

Preliminary questions

Tasks 

Follow up questions

Long strings of info of performers under magic flute - aren’t necessarily helpful. 

Other contributors: partial list followed by “more” link. Feels much more user-friendly

Work info: like this idea. Confused at first b/c not used to in library catalog.  Solved that info overload problem from the Mozart page.  In a way that info still accessible. 

Having source info: Discogs or Wikidata.  Would be really useful if there was a recording I wanted info. Saw it but didn’t have a way of getting physical copy.  Having sourcing info.  Discogs is community sourced but may not be sure of the info, in the case of using library catalog as a primary source.  

Transcription of CD booklet: may trust that more than a publicly editable database. 

Translation of titles: don’t know what an easy way to implement that would be.  Really helpful tool too have, Multiple languages referenced in info in that page. 


Participant Five

Preliminary questions

Tasks 

Follow up questions