Page History

...

Huda Khan, Astrid Usong, Steven Folsom
December 2022

TABLE OF CONTENTS

GOAL

METHODOLOGY

PARTICIPANTS

SCHEDULE

KEY OUTCOMES

RESULTS SUMMARY

TASKS AND SCREENSHOT REFERENCES

TASKS

Screenshots from the prototype

SUMMARY BY PARTICIPANT

NOTES (Huda)

Anchor
GOAL GOAL

GOAL

We wanted to get participant reactions to our inclusion of Wikidata information directly within the page and through the use of work knowledge panels.   We also wanted to understand which of the Wikidata properties the participants might find useful. 

Anchor
METHODOLOGY METHODOLOGY

METHODOLOGY

We sent out a recruitment email to Tracey Snyder, a Cornell music librarian, who forwarded the message to staff and graduate students.   When participants responded, we scheduled a half hour Zoom session with them and sent them the consent form as an attachment.  During the Zoom session, after obtaining verbal consent from the participants, we provided a link to the tasks and links to the prototype.   We began the session with a preliminary question about how participants used the library catalog to look for musical resources and ended the session with some follow up questions.   

Anchor
PARTICIPANTS PARTICIPANTS

PARTICIPANTS

Anchor
SCHEDULE SCHEDULE

SCHEDULE

December 19-22, 2022

Anchor
KEY OUTCOMES KEY OUTCOMES

KEY OUTCOMES

• Work info buttons appeared easy to find, with only one participant requiring a prompt to look at the included works section of the page.  Once the button was clicked, all participants were easily able to navigate to and find the information on the resulting author title browse page. Future implementation could incorporate work info buttons next to included works. 
• Catalog numbers provide potentially useful distinguishing information and may be best included nearer the top of the page or next to the title.  
• Instead of “codes”, we should use a term more commonly used for this information such as “catalog numbers” or “thematic catalog numbers”.
• If the title is available in other languages, that information may best be positioned very near the title itself, in the languages field on the page, or somehow accessible in the “other forms” of this work page. 
• When using asterisks in fields to indicate the data in those fields comes from Wikidata, we could reword the statement about the Wikidata source to say “This information comes from Wikidata” instead of “Some of the information on this page comes from Wikidata”.  Additional design options should be reviewed to ascertain how to display Wikidata source information and how these options may be perceived on pages where Discogs information and highlighting are also present. 
• Additional research should be conducted to evaluate which Wikidata properties may be most useful for the wider library catalog audience.  Among the Wikidata properties we included, catalog number, instrumentation, librettist, and tonality may be candidates for most relevant information to include for a musical recording.  Historical information, such as date and location of first performance, was deemed potentially useful for specific cases of research but not necessarily for the participants themselves.  
• Another potential area of exploration may center around the use of the information captured in thematic catalogs, such as chronology of works and snippets of music for a particular work, to support discovery in library catalogs. 

Anchor
RESULTS SUMMARY RESULTS SUMMARY

RESULTS SUMMARY

• All participants were able to complete the tasks and find the information we asked them to identify in the prototype.  Three participants completed all the tasks without any additional prompts. One participant had to be prompted to look at the included works section to find the work info buttons.  One participant had to be prompted to continue to the end of the page to see the librettist information, which they also identified within the contributors section at the top of the page. 
• Work info buttons appeared easy to find, with only one participant requiring a prompt to look at the included works section of the page.  Once the button was clicked, all participants were easily able to also go to the full information page. 
• Although participants were able to correctly answer all the questions regarding catalog numbers, one participant noted that “codes” was not how they would usually refer to this information.  “Catalog number” may be a better label.
• When asked which Wikidata properties they thought might be useful based on what they had seen in the prototype, all participants indicated catalog numbers were helpful to include.  Three participants stated instrumentation was useful information.  Three said information about the librettist was useful, with one of these participants saying the information would be useful if they were searching by the librettist.  Two indicated tonality may be useful information to include, with one specifying how some pieces of music are identified through their tonality.  Another participant stated tonality information was of mixed relevance, as the tonality may be information that could be contested or debatable.  One participant mentioned Opus numbers as being useful to include.  It is important to note that participants were not given the whole list of properties again when answering this question but asked to react to what they had already seen while completing the tasks.   
• Two participants identified that the asterisk at the end of certain fields meant that that information was coming from Wikidata.  The other three participants first saw and commented on the Discogs information statement.  One of these participants suggested different wording for the Wikidata acknowledgment, replacing “some information” with “this information”.   
• While answering follow up questions, all participants indicated they had some familiarity with the concept of catalog numbers.  Two participants indicated they were familiar with some types of catalog numbers but not all of them.  

Anchor
TASKS AND SCREENSHOT REFERENCES TASKS AND SCREENSHOT REFERENCES

TASKS AND SCREENSHOT REFERENCES

We shared the following document with the participants with the tasks and questions and links to the prototype.   We are also including the text of the questions and tasks below.  Screenshots from the prototype and production catalog are included below for documentation.  

...

...

SCREENSHOTS FROM THE PROTOTYPE

Link to Google slides

Figure 1: Top of the page for Task 1.  "Sonata in A major, for violin (or viola) and piano".

...

Figure 12: Author title browse page for "Stravinsky, Igor, 1882-1971. | Ebony Concerto" for Task 4.  This page shows the inclusion of information from Wikidata for first performance date, first performance location, and instrumentation. Clicking on "View full info" in the knowledge panel shown in Figure 11 leads to this page.

Anchor
SUMMARY BY PARTICIPANT SUMMARY BY PARTICIPANT

SUMMARY BY PARTICIPANT

In the tables below, we summarize participant behavior and answers to follow up questions. “#” denotes the column for participant number. 

...

Table 2: Summarizing answers to follow up questions by participant. 

Anchor
NOTES NOTES

NOTES (Huda)

Participant One

Grad/Staff:

...