Search This Blog

Showing posts with label rda. Show all posts
Showing posts with label rda. Show all posts

Tuesday, January 7, 2014

Thoughts on CATALOGING, RDA, and metadata in netflix

 I have so many thoughts on this nexflix article but they can all be summed as humans and machines working together to organize, describe and provide relevance (the best of both worlds!) : semantic cataloging. Of course, libraries have been organizing, categorizing, and describing materials from the beginning, but RDA is a big step forward. With the end of print card catalogs and record limits (for the most part), the amount of data within a library catalog record can be much more expansive. Other library databases like repositories and digital libraries, generally have not faced record limits nor have they been tied to MARC (which has its own pros/cons). Of course, quantity doesn't always equal quality, either, but under RDA, we can provide as much description as we would like.

Another aspect of RDA is breaking up more data into smaller bits. Information that might have only appeared in a free text note field or was omitted from a library catalog record, may now be included in -- in some cases, as part of a controlled vocabulary, such as relator codes. These CODES provide information about the relationship of a particular person to a variety of things and can be used to build different kinds of linking, relevance, and all sorts of things! Libraries could create mechanisms so that users and others can more easily use the data to dynamically build lists or collections that are relevant to them (there's the semantic aspect!)  Of course, in order to use the data to make new things, it has to be open

Netflix has had a similar evolution in metadata. Thinking to what our nexgen library catalog systems could be like, let's look at what Netflix has done (and what a few folks have done with their data, which could only happen with at least, some of the data being open). 

Tagging/Data
It starts with people creating data and machine data collection:

"They [workers] capture dozens of different movie attributes. They even rate the moral status of characters. When these tags are combined with millions of users viewing habits, they become Netflix's competitive advantage. "


Much like traditional cataloging work, tagging is only as good as the tagger. The advantage that libraries have had is that the staff who do this sort of work (cataloging) most likely have some sort of training or relevant education.

In most popular social media (facebook, twitter, etc.) and image gallery sites (flickr, youtube, etc.) sub-tags if any, are limited: geographic (GIS , frequently from phone or camera gps coordinates in the exif metadata), subjects (topics as input by the uploader or tagger), names (user who uploaded or who tags other users in item), dates (item uploaded), access (public/private/select user group), system file information (file format, name, etc.)  and rights (copyright, permissions, etc.) are among the most common. For some image sites, exif data will automatically be loaded in, most frequently date, type of camera, file information and general image specs (size, resolution, etc.) ; other information such as rights (copyright)  is less likely to be picked up.  Facebook's support of metadata is marginal* (EXIF metadata is stripped out) and while Flickr does support the most metadata for images*, it relies primarily on the user to fill out the forms correctly to describe and assign the metadata. (See photometadata.org for more information about EXIF and social media).

In terms of search, crowdsourced metadata can be a challenge. It is only as good (and complete!) as the user who creates it. If you have ever searched for hashtags in twitter, or tags in Flickr, you will see they are used every way imaginable. Hashtags are used as a statement #fail #thisisstupid #greatread,  duplicated #ala (multiple things with the same keyword),  or misspelled #teh (the), with little in the way of quality control placed on them.

Structure
However, there is some structure in place, which facilitates searching by hashtag/tag vs. date.

While libraries have had better systems in that the metadata was created by experts and experienced staff, much of the data in a traditional MARC record is unstructured. Funny, no? We think of MARC as being so structured and while it is in terms of field order and use and the fixed field (character placement is essential there), it is not so structured within some fields, like the 5XX fields or even within the 245 (title/statement of responsibility) field. As long as the indicators are correct and the subfields are input correctly, the content within that field is really a type of free text. albeit with some rules for inputting. For example, while the 245 was and remains under RDA as a transcription field (key it as you see it), there are still "shortcuts" (i.e., ways to minimize data recorded) under RDA (See: a nice overview of changes between AAC2 and RDA). So, while it's transcription, it's not exactly ALWAYS word for word (albeit more so with RDA).

The third major component is that the data is open, or at least partially open.With siloed data, this experiment would have not been possible. Having siloed data decreases its ability to be used by others, as well.



So, how was Netflix able to make this successful from a metadata standpoint?

  • a defined (controlled) vocabulary (subject headings, authorities): " The same adjectives appeared over and over. Countries of origin also showed up, as did a larger-than-expected number of noun descriptions like Westerns and Slasher..."  
  • a structure (for catalogers, a similarity to how subject headings are formatted in a traditional library catalog), in netflix:  
    • Region, Awards named first (at least for Oscars)
    • Adjectives (Keywords, subject headings)
    • Dates and places named last (akin to a geographic subdivision)
"If a movie was both romantic and Oscar-winning, Oscar-winning always went to the left: Oscar-winning Romantic Dramas. Time periods always went at the end of the genre: Oscar-winning Romantic Dramas from the 1950s....
In fact, there was a hierarchy for each category of descriptor. Generally speaking, a genre would be formed out of a subset of these components:
Region + Adjectives + Noun Genre + Based On... + Set In... + From the... + About... + For Age X to Y"
 Akin to traditional subject headings:
6510 Sardinia (Italy) $v maps $v Early works to 1800  
650 0  $a Beach erosion $z Florida $z Pensacola Beach $x History $y 20th century $v Bibliography.

  •  data bits that can be repackaged: "little "packets of energy" that compose each movie.... "microtag."" (the smaller the data bits, the more they can be repackaged in different ways) 
 "Netflix's engineers took the microtags and created a syntax for the genres..... "


Thinking back to nexgen systems: RDA is providing a fairly good foundation to go beyond the traditional catalog. When done right (more vs. less, quality AND quantity), cataloging will net structured data bits that can be repackaged and relationship information that can build provide links between previously unrelated items (at least within the catalog); provided the data is open to be used and mechanisms are built so that users can create their own catalog experience. In that world, cataloging truly becomes semantic.
 


References:
Open Bibliographic Data, http://opendefinition.org/bibliographic/
Photometadata.org photometadata.org
AACR2 compared to RDA, field by field: http://www.rda-jsc.org/docs/5sec7rev.pdf  
How netflix reverse engineered hollywood: http://www.theatlantic.com/technology/archive/2014/01/how-netflix-reverse-engineered-hollywood/282679/
 

*Disclaimer: I have no idea what the backend systems of sites do with metadata; my thoughts are based upon the user experience. 

Wednesday, September 19, 2012

You can get there from here: AACR2 / MARC>RDA / FRBR / Semantic web

Although my graphics didn't turn out too nicely at slideshare, overall I think this covers what I'd like my staff to understand about RDA and FRBR in terms of foundation knowledge. We build from here...

Monday, August 13, 2012

Updates on RDA (LIbrary metadata; 264; authority records, more)

New MARC 264 field (publishing):
Few examples of RDA records in OCLC (and/or in LC's catalog) with the new MARC 264 field; most seem to be using only a 264 in lieu of a 260 which seems to follow the recommendations of the RDA proposal.


#56451778
264 1Sawtry, Cambs : ǂb Dedalus, ǂc 2004.

#20722916 (record in LC has not been updated) but the fields in question:
264 1Carbondale ; ǂa Edwardsville : ǂb Southern Illinois University Press, ǂc [1990]
264 4ǂc ©1990

#61821848 ; via the LC catalog



Updates to authority records:

[Snipped from a list]
The PCC Acceptable Headings Implementation Task Group (PCCAHITG) has successfully tested the programming code for Phase 1 in preparation for the LC/PCC Phased Implementation of RDA as described in the document entitled "The phased conversion of the LC/NACO Authority File to RDA" found at the Task Group's page at: http://files.library.northwestern.edu/public/pccahitg/.

Changes to name authority records (NARs) that are not susceptible to a mechanical change under Phase 2 will have a 667 note aded to them with the statement:
                THIS 1XX FIELD CANNOT BE USED UNDER RDA UNTIL THIS RECORD HAS BEEN REVIEWED AND/OR UPDATED

Some other enhancements will be made, when applicable, if the record is being updated to add the note (e.g., 046 fields are added to records for persons when the information is available).

If a record is a candidate for a mechanical change in Phase 2, no note will be added to the record during Phase 1.

Wednesday, February 29, 2012

Library of Congress RDA "Day 1" will be March 31, 2013

Big News from LC regarding RDA implementation:

As will be seen in the attached plan [on the website via the link below], we have determined that date to be March 31, 2013.
LC’s partner national libraries (U.S.: National Agricultural Library and National Library of Medicine; and non-U.S.: British Library, Library & Archives Canada, Deutsche Nationalbibliothek, and National Library of Australia) have been apprised of our plan and also intend to target the first quarter of 2013 as their RDA implementation date, i.e., between January 2 and March 31, 2013.

LC training plan:
http://www.loc.gov/aba/rda/pdf/RDA_Long-Range_Training_Plan.pdf


Announcement here:
http://www.loc.gov/catdir/cpso/news_rda_implementation_date_120227.html

Wednesday, February 15, 2012

OCLC/WorldCat discussion paper on RDA

Many points of interest in the OCLC discussion paper on RDA including  how catalogers may  use OCLC records postRDA implementation:

Proposed Future Cataloging Policy for Member Contribution to WorldCat after RDA Implementation

  • Catalogers are not required to update or upgrade existing records to RDA.
  • Catalogers may re-catalog items according to RDA if it is considered useful. Such recataloging should only be done with access to the item. All descriptive fields would need to be reconsidered and revised to conform to RDA instructions. The revised record would then be changed to Desc (Leader/18) coded as c or i as appropriate with 040 $e rda added.
  • Catalogers may update individual fields in pre-RDA records to reflect RDA practices if it is considered useful. Fields involving the transcription of data require access to the item in order to change transcribed data. The partially changed record would retain the indication of the rules under which it was initially cataloged, i.e., no changes would be made to the coding of Desc (Leader/18) and 040 $e would not be added or changed.Catalogers should use access points as established in the authority file, whether those forms are coded as RDA or AACR2.
The paper in full is available http://www.oclc.org/us/en/rda/discussion.htm

Friday, October 22, 2010

RDA vs. AACR2 for serials


A little powerpoint (pptx format) comparing RDA and AACR2 for serials courtesy of Renette Davis. I wish it were embeddable, but it's not.

Sunday, June 21, 2009

Sneak Peek at RDA


some screen shots of the RDA online product, links to documents giving background information, an RDA FAQ, a link to the Web site for the Joint Steering Committee for the Development of RDA (JSC) and to the AACR2 Web site.

Ooh, ooh -- a core record example using Oxygen XML editor!

http://www.rdaonline.org/rda_samples/rda_samples.html

Thursday, August 14, 2008

Survey: Catalogers working in non-MARC metadata

Hopefully, some of my fellow metadata "moonlighters" will see this survey also.

------------
To *all catalogers* (with or without MLS) in academic libraries:

SURVEY: Integrating Non-MARC Metadata Production into the Duties of Traditional
Catalogers. You are invited to participate in a brief national, online survey. The objective of this survey is to research the national trends in the integration of Non-MARC metadata work into the duties of traditional catalogers and the perceptions and attitudes catalogers hold towards non-MARC metadata.

For this study we would like to invite all catalogers in academic libraries, with or without MLS, who are involved in any aspect of non-MARC metadata work.
I am asking you to please participate by answering this multiple choice survey. Your answers will be completely anonymous and confidential and will only be used to summarize information.

*No* names or institution affiliation will be asked.

Responding to the survey constitutes informed consent to participate in the research. The survey is voluntary, and you may withdraw from it at any time.

It should take approximately 10 minutes to answer the 28 multiple choice questions of the survey.
To complete the survey, follow this link
http://www.surveymonkey.com/s.aspx?sm=b2XVTS5Z_2f5GV_2fXKUWTfyKw_3d_3d

The deadline to complete the survey is Sept.1, 2008.
If you have questions at any time about the study or the procedures, you may contact the principal researcher, Marielle Veve; at Hodges Library, 1015 Volunteer Blvd., Knoxville, TN 37996; mveve@utk.edu. If you have questions about your rights as a participant,
contact the Compliance Section at (423) 974-3466.

Thank you in advance for assisting in this research project by taking the time to respond to the survey. This research project has been approved by the University of Tennessee's Institutional
Review Board.