Kanopy Video Collection

Overview

Kanopy Videos are a combination of licensed videos and a PDA program. As such, we need to distinguish one type of file from the other and load them accordingly. Up until 2015, both types of videos, licensed and PDA, were loaded into the UXU01 catalog. However, in 2015, the PDA videos will be moved out of UXU01 and into PDA01 so they follow the shared bib PDA best practice. These procedures explain the process of getting MARC records for Kanopy, distinguishing between PDA and licensed data, and then loaded them to the proper directory.

Accessing MARC Records

Kanopy delivers MARC records as updates since the last recorded download. For example, if the last download was 1/1/2015, they will automatically indicate the number of new records available since that time. To find the MARC records, go to https://www.kanopystreaming.com/user/1198/mr (log in available through Serial Solutions portal). In addition to downloading updated records, you can download the full set or the records from each package by navigating to the package.

Licensed Packages

The packages licensed are listed. For the most part, we've licensed individual videos or playlists. However, we've also licensed the MEF Collection, which makes up the majority of our licensed videos.

PDA Packages

PDA Packages are available, predictably, under the PDA Packages heading on the Kanopy Dashboard. The packages we've licensed are either under Categories or Producers. They'll be highlighted if we've licensed the package, indicate a status of active, and have a symbol for MARC records.

Determining Between Licensed Videos and PDA Videos

Since Kanopy provides updated MARC records for both the PDA and licensed videos, it can be difficult to determine which ones are which. To figure it out, we need to look at the source of the video.

We will assume that all new MARC records are PDA since licensed titles or purchases will be noted and downloaded by collection. Still, we have to make sure. To do this, we'll download all the MARC records for all the licensed titles. To do this, go to the Kanopy homepage and login. Select "Licenses."

At time of writing, there are only 2 upfront licenses. Download the MARC records for these collections manually.

Go to the PDA tab. At the time of writing, there are 39 licenses, across two pages. Should this process expand, repeat for each page.

• 1. For each page of PDA license titles, right click the page and select view source. Find the HTML that has "<table class="ui inverted table ui table inverted" id="license_list">" Select the text down to the end tag for the the table (</table>). Copy and paste this data into a text file. Remove the tbody and table tags, keeping only the rows starting with <tr class>.

  2. Combine all the pages into a single text file and then copy and paste the lines into an Excel file so that the data is in A2 (leaving A1 for a label).

  3. Put the following formulas into B2, C2, D2, E2, and F2 respectively (labels could respectively be, URL, Title, ID, Marc Records, MARC Record Download)

     1. =MID(A2,FIND("href=",A2)+6,FIND(""">",A2,(FIND("href=",A2)+6))-(FIND("href=",A2)+6))

     2. =MID(A2,FIND(B2,A2)+LEN(B2)+2,FIND("</a>",A2,(FIND(B2,A2)+LEN(B2)+2))-(FIND(B2,A2)+LEN(B2)+2))

     3. =VALUE(MID(A2,FIND("nid/",A2)+4,FIND("/d",A2,FIND("nid/",A2)+4)-(FIND("nid/",A2)+4)))

     4. =VALUE(MID(A2,FIND("Download the",A2)+LEN("Download the"),FIND("Marc Records",A2)-(FIND("Download the",A2)+LEN("Download the"))))

     5. ="start chrome https://www.kanopystreaming.com/ks-mr/nid/"&D2&"/download?uid=1198"

  4. Copy the values from column F into a notepad file. Remove any rows with an error (most likely #VALUE).

  5. open a command line or power shell window

  6. paste the lines from the notepad into the command line or power shell - this will start Google Chrome and download all of the MARC files.

  7. Use MarcEdit to join all the files together - along with the upfront MARC files.

Export the IDs from the joined MARC file and see if any of the IDs are in the new additions MARC file from Kanopy. If not, you can safely assume they are all DDA titles. If they are in the new additions file, then you'll want to extract those files to load to UXU01 instead of PDA01.

Workflow Diagram

Loading the Licensed Data

The licensed video MARC file can be loaded using the standard 035 to 599 Genload profile. Be sure to clean up the file using MarcEdit first. This usually includes:

• 1. Removing subfield $z from tag 856

Also, be sure to set holdings in OCLC with MarcEdit.

Loading the PDA Records

**In effect as of 7/21/2015

The PDA records file will be sent to FLVC through a help desk ticket (help@flvc.org) to be loaded into PDA01.

Records loaded may be seen by using the following Arrow report:

http://arrow.flvc.org/reports/f?p=145:119

Additionally, records may be viewed by using the Data Warehouse. In the FCLNX33.SUSREPT.CM connection (the Aleph Report Mode connection), run the following query (specify records in the commented blue text).

select Z13U_REC_KEY, b.Z13_TITLE, Z13U_USER_DEFINED_4 AS SYSTEM_NUMBER, b.Z13_YEAR, b.Z13_UPDATE_DATE

from PDA01.Z13U a

join PDA01.z13 b on a.Z13U_REC_KEY = b.Z13_REC_KEY

where 1=1

and Z13U_USER_DEFINED_5 = 'FA'

--and a.Z13U_REC_KEY in('000912559', '000913275', '000912558')

Purchases of PDA Titles

When a PDA title is purchased, you'll need to find it in PDA01. Next, load the title into UXU01. Finally, submit a ticket to FLVC to remove the system number from PDA01.

Deletion of PDA Titles

Kanopy makes available MARC files for titles that have been deleted. These will also need to be compared to both the firm orders and the PDA records to see which set they belong to. For the former, you can use a ret-06 search against the UTL index after extracting the MARC 001 and MARC 003 from the deletion MARC records. For the PDA records, you'll do the same, but search using either an arrow report or a query.

As of 10/17/2016 there were 88 deletion files

PDA Comparison against Purchased Titles

After each load of purchased video titles, we should compare the new MARC file to the PDA files we have. The steps for this are as follows:

• 1. Create the MARC file from the loaded records or use the file provided by the vendor (Films on Demand, Alexander Street Press, etc)

  2. Update the set of PDA titles we have, which are almost all Kanopy titles as of writing.

     • select b.Z13U_REC_KEY, a.Z13_TITLE, a.Z13_IMPRINT, b.Z13U_USER_DEFINED_4 AS Control_Number, a.Z13_UPDATE_DATE, a.*

     • from PDA01.Z13 a

     • join PDA01.z13u b on a.Z13_REC_KEY = b.Z13U_REC_KEY

     • where 1=1

     • and Z13U_USER_DEFINED_5 = 'FA'

     • and b.Z13U_USER_DEFINED_1 = 'VM'

  3. Put the results of query into the csv file in the local directory of the script found here: https://github.com/EthanDF/videoDDACheck

  4. Run the script

  5. Any results should be reviewed and sent to the FLVC Help Desk if determined to be equivalent to the licensed titles

As a note, the script will cycle through the MARC file and see if the title (245$a and if 245$b exists, it adds a ":" and the 245$b) matches any of the titles from the PDA01 database.