Skip to main content
Avalon Media System:
Community Implementation and
Sustainability
Open Repositories 2015
10 June 2015
Jon Dunn, Indiana University
Julie Rudder, Northwestern University
Debs Cane, Northwestern University
Mike Durbin, University of Virginia
Hannah Frost, Stanford University
Open Source Technologies
With Avalon You CAN:
Release 4
Accessibility:
Phase One
Dependency
Simplification
- Transcoding
API
Structural
Metadata
Release 4: Summer 2015
Other Features:
 Wowza integration
 Hydra 8
 Canvas LTI integration
improvements (linking directly
to item/section)
 oEmbed support
• Continuing software development and
integration
• Assessment of Scholarly Needs
• Business and Sustainability Model
Development
• Hosted Service Offering
Mellon Grant Overview
Release Functionality
Release 5
December 2015
•Technical environment for
pilot SAAS
•Captioning
•Robust API development
Release 6
June 2016
•Bookmarking, Clip making,
Playlists
•Annotation
•Synchronized Transcripts
•Spotlight Integration
Release 7
December 2016
•Publishing Out to External
Media Sites
•Dynamic Adaptive
Streaming
•Access control
enhancements
The team approaches release plans in an agile manner, allowing for a
solid path forward but also leaving room to respond to community and
user feedback in a timely manner.
Mellon Grant Overview
Assessment of Scholarly Needs
One important goal of this project is to fill out the Avalon
requirements and implementation such that the system offers robust
support for humanities scholarship.
Mellon Grant Overview
Business and Sustainability Model Development
The community of Avalon users and developers needs to become a robust, self-funded
entity attracting continued investment so it can keep pace with technology changes and
emerging use cases.
Mellon Grant Overview
Hosted Service Offering
Even some larger institutions have indicated an interest in being able to subscribe to a cloud-hosted instance of
Avalon without having to devote their own system administrator and developer resources to its installation,
maintenance, customization, and technical support.
Chris Colvard
Lead developer
Julie Hardesty
Scrum master, metadata analyst
Jon Dunn
Project director
Leah Lee
Developer
Brian Keese
Developer
Cynthia Ramlo
Lead User Experience Designer
Karen Miller
Metadata analyst
Debs Cane
Repository Community Manager
Julie Rudder
Project owner
Michael B. Klein
Lead developer
Stefan Elnabli
Audiovisual Media Specialist
Paul Clough
Developer
Development Team
Avalon at Indiana University
IU Context
• History of audio/video digitization
• Legacy systems for delivery
• Eight campuses
• New demands
• Media Digitization and
Preservation Initiative
18
Legacy Systems
19
IU Enterprise Streaming
Adobe
Media
Server
4 core, 1GB RAM VM
1GB Disk (VMware)
Avalon Web App
Solr, Fedora
12 core, 120GB
RAM,8TB dedicated
hardware
Transcoding
IU Deployment Environment
Shared SAN Derivatives
Redundant Archive Storage
(HPSS)
Master
Files
Library servers University IT Services
IU Production Instance
media.dlib.indiana.edu
21
Archival Film
22
Omeka Online Exhibit:
World War II Propaganda Frilms
23
Media Within Archival Collections
24
Online Publishing:
Ethnomusicology Multimedia
25
Institute for Juvenile Court
and Corrections Research
26
Specialized Avalon Instance:
Kelley School of Business
27
Future Migrations
• Video e-reserves
• LTI integration with Sakai, Canvas
• Licensed educational video
• LDAP for campus restriction
• Variations: music audio
• Pedagogical, annotation tools
• Media Digitization and Preservation
Initiative
28
IU Media Digitization and
Preservation Initiative
mdpi.iu.edu 29
Julie Rudder j-rudder@northwestern.edu
Digital Initiatives Project Manager
OR2015
and
+
• Spreadsheets
• Emailing links
• Limited access control
• Lots of support, help pages, phone calls, email
• Minimal metadata
How we managed 30k assets
Really long help pages
Retire current infrastructure
by summer 2015
Summer
2014
All new requests go into Avalon....
Summer
2015
...Retire legacy systems
Starting 2004 – 30,000+ streamed assets served
I ‘ M HAVING CANDY FOR DINNER
NU Integrations
• LDAP
• Permanent URLs – Handle.net
• Private dropbox for collections (SMB mounts)
• AMS streaming
• Integration to existing Fedora
• Canvas LTI
Avalon LTI View
NU Production Environment
Enterprise Campus
Streaming with
Load Balancer
Streaming -
FMS 1
Streaming -
FMS 2
VM
Avalon Web App
4 TB dedicated
Hardware
Transcoding
Shared Production Fedora Fedora
Shared SOLR Dedicated SOLR Core
Existing Production SystemsNew Provisions
1 DevOps (install, configure, support)
1 Developer (app customization, support)
1 Project Manager (app oversight, integrations oversight)
1 Service Manager (liaise with units & users, workflow, support
Staffing and Support
Google Analytics
Sept 1, 2014 to June 1, 2015
Avalon allows for new uses
• Collections that were not available before or
were scattered around on Youtube
• Digital Humanities support
• Faculty research output
• Multimedia Learning Center
Unit -Multimedia Learning Center
Unit -Multimedia Learning Center
Supporting faculty research
AVALON at the
University Of Virginia
Open Repositories 2015
Background
Online Access before Avalon
● “Boutique” websites
o QuickTime media embedded in static pages
o occasional access controls
● Kaltura-hosted streaming media linked from MARC records
● Kaltura video embedded in OPAC view
● Shared Shelf
Description before Avalon
● MARC records in Sirsi Workflows
● Google Forms
● Spreadsheets
● Shared Shelf
Preservation before Avalon
Lots of copies with…
...info about where they were…
...spread across staff members for safe
keeping.
LOTS OF COPIES on my desk KEEPS
STUFF SAFE
Current State
Implementation Timeline
● 2014-July - 3.0 soft launch
● 2014-September - 3.1 upgrade
● 2015-January - 3.2.1 update
● 2015-February - OPAC integration
● 2015-May - 3.3 update
o added MARC import feature for copy cataloging
Content
● Licensed commercial content
● University-produced content
o lectures
o concert recordings
● Reformatted rare and unique A/V resources
o films
o newsreel footage
o radio programs
o oral history recordings
o unpublished traditional music recordings
Access Scenarios
● Consortial access
● University access
● Collection Manager access
● Public access
Production Setup
Firewall
Avalon VM
Rails (RVM)
Fedora
Solr
Transcoding
Hardware
Matterhorn
Hardware
Streaming
Red5
Hardware
Streaming
Red5
F5 Load
Balancer
F5 Load
Balancer
F5 Load
Balancer
Blacklight -
based OPACBlacklight -
based OPAC
Blacklight -
based
Discovery
and Access
Solr
Solr
Solr
Indexing
process
embeds
Access Experience
● Consortial Users access the materials directly in Avalon through links at
portal sites or within their catalog
● UVA users view content embedded within Virgo
● Privileged/Expert users may access or discover resources directly within
Avalon
Description Workflows
● Spreadsheet import
o legacy collection, migration
● Avalon form entry
o customized descriptions and guidelines from Metadata team
o Training and documentation for catalogers
Preservation
● Avalon is now the system of record for item-level descriptive metadata
● Master files are passed along to mirrored storage
● External processes can perform fixity checks
● Content can be packaged for submission into AP Trust
Conclusions
Customization/Integration
● Authentication
● Branding
● Publication pipeline
● Preservation pipeline
Results
● A service and a brand
● Replaced old functionality
● Addresses many needs as “low-hanging fruit”
● Frees up time, clarifies needs for more robust preservation planning
Thanks
Michael Durbin
md5wz @ virginia.edu
Avalon
at Stanford
Hannah Frost
Services Manager
Stanford Digital Repository
Stanford Media Preservation Lab
OR 2015  Indianapolis  June 10, 2015
Imperfect World
Stanford Media Group
AV Media Assets to Manage
• Collections acquired by the library
• Works produced by faculty, students,
campus units
• Content selected for course reserves
Our Special Concerns
• Metadata standards
• Preservation
• Rights management
• Controlled access
• Persistent online location
• Accessibility
Need 1: Library collections
Media Preservation Program Goals
• Maintain long-term access to at-risk materials through
high-quality reformatting
• Support collection development
• Promote use of media in teaching and research
• Integrate with digital library
– Services
– Technology
• Develop expertise, best practices, community
Michael in Video Lab
0
100
200
300
400
500
600
700
800
2009 2010 2011 2012 2013 2014
69 Items
requested in
Sept 2014
alone!
Rising Patron Digitization Requests
Top Collection Websites: Media
Maintain long-term access to at-risk materials
through high-quality reformatting
Support collection development
Promote use of media in teaching and research
Integrate with digital library
✔ Services
☐ Technology: discovery and delivery
Develop expertise, best practices, community
Program Goals – Checking In
✔
✔
☐
✔
☐
Media Access Working Group (2013)
Recommendations include:
• Augment systems and tools that
– Reduce ingest backlog
– Promote discovery and use
• Confront the rights barriers by
– Developing reasonable access policies
– Implementing technologies to control access
Need 2: Stanford media makers
Launched 2013 * 562 collections * 358 depositors
Jonathan Berger, Professor & Composer
Department of Music
Michael Osborne & Miles Traer, PhD Students
Anna Schultz, Assistant Professor
Department of Music
Chris Gerdes, Director
Revs Program, Dynamic Design Lab
Need 3: Content for access by LMS
+ ?
Looking for a Solution
• Technology
– Open source
– Open-minded and flexible
• Community
– Vibrant, smart
– Digital library-centric
Avalon at Stanford
• Shares common concerns
– Standards, preservation, access control,
persistence, etc.
• Meets our core needs
– Functional, technical, philosophical
– Tested by Media Access Working Group
– Supported by SUL Management
Adoption has been obvious, but …
Avalon is self-contained
Our digital library is not self-contained
Then comes
Avalon Release 4
Avalon on Stanford’s digital library
Special Areas of Interest
• Wowza Streaming Engine
• Pluggable transcoding engine
• Open Annotation
• Transcripts/captions
• Capturing special license terms
• Integration with Fedora 4
• Making Avalon more modular
Thank you!
Hannah Frost
hfrost@stanford.edu
Questions?
www.avalonmediasystem.org
Morty Proxy This is a proxified and sanitized view of the page, visit original site.