Library Of Congress Goes Grid

Grid computing technology may soon be used to preserve such priceless
artifacts of American history as films of the Spanish-American War and
the 1906 San Francisco earthquake, the photographs of Matthew Brady and
Ansel Adams, and Walt Whitman’s notebooks.

The Library of Congress is evaluating Grid technology developed at the
San Diego Supercomputer Center to archive and preserve these works and
the Library’s other digital collections.

The Library has assembled numerous important digital collections such as
American Memory, a treasure trove of
films, recordings, photos and documents from U.S history and culture.
The collection, “rich primary source materials on the history and
culture of the United States,” contains more than 7.5 million digital
items on more than 100 topics from the collections of the Library and
other repositories. Items include encoded text, images, and audio and
video files varying in size from 25 kilobytes to 5 megabytes each, for a
total of some 8 terabytes of digital data.

Powerful data Grid technologies such as the Storage Resource Broker
(SRB) developed at the San Diego Supercomputer Center (SDSC) for
scientific computing are showing promise of being able to preserve these
digital holdings. SDSC and the Library are collaborating to evaluate the
SRB data Grid software to preserve and manage priceless national digital
collections.

“We’re interested in how the SRB can be applied to the task of building
a repository for managing Library of Congress digital holdings,” said
Martha Anderson of the Library’s Office of Strategic Initiatives.

‘Repurposing’ Collections

“We’re entering an era in which digital libraries can be used to
preserve intellectual capital,” said Reagan Moore, co-director of the
Data and Knowledge Systems program at SDSC. “And beyond preservation,
the ability to discover the information and knowledge content within
digital holdings will add even greater value to these collections.”

The researchers will investigate the capabilities of the SRB to manage
and “repurpose” Library of Congress collections. Repurposing a
collection involves giving users the ability to generate new views of
the digital holdings. For example, a user might want to gather the
material in the American Memory collection that is relevant to a landing
on Mars. This material might involve NASA material on the mission and
space vehicle, Congressional material on the budget debates involving
the funding, and other material that puts the mission in historical
context.

The collaboration will involve the installation at the Library of
Congress of the SRB software and the Metadata Catalog, which keeps track
of each digital object. Library of Congress staff will then build a test
collection and use it to evaluate the capabilities of the SRB data Grid
middleware to preserve both the collection and descriptive information
about the collection; to enable a naming convention that spans the
entire collection, no matter where its components are located; to merge
different collections seamlessly into new virtual collections; and to
control access.

Library of Congress researchers are also interested in
evaluating the ability of the SRB to interoperate with other systems
using open standards.

“We’re looking forward to the research opportunities this collaboration
will give us to understand how digital library, data Grid, and
persistent archive technologies can all be integrated in support of
preservation of digital holdings,” said Moore. “This will help extend
our ability to preserve intellectual capital.”

RELATED NEWS AND ANALYSIS

• Huawei’s AI Update: Things Are Moving Faster Than We Think

  FEATURE |  By Rob Enderle,
  December 04, 2020

• Keeping Machine Learning Algorithms Honest in the ‘Ethics-First’ Era

  ARTIFICIAL INTELLIGENCE |  By Guest Author,
  November 18, 2020

• Key Trends in Chatbots and RPA

  FEATURE |  By Guest Author,
  November 10, 2020

• Top 10 AIOps Companies

  FEATURE |  By Samuel Greengard,
  November 05, 2020

• What is Text Analysis?

  ARTIFICIAL INTELLIGENCE |  By Guest Author,
  November 02, 2020

• How Intel’s Work With Autonomous Cars Could Redefine General Purpose AI

  ARTIFICIAL INTELLIGENCE |  By Rob Enderle,
  October 29, 2020

• Dell Technologies World: Weaving Together Human And Machine Interaction For AI And Robotics

  ARTIFICIAL INTELLIGENCE |  By Rob Enderle,
  October 23, 2020

• The Super Moderator, or How IBM Project Debater Could Save Social Media

  FEATURE |  By Rob Enderle,
  October 16, 2020

• Top 10 Chatbot Platforms

  FEATURE |  By Cynthia Harvey,
  October 07, 2020

• Finding a Career Path in AI

  ARTIFICIAL INTELLIGENCE |  By Guest Author,
  October 05, 2020

• CIOs Discuss the Promise of AI and Data Science

  FEATURE |  By Guest Author,
  September 25, 2020

• Microsoft Is Building An AI Product That Could Predict The Future

  FEATURE |  By Rob Enderle,
  September 25, 2020

• Top 10 Machine Learning Companies 2020

  FEATURE |  By Cynthia Harvey,
  September 22, 2020

• NVIDIA and ARM: Massively Changing The AI Landscape

  ARTIFICIAL INTELLIGENCE |  By Rob Enderle,
  September 18, 2020

• Continuous Intelligence: Expert Discussion [Video and Podcast]

  ARTIFICIAL INTELLIGENCE |  By James Maguire,
  September 14, 2020

• Artificial Intelligence: Governance and Ethics [Video]

  ARTIFICIAL INTELLIGENCE |  By James Maguire,
  September 13, 2020

• IBM Watson At The US Open: Showcasing The Power Of A Mature Enterprise-Class AI

  FEATURE |  By Rob Enderle,
  September 11, 2020

• Artificial Intelligence: Perception vs. Reality

  FEATURE |  By James Maguire,
  September 09, 2020

• Anticipating The Coming Wave Of AI Enhanced PCs

  FEATURE |  By Rob Enderle,
  September 05, 2020

• The Critical Nature Of IBM’s NLP (Natural Language Processing) Effort

  ARTIFICIAL INTELLIGENCE |  By Rob Enderle,
  August 14, 2020