Tag Archives: preservation

New look and URL for LoC formats site

The Library of Congress has reorganized its site on file format sustainability and given it a new URL. (The old one redirects there.) A blog entry discusses the change. Relationships among formats are a big part of the site. It’s significant, for instance, that the MP3 encoding and the de facto MP3 file format get separate entries.

My reactions are mixed. When you click “Format Descriptions” on the main page, you get a page titled “Format Description Categories.” The nesting description at the top says you’re in “Format Descriptions as XML.” Eight categories are listed, and two formats plus “All xxx format descriptions” are listed under each category. There’s no obvious reason why those two formats get special prominence, or what the page has to do with XML.
Continue reading

Bit-rot tolerance doesn’t work

My brief post yesterday on the TI/A initiative provoked a lively discussion on Twitter, mostly on whether archival formats should allow compression. The argument against compression rests on the argument that archives should be able to deal with files that have a few bit errors in them. This is a badly mistaken idea.
Continue reading


File format analysis tools for archivists

My article on “File Format Analysis Tools for Archivists” is up on LWN.net.

XKCD on digital preservation

Today’s XKCD comic comments on digital preservation in Randall Munroe’s usual style.
XKCD cartoon on Digital Data
Continue reading

Are uncompressed files better for preservation?

How big a concern is physical degradation of files, aka “bit rot,” to digital preservation? Should archives eschew data compression in order to minimize the effect of lost bits? In most of my experience, no one’s raised that as a major concern, but some contributors to the TI/A initiative consider it important enough to affect their recommendations.
Continue reading

JHOVE 1.14

The Open Preservation Foundation has just announced JHOVE 1.14. The numbering is a bit odd. Version 1.12 never made it to release, and they seem to have skipped 1.13 entirely.

This includes three new modules: the PNG module, which I wrote on a weekend whim, and GZIP and WARC modules adapted from JHOVE2. The UTF-8 module now supports Unicode 7.0.

The release isn’t showing up yet on the OPF website, but I expect that will happen momentarily.

It’s nice to see that the code which I started working on over a decade ago is still alive and useful. Congratulations and thanks to Carl Wilson, who’s now its principal maintainer!

The end of UDFR

The Unified Digital Format Registry (UDFR), created and maintained by the California Digital Library, will shut down on April 15, 2016. I don’t know whether the whole site will go away or just the ability to query the registry.

Information Standards Quarterly has an article on UDFR by Andrea Goethals. The source code repository is on GitHub.

The predecessor project, GDFR, never got to publicly usable status. The site gdfr.info still responds to pings, but apparently not to HTTP requests.

Quoting its description here, so it’s saved in at least one place if the site completely goes away:

The UDFR is a reliable, publicly accessible, and sustainable knowledge base of file format representation information for use by the digital preservation community.

A format is a set of semantic and syntactic rules governing the mapping between abstract information and its representation in digital form. While many worthwhile and necessary preservation activities can be performed on a digital asset without knowledge of its format, that is, merely as a sequence of bits, any higher-level preservation of the underlying information content must be performed in the context of the asset’s format.

The UDFR seeks to “unify” the function and holdings of two existing registries, PRONOM and GDFR (the Global Digital Format Registry), in an open source, semantically enabled, and community supported platform.

The UDFR was developed by the University of California Curation Center (UC3) at the California Digital Library (CDL), funded by the Library of Congress as part of its National Digital Information Infrastructure Preservation Program (NDIIPP). The service is implemented on top of the OntoWiki semantic wiki and Virtuoso triple store.

Upcoming book on digital preservation

Thumbnail cover of When We Are No MoreAlmost all the published books on digital preservation are academic writing for a very limited audience. My own Files that Last wasn’t intended for a tiny audience but ended up that way. The chances look better for Abby Smith Rumsey’s upcoming When We Are No More: How Digital Memory Is Shaping Our Future.
Continue reading

Billion-year storage?

What would you say about data storage with a lifetime of billions of years? I’d say that extraordinary claims require extraordinary support. The University of Southampton’s Optoelectronics Research Center says it’s developed digital storage that will last for 13.8 billion years at 190° C — or at least that’s how it came out in the report. Peter Kazansky says “we have created the first document which will likely survive the human race.” (And the death of the Sun?)
Continue reading

Preservica’s “eX-Files”

Preservica has introduced a catchy campaign warning people against letting their files become “eX-files.” It includes a downloadable PDF, “Safeguarding your Vital Long-term Electronics Records.” (You have to provide your email address to download it, and you may have to turn off ad blocking temporarily to see the form where you do that.)
Continue reading