Redundancy is central to digital preservation. When only one copy exists, it’s easy to destroy it. Backups and mirrors help, and the more copies there are, the safer the content is. The InterPlanetary File System (IPFS) is a recent technology that could be tremendously valuable in creating distributed archives. I haven’t seen much discussion of it in digital preservation circles; Roy Tennant has an article in Library Journal briefly discussing it.
IPFS is based on a radical vision. Its supporters say that HTTP is broken and needs a replacement. What they mean is that location-based addressing by URLs makes the Web fragile. If a server loses a file, you get a 404 error. If the serving domain goes away, you don’t get any HTTP response. IPFS ensures the persistent availability of files by allowing multiple copies on nodes of a peer network. The trick is that they’re addressed by content, not name. An IPFS identifier uses a hash of the content. This protects against file tampering and degradation at the same time; it also means that objects are immutable.
IPFS hashes are long strings that no one’s going to remember, so a naming convention called IPNS (InterPlanetary Naming Service) can sit on top of it. IPNS seems to be in a primitive state right now; in the future, it may support versioning and viewing the history of named objects. IPFS itself supports a tree of versioned objects.
The enthusiasts of IPFS don’t talk much about dynamic content; the whole concept is antithetical to dynamic, interactive delivery. I can’t imagine any way IPFS could support a login or an online purchase. This means that it can never completely replace HTTP, to say nothing of HTTPS.
What’s especially exciting about IPFS for readers of this blog is its potential for creating distributed archives. An IPFS network can be either public or private. A private net could consist of any number of geographically dispersed nodes. They aren’t mirror images of each other; each node can contain some or all of the archive’s content. Nodes publish objects by adding them to a Distributed Hash Table (DHT); if it isn’t there, no one knows how to request it. They can decide which nodes listed in the DHT they’re going to copy. I don’t know if there’s any way to tell how many nodes have a copy of a file or any balancing mechanism to guarantee that each node has a safe number of copies; a robust archive would need these features. If a server is going to drop out of the network in an orderly manner, it needs to make sure at least one other node has every file that it wants to persist. Short of having these features, a distributed archive could set up a policy of putting every file on every node, or it could create a partitioning scheme. For instance, it could compute a three-bit hash of all objects, and each node would be responsible for grabbing files with overlapping subsets of the eight possible hashes.
Some of you must already be thinking about LOCKSS and how that compares with IPFS. The comparison isn’t one-to-one; LOCKSS includes higher-level protocols, such as OAIS ingest and format migration. It isn’t about making distributed copies; participants independently subscribe to content and compare copies with one another, copying to fix damaged files. An IPFS network assumes that all participants have access to all shared content. For a large public domain archive, this could be ideal.
With a public IPFS network, removing material is virtually impossible. This is intentional; redaction and censorship are computationally indistinguishable. An IPFS under a single authority, however, can delete all copies of a file if it turns out to violate copyright or have private information. Or, unfortunately, if an authoritarian government orders removal of information that it doesn’t want known.
IPFS could develop into a hot technology for archives. Developers should look into it.
For most people, DNA is some kind of magic. The Fantastic Four gained their powers when space radiation altered their DNA. Barack Obama, in one of the most inappropriate metaphors in presidential history, said 
iTunes is horrible and keeps getting worse. The current version has come down with dyslexia; it can’t even play my files in order. On top of that, it supports a poor range of file formats, knowing nothing about popular open formats like FLAC and Ogg Vorbis. QuickTime Player has a saner user interface but the same format limitations. If you want to play music in those formats, you need to look for other software. I’ve just grabbed 
In December, JHOVE 12.0 was very close to a release. Since then, 
Why exactly is MP3 still popular? It’s not as efficient as more recent compression methods, and it’s encumbered by patents. People keep using what’s familiar. In a few years, it may become patent-free.
An online discussion led to my learning about Udemy’s support for closed captioning and to the formats available for it. Since I hadn’t heard about these formats before, I’m guessing a lot of other people haven’t. They can be useful not only for accessibility but for preservation, since they provide a textual version of spoken words in a video. These are just some notes on what I’ve found in a cursory investigation. In general, sites that support closed captioning expect a text file in one of several formats, which has to have at least the text of the caption, its starting time, and its duration or ending time.
Mad File Format Science 
Spintronics for data storage
DNA data storage sounds like the stuff of science fiction, yet other technologies look even farther out. Spintronics data storage offers greater storage density and stability than magnetic storage, if engineers can get it to work. It depends on the quantum property of an electron called “spin,” which is a measure of angular momentum but doesn’t exactly mean the electron is spinning like an orbiting planet. Analogies of quantum properties to the macroscopic world don’t work very well.
It turns out there are more kinds of magnetism than the ferromagnetism we’re familiar with. Spintronics uses antiferromagnetism. With ferromagnetic materials, ions all line up their individual magnetic fields in the same direction, so that the material overall has a noticeable magnetic field. In antiferromagnetic materials, they line up in “antiparallel” formation, head to head and tail to tail, so that the fields cancel out and there’s no magnetic field on a large scale. With materials of this kind, it’s feasible (for cutting-edge values of “feasible”) to manipulate the spin of the electrons of individual atoms (or perhaps pairs of atoms is more exact), flipping them magnetically.
Continue reading →
Comments Off on Spintronics for data storage
Posted in commentary
Tagged storage media