The future of archiving

We all know content is king but just as important is the need to prepare, protect and preserve the content through viable and long lasting solutions.

Within the video production industry alone, data-heavy content such as HD, 4K and high frame rate videos are exponentially growing by the day. Subsequently, these newly created assets need to be managed effectively, stored safely, and utilised along with the old assets.

Broadcasters, production companies, and other content holders are not only handling large and growing quantities of daily content, but are also much concerned with digitising the massive VTR assets currently sitting on shelves. As it becomes increasingly possible to effectively manage and rapidly search these materials via shared networks, new potential is discovered for the reuse of such assets.

As data volumes rise, so do storage costs – making it essential to implement storage systems that distinguish between hot (frequently accessed), warm (occasionally accessed), and cold (infrequently accessed) data, and se-lecting the best storage media for each. The main obstacle for content owners is to ensure the ability to preserve, access, and re-use their valuable assets without incurring repeated investment, and huge running costs.

The requirements of long term reliability, the ability to maintain large quantities of data at relatively low costs, and the ability to maintain data integrity in “green environments” with limited environmental controls are essential.

Sony is convinced that optical disc storage fills all of these requirements, and is therefore ideal for warm and cold storage. The new technology, with open and non-proprietary formats, involves the use of multiple bare discs contained within a robust cartridge and a dedicated disc drive unit with an associated software driver able to manipulate the discs individually – providing a seamless read/write capability.

The non-contact read/write technology offers the ability to access data with remarkable speed compared to tape data that necessitates the physical fast-forwarding and rewinding of a tape, 800 metres or more in length, until the location of the required data is reached. Also, it’s never going to jam, tangle or snap.

The fact remains that optical discs are considerably more durable than hard-disk storage systems or magnetic tape based media, with a 100-year shelf life expectancy. The system is highly reliable and optimised for long-term archiving. It also succeeds in keeping down total archiving costs, and has a low environmental footprint. It offers accessibility, high speed, and can be scalable to fit the users’ needs which can begin with small archive stored on a few shelves, and expand into a large library as data accumulates.

Whilst the professional AV media industry has moved steadily from its tape based origins toward file based workflows for acquisition, post-production and distribution, the archive domain continues to remain largely tape-based. An alternative modern day solution, the Optical Disc Archive (ODA), has been created helping organisations achieve safe, long-term storage of video, photos, text, and other important digital assets.

Both LTO magnetic tape and Optical Disc Archive are viable cold storage options. The most common complaint from the user community is the constant need to migrate valuable assets from one form of tape media to the next version upgrade simply to maintain a viable archive. This requirement for copy migration every two generations (approximately five to six years), incurs substantial media and labour costs.

By leveraging the proving optical technologies, and inter-generational compatibility of optical discs, ODA technology can store important data safely, eliminating the need for migration every few years. This eliminates the need for media, hardware and software re-investment, as well as the cost of human resources required to perform copying work, resulting in reduced total cost of ownership.

 
ODA solutions are also ideal for deep archive, whereas data tape does not provide the assurance or meet the need for very long-term archive requirements. It also provides a second copy broadcast archive solution at a remote site and is suitable for business continuity, disaster recovery, post house and production back-up and, for video, film and stock footage archives or AV national archives. The system can also be used for news and sports clips that need to be near-online and as an on-line browse and proxy clip store.

Recently, Sony unveiled the second generation of its Optical Disc Archive System, which doubles the capacity of a single cartridge, and doubling read/write speeds over the previous generation, accommodating 4K video in real time, and maintains backwards read compatibility with first generation optical disc drives.

Optical disc archive can serve as the core of highly productive archive systems capable of managing and storing valuable, high-volume data—including 4K video, future-generation video, older video assets, and multimedia video content.

The technology is future proof and achieves a revolutionary jump in the world of data storage ideal for any circumstance.

Now and in future, this system delivers an efficient, secure, and reliable archive solution. Unlike data tape technology, where you have to migrate your content or you can’t access it as your technology moves on, the Optical Disc Archive media written today, will be readable by the drives of tomorrow.

Bottom line is with the current region pre-dominantly tape based, it is now time to transition towards the future. Optical disc archiving is the way forward – it is a solution that is long term, economical, and ultimately scala-ble to grow with your business.

Written by Nabil El Madbak

 

Source: ScreenAfrica

From floppy disks to deep freeze: what’s the best way to store data?

A New York-based team of volunteer archivists and preservationists are working to transfer old VHS videotapes into digital formats. Volunteers meet weekly in a Tribeca loft filled with “racks of tape decks, oscilloscopes, vectorscopes and waveform monitors” to painstakingly digitize cassettes from the 1980s and 1990s. As they note, transferring video isn’t plug-and-go; much tweaking and troubleshooting can be required to get it right. That’s why they’ve only managed to transfer 155 tapes so far – a very small percentage of the total analog format archive.

The group partners with artists, activists, and individuals to lower the barriers to preserving at-risk audiovisual media – especially unseen, unheard, or archived works.

Whatever the content, once it’s digitized, it becomes publicly available via the Internet Archive.

And what about your own tapes? There are plenty of paid services that will help you to digitize old videotapes – or you can do it yourself using directions from open sources. And if you still have a big dusty box of your home video tapes stored somewhere deep in the closet, it may be a good idea to transfer their contents on the new storage mediums. In fact, we have already discussed that in one of our previous articles.

Tape manufacturers predicted 20 to 30 years of life expectancy, but media lifespan depends greatly on environmental conditions. Format obsolescence contributes to the crisis: Umatic and VHS tapes are no longer manufactured and BetaSP will soon be discontinued. Machines to play these formats are becoming more scarce as are the skills to maintain and repair them.

Of course, it’s not only the videotape that’s at risk. Entropy is relentless, and anything recorded on the old storage mediums will eventually have to be transferred and digitalized. Even if the medium remains intact, formats and interfaces become obsolete and disappear. Preserving data for the long term is a discipline worth more attention than we can give it here, but a few tips might be helpful.

Lifespan comparison of different backup storage media

 

Keep track of how long media is likely to last – but remember that the statistics are controversial projections, and many won’t be so precise. The general consensus is that consumer segment CD-Rs should last 30 to 50 years, DVD-Rs less than that, and CD-RWs and DVD-RWs even less. Similarly, tapes and hard disks can be expected to be readable for 10 to 30 years, while portable disks, USB thumb drives, and other solid-state storage devices may survive for half that time, maybe.

Back in 2005, The New York Times reported that 3.5” floppies have “an estimated life span of 10 years if stored in a cool, dry place with average care and use”. If you’ve still got any, we’ll bet they’re older than that!

With this in mind, regularly copy data to new media, especially if it’s approaching its expiration date. And make sure anything you haven’t saved is “in a cool, dry place,” not your attic or garage. It is strongly recommended to use a specialized archival optical media, like FalconMedia Century Archival, which are able to secure your data for up to 500 years.

Move away from physical formats that are becoming obsolete. For example, many people who used to back up their data on Zip drives, Syquest cartridges, and 1.44MB floppy drives no longer have access to these. Even interfaces can be an issue: external devices often used serial or parallel ports that no longer ship standard on computers (though desktop PC and ExpressCard laptop adapters can still be found). Make sure you’ve migrated your data before you dispose of an old device or format.

A common related issue: data trapped on a working hard disk in a dead PC or laptop. The Guardian serves up some useful guidance on installing the drive in an external USB enclosure and restoring from there.

Migrate data from obsolete programs, or at least make sure you have the tools to do so when necessary. Millions of people still have content trapped in ancient word processing. Tools for viewing such data or move it into “living” software include Quick View Plus and FastLook; for some formats, the free LibreOffice productivity suite or XNView image viewer might be all you need.

TechRepublic offers some useful high-level advice on planning a long-term strategy for protecting your data here. 

All this is great as far as it goes, but as the amount of data we’re generating continues to soar, we’re likely to need some radically new. Here are some technologies that may potentially improve data storage in near future:

Analog micro-etching: The Long Now Foundation  – which specializes in trying to envision the long-term future and solve the problems it might present – ran a full conference on super-long-term data storage. The solution it found promising enough to test: analog micro-etching onto nickel disks. Eight years later, they had a prototype: a disk containing information in about 1,500 human languages, plus translations of the Book of Genesis in each. Since the information is analog, it’s readable directly by humans (though they will need a microscope).

The Arctic World Archive: Officially opened on March 27 in Norway’s Svalbard Arctic region, the for-profit Arctic World Archive is already housing key documents from Brazil, Mexico, and Norway — safe, theoretically, from natural disaster and warfare. According to a report in The Verge, data is actually imprinted on special film, in huge high-density greyscale QR codes – and the archive is completely disconnected from the Internet to protect against hackers and ransomware.

DNA:  According to Science Magazine, researchers have been making breathtaking progress since the first attempts to store data in DNA molecules back in 2012. DNA is ultracompact, and it can last hundreds of thousands of years if kept in a cool, dry place. And as long as human societies are reading and writing DNA, they will be able to decode it – not something you can say with confidence about videocassettes or QR codes.

 

Source: Naked Security

 

End of the VHS-era: How Home Video Shaped The Media Industry.

Rewind your memories and just take a moment to realize that the entire era has just ended this summer; the last-known company that was still producing video cassette recorders (also known as VCRs) has officially announced that it has finalized production of the last unit.

That’s right, on July 21 The New York Times pointed to a short announcement published earlier in the Japanese newspaper Nikkei which was essentially a press release by the Funai Corporation, stating that the company took a decision to cease the production of VCRs due to the “difficulty of acquiring parts”.

Funai Corporation said that there is a "difficulty in acquiring parts" for VCRs
Funai Corporation said that there is a “difficulty in acquiring parts” for VCRs

 

The New York Times also referenced a statement in which the company said, “We are the last manufacturer (of VCRs) in all of the world.” Further to this, it was stated that only 750,000 VCRs were sold in 2015 worldwide, significantly down from the millions sod every year decades earlier.

It is hard to imagine anyone from generations growing up with streaming technology which brings all the latest movies and television shows straight to TV’s, tablets and smartphones screens, to get a feeling of nostalgia from this news. However, virtually everyone from those in their late-20s and older will almost certainly remember the sight of VHS tapes scattered around the floor adjacent to their televisions, and boxes full of old VHS tapes dumped somewhere in the closet or the basement of their homes. These tapes were extremely popular in 80s and 90s, when VHS was one of the most popular kinds of home entertainment.

Piles of old VHS tapes - nostalgia of 90s and 80s
Piles of old VHS tapes – nostalgia of 90s and 80s

 

People used to record their favorite TV shows and popular movies from premium cable channels so that they could view them again later, which was sometimes a complicated procedure requiring the setting of a timer on the VCR in order to program unit to record at a certain time period. For the first time, people started having the magic feeling of freedom from the TV schedule: you didn’t have to be at home at a certain time to watch something anymore.

Programming the timer on a VCR to get the right TV shows recorded was sometimes tricky
Programming the timer on a VCR to get the right TV shows recorded was sometimes tricky

 

In some parts of the world, like mid-80s USSR, very often smuggled VHS tapes carried the valuable information about “Western culture” and “the capitalist way of life” to the younger generations who were planning to rise in rebellion against the isolation imposed by the old Soviet Union.

Many of us have important memories stored in a form of home video footages on VHS tapes: a wedding video, the birth of a child, vacations, proms and other important events. These footages are really important for us – they are like time capsules that conserve the best moments that can be always pulled out and re-lived at any moment.

Important memories stored on VHS and other tapes.
Important memories stored on VHS and other tapes.

 

VHS tapes have now been officially consigned to history – making it a good idea to transfer all the footage stored on them to some more reliable media storage, such as DVDs. Magnetic tape is more sensitive to environmental factors, and therefore the tape (and footage!) may deteriorate and result in data loss. DVDs are more long lasting, so you might consider to use them to make a backup of your precious memories.

 

FalconMedia Value Line - a product that is suitable for your important memories storage.
FalconMedia Value Line – a product that is suitable for your important memories storage.

 

Falcon Technologies International LLC has developed a product line specially designed for consumer market. Value Line is designed to meet the needs of cost-conscious consumer and represents a perfect balance between quality and price. The good product is complimented by entry-level price range and no failure guarantee, making Value Line a highly competitive product on the market.