my profile | my password | search | faq & rules | forum home

» Film-Tech Forum ARCHIVE   » Operations   » Digital Cinema Forum   » Ingest issues

Author Topic: Ingest issues Ohad Ephrath Film Handler Posts: 1 From: Ramat Gan, Ramat Gan, Israel Registered: May 2018 posted 05-14-2019 05:43 AM                     Hello all. I work in the film festival industry and do a lot of DCP ingestion and testing. I have recently bought a CRU DX115 and have decided to put a Crucial MX500 2TB in it for faster ingestion. (My first CRU is with the WD Black 2TB) I have formatted the drive to be EXT3, 128 inode. I work on a mac system and use Paragon EXTfs to transfer DCPs to the CRU. I have noticed that some DCPs do ingest but some give a file hash error. Is there an issue with SSDs being used for ingestion? Do all SSDs work well with EXT3? Should I format it to NTFS?  |  IP: Logged Ed Gordon Film Handler Posts: 31 From: Mountlake Terrace, WA, USA Registered: May 2019 posted 05-14-2019 05:36 PM                     There is a mention of similar issues at: https://groups.google.com/forum/#!topic/opendcp/fEqNav8BJGM You might also search "wear leveling and file hash errors" in regard to SSD usage. The use and validation of images of SSD's (not necessarily individual files) is a concern for digital forensic professionals. Example article at: https://www.forensicmag.com/article/2014/06/solid-state-drives-part-6 Ed  |  IP: Logged Marcel Birgelen Film God Posts: 3357 From: Maastricht, Limburg, Netherlands Registered: Feb 2012 posted 05-14-2019 07:01 PM                     The problems with complex NAND-based disks (also known as SSDs) and forensics are a bit out of scope here. Nobody is trying to recover data that, according to the filesystem doesn't exist anymore. A forensic copy of an SSD is still something problematic, compared to magnetic discs. In this particular case, there seems to be data-corruption happening somewhere, which is most likely an indicator for a driver problem or a defective SSD. You can simply check if files are different by creating a hash of the original and the one on the SSDs, e.g. a simple MD5 hash would be a good indicator (yes, MD5 isn't usable anymore for real security related stuff, but for comparing two files without any possible malicious intent it's still fast, ubiquitous and reliable).  |  IP: Logged Carsten Kurz Film God Posts: 4340 From: Cologne, NRW, Germany Registered: Aug 2009 posted 05-15-2019 09:00 AM                     From my experience, Paragon ExtFS is not very reliably. If you do a lot of copying, you should try to use a native Linux (you should be able to boot your Mac into e.g. GPARTED or another Linux on a stick.) Also, try to perform a hash check immediately after the copy, or while copying. How is that SSD connected to the Mac? Note, SSDs usually do not perform faster during ingests than hard discs. They may be a bit fast during copying from your Mac, but the ingest on the DCI server is usually slowed down by housekeeping tasks. - Carsten  |  IP: Logged

All times are Central (GMT -6:00)

Printer-friendly view of this topic

Hop To: Select a Forum: Category: Operations -------------------- Digital Cinema Forum Film Handlers' Forum Large Format Forum Ground Level Feature Info, Trailer Attachments & REAL Credit Offsets Category: Community -------------------- Film-Yak Film Handlers' Movie Reviews The Afterlife Bob Maar's Joke-A-Thon Category: Classified -------------------- Equipment and Supplies Wanted/For Sale Help Wanted/Seeking Employment Category: System -------------------- Software Beta Testing Forum

The Film-Tech Forums are designed for various members related to the cinema industry to express their opinions, viewpoints and testimonials on various products, services and events based upon speculation, personal knowledge and factual information through use, therefore all views represented here allow no liability upon the publishers of this web site and the owners of said views assume no liability for any ill will resulting from these postings. The posts made here are for educational as well as entertainment purposes and as such anyone viewing this portion of the website must accept these views as statements of the author of that opinion and agrees to release the authors from any and all liability.