Film-Tech Cinema Systems
Film-Tech Forum


Post New Topic  Post A Reply
my profile | my password | register | search | faq & rules | forum home
  next oldest topic   next newest topic
» Film-Tech Forum   » Operations   » Digital Cinema Forum   » Disk Cleanup

   
Author Topic: Disk Cleanup
Gronw Roberts
Film Handler

Posts: 54
From: Y Felinheli, Gwynedd, Wales
Registered: Oct 2015


 - posted 07-25-2017 09:42 AM      Profile for Gronw Roberts   Email Gronw Roberts   Send New Private Message       Edit/Delete Post 
I'm finding that my Doremi server is saying it's fuller than it should (i've had more films in it in the past without it filling the drive up so much) so I think it's time for a disk cleanup. I'm not very familiar with the process so I wanted to check with you before I do anything silly!

I got to the point last night where I anylized the disks but I need an explination of the options given - Orphan assets, Incoming assets and Incompete composition playlist.

I don't want to click everything and do the cleanup only find that a file I need is missing!

Thanks in advance.

 |  IP: Logged

Carsten Kurz
Film God

Posts: 3681
From: Cologne, NRW, Germany
Registered: Aug 2009


 - posted 07-25-2017 10:33 AM      Profile for Carsten Kurz   Email Carsten Kurz   Send New Private Message       Edit/Delete Post 
In your situation with a single, standalone server, you can just choose all three options. All playable content will remain on the RAID.
Make sure no playout, ingest, etc. are running when you do this.

Are there any size/numbers given behind each option after you analyzed?

- Carsten

 |  IP: Logged

Leo Enticknap
Film God

Posts: 6900
From: Loma Linda, CA
Registered: Jul 2000


 - posted 07-25-2017 11:30 AM      Profile for Leo Enticknap   Author's Homepage   Email Leo Enticknap   Send New Private Message       Edit/Delete Post 
The way I used to do this was to keep all the DCPs that were to stay on the server permanently (frequently played ads and trailers, snipes, technical test DCPs, transitions, etc.) on an external drive, export all the automation cues and configuration settings (if possible and applicable) and then periodically, just nuke the whole server by doing a factory reset/clean install of the software, then reconfigure/restore/reingest. That gets rid of everything unneeded, defrags the drives and gets rid of any RAID errors (e.g. reallocated sectors) that aren't physical ones.

 |  IP: Logged

Gronw Roberts
Film Handler

Posts: 54
From: Y Felinheli, Gwynedd, Wales
Registered: Oct 2015


 - posted 07-25-2017 11:47 AM      Profile for Gronw Roberts   Email Gronw Roberts   Send New Private Message       Edit/Delete Post 
Hi Carsten.

Orphan - 406086277KB (free's up 387.3GB)
Incoming - 18467489KB (free's up 178.8GB)
Incomplete - It was a similar number to the Incomplete asset, I actually ran that last night because I knew that wasn't going to affect playable files because I had to use it before to solve an ingest problem.

Can you explain to me what they are? I'm trying to learn as I go!

Thanks Leo, I'll keep that in mind.

 |  IP: Logged

Marco Giustini
Film God

Posts: 2536
From: Reading, UK
Registered: Nov 2007


 - posted 07-25-2017 12:49 PM      Profile for Marco Giustini   Email Marco Giustini   Send New Private Message       Edit/Delete Post 
imagine you ingest some content and the transfer fails at 90%. The server won't delete the content which is already on the server - and fully validated - so if you try ingesting it again with a good drive, it will resume from where it left.

Over time those "orphan" files (not linked to any CPL's) will fill up your hard drive!

 |  IP: Logged

Frank Cox
Phenomenal Film Handler

Posts: 1943
From: Melville Saskatchewan Canada
Registered: Apr 2011


 - posted 07-25-2017 01:34 PM      Profile for Frank Cox   Author's Homepage   Email Frank Cox   Send New Private Message       Edit/Delete Post 
I don't get it.

If I have files 1,2,3 and 4 to ingest and the transfer fails on file 3, then I have files 1 and 2 and part of 3 on my server.

Then I do it again and it starts with 3(?) and 4, so now I have the whole thing ingested.

So where does the orphan file come from? I don't think it would be very common to have an ingest fail and just say "Oh well, I'll just ingest something else instead", and not take steps to complete the failed ingest? You were probably ingesting it for reason, after all.

 |  IP: Logged

Carsten Kurz
Film God

Posts: 3681
From: Cologne, NRW, Germany
Registered: Aug 2009


 - posted 07-25-2017 01:57 PM      Profile for Carsten Kurz   Email Carsten Kurz   Send New Private Message       Edit/Delete Post 
The server may leave the partial part/reel on the server, and reingest it again.

It may not sound smart, but only the Doremi programmers would be able to explain this sort of behavior.

Skipping an ingest after it failed is not too unusual. Not everything I ingest is targeted at immediate screening. Sometimes mid-ingest you notice you picked the wrong VF or OV and cancel.

What's important for Gronw is that the Doremi doesn't clean up files light-heartedly, these files are in temporary directories, or are not part of the Doremis DCP/asset database. I have never heard of issues after doing a full cleanup. Of course you should never do it WHILE an ingest is running (e.g. to free up some space in the last possible moment). That will probably delete files that have been/are currently being ingested, thus the current ingest will not be complete and will leave more orphan files.

Grown - the amount of data you quote is considerable. Go ahead. But still, it is a good measure to make sure you have the distribution discs for immediate upcoming shows still on site before you do any content clean ups.

With the Doremi file manager, one could probably have a look into these directories and find out what it is or at least when it has been copied.

Then again, sometimes a server crashes or is shut down during an operation. In a larger TMS environment, more scenarios are possible, e.g. files first being copied to the server through network transfers, for being processed later.

- Carsten

 |  IP: Logged

Gronw Roberts
Film Handler

Posts: 54
From: Y Felinheli, Gwynedd, Wales
Registered: Oct 2015


 - posted 08-05-2017 06:22 AM      Profile for Gronw Roberts   Email Gronw Roberts   Send New Private Message       Edit/Delete Post 
Thanks all, I meant to post earlier but got side tracked! I went ahead and cleaned up the drives. Great stuff, there's plenty of room now, it's making life much easier.

 |  IP: Logged



All times are Central (GMT -6:00)  
Post New Topic  Post A Reply Close Topic    Move Topic    Delete Topic    next oldest topic   next newest topic
 - Printer-friendly view of this topic
Hop To:



Powered by Infopop Corporation
UBB.classicTM 6.3.1.2

The Film-Tech Forums are designed for various members related to the cinema industry to express their opinions, viewpoints and testimonials on various products, services and events based upon speculation, personal knowledge and factual information through use, therefore all views represented here allow no liability upon the publishers of this web site and the owners of said views assume no liability for any ill will resulting from these postings. The posts made here are for educational as well as entertainment purposes and as such anyone viewing this portion of the website must accept these views as statements of the author of that opinion and agrees to release the authors from any and all liability.

© 1999-2018 Film-Tech Cinema Systems, LLC. All rights reserved.