Latest post Tue, Jun 24 2008 2:57 PM by macjaeger. 25 replies.
Page 1 of 2 (26 items) 1 2 Next >
Sort Posts: Previous Next
  • Tue, Oct 2 2007 6:03 PM

    LARGE PROJECT - media management question

    I have a project which has about 200GB of media - when there is a corrupt file (and the msm's need to be recreated), it takes about 40 minutes to scan - Is there a way i can reduce this? Perhaps, can I create folders within the room's directory - so for example, the room's folder is Avid2 and thus the folder is Avid2 - Can I create more folders - Avid 2.1, Avid 2.2, etc?

    i am running Windows XP with Avid version 7.2
  • Tue, Oct 2 2007 6:28 PM In reply to

    • raspago
    • Top 50 Contributor
    • Joined on Thu, Oct 13 2005
    • FL, USA
    • Posts 906
    • Points 11,180
    • Moderator: Spanish Language

    Re: LARGE PROJECT - media management question

    .- I used to have the very same problem like 3 times a week.

    1.- You shouldn't have more than 10.000 files by OMFI folder. That means trouble. If you can, delete some.

    2.- You can't have more than one OMFI folder per disk/partition. I mean, you can't, even if you want to.

    3.- My solution? I partitioned my large Raid (1.5 TB) in several smaller partitions (no larger than 200 Gigs)

    4.- If you cant make new partitions, try to delete the precomputes and then rebuild the omfi database, this is temporary but would work.

    5.- Delete ALL msm, I mean ALL OF THEM, even in different disks.

    6.- Make the small partitions ASAP!!

    Custom made Intel core 2 duo 2.4 (overclocked to 3.0) Nvidia 8800GS, 3GB Ecc Ram, E-MU 1212M Sound card, Sata Drives, Analog Mojo. [view my complete system specs]

    "Art can't exist without Craft"

  • Tue, Oct 2 2007 6:43 PM In reply to

    Re: LARGE PROJECT - media management question

    Does the same apply for MXF?
  • Tue, Oct 2 2007 8:15 PM In reply to

    • sep
    • Top 10 Contributor
    • Joined on Thu, Oct 13 2005
    • France
    • Posts 5,593
    • Points 62,530

    Re: LARGE PROJECT - media management question

    No, MXF will create a new subfolder when there is un overflow.

    These subfolders are called "1", "2"...

    Adrenaline MCA 2.8 XW8400 3Gb RAM DNxcel Board, 760 Gb striped SCSI media storage, 1.2 TB 4 X striped SAS 15 000rpm storage.----MC Soft 2.8 + Mojo HP XW8000... [view my complete system specs]

    sep

     

    "out of difficulty comes performance"

    ______________________________

     

     Web site : www.audiacom.com

  • Tue, Oct 2 2007 8:17 PM In reply to

    • sep
    • Top 10 Contributor
    • Joined on Thu, Oct 13 2005
    • France
    • Posts 5,593
    • Points 62,530

    Re: LARGE PROJECT - media management question

    raspago:

    2.- You can't have more than one OMFI folder per disk/partition. I mean, you can't, even if you want to.

    http://www.avid.com/exchange/forums/post/278003.aspx

    Adrenaline MCA 2.8 XW8400 3Gb RAM DNxcel Board, 760 Gb striped SCSI media storage, 1.2 TB 4 X striped SAS 15 000rpm storage.----MC Soft 2.8 + Mojo HP XW8000... [view my complete system specs]

    sep

     

    "out of difficulty comes performance"

    ______________________________

     

     Web site : www.audiacom.com

  • Wed, Oct 3 2007 2:23 AM In reply to

    • raspago
    • Top 50 Contributor
    • Joined on Thu, Oct 13 2005
    • FL, USA
    • Posts 906
    • Points 11,180
    • Moderator: Spanish Language

    Re: LARGE PROJECT - media management question

    sep:
    raspago:

    2.- You can't have more than one OMFI folder per disk/partition. I mean, you can't, even if you want to.

    http://www.avid.com/exchange/forums/post/278003.aspx



    .- Good info to know in case of emergency, really!!!

     but I prefer prevention (partitions):

    http://www.avid.com/onlineSupport/supportcontent.asp?contentID=8082

    "- By creating more, yet smaller Drive Partitions, the Avid can more efficiently and reliably maintain its Media Database files, giving overall stability and speed back to the system."

    Custom made Intel core 2 duo 2.4 (overclocked to 3.0) Nvidia 8800GS, 3GB Ecc Ram, E-MU 1212M Sound card, Sata Drives, Analog Mojo. [view my complete system specs]

    "Art can't exist without Craft"

  • Wed, Oct 3 2007 3:02 AM In reply to

    Re: LARGE PROJECT - media management question

    raspago:
    "- By creating more, yet smaller Drive Partitions, the Avid can more efficiently and reliably maintain its Media Database files, giving overall stability and speed back to the system."
    Avid does not know the difference between a real partition and a "virtual drive"  partition so there is no benefit either way based on that parameter.
    If you embrace the concept of one Avid media folder for each project and create that folder before you start a each project you would be amazed at the long term advantages this method can offer.  For local storage Avid systems project based media management and archiving suddenly becomes a breeze. 
  • Wed, Oct 3 2007 3:46 AM In reply to

    Re: LARGE PROJECT - media management question

    If you're on a Unity or ISIS shared storage system, then it will automatically create and track your subfolders for you.  So, it would create your Avid2.1, 2.2, folders etc. 

    PS, there is no Avid version 7.2 that will run on WinXP, unless you're talking about Liquid.... then again, if you're talking about Liquid, you're a) in the wrong forum and b) not using OMF or MXF media with msm database files.  I can only guess/assume that you've simply transposed the version numbers and meant to say 2.7, which is a valid MC version that runs on WindowsXP
    MacPro dual 2.66GHz 2GB RAM NVIDIA GeForce 7300 GT Storage: 2TB G-Speed eS with controller card 3x500GB Hitachi SATA-II internals various external... [view my complete system specs]

    -------------------------- Kenton VanNatten Avid Editor "I'm not obsessed... I'm detail-oriented" --------------------------

  • Wed, Oct 3 2007 8:28 AM In reply to

    • raspago
    • Top 50 Contributor
    • Joined on Thu, Oct 13 2005
    • FL, USA
    • Posts 906
    • Points 11,180
    • Moderator: Spanish Language

    Re: LARGE PROJECT - media management question

    AndrewAction:
    raspago:
    "- By creating more, yet smaller Drive Partitions, the Avid can more efficiently and reliably maintain its Media Database files, giving overall stability and speed back to the system."
    Avid does not know the difference between a real partition and a "virtual drive"  partition so there is no benefit either way based on that parameter.
    If you embrace the concept of one Avid media folder for each project and create that folder before you start a each project you would be amazed at the long term advantages this method can offer.  For local storage Avid systems project based media management and archiving suddenly becomes a breeze. 

    .-  BTW. They are not my words, they're Avid's

    Custom made Intel core 2 duo 2.4 (overclocked to 3.0) Nvidia 8800GS, 3GB Ecc Ram, E-MU 1212M Sound card, Sata Drives, Analog Mojo. [view my complete system specs]

    "Art can't exist without Craft"

  • Wed, Oct 3 2007 9:34 AM In reply to

    • sep
    • Top 10 Contributor
    • Joined on Thu, Oct 13 2005
    • France
    • Posts 5,593
    • Points 62,530

    Re: LARGE PROJECT - media management question

    raspago:


     but I prefer prevention (partitions):

    http://www.avid.com/onlineSupport/supportcontent.asp?contentID=8082

    Is this still true today, it seems these recommendations are (were) for Meridien systems, I 've heard that in terms of partition this was no longer true, however file amount limit in OMFI folder is still 10 000 !

    Adrenaline MCA 2.8 XW8400 3Gb RAM DNxcel Board, 760 Gb striped SCSI media storage, 1.2 TB 4 X striped SAS 15 000rpm storage.----MC Soft 2.8 + Mojo HP XW8000... [view my complete system specs]

    sep

     

    "out of difficulty comes performance"

    ______________________________

     

     Web site : www.audiacom.com

  • Wed, Oct 3 2007 5:17 PM In reply to

    Re: LARGE PROJECT - media management question

    raspago:
    BTW. They are not my words, they're Avid's
    Sure. But then Avid have never officially recognised that virtual drives work.
    I have used virtual drives for six years now with Avids. No problems at all. Therefore I have no problem recommending them as a solution. Ideal for solving an oversized OMFI MediaFiles folder problems without having to partition a drive.
    For me they are ideal for project based media management and archiving.
    On a 2 TB raid here I have no partitions but 30 project media folders any of which can be turned into a working virtual drive in less than a minute. Avid sees up to 20 "partitions" at any time on this raid and all of them are under 100GB's so "By creating more, yet smaller Drive Partitions, the Avid can more efficiently and reliably maintain its Media Database files" my Avids are very happy virtual campers.
  • Wed, Oct 3 2007 5:37 PM In reply to

    • Hofler
    • Not Ranked
    • Joined on Thu, Oct 13 2005
    • New Orleans
    • Posts 46
    • Points 635

    Re: LARGE PROJECT - media management question

    Action,

    let me see if I am understanding you. I too am runing a raid media server and have gotten in the habit of making larger partitions to work from. You feel that it is better to limit partitions to 100 gig? The issue I had run into was that I would run out of drive letter designations so I began making larger partitions to reduce the number of partitions that needed to be mounted at any one time. As my projects get closer to being finished I offten begin to get various errors and bin read errors, do you feel this is due to excessive OMFI folder size and ergo database filesize?

    Thanks

    Adrenaline Mc Express Pro HD Mojo Meridien Xpress Elite all working form Facilis Terrablock media server via Fiber Channel [view my complete system specs]
    Well Bob...I wouldn't say I've been "missing" work.
  • Wed, Oct 3 2007 5:54 PM In reply to

    Re: LARGE PROJECT - media management question

    I am not recommending any sizes it was just an example of what is heppening here at present.
    The advantage I see for your situation would be that you could have a few partitions on your raid for overall managability. Then by using folders as virtual drives you can manage how many drive letter designations you use at any time by only activating the virtual drive function for folders needed for the project you are working on.  These virtual drives are completely dynamic in their size as they are actuallly only folders
    Real partitions take up your drive letters regardless of wether you have media on them or not. Virtual drives are fluid for drive letters as you only activate them on a need to use basis.

    "I offten begin to get various errors and bin read errors, do you feel this is due to excessive OMFI folder size and ergo database filesize?" could very well be. Touch wood.  I have not had a database error on any Avid here for several years now.

  • Fri, Jun 20 2008 2:40 PM In reply to

    • catwoman
    • Top 500 Contributor
    • Joined on Thu, Oct 13 2005
    • London
    • Posts 122
    • Points 1,630

    Re: LARGE PROJECT - media management question

    Andrew, your solution with virtual drives sounds great. Could you tell us your workflow and what virtual-drive-software you are using (daemontool??)? I am trying to keep the system as clutter-free as possible, so I wonder if the virtual-drive running software in the background would compromise resources. Also, are you using MXF or OMFI? It seems the former is more recommandable for larger projects.

    Thanks.

    Hardware: Inted Dual Core 3 GHz Asus P5K Mobo 4GB DDR2-SDRAM (1066 MHz) NVIDIA Quadro FX 3500 SIIG firewire card Raptor 40GB SATA (system) Raptor... [view my complete system specs]
  • Fri, Jun 20 2008 2:45 PM In reply to

    • JVR
    • Top 50 Contributor
    • Joined on Thu, Jul 13 2006
    • Bulli , Australia
    • Posts 1,243
    • Points 13,880

    Re: LARGE PROJECT - media management question

    Isn't the 10000 file count a windows limitation?

     

    MC 3.0 QTime 7.4.5 win xp pro service pak 3 Core 2 Duo Quad core 2.4 4 gig ram 667mhz pci x nvidia 512mb geforce 7600 162.50 driver 1 x 7200rpm... [view my complete system specs]
Page 1 of 2 (26 items) 1 2 Next >