Shirt Pocket Discussions  
    Home netTunes launchTunes SuperDuper! Buy Now Support Discussions About Shirt Pocket    

Go Back   Shirt Pocket Discussions > SuperDuper! > General

Reply
 
Thread Tools Rate Thread Display Modes
  #1  
Old 12-15-2006, 10:00 PM
mykmelez mykmelez is offline
Registered User
 
Join Date: Jul 2005
Posts: 34
questions about copying of very large (32GB) file

I run a Parallels VM with a virtual drive that lives as a single very large (currently 32GB) file on my hard drive. SD appears to stall for a long time in the middle of a Smart Backup (files evaluated, effective copy speed, etc. statistics stop changing), and I suspect that it's just copying that very large file.

I have a few questions about that:

If anything changes in a file, does SD copy over the entire file or just the changed bits? If so, has any thought been given to implementing the latter? If would significantly improve performance in my use case, since much of the stuff on my virtual drive doesn't change between backups.

Or, if that's not practical or feasible, might stats be made available during the copying of a large file (f.e. the name of the file and how much has been copied) to stop me from fretting about SD's state?

Finally, if I run SD while I'm using my virtual machine, what'll happen when SD reaches that file? Will it lock it for copying, freezing my VM; stall waiting for my VM to finish with it; or copy it concurrently, potentially leaving the backup in an inconsistent state?
Reply With Quote
  #2  
Old 12-15-2006, 10:23 PM
dnanian's Avatar
dnanian dnanian is offline
Administrator
 
Join Date: Apr 2001
Location: Weston, MA
Posts: 14,809
Send a message via AIM to dnanian
That's right, it's copying the whole file. It has to copy the entire file every time: there's no way -- without reading the entire file and looking -- to see if "part" of it has changed. That's just not how things work, and reading/comparing two huge files would take as long as just copying it.

At present, the APIs we're using to copy files do not give any status during a file copy, so we have no way of letting you know how much of a file is copied, sorry.

Don't run SD! while your VM is running. It'll likely end up filling the destination... bad idea.
__________________
--Dave Nanian
Reply With Quote
  #3  
Old 12-15-2006, 10:31 PM
mykmelez mykmelez is offline
Registered User
 
Join Date: Jul 2005
Posts: 34
Quote:
Originally Posted by dnanian View Post
At present, the APIs we're using to copy files do not give any status during a file copy, so we have no way of letting you know how much of a file is copied, sorry.
Ok, good to know. FWIW, in a "related thread", I found this technique you posted for figuring out what file is being copied:

Quote:
Originally Posted by dnanian View Post
run the following in Terminal:

Code:
sudo lsof | grep SDCopy
The last two files listed are what we're reading and writing.
Using this technique, I was able to confirm that SD! is indeed copying my large virtual drive file when it appears to stall.

Quote:
Originally Posted by dnanian View Post
Don't run SD! while your VM is running. It'll likely end up filling the destination... bad idea.
Oof, sounds bad. Ok, I'll avoid that.
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Strange 'Result too large' error when copying kbradnam General 4 07-17-2007 02:22 AM
Smartupdate File Size seems Large rwg4 General 1 09-15-2006 03:12 PM
SD Appears to freeze on large file copies xochi General 1 08-16-2006 01:08 PM
Which file is currently copying? minckster General 3 08-14-2006 12:04 PM
Problems with SD fdwlaw General 8 01-15-2006 10:58 AM


All times are GMT -4. The time now is 08:50 PM.


Powered by vBulletin® Version 3.8.9
Copyright ©2000 - 2022, vBulletin Solutions, Inc.