TurnKey Linux Virtual Appliance Library

tklbam-restore painfully slow, duplicity at 1% CPU usage on average

As stated in the title, my tklbam-restore is already a few hours in for a 6 Gigs backup, and I'm starting to think that this is a little too much.

I have absolutely no clue as to where to start to investigate what is happening.

I did the following thing :

  1. Install OpenVZ template in proxmox
  2. Connect to it as root
  3. Run tklbam-init with my API key
  4. Run tklbam-restore 7
  5. ... not profit ??
  6. Still waiting :)

I would appreciate any help from anyone.

Cheers.

Edit: Forgot to mention that the download from Amazon S3 went ok, I'm stuck at a message displaying "Last full backup the ..." where it just sits there.

Jeremy's picture

Have you run out of room?

As the restore downloads and unpacks to /tmp if you have a sizeable backup and/or a small container and there is insuffient room, the TKLBAM restore will hang. This is a known issue. The only real universal solution is for the devs to make TKLBAM check for this and to error with an explanation (which I'm sure they'll do when they get a chance).

Assuming this is the problem - One workaround is just to make your container bigger. Alternatively you could create an external bind mount to the /tmp dir of your container - ie use the HDD space of your host OS to store the container's /tmp folder (check OVZ docs for how to do this, I've done it before but don't remember the steps OTTOMH).

Liraz Siri's picture

Probably a network thing...

I'll bet it's probably just TKLBAM shuffling bits back and forth from S3. That can take time and duplicity doesn't use much bandwidth while it's doing that. To see the load on the network I like to use nload:

apt-get install nload
nload

I'll try nload, but I thought

I'll try nload, but I thought that when saying "Last Full backup", it meant that already was already downloaded.

About the disk space, I had like a 5 gigas backup that I tried to restore on a 100 Giga OpenVZ appliance.
 
Also, this was in a server bay with an outstanding internet connection.

I feel the same

I experienced the same today (read: this night). A 3.3 GB backup took around 6,5 hours to complete. In the mean time (after coffee, dinner, a beer and some cookies) I  figured out (on a second instance) how to rsync the old machine to a new instance (on other host hw) and had it almost done when the restore said: "Done".

To follow what is going on tail -f /var/log/tklbam-restore

I used top and iftop (or nload) to see that the process was still and that running comforted me, but the amount of feedback is very, very little and a very discomforting.

Post new comment

The content of this field is kept private and will not be shown publicly. If you have a Gravatar account, used to display your avatar.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <p> <span> <div> <h1> <h2> <h3> <h4> <h5> <h6> <img> <map> <area> <hr> <br> <br /> <ul> <ol> <li> <dl> <dt> <dd> <table> <tr> <td> <em> <b> <u> <i> <strong> <font> <del> <ins> <sub> <sup> <quote> <blockquote> <pre> <address> <code> <cite> <strike> <caption>

More information about formatting options

Leave this field empty. It's part of a security mechanism.
(Dear spammers: moderators are notified of all new posts. Spam is deleted immediately)