TurnKey Linux Virtual Appliance Library

File Compression for Linux

Has anyone found a good solution for file compression for Linux at the filesystem level?  In other words similar to the drive/folder compression of NTFS.

I have one TKL-FileServer which contains mostly text files (or other files which compress very well) and they don't get changed very often.

It would be nice to be able to compress this to save some disk space.

Any ideas?

-Todd

Jeremy's picture

It is something I've never used but a good question

According to Wikipedia Btrfs seems to be the only native Linux FS that supports such a feature. I can't 100% confirm but my brief research online suggests that Btrfs support in Ubuntu 10.04 (the basis of TKL v11.x) is only experimental and you are not able to use it as the default root filesystem so without other modification, you would need to maintain ext4(/3/2) for / (root) but could have a Btrfs formatted partition mounted for storage of your shared files.

Googling about to assist you with your question, I came across FuseCompress which seems to acheive the same ends but coming from a different angle which seems to be FS agnostic and doesn't require kernel support.

I can't vouch for either of these solutions and TBH considering how cheap HDDs are, personally I'd probably just buy an additional (or bigger replacement) HDD rather than muck around with this sort of thing, but each to their own. :)

If you do end up trying out either of these (or some other solution you come across) I'd be interested to hear how it all goes for you.

Also, obviously I don't need to stress the importance of good and regular backups when doing this sort of testing, but I'd rather bore you with a reminder than let you forget to do it!

Found a couple more...

Found a couple more...

http://zfs-fuse.net/

http://e3compr.sourceforge.net/

"E3compr" did not impress me too much, mostly since it seems the project is no longer active.

I was reading a bit about ZFS.  It looks "FULL-Featured" and very nice, but when I got to the list of supported platforms, it stated some sort of licensing issue with the linux kernel.  

Then after searching a bit more I found "ZFS-Fuse".  I'm guessing that it is a port of the ZFS into FuseCompress project.  I'm gonna try it out on a "purely" test VM.

-Todd

I got it to install ok, but

I got it to install ok, but now I'm at a loss as how to configure it.  

I know this is sorta far of the TKL path, but if it works good, maybe an add-on for the FileServer appliance.

Jeremy's picture

No idea sorry

And yes from my reading ZFS is a killer FS and AFAIK ZFS was in the process of being ported to Linux. But when Oracle bought out Sun that apparently stopped dead in it's tracks and now looks like it's unlikely it will be resurected due to licencing (as you suggest).

Thanks.  I found FuseCompress

Thanks.  I found FuseCompress also after posting the msg.  Ya, I think I'll just add another HDD.  I may try out Btrfs just for fun.  If I do, I'll post back here.

Post new comment

The content of this field is kept private and will not be shown publicly. If you have a Gravatar account, used to display your avatar.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <p> <span> <div> <h1> <h2> <h3> <h4> <h5> <h6> <img> <map> <area> <hr> <br> <br /> <ul> <ol> <li> <dl> <dt> <dd> <table> <tr> <td> <em> <b> <u> <i> <strong> <font> <del> <ins> <sub> <sup> <quote> <blockquote> <pre> <address> <code> <cite> <strike> <caption>

More information about formatting options

Leave this field empty. It's part of a security mechanism.
(Dear spammers: moderators are notified of all new posts. Spam is deleted immediately)