Results 1 to 8 of 8

Thread: Transparent Compression on File Systems

  1. #1
    Member
    Join Date
    Aug 2014
    Location
    Argentina
    Posts
    464
    Thanks
    202
    Thanked 81 Times in 61 Posts

    Transparent Compression on File Systems

    The primary purpose for this thread is to ask for help.

    But probably my question will be quickly answered by any of you. Even if not, I want to post here for further discussion some interesting projects.

    I'll start making an -still incomplete- list of file systems that support transparent compression. I'm open to your additions, so new users/viewers can have an all-in-one quick overview about the subject. Or if it is preferred, each one can have its own thread. Let me know please.

    By the way, the question is: How can I mount an external device (pendrive) which is formatted with HFS+ in order to activate its built-in compression on Linux? I have such a device working, but with no compression. All hfs* packages are installed. I've searched the best I can, without results... Thanks in advance.
    Last edited by Gonzalo; 12th January 2015 at 04:58.

  2. #2
    Member
    Join Date
    Aug 2014
    Location
    Argentina
    Posts
    464
    Thanks
    202
    Thanked 81 Times in 61 Posts
    The yet incomplete list, sorted by name:

    Btrfs (lzo, zlib) - LZ4, Snappy and LZMA proposed but not implemented yet.
    >Kernel.org
    >
    Wikipedia
    >
    Repository

    GBFS (gzip) - Stands for GeoBase file system. Intended for spatial data storage.
    > Release notes in version 3.9.7.5 (The last one as of January 2015)

    GBFS (Deduplication) - This one stands for GreenBytes File System. Based on ZFS.

    HFS+ (zlib)

    HAMMER2 (per-block deduplication, LZ4, ZLIB) - Not finished.

    NTFS (LZNT1)
    >Wikipedia
    >SourceForge

    Reiser4 (lzo, zlib)
    >Kernel.org
    >
    Wikipedia
    >
    SourceForge

    Squashfs (per-file deduplication, lz4, lzma, lzma2, lzo, zlib) - Read only. Used on live-cds.
    >Kernel.org
    >Wikipedia
    >SourceForge
    >
    LZMA patches

    ZFS (Deduplication, LZ4, LZJB, GZIP, ZLE)
    >Wikipedia
    >
    Open-source multi-platform fork







    *New entries will be added in THIS post, included your suggestions. So stay tuned.
    Last edited by Gonzalo; 19th March 2016 at 22:10. Reason: Update SquashFS.

  3. #3
    Member m^2's Avatar
    Join Date
    Sep 2008
    Location
    Ślůnsk, PL
    Posts
    1,612
    Thanks
    30
    Thanked 65 Times in 47 Posts
    ZFS has LZJB, not LZJ.
    HAMMER2 has lz4, zlib
    GBFS (formely ZFS+) has somethig too.
    Does dedupe count?
    Last edited by m^2; 12th January 2015 at 18:00.

  4. #4
    Member
    Join Date
    Aug 2014
    Location
    Argentina
    Posts
    464
    Thanks
    202
    Thanked 81 Times in 61 Posts
    Yes! I have to add dedupe to ZFS too. Thanks.

  5. #5
    Member
    Join Date
    Dec 2013
    Location
    Italy
    Posts
    342
    Thanks
    12
    Thanked 34 Times in 28 Posts
    the today most advanced fs, used for years in production, is zfs, but is not very well supported on linux for license problem
    i do not know stable and widely used file systems that use compression (not counting ntfs)

  6. #6
    Member m^2's Avatar
    Join Date
    Sep 2008
    Location
    Ślůnsk, PL
    Posts
    1,612
    Thanks
    30
    Thanked 65 Times in 47 Posts
    HAMMER1 has dedupe.
    Besides, https://en.wikipedia.org/wiki/Compar...f_file_systems lists FSes with compression and dedupe.

  7. #7
    Member
    Join Date
    Aug 2014
    Location
    Argentina
    Posts
    464
    Thanks
    202
    Thanked 81 Times in 61 Posts
    Updated first post with SquashFS 4 (added lz4, lzo and documentation)

  8. #8
    Member
    Join Date
    Nov 2015
    Location
    ?l?nsk, PL
    Posts
    81
    Thanks
    9
    Thanked 13 Times in 11 Posts
    Quote Originally Posted by Gonzalo View Post
    Updated first post with SquashFS 4 (added lz4, lzo and documentation)
    If you're listing FS with dedup, HAMMER (not HAMMER2) has it.

Similar Threads

  1. List of Asymmetric Numeral Systems implementations
    By Jarek in forum Data Compression
    Replies: 13
    Last Post: 1st March 2018, 00:06
  2. How to detect compression of file
    By achik961 in forum Data Compression
    Replies: 10
    Last Post: 19th January 2013, 05:01
  3. 7GB ISO file compression (from DVD)
    By anthalamus in forum Data Compression
    Replies: 3
    Last Post: 24th September 2011, 20:06
  4. Memory Limits for Windows Operating Systems
    By LovePimple in forum The Off-Topic Lounge
    Replies: 1
    Last Post: 12th July 2008, 23:40
  5. my file compression considerations
    By JB_ in forum Data Compression
    Replies: 2
    Last Post: 5th May 2008, 19:47

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •