Page 1 of 2 12 LastLast
Results 1 to 30 of 41

Thread: EcoZip

  1. #1
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts

    Arrow EcoZip

    The following is my attempt to close the gap between 7-Zip and FreeARC.
    I do not want to offend anyone.
    A freelancer did that project for me.
    Please be kind with me.

    EcoZip
    https://github.com/StephanBusch/EcoZip

    is a free, open-source archiver for Windows similar to 7-Zip with:

    * new GUI written from scratch
    * new progress bar design
    * 7ze archive format
    * easy plugin interface for new codecs
    * a configurable list where codecs can be defined for file extensions

    This project runs by raising funds for freelancers as I am not a programmer. It can contain bugs which cannot be fixed by me.

    How can I contribute?

    You can have a look at the Issue list You can build the project or download the binaries (see below), run it on your system and report bugs or make enhancement proposals.
    Credits

    Thanks for support, help and comments:

    * Igor Pavlov (author of original 7-Zip)
    * PhonPhanom Sivilay (my freelancer)
    * Manfred Slot (designer)
    * Bulat Ziganshin (thanks for the idea of grouping file extensions in a config file)
    * Ilya Grebnov (author of LIBBSC 3.1.0)
    * Mario Scholz (author of m7zRepacker)
    * Mathieu Chartier (author of MCM 0.83)
    * Matthias Stirner (author of packMP3)
    * Matthias Stirner (author of packPNM)
    * Moinak Ghosh (thanks for speeding up LZMA using prefetch instructions)
    * Siyuan Fu (author of CSC 3.2)
    * Francesco Nania
    * Ilya Muravyov

    License

    Copyright 2014-2016 Stephan Busch

    Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

    Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
    Legal stuff

    * 7-Zip library Copyright (c) 1999-2014 Igor Pavlov LGPL license (except unRar source)
    * CSC 3.2 Final File Compressor, Ver.2011.03.01 written by Siyuan Fu fusiyuan2010@gmail.com public domain
    * LIBBSC 3.1.0 Copyright (c) 2009-2012 Ilya Grebnov Ilya.Grebnov@gmail.com LGPL license
    * MCM 0.83 Copyright (c) 2015 Mathieu Chartier GPL license
    * packMP3 1.0e Copyright 2010-2014 Ratisbon University & Matthias Stirner LGPL license
    * packPNM 1.6c Copyright 2006-2014 HTW Aalen University & Matthias Stirner LGPL license

    Known Limitations

    * there is no commandline executable and no 32-bit executable
    * Compression settings are read from groups defined in the 7z.groups.ini file. To change compression of filetypes defined in that file, you need to edit this .ini file.
    * when using the 7z.groups.ini file, you will need approx. 4 GB of free memory
    * in the sources, packJPG is mentioned but the codec integrated here is packMP3
    * some plugin codecs (MCM, packPNM) are experimental and not used in 7z.groups.ini by default
    * may contain bugs
    Last edited by Stephan Busch; 3rd August 2016 at 09:21.

  2. The Following 12 Users Say Thank You to Stephan Busch For This Useful Post:

    anterus (9th January 2017),Bulat Ziganshin (18th May 2016),Cyan (18th May 2016),encode (18th May 2016),Gonzalo (19th May 2016),load (18th May 2016),nikkho (19th May 2016),RamiroCruzo (19th May 2016),Razor12911 (22nd May 2016),Simorq (14th January 2017),Sportman (18th May 2016),Turtle (20th May 2016)

  3. #2
    Member
    Join Date
    Aug 2008
    Location
    Planet Earth
    Posts
    772
    Thanks
    63
    Thanked 270 Times in 190 Posts
    Quote Originally Posted by Stephan Busch View Post
    7-Zip-Pro
    Nice! I miss type (like MB) of value behind "Memory usage for compressing" by some compression formats.

  4. #3
    Member
    Join Date
    May 2008
    Location
    Germany
    Posts
    410
    Thanks
    37
    Thanked 60 Times in 37 Posts
    congratulation - sounds very interesting

    Where i can found a windows-binary ? Are there benchmark-results available?

    What does "7ze archive format" means ?
    Will it be 7zip-compatible, if only standard-compression-methods as in "7z a -mx=5" or "7z a -mx=7" will be used ?

    I read "LIBBSC 3.1.0 Copyright (c) 2009-2012 Ilya Grebnov Ilya.Grebnov@gmail.com LGPL license"
    Does it mean it is possible to use the compressioning method ST order 5 and ST order 6 , which are implemented in the LIBBSC / "BSC 3.1.0" from Ilya Grebnov ?
    If yes , is it possible to use such compression methods via CUDA (this means using Nvidia GPU) ?
    It is possible to use the "LZHAM custom codec plugin for 7-zip" from Rich Geldreich ?

    Is there a 64bit-commandline-version for batch-processes planned?

    best regards

  5. #4
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,497
    Thanks
    733
    Thanked 659 Times in 354 Posts
    Where i can found a windows-binary ?
    as usual on github:
    https://github.com/StephanBusch/7-Zip-Pro/releases

    7-Zip-Pro
    do you asked Igor permission to use "7-zip" as part of program name? i will feel uncomfortable if someone will release "freearc pro" that is mostly just a fancy gui around my sources

  6. #5
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts
    Yes I have asked him

  7. #6
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    7ze is great and innovative archiver!

  8. The Following User Says Thank You to Nania Francesco For This Useful Post:

    Stephan Busch (19th May 2016)

  9. #7
    Member
    Join Date
    Apr 2009
    Location
    here
    Posts
    202
    Thanks
    165
    Thanked 109 Times in 65 Posts
    cool, thanks a lot.

    but how to use the plugins? call me a noob, but i'm sure i'm not the only one.

    it was easy to add LzhamCodec_x64.dll, and i can open such files. but how to create?

    how to use packjpg? i tried 7ze, but still could not figure out how it works.

  10. #8
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,497
    Thanks
    733
    Thanked 659 Times in 354 Posts
    load, "in the sources, packJPG is mentioned but the codec integrated here is packMP3"

    the 7ze format is a 7z format sources with a few modifications, mainly support for new builtin methods (bsc,csc) and sorting/grouping files a-la arc.groups. so text files are compressed with bsc, and fast compression modes probably employs csc.
    7z.groups.ini defines groups as well as compression algos for the "load config file" mode

  11. The Following User Says Thank You to Bulat Ziganshin For This Useful Post:

    load (19th May 2016)

  12. #9
    Member
    Join Date
    Apr 2009
    Location
    here
    Posts
    202
    Thanks
    165
    Thanked 109 Times in 65 Posts
    ah, so i have to ad (for example) something like

    ----$blahblah - use LZHAM
    *.this
    *.that
    ...
    ...
    ...


    still i don't get it why the dll is called packjpg.dll when it actually is packmp3.

  13. #10
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,497
    Thanks
    733
    Thanked 659 Times in 354 Posts
    Quote Originally Posted by load View Post
    still i don't get it why the dll is called packjpg.dll when it actually is packmp3.
    probably just a small mistake that will be fixed in the next version. it's open-source so you can do it yourself!

    btw, CSC/LIBBSC/MCM/PackJpg.dll can be used by 64-bit 7-zip too. just put them into Codecs subdir of 7-zip installation. example:

    7z a archive -m0=libbsc -m1=csc32 -m2=mcm -m3=packmp3

  14. #11
    Member
    Join Date
    Apr 2009
    Location
    here
    Posts
    202
    Thanks
    165
    Thanked 109 Times in 65 Posts
    what packjpg.dll do i need? the ones i compiled won't work... i get "wrong parameter"

  15. #12
    Member
    Join Date
    Aug 2014
    Location
    Argentina
    Posts
    464
    Thanks
    202
    Thanked 81 Times in 61 Posts
    Cool!!! I have to see it under WINE but seems really nice.
    Now, WIN32 build, please?? Visual Studio refuses to build the solution. Gives me dozens of errors about missing files.

    --------------------------

    Besides, a few notes:

    1) PackJPG is included, indeed, but not used:
    Code:
    ----$jpeg - use LIBBSC c=f e=2 b=7 H=28
    *.cbt
    *.epub
    *.jpg
    *.jpeg
    2) EPUB files are simply *.zip renamed. They are compressed using zlib and have no jpgs exposed in any way.

    3) You use CSC for audio filtering. That's cool, but why not a proper audio packer, like TTA or OptimFrog?

    4) REP filter is a win-win. The most times it speeds up compression while improves ratio.

    5) The use of PackPNM could be a little tricky here. It only accepts single files as its input AFAIK, but as I've seen, in the real world bitmaps are better compressed together in solid mode by a general purpose algo. I'm talking about faster and stronger compression (checked by myself a while ago in real case scenarios).

    6) Using Deflate64... Really?
    Code:
    ----$compressed3 - use Deflate64:x9
    7) Mode selection appears to be broken on 7ze format. Fastest mode took me the same time and produced a file of identical size than the strongest mode.

    --------------------------

    Anyway, I am very excited to see the field of practical archivers heading up! Continue with the great work!
    Last edited by Gonzalo; 19th May 2016 at 03:42.

  16. #13
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts
    Quote Originally Posted by joerg View Post
    congratulation - sounds very interesting

    Where i can found a windows-binary ? Are there benchmark-results available?

    What does "7ze archive format" means ?
    Will it be 7zip-compatible, if only standard-compression-methods as in "7z a -mx=5" or "7z a -mx=7" will be used ?

    I read "LIBBSC 3.1.0 Copyright (c) 2009-2012 Ilya Grebnov Ilya.Grebnov@gmail.com LGPL license"
    Does it mean it is possible to use the compressioning method ST order 5 and ST order 6 , which are implemented in the LIBBSC / "BSC 3.1.0" from Ilya Grebnov ?
    If yes , is it possible to use such compression methods via CUDA (this means using Nvidia GPU) ?
    It is possible to use the "LZHAM custom codec plugin for 7-zip" from Rich Geldreich ?
    7ze format is .7z format with some enhancements such as support for new algorithms.
    At present, this format can be unpacked with special 7-Zip versions (that's what Igor said)
    but there is no command line executable.
    Sort Transform in LIBBSC have been commented out so it cannot be used.
    It would be possible to add a plugin of LZHAM algorithm, but Rich has no time to do it.

  17. #14
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts
    Quote Originally Posted by Gonzalo View Post
    Cool!!! I have to see it under WINE but seems really nice.
    Now, WIN32 build, please?? Visual Studio refuses to build the solution. Gives me dozens of errors about missing files.
    There is currently no win32 build.

    --------------------------

    Quote Originally Posted by Gonzalo View Post
    Besides, a few notes:

    1) PackJPG is included, indeed, but not used:
    Code:
    ----$jpeg - use LIBBSC c=f e=2 b=7 H=28
    *.cbt
    *.epub
    *.jpg
    *.jpeg
    packJPG is not included. It is a small typo. The codec included is packMP3. This has to be fixed.

    Quote Originally Posted by Gonzalo View Post
    2) EPUB files are simply *.zip renamed. They are compressed using zlib and have no jpgs exposed in any way.
    All .EPUB I looked into have dozens of JPEG embedded.

    Quote Originally Posted by Gonzalo View Post
    3) You use CSC for audio filtering. That's cool, but why not a proper audio packer, like TTA or OptimFrog?
    CSC is pretty fast and handy so I decided to use it.
    Of course you can create and use any other audio algorithm.

    Quote Originally Posted by Gonzalo View Post
    4) REP filter is a win-win. The most times it speeds up compression while improves ratio.
    Yes it is. I have not asked Bulat yet if REP can be used and it might not be easy to implement.

    Quote Originally Posted by Gonzalo View Post
    5) The use of PackPNM could be a little tricky here. It only accepts single files as its input AFAIK, but as I've seen, in the real world bitmaps are better compressed together in solid mode by a general purpose algo. I'm talking about faster and stronger compression (checked by myself a while ago in real case scenarios).
    Integrating packPNM was just an experiment. It is not used in present 7z.groups.ini as it causes CRC mismatches and you are right -
    the solid mode and a general purpose algorith, often outperforms packPNM.

    Quote Originally Posted by Gonzalo View Post
    6) Using Deflate64... Really?
    Code:
    ----$compressed3 - use Deflate64:x9
    Yes
    On some files, Deflate is the algorithm of choice.

    Quote Originally Posted by Gonzalo View Post
    7) Mode selection appears to be broken on 7ze format. Fastest mode took me the same time and produced a file of identical size than the strongest mode.
    When using 7ze format, 7-Zip Pro just reads the 7z.groups.ini - at present, no other modes are usable.


    Quote Originally Posted by Gonzalo View Post
    Anyway, I am very excited to see the field of practical archivers heading up! Continue with the great work!
    Thank you very much. The 7-Zip Pro project is driven entirely by donations, freelancers and fans that post issues and commits.
    Lets see who else will join the project.

  18. #15
    Member nikkho's Avatar
    Join Date
    Jul 2011
    Location
    Spain
    Posts
    542
    Thanks
    214
    Thanked 163 Times in 104 Posts
    Looking promising. Thanks.

  19. The Following User Says Thank You to nikkho For This Useful Post:

    Stephan Busch (19th May 2016)

  20. #16
    Member
    Join Date
    Aug 2014
    Location
    Argentina
    Posts
    464
    Thanks
    202
    Thanked 81 Times in 61 Posts
    Quote Originally Posted by Stephan Busch View Post
    All .EPUB I looked into have dozens of JPEG embedded.
    Mmm... How's that? Maybe if you run precomp on it, yes, below first recursion depth are surely hundred of JPGs, of course, but unless you have some weird EPUB uncompressed, it can't be. Try running on them extrjpg utility, from Matthias Stirner. If you don't believe me, just open up any EPUB with your own 7-zip. You will see on the details it is recognized as a perfectly normal zip archive, like Android APKs, OpenOffice or Ms Office documents, compressed with deflate...
    Click image for larger version. 

Name:	nwt_E.epub.png 
Views:	229 
Size:	110.4 KB 
ID:	4392Click image for larger version. 

Name:	Properties.png 
Views:	196 
Size:	19.1 KB 
ID:	4393

  21. #17
    Member FatBit's Avatar
    Join Date
    Jan 2012
    Location
    Prague, CZ
    Posts
    189
    Thanks
    0
    Thanked 36 Times in 27 Posts
    Dear Mr. Busch,

    thank you for your step ahead in practical compression. But I have questions:

    1. Could you be so kind and tell us something more about your "7z.groups.ini file" approach/development? I do not a bit agree, that "read.me " file compression is the largest compression problem.
    2. Some files have same extension, but are of different kind. How to solve?
    3. Is "7z.groups.ini file" included in 7ze archive file? What happens when I obtained archive from different person (= person with different (de)archivers settings in 7z.groups.ini file)? Will be possible to decompress the archive?

    Best regards,

    FatBit

    PS: If you wish, I can collect a lot of extensions.

  22. #18
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts
    Dear FatBit,

    The 7z.groups.ini is a configuration file where you can create groups by using that string: ----$ followed by a unique name like yournewgroup
    After that you can define which codec you want to use for that new group by writing one of these in that line:

    Bzip2
    CSC32
    Deflate64
    LIBBSC
    LZMA
    LZMA2
    packMP3
    PPMd

    Each codec accepts further options which have to be separated by colon.
    If you want to use the 7z delta filter before, you can use it by typing Delta:xx + before your chosen codec.
    xx is your value for the delta filter.

    you can decode any .7ze with 7-Zip Pro - no matter which configuration was used on encoding systems 7z.groups.ini.
    At present, you can define every extension only once in the 7z.groups.ini.

    This can be solved later by advanced detection routines or parsers.

    I wish to have more codecs integrated later like ZSTD, LZHAM and packJPG but I need the help of this community to do so

  23. #19
    Member FatBit's Avatar
    Join Date
    Jan 2012
    Location
    Prague, CZ
    Posts
    189
    Thanks
    0
    Thanked 36 Times in 27 Posts
    Dear Mr. Busch,

    thank you for your answer. I fully understood (at least I hope). To be more precisely - imagine this situation (artificial example):

    7z.groups.ini on encoder's side

    ----$mp3 - use PACKMP3
    *.mp3

    7z.groups.ini on decoder's side

    ----$mp3 - use LZMA:d28:fb273:lc5:lp0b0
    *.mp3

    How 7-Zip Pro will recognize which decoder to use, or what to do if group will not exist on decoder site, when in archive is not present any information except archive content itself? True?

    You wrote "no matter which configuration was used on encoding systems". It looks like in archive is something like 7-Zip Pro lite embedded. True?

    Best regards,

    FatBit

  24. #20
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts
    For decoding 7-Zip Pro doesn't need the ini file

  25. #21
    Member
    Join Date
    Mar 2016
    Location
    Croatia
    Posts
    181
    Thanks
    74
    Thanked 10 Times in 10 Posts
    hi,

    where can i download 7-ZipPRO for win7-64bit?

    regards
    Dado

  26. #22
    Member
    Join Date
    Apr 2009
    Location
    here
    Posts
    202
    Thanks
    165
    Thanked 109 Times in 65 Posts

  27. The Following User Says Thank You to load For This Useful Post:

    dado023 (23rd May 2016)

  28. #23
    Member
    Join Date
    Mar 2016
    Location
    Croatia
    Posts
    181
    Thanks
    74
    Thanked 10 Times in 10 Posts
    tnx mate...that was fast

  29. #24
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts
    EcoZip 16.02 was released. Grab your copy here: https://github.com/StephanBusch/EcoZ...02-win-x64.zip

    changes:

    • bugfixes
    • move of menu button
    • updated sources of 7-Zip & packMP3
    • fixed spelling error of packmp3 sources

  30. The Following User Says Thank You to Stephan Busch For This Useful Post:

    load (4th August 2016)

  31. #25
    Member
    Join Date
    May 2008
    Location
    Germany
    Posts
    410
    Thanks
    37
    Thanked 60 Times in 37 Posts
    @Stephan "EcoZip 16.02 was released" ....

    - what is the main difference , when selecting *.7ze and not *.7z ?
    - i am reading about libbsc - is there a support for the wonderful compressing methods ST5 or ST6 ?
    - is there an option to use the program via the commandline ?

    --
    i have tested decompressing a file from a bigger archive and it decrompresses with a good speed within 15 min (total commander needs for this 18 min)
    --
    i have selected 1 file to compress to "7ze" and "maximum" - after 3 .. 4 hours the program tells an error "bad parameter?" ...
    i will try to reproduce the error - do you want to have a screenshot?
    --

    best regards

  32. #26
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts
    Dear Joerg,

    7ze uses different methods in one pass (by reading 7z.groups.ini) and it uses more methods than 7z does.
    This allows for better compression and more speed in most cases.
    LIBBSC used here does not use ST since Schindler transform is patented and I do not want to use that.

    The 'bad parameter' issue is already being worked on - thank you for reporting.

  33. #27
    Member
    Join Date
    Jun 2013
    Location
    Sweden
    Posts
    150
    Thanks
    9
    Thanked 25 Times in 23 Posts
    Quote Originally Posted by Stephan Busch View Post
    EcoZip 16.02 was released. Grab your copy here: https://github.com/StephanBusch/EcoZ...02-win-x64.zip
    Unpacked to ramdisk and found 2 exe, EcoZipFM (8mb) and EcoZipFMLite (6mb), what differs?
    Test of format 7ze:
    Tried to compress a text-file from this folder = bad parameter.
    Tried to compress both exe-files in this folder (one at a time) = bad parameter.
    Tried to compress a XLS (excel 97 format) of 3mb = crashed almost directly.

    This occurs on both exe. I have ~25GB of free ram, 32GB - ramdisk of 6GB. No swapfile.

    When choosing archive format in EcoZipFM all formats is shown twice.

  34. #28
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts
    The 'bad parameter' issue is already being worked on - thank you for reporting.

    This also applies to the double entries in the drop-down list

  35. #29
    Member
    Join Date
    Mar 2016
    Location
    Croatia
    Posts
    181
    Thanks
    74
    Thanked 10 Times in 10 Posts
    it would be great if program would be by default in English language, rather than system/location language.

  36. #30
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts
    you can change language in menu under options.
    EcoZip uses the same language files as 7-Zip 16.02. They have to be in a sub-folder called 'Lang'

Page 1 of 2 12 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •