Data-Compression.org

data compression link collection

Compressed Virtual Memory

Rodrigo Castro has an interesting project going at the University of Sao Paulo in Brasil. Rodrigo is integrating compression with the virtual memory system of Linux. By storing compressed pages in RAM, he hopes to improve overall system performance. The goal is to read and write fewer pages to disk. See the full details on
his project page
at SourceForge.

http://linuxcompressed.sourceforge.net/

         

Posted in October 3rd, 2001

Aladdin Expander

Aladdin Systems, makers of the popular Stuffit program, have a free program called Expander that can be used to extract files from many popular archive formats, including Zip, Sit, and more.

http://www.stuffit.com/expander/index.html

         

Posted in September 30th, 2001

IEEE Information Theory Society Web Portal

The home page for the society. Links to newsletters, conferences, tutorials, abstracts, and other miscellaneous fun things.

http://www.itsoc.org/

* * *    

Posted in September 27th, 2001

Carryless Rangecoder

Mikael Lundqvist has adapted Dmitry Subbotin’s C++ rangecoder to C. Michael says it is simple and fast.
One DataCompression.info commented that some more documentation would be helpful.

http://w1.515.telia.com/~u51507446/range.tgz

* * *    

Posted in September 27th, 2001

Shorten Utilities (shnutils)

shnutils is a collection of 3 Perl scripts developed to assist in the process of using shorten to trade digital music. These scripts, which run on both Linux and Windows, facilitate compressing WAV files using shorten, and also in creating and verifying MD5 hashes.

http://freshmeat.net/projects/shnutils/

         

Posted in September 27th, 2001

Advanced Encryption Package 2001

This archiving package works with zip files, creates encrypted archives, wipes files, etc.

http://www.secureaction.com/encryption/

         

Posted in September 27th, 2001

Huffman-Ricardo Coding

Daniel Ricardo has a new algorithm for generation of Huffman codes. He claims superior performance and small memory footprint. Algorithm description here, but no code.

http://www.rootshell.be/~dan/hrc.html

         

Posted in September 22nd, 2001

LZO Streaming Code

Published in Source Code, LZO

Tom St Denis posted an article on comp.compression announcing free source code for streaming to and from files using the LZO engine. This link takes you to stream.c, modify it slightly to get stream.h, the corresponding header file.

http://tom.iahu.ca:8080/src/stream.c.html

* * * * *

Posted in September 22nd, 2001

Pandora - Markup metadata inside JPEG 2000 files

Pandora is a web-oriented application of JPEG 2000. It uses web pages as a novel example of XML metadata. A multi-image, multi-page website can be stored within a single JPEG 2000 file, and viewed using an ordinary web-browser.

http://www.migrator2000.org/pandora

* * * * *

Posted in September 22nd, 2001

PKWare Data Compression Library Format

In this comp.compression posting, Ben Rudia-Gould opens up the compression format used by the PKWare Data Compression Library. This is the only place I have ever seen this information disclosed; PKWare has certainly not done so.

http://groups.google.com/groups?q=author:Ben+author:Rudiak-Gould&hl=en&rnum=1&selm=34259d5
2.0108131038.21dd88f9%40posting.google.com

* * * * *

Posted in September 22nd, 2001

Hardware Support for MP3Pro

Published in Hardware, MP3/MPEG Audio

EE Times reports that both TI and SMT are making chips that support the new MP3Pro format, clearing the way for its inclusion in portable audio devices.

http://www.eet.com/story/OEG20010921S0021

         

Posted in September 21st, 2001

The Glicbawls page

Glicbawls is a lossless and/or near-lossless image compression algorithm that apparently does really well on gray-scale images but perhaps not as well on color. This link points to an archived page, as the original has disappeared from the net. As a result, links on the page may or may not work propery

http://web.archive.org/web/20020604145417/http://byron.csse.monash.edu.au/glicbawls/index.
html

         

Posted in September 19th, 2001

On variants of block-sorting compression using context from both the left and right

A technical note from Mike Burrows regarding a variation on block sorting.

http://citeseer.nj.nec.com/432943.html

         

Posted in September 14th, 2001

Differences Between Microsoft and Apple ADPCM Files

Apple has published a tech note describing the differences between these two file formats, which on the face of it ought to be identical.

http://developer.apple.com/technotes/tn/tn1081.html

         

Posted in September 14th, 2001

On2 Technologies VP3.2 Open Source Project

These folks are hard at work on an open source video codec. VP4 appears to be a commercial effort, VP3 seems to be free.

One DataCompression.info user had this to say: Impressive effort by both ON2 and Xiph. Something has to replace MPEG with its rapidly deteriorating technnology and efficiency. This one has the potential but now needs the acceptance.

http://www.vp3.com

* * * * *

Posted in September 14th, 2001

libcomprex - Comprex (de)compression library

From the site: The libcomprex library transparently handles automatic compression and decompression of files. The API is similar to C’s built-in file access functions, which provides a smooth transition to libcomprex. libcomprex can also open uncompressed files, making it a good replacement for the native file access functions.

http://www.gnupdate.org/components/libcomprex/index.xml

         

Posted in September 4th, 2001

Some Summary

This web page explains a proposed categorizaton of various data compression methods.

http://geocities.com/eri32/summary.html

         

Posted in September 3rd, 2001

Sorting the matrix of two-sided contexts

This article describes a variant on BWT that doesn’t use the cyclical rotations of strings used for BWT, but a different scheme. DCL reader points to a Burrows paper showing that this scheme is suboptimal.

http://geocities.com/eri32/slrm.htm

*        

Posted in September 3rd, 2001

ArjFolder

ArjFolder is a utility that makes it easy to read or write ARJ and ZIP files, and to read a slew of other file types. Sit can be viewed in French or English.

http://www.iceows.com/

         

Posted in September 3rd, 2001

PICTools JPEG2000

This is the PicTools JPEG2000 SDK, which lets you drop JPEG2000 compression and decompression into your C/C++ programs. Pegasus Imaging makes quite a few compression library products. In this particular case, it appears they enlisted the help of

Algo Vision plc
to develop this product.

http://jpeg2000.jpg.com/

* * * *  

Posted in September 3rd, 2001

Kexis

An open source lossless audio file compressor.

http://sourceforge.net/projects/kexis/

* * * * *

Posted in August 30th, 2001

Pngcrush

From the site: Pngcrush is an optimizer for PNG (Portable Network Graphics) files. It can be run from a commandline in an MSDOS window, or from a UNIX or LINUX commandline. .

http://pmt.sourceforge.net/pngcrush/

         

Posted in August 30th, 2001

Information on lossy audiocoding and the MPEGplus-project

Mpegplus is an open source lossy encoder that the author apparently has created in response to dissatisfaction with existing MP3 encoders. MP+ has plugins for WinAmp and other players.

http://www.personal.uni-jena.de/~pfk/mpp/audiocoder_english.html

         

Posted in August 30th, 2001

mp3 Decoder Tests

Published in Results, MP3/MPEG Audio

The author of this page clearly has a bone to pick with some of the MP3 decoders out there. From the site: This site contains test results on a number of mp3 decoders. Such a test wouldn’t be necessary if all decoders worked properly, but unfortunately they don’t. In fact the outputs of many popular decoders were found to be incorrect. .

http://web.archive.org/web/20020124200304/http://privatewww.essex.ac.uk/~djmrob/mp3decoder
s/intro.html

* * * *  

Posted in August 30th, 2001

Qdesign

The folks at Qdesign have a new audio encoding format they’d like you to use.

http://www.qdesign.com/

         

Posted in August 30th, 2001

Listening Test Using Male Opera Voice

Published in Results, Audio

A set of subjective tests of various encoders.

http://fastforward.iwarp.com/1400.html

         

Posted in August 30th, 2001

Analysis of Microsoft Audio Codec

Real takes a whack at their chief competitor, Microsoft. Looks like they put some time and effort into this.

http://www.real.com/msaudio/

         

Posted in August 30th, 2001

Fractal Compression

A giant bibliography with pointer to on-line papers, as well as some basic information on the state of the art. Not for the timid or the beginner.

ftp://axes.informatik.uni-leipzig.de/pub/Fractal/index.html

         

Posted in August 27th, 2001

The Official daxaif Home Page

From the site: daxaif is a no-loss audio compression program which performs live capture or converts audio files, movie sound tracks, or audio CD tracks into a compressed “.dax” file format. This format allows fast locating and selection of audio passages through the use of a clickable compression-factor map. The selections can be played or saved in uncompressed AIFF or further compressed to AIFC format using any QuickTime-supported compresser. .

http://www.dakx.com/daxaif/

         

Posted in August 26th, 2001

Creating a Zip file in Java

Published in Source Code, Zip

This example from Sun shows how to create a file using the library components in java.util.zip.

http://developer.java.sun.com/developer/codesamples/examplets/java.util.zip/169.html

         

Posted in August 25th, 2001