Data-Compression.org

data compression link collection

Fyffe Codes for Fast Codelength Approximation

Graham Fyffe proposes a variable length integer code that he says is easier to compute than Huffman codes.

http://www.geocities.com/g_fyffe/fastselext.htm

         

Posted in July 18th, 2002

Improving the Speed of LZ77 Compression by Hashing and Suffix Sorting

by Kunihiko Sadakane, Hiroshi Imai. This paper proposes two new methods of performing fast string matching in LZ77 compression. One method uses a new hashing algorithm, the other uses suffix sorting.

http://citeseer.nj.nec.com/sadakane00improving.html

         

Posted in July 16th, 2002

The Golomb/Rice Image Compression Web Page

A senior project whose goal was to design a hardware compressor for continuous tone images. Contains a description of the algorithm, Matlab implementations, chip designs, and more.

http://www.ece.utep.edu/research/webspc/wwwdocs/teams/golombriceimag/welcome_to_the_golomb
.htm

         

Posted in July 15th, 2002

Pegasus ELS Sample Code

Pegasus has a patented range coder that they license at no charge. This archive contains some C code that provides a sample implementation.

ftp://www.jpg.com/Osaugels.zip

         

Posted in July 12th, 2002

Compressors Comparison Test WIN | KOI | LAT Compressors Comparison Test Compressors Comparison Test

Published in Results, Archiving

Yoockin Vadim has a page here with ratings of 10 popular lossless compressors.

http://compression.graphicon.ru/ybs/best.htm

* * * * *

Posted in July 11th, 2002

YBS (blocksorting compressor)

YBS is a high-performance archiver based on Burrows-Wheeler Transform and distance coding modelling. It’s quite fast even on skew data and achives high compression ratio. Versions are posted here for DOS and Win32. It appears that the last update was in 2000.

http://compression.graphicon.ru/ybs/#YBS

         

Posted in July 11th, 2002

WIS Technologies announces PC Video chip

Published in Hardware, Video

EE Times carries this announcement of a new PC video encoder chip from WIS Technologies. The chip is designed to do the heavy lifting that is real trouble for a host CPU, by taking care of things like DCTs and motion estimation. It relies on that same host CPU to do format conversion and other more mundane tasks. The chip currently supports video formats that include DiVX, H.261, H.263, MPEG-2, and more

http://www.eet.com/semi/news/OEG20020626S0029

         

Posted in July 9th, 2002

Advanced MP3 Converter

This conversion tool will convert between several audio formats, including WAV, OGG, and MP3. Supports ID3V1 and V2, plus other goodies.

http://www.mp3do.com/mp3converter.html

         

Posted in July 9th, 2002

AM-Zip

Lots of folks (including me) perform system backups into Zip archives. Over the years I became leery of proprietary formats used by various manufacturers of tape drives, removable disks, etc. Zip files give me a much better feeling, and make it a lot easier to browse through my backups. Martin Aignesberger must feel the same way, because he has created a product that performs daily backups into Zip files. This is a commercial product, but he does offer a 30 day free evaluation.

http://aignes.com/zip.htm

         

Posted in July 9th, 2002

Codecs 101 for Microsoft Windows Media Technologies

This article from Microsoft’s Knowledge Base talks about the role of the codec in Microsoft’s Media Technologies.

http://msdn.microsoft.com/library/default.asp?url=/library/en-us/dnwmt/html/codecs.asp

         

Posted in July 9th, 2002

MPEG-4 encoding on a cell phone?

This article describes a proof-of-concept app running on a Nokia 7650 that performs MPEG-4 encoding and decoding, creating a portable video phone. No word on how you can get the code, or how difficult it would be to port this Symbios OS product to other platforms. Still, the company that developed the product, Hantro Products, does supply the codecs that do the trick.

http://www.infosync.no/show.php?id=2016

         

Posted in July 9th, 2002

Chinese JPEG2000 business on runway

Published in Hardware, JPEG-2000

This article in EE Times describes an effort to steer the Chinese
digital camera business onto the JPEG-2000 road. The goal is to create a chip that can be inserted into cameras for less than $10.
The supplier of the algorithm used in the chip is WIS Technologies.

http://www.eetimes.com/story/OEG20000707S0004

         

Posted in July 9th, 2002

ZipRecovery

Published in Commercial Programs, Zip

ZipRecovery purports to be able to repair your corrupted Zip files. They don’t talk too much about the details on the site, but they offer a demo program, so you can get an evaluation without actually buying a copy.

Version 1.5 is shipping as of October, 2003.

http://www.officerecovery.com/zip/?submit

         

Posted in July 2nd, 2002

David Scott’s bijective 2nd order English compressor

This is compressor has static probabilities designed for English language text, encoding ASCII text and spaces only.

http://bijective.dogma.net/compres2bse.htm

         

Posted in July 2nd, 2002

Baseline JPEG and JPEG2000 Artifacts Illustrated

This paper by Aleks Jakulin discusses the artifacts that show up in images compressed using the JPEG and JPEG2000 algorithms. He includes some nice sample images to illustrate what he is talking about.

http://ai.fri.uni-lj.si/~aleks/jpeg/artifacts.htm

         

Posted in July 1st, 2002

David Scott’s Bijective Static Entropy Compression

This compressor is designed to operate on English text - it has a static probability table configured for written English.

http://bijective.dogma.net/compres1bse.htm

* * * * *

Posted in June 26th, 2002

Peribit

These folks make a box that transparently compresses network traffic. Designed to work on any sort of WAN interface, including T1, E1, ATM, etc. The web site includes an ROI calcuator that will convince you this box will pay for itself!

http://www.peribit.com/

*        

Posted in June 25th, 2002

Flatcompression

This open source project is working on an ISAPI compression filter, designed for use with IIS. The project is listed as being in beta status by the maintainer, with hopeful comments for the future in the SourceForge discussion forums.

http://sourceforge.net/projects/flatcompression

         

Posted in June 23rd, 2002

UniquE’s RAR File Library

The URARFileLib is a small library that allows you to read files from RAR archives created with RAR and WinRAR. Decompression and decryption with full RAR v2.0 compatibility is done directly in your application, thus there is no need for a DLL or any other external file. This file library is based on the free unRAR source code by Eugene Roshal, and designed for easy but powerful usage in demos and intros. This library is also useful if you want to port your demos since the URARFileLib supports multiple operating systems (Linux, SunOS, and Win32).

Update: As of June, 2002, The library is hosted at a new URL, has a new dual license, and improved samples for Win32, Linux, and UNIX.

http://www.unrarlib.org/

* * * * *

Posted in June 19th, 2002

PifPaf zip/unzip

PifPaf zip/unzip is a small and simple drag-and-drop ZIP compressor for MacOS and MacOS X.. PifPaf Mac/Win is a small and simple drag and drop LZW compressor (DiskDoubler type, file’s tree keeping) for MacOS AND Windows (.ssr extension) This is a French language site.

http://croggeo.free.fr/pifpaf/php-forge2/home.php

         

Posted in June 12th, 2002

A Block-sorting Lossless Data Compression Algorithm

Burrows, M. and Wheeler, D.J., A Block-sorting Lossless Data Compression Algorithm, Digital Systems Research Center Research Report 124, May 1994. The original paper on BWT compression. This very effective compression technique was first described in this paper.

Michael Schindler reviewed it thus:Even through it is the first paper about blocksort it is still excellent literature for introduction to this method and its general ideas..

Note: after many years, the DEC web site hosting this paper finally disappeared, not surprisingly. The new link is via the CiteSeer search engine, which I hope is a permanent solution.

http://citeseer.nj.nec.com/76182.html

* * * * *

Posted in June 9th, 2002

lz.adb

Ada source for compression based on the LZH package.

http://www.mysunrise.ch/users/gdm/lz__adb.htm

* * * * *

Posted in June 8th, 2002

VCEG ftp server

Published in Files, Standards, Video

This is described as the ftp server for the Video Coding Experts Group, which is working on H.26L and other video projects. A ton of stuff here, no guideposts or indices, have at it.

ftp://standard.pictel.com/video-site/

         

Posted in June 6th, 2002

Entropy on the web

Describe as Some resources of information theory and entropy concepts on the Internet.

http://www.mdpi.org/entropy/entropyweb/entropyweb.htm

         

Posted in June 6th, 2002

GWIC - GNU Wavelet Image Codec

From the site: GWIC is a simple, fast and relatively efficient lossy image compression algorithm designed for compression of natural images. Currently both gray scale (8 12 and 16bpp) and RGB-images are supported, but in future support for alpha-channels is planned. GWIC is still in the middle of the designing phase, and thus should not yet be used in any real applications, since the file-format and algorithms are likely to change..

http://www.jole.fi/research/gwic/

         

Posted in June 6th, 2002

PPM FAQ

What appears to be a comprehensive FAQ on PPM programming. Russian language, and fairly slow loading, but no reason not to try Google or BabelFish for a translation.

http://www.arctest.narod.ru/descript/ppm-faq.htm

         

Posted in June 6th, 2002

Amiga compression formats

A good resource for anyone using compression or writing compression code for the Amiga platform. Includes tutorial and background information as well as links to code.

http://www.kyz.uklinux.net/packers.php3

         

Posted in June 6th, 2002

AG Information und Komplexität

A nice set of links to various resources related to info theory and data compression. German language.

http://www.mathematik.uni-bielefeld.de/ahlswede/itlinks_f.html

         

Posted in June 6th, 2002

Ondolette.com

A forum dedicated to the discussion of Wavelets. This link takes you to the French language version of the board - click on the “English” link on the left side of the page for English language discussion.

http://www.ondelette.com/

* * * * *

Posted in June 5th, 2002

Daniel Lemire

Daniel Lemire is a researcher at the National Research Council of Canada. Some of his recent research interest is on wavelet-based prefix sum methods for On-Line Analytic Processing (OLAP). Some of his publications are relevant to compression techniques including a white paper on image compression by wavelets.

http://www.ondelette.com/acadia/

         

Posted in June 5th, 2002