Data-Compression.org

data compression link collection

Estimating entropy rates with Bayesian confidence intervals

I’m pleased to announce with my co-authors availability of a preprint on our new algorithm to estimate the Shannon entropy rate (bits/symbol) or (bits/sec) of an observed sequence of low-alphabet symbols. It uses the Context-Tree-Weighting universal compression method, but doesnot use the compression ratio directly as an entropy estimator but as a scaffold for a Bayesian estimate. The result is significantly lower bias.

ftp://lyapunov.ucsd.edu/pub/nonlinear/bayesian_information/Kennel_Shlens_et_al_2004.pdf

         

Posted in July 10th, 2004

No User Commented In " Estimating entropy rates with Bayesian confidence intervals "

Subscribes to this post Comment RSS or TrackBack URL

Leave Your Reply Below

 Username

 Email Address

 Website

Sticky note: Please double check your comments before submit Please Note: The comment moderation maybe active so there is no need to resubmit your comment