Estimating entropy rates with Bayesian confidence intervals
I’m pleased to announce with my co-authors availability of a preprint on our new algorithm to estimate the Shannon entropy rate (bits/symbol) or (bits/sec) of an observed sequence of low-alphabet symbols. It uses the Context-Tree-Weighting universal compression method, but doesnot use the compression ratio directly as an entropy estimator but as a scaffold for a Bayesian estimate. The result is significantly lower bias.
ftp://lyapunov.ucsd.edu/pub/nonlinear/bayesian_information/Kennel_Shlens_et_al_2004.pdf
Posted in July 10th, 2004
No User Commented In " Estimating entropy rates with Bayesian confidence intervals "
Subscribes to this post Comment RSS or TrackBack URL