Tokenization and the noiseless channel

V Zouhar, C Meister, JL Gastaldi, L Du… - arXiv preprint arXiv …, 2023 - arxiv.org
noisy channel, we seek an encoding scheme that will help ensure that σ is resilient to noise
in addition to efficiently encoding σ. However, in the noiselesscodewords of the same length

Minimum-redundancy coding for the discrete noiseless channel

R Karp - IRE Transactions on Information Theory, 1961 - ieeexplore.ieee.org
code-word length, where the length of Ci is Xi=1 Ni. The only exhaustive prefix code with
maximum length … Suppose 3) holds for all exhaustive prefix codes of maximum length less than …

Universal noiseless coding

L Davisson - IEEE Transactions on Information Theory, 1973 - ieeexplore.ieee.org
… Suppose we are given a discrete-time and discrete-alphabet source that we wish to block
encode without error to minimize the average codeword length, where the code is not allowed …

A noiseless coding theorem for sources having utilities

G Longo - SIAM Journal on Applied Mathematics, 1976 - SIAM
… ui, and the cost ci of transmitting a through the noiseless channel fed by 5e is proportional
to the product un, where n is the length of the codeword associated with ai. Then the coder-…

Bounds on codeword lengths of optimal codes for noiseless channels

V Munteanu, D Tarniceriu - 2007 International Symposium on …, 2007 - ieeexplore.ieee.org
… Using an encoding procedure on a noiseless channel [4], we reach … code words c1 of length
ij, i = 1,n are obtained for (2) and (3), we can write source S. The average code word length

[PDF][PDF] Block coding with noiseless feedback

ER Berlekamp - 1964 - dspace.mit.edu
… In View of these results, we focus our primary attention on low rate codes, including zero-rate
codes whose block length approaches infinity while the number of codewords remains fixed…

Optimum block codes for noiseless input restricted channels

CV Freiman, AD Wyner - Information and Control, 1964 - Elsevier
… Comparison of coefficients for a particular block length establishes an optimum terminal set
and codewords of the maximum-size code are then obtained directly. Two important classes …

[PDF][PDF] Communication on noisy channels: A coding theorem for computation

LJ Schulman - FOCS, 1992 - authors.library.caltech.edu
… }" such that every codeword transmitted across the channel is decoded correctly with …
noiseless channel protocol 1r of length n, there exists a privatecoin noisy channel protocol of length

Code construction for the noiseless binary switching multiple-access channel

P Vanroose - IEEE Transactions on Information Theory, 1988 - ieeexplore.ieee.org
… indicating which coordinates of a codeword of length n are erased. An erasure pattern pL is
the indicator function of L‘, being an element of V, with zeros in the coordinates belonging to …

Progressive transmission of images over memoryless noisy channels

V Chande, N Farvardin - IEEE Journal on Selected Areas in …, 2000 - ieeexplore.ieee.org
length source-packet to fixed-length channel packets lose this advantage. 2) The variable
codeword lengths … usually multiples of a smaller fixed-length channel block, which can be used …