Information inequalities and finite groups : an overview
Date of Issue2014
2014 International Symposium on Information Theory and its Applications (ISITA)
School of Physical and Mathematical Sciences
An entropic vector is a 2n - 1 dimensional vector collecting all the possible joint entropies of n discrete jointly distributed random variables. The region Γ*n of entropic vectors plays a significant role in network information theory, since it is known that the capacity of large classes of networks can be computed by optimising a linear function over Γ*n, under linear constraints, where n is the number of variables involved in a given network. However so far only Γ*2 and Γ*3 are known. One approach to study Γ*n is to identify smaller regions that serve as inner bounds, and to look for entropic vectors violating inequalities characterising these regions. For example for n = 4, the inequality of interest is the so-called Ingleton inequality. We give an overview of recent work studying entropic vectors using a group theoretic approach. We recall Chan's technique of constructing random variables from groups and the corresponding notion of (abelian) group representable entropic vectors. We review different works on groups yielding violations of linear rank inequalities, and discuss the classification of finite groups based on the entropic vector that they yield.
© 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: [http://ieeexplore.ieee.org.ezlibproxy1.ntu.edu.sg/xpl/articleDetails.jsp?tp=&arnumber=6979933&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D6979933].