A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf
.
Filters
On Information Divergence Measures and a Unified Typicality
2006
2006 IEEE International Symposium on Information Theory
In this paper, the relation between typicality and information divergence measures is discussed. ...
The new definition of information divergence measure in this paper leads to the definition of a unified typicality for finite or countably infinite alphabets which is stronger than both weak typicality ...
In this section, we introduce a new information divergence measure and discuss the properties of the typicality it induces. ...
doi:10.1109/isit.2006.261685
dblp:conf/isit/HoY06
fatcat:d3h3udszpnf2bakmz7yjjo2k4i
On Information Divergence Measures and a Unified Typicality
2010
IEEE Transactions on Information Theory
In this paper, the relation between typicality and information divergence measures is discussed. ...
The new definition of information divergence measure in this paper leads to the definition of a unified typicality for finite or countably infinite alphabets which is stronger than both weak typicality ...
In this section, we introduce a new information divergence measure and discuss the properties of the typicality it induces. ...
doi:10.1109/tit.2010.2080431
fatcat:axlm6c7yc5evpcu4w6w7pmjvni
A Unified Statistical and Information Theoretic Framework for Multi-modal Image Registration
[chapter]
2003
Lecture Notes in Computer Science
We formulate and interpret several registration methods in the context of a unified statistical and information theoretic framework. ...
A unified interpretation clarifies the implicit assumptions of each method yielding a better understanding of their relative strengths and weaknesses. ...
Acknowledgement This work has been supported by NIH grant R21CA89449, by NSF ERC grant (JHU Agreement #8810-274), by the Whiteman Fellowship and The Harvard Center for Neurodegeneration and Repair. ...
doi:10.1007/978-3-540-45087-0_31
fatcat:zerx4jl3nzep3bhc6c3k5ylodq
Non-negative matrix factorization based on generalized dual divergence
[article]
2019
arXiv
pre-print
A theoretical framework for non-negative matrix factorization based on generalized dual Kullback-Leibler divergence, which includes members of the exponential family of models, is proposed. ...
A measure to evaluate the goodness-of-fit of the resulting factorization is described. This framework can be adapted to include penalty, kernel and discriminant functions as well as tensors. ...
A unified NMF algorithm based on dual divergence We derive a unified NMF algorithm where ǫ in equation (2.1) is a member of the class of models included in (2.7). ...
arXiv:1905.07034v1
fatcat:zoirsnajafcahmxso552xarqxa
Unified Fuzzy Divergence Measures with Multi-Criteria Decision Making Problems for Sustainable Planning of an E-Waste Recycling Job Selection
2020
Symmetry
Firstly, directed divergence (Kullback–Leibler or Jeffrey invariant) and secondly, Jensen difference divergence, based on these measures, we develop a class of unified divergence measures for fuzzy sets ...
In the literature of information theory and fuzzy set doctrine, there exist various prominent measures of divergence; each possesses its own merits, demerits, and disciplines of applications. ...
Later on, we defined a family of unified divergence measures for FSs based on various types of entropy function. ...
doi:10.3390/sym12010090
fatcat:vreqtfyd7zbkrn5uz3izj2fucy
Action and Perception as Divergence Minimization
[article]
2022
arXiv
pre-print
This explains a wide range of unsupervised objectives from a single principle, including representation learning, information gain, empowerment, and skill discovery. ...
While the narrow objectives correspond to domain-specific rewards as typical in reinforcement learning, the general objectives maximize information with the environment through latent variable models of ...
Based on the KL divergence (Kullback and Leibler, 1951) , we propose a unified framework for action and perception that connects a wide range of objectives to facilitate our understanding of them while ...
arXiv:2009.01791v3
fatcat:zvczhk74yffpbadt5owx7h7ife
DIVEIN: a web server to analyze phylogenies, sequence divergence, diversity, and informative sites
2010
BioTechniques
AI047734 and AI057005), including support to the Computational Biology Core of the University of Washington Center for AIDS Research (grant no. AI27757). ...
The MRCA and COT sequences are reconstructed using a DIVEIN: a web server to analyze phylogenies, sequence divergence, diversity, and informative sites DIVEIN is a web interface that performs automated ...
Using d(i,j) to denote either the path length between nodes i and j in the reconstructed phylogenetic tree or a genetic distance between sequences i and j, we measure diver- 1 1 ( , / ) N divergence ...
doi:10.2144/000113370
pmid:20569214
pmcid:PMC3133969
fatcat:qp64ylqudvc7neybxpdk4bn7ee
A unified statistical and information theoretic framework for multi-modal image registration
2003
Information processing in medical imaging : proceedings of the ... conference
We formulate and interpret several registration methods in the context of a unified statistical and information theoretic framework. ...
A unified interpretation clarifies the implicit assumptions of each method yielding a better understanding of their relative strengths and weaknesses. ...
Unified View of Maximum-Likelihood, Mutual Information, and Kullback-Leibler Divergence For simplicity, we consider the case of two registered data sets, u(x) and v(x) sampled on x ∈ M . ...
pmid:15344472
fatcat:t2u7jejubbd5tdyejkzkr3bhty
Towards a combined model for search and navigation of annotated documents
2008
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '08
The theme of my proposed research is to capture two aspects in a single, unified model: retrieval and navigation. ...
Given a query, this entails using both term-based and concept-based evidence to locate relevant information (retrieval) and suggesting useful browsing suggestions (navigation). ...
The theme of my proposed research is to capture two aspects in a single, unified model: retrieval and navigation. ...
doi:10.1145/1390334.1390573
dblp:conf/sigir/Meij08
fatcat:dp7i5m7m65dyzouwh74hijr2ky
Connectivity-Driven Brain Parcellation via Consensus Clustering
[chapter]
2018
Lecture Notes in Computer Science
We assess the quality of our parcellations using (1) Kullback-Liebler and Jensen-Shannon divergence with respect to the dense connectome representation, (2) interhemispheric symmetry, and (3) performance ...
The proposed methods exploit a previously proposed dense connectivity representation, termed continuous connectivity, by first performing graph-based hierarchical clustering of individual brains, and subsequently ...
Classification perfomance is measured in terms of ROC AUC score, which is typical for binary classification tasks. ...
doi:10.1007/978-3-030-00755-3_13
fatcat:nrpoutguknbtvoe5nkbt7zirge
A unified statistical approach to non-negative matrix factorization and probabilistic latent semantic indexing
2014
Machine Learning
In this paper, we present a generalized statistical approach to NMF and PLSI based on Renyi's divergence between two non-negative matrices, stemming from the Poisson likelihood. ...
We propose a unified algorithm for NMF and provide a rigorous proof of monotonicity of multiplicative updates for W and H . ...
The work of GW was done while he was a member of the High-Performance Computing Facility at Fox Chase Cancer Center. The authors thank Prof. ...
doi:10.1007/s10994-014-5470-z
pmid:25821345
pmcid:PMC4371760
fatcat:r3oqfmqufneevl3iadf4bc456q
The disunity of neuroeconomics: a methodological appraisal
2010
Journal of Economic Methodology
McKenzie Alexander and Ivan Moscati for the insightful criticisms and suggestions they formulated on earlier versions of this paper. ...
I also wish to thank Richard Bradley, Don Ross and Chris Starmer for their comments and observations.
Notes ...
ones typically considered by economists. ...
doi:10.1080/13501781003756493
fatcat:wqrypq7fzvfgpif6c23usojzte
Trading Off Privacy, Utility, and Efficiency in Federated Learning
2023
ACM Transactions on Intelligent Systems and Technology
We propose a unified federated learning framework that reconciles horizontal and vertical federated learning. ...
Federated learning (FL) enables participating parties to collaboratively build a global model with boosted utility without disclosing private data information. ...
This work was partially supported by the National Key Research and Development Program of China under Grant 2018AAA0101100 and Hong Kong RGC TRS T41-603/20-R. ...
doi:10.1145/3595185
fatcat:xqfja4antvgbhl7lmqkbyffolu
An objective prior that unifies objective Bayes and information-based inference
[article]
2015
arXiv
pre-print
We describe an objective prior (the weighting or w-prior) which unifies objective Bayes and information-based inference. ...
There are three principle paradigms of statistical inference: (i) Bayesian, (ii) information-based and (iii) frequentist inference. ...
Criterion (AIC) [7] [8] [9] , unifying objective-Bayes and information-based inference. ...
arXiv:1506.00745v2
fatcat:isfont2ozfcuhd4dueg7ikkm54
Page 7069 of Mathematical Reviews Vol. , Issue 93m
[page]
1993
Mathematical Reviews
On unified (r, s)-weighted information measures. (English summary)
Soochow J. Math. 19 (1993), no. 1, 11-30. ...
[“Coding for a discrete information source with a distortion measure”, Ph.D. Thesis, Massachusetts Inst. Tech., Cambridge, MA, 1962; per bibl.] and T. ...
« Previous
Showing results 1 — 15 out of 100,272 results