Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Filters








100,272 Hits in 5.3 sec

On Information Divergence Measures and a Unified Typicality

Siu-wai Ho, Raymond Yeung
2006 2006 IEEE International Symposium on Information Theory  
In this paper, the relation between typicality and information divergence measures is discussed.  ...  The new definition of information divergence measure in this paper leads to the definition of a unified typicality for finite or countably infinite alphabets which is stronger than both weak typicality  ...  In this section, we introduce a new information divergence measure and discuss the properties of the typicality it induces.  ... 
doi:10.1109/isit.2006.261685 dblp:conf/isit/HoY06 fatcat:d3h3udszpnf2bakmz7yjjo2k4i

On Information Divergence Measures and a Unified Typicality

Siu-Wai Ho, Raymond W. Yeung
2010 IEEE Transactions on Information Theory  
In this paper, the relation between typicality and information divergence measures is discussed.  ...  The new definition of information divergence measure in this paper leads to the definition of a unified typicality for finite or countably infinite alphabets which is stronger than both weak typicality  ...  In this section, we introduce a new information divergence measure and discuss the properties of the typicality it induces.  ... 
doi:10.1109/tit.2010.2080431 fatcat:axlm6c7yc5evpcu4w6w7pmjvni

A Unified Statistical and Information Theoretic Framework for Multi-modal Image Registration [chapter]

Lilla Zöllei, John W. Fisher, William M. Wells
2003 Lecture Notes in Computer Science  
We formulate and interpret several registration methods in the context of a unified statistical and information theoretic framework.  ...  A unified interpretation clarifies the implicit assumptions of each method yielding a better understanding of their relative strengths and weaknesses.  ...  Acknowledgement This work has been supported by NIH grant R21CA89449, by NSF ERC grant (JHU Agreement #8810-274), by the Whiteman Fellowship and The Harvard Center for Neurodegeneration and Repair.  ... 
doi:10.1007/978-3-540-45087-0_31 fatcat:zerx4jl3nzep3bhc6c3k5ylodq

Non-negative matrix factorization based on generalized dual divergence [article]

Karthik Devarajan
2019 arXiv   pre-print
A theoretical framework for non-negative matrix factorization based on generalized dual Kullback-Leibler divergence, which includes members of the exponential family of models, is proposed.  ...  A measure to evaluate the goodness-of-fit of the resulting factorization is described. This framework can be adapted to include penalty, kernel and discriminant functions as well as tensors.  ...  A unified NMF algorithm based on dual divergence We derive a unified NMF algorithm where ǫ in equation (2.1) is a member of the class of models included in (2.7).  ... 
arXiv:1905.07034v1 fatcat:zoirsnajafcahmxso552xarqxa

Unified Fuzzy Divergence Measures with Multi-Criteria Decision Making Problems for Sustainable Planning of an E-Waste Recycling Job Selection

Rani, Govindan, Mishra, Mardani, Alrasheedi, Hooda
2020 Symmetry  
Firstly, directed divergence (Kullback–Leibler or Jeffrey invariant) and secondly, Jensen difference divergence, based on these measures, we develop a class of unified divergence measures for fuzzy sets  ...  In the literature of information theory and fuzzy set doctrine, there exist various prominent measures of divergence; each possesses its own merits, demerits, and disciplines of applications.  ...  Later on, we defined a family of unified divergence measures for FSs based on various types of entropy function.  ... 
doi:10.3390/sym12010090 fatcat:vreqtfyd7zbkrn5uz3izj2fucy

Action and Perception as Divergence Minimization [article]

Danijar Hafner, Pedro A. Ortega, Jimmy Ba, Thomas Parr, Karl Friston, Nicolas Heess
2022 arXiv   pre-print
This explains a wide range of unsupervised objectives from a single principle, including representation learning, information gain, empowerment, and skill discovery.  ...  While the narrow objectives correspond to domain-specific rewards as typical in reinforcement learning, the general objectives maximize information with the environment through latent variable models of  ...  Based on the KL divergence (Kullback and Leibler, 1951) , we propose a unified framework for action and perception that connects a wide range of objectives to facilitate our understanding of them while  ... 
arXiv:2009.01791v3 fatcat:zvczhk74yffpbadt5owx7h7ife

DIVEIN: a web server to analyze phylogenies, sequence divergence, diversity, and informative sites

Wenjie Deng, Brandon Maust, David Nickle*, Gerald Learn**, Yi Liu, Laura Heath, Sergei Kosakovsky Pond, James Mullins
2010 BioTechniques  
AI047734 and AI057005), including support to the Computational Biology Core of the University of Washington Center for AIDS Research (grant no. AI27757).  ...  The MRCA and COT sequences are reconstructed using a DIVEIN: a web server to analyze phylogenies, sequence divergence, diversity, and informative sites DIVEIN is a web interface that performs automated  ...  Using d(i,j) to denote either the path length between nodes i and j in the reconstructed phylogenetic tree or a genetic distance between sequences i and j, we measure diver- 1 1 ( , / ) N divergence  ... 
doi:10.2144/000113370 pmid:20569214 pmcid:PMC3133969 fatcat:qp64ylqudvc7neybxpdk4bn7ee

A unified statistical and information theoretic framework for multi-modal image registration

Lilla Zöllei, John W Fisher, William M Wells
2003 Information processing in medical imaging : proceedings of the ... conference  
We formulate and interpret several registration methods in the context of a unified statistical and information theoretic framework.  ...  A unified interpretation clarifies the implicit assumptions of each method yielding a better understanding of their relative strengths and weaknesses.  ...  Unified View of Maximum-Likelihood, Mutual Information, and Kullback-Leibler Divergence For simplicity, we consider the case of two registered data sets, u(x) and v(x) sampled on x ∈ M .  ... 
pmid:15344472 fatcat:t2u7jejubbd5tdyejkzkr3bhty

Towards a combined model for search and navigation of annotated documents

Edgar Meij
2008 Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '08  
The theme of my proposed research is to capture two aspects in a single, unified model: retrieval and navigation.  ...  Given a query, this entails using both term-based and concept-based evidence to locate relevant information (retrieval) and suggesting useful browsing suggestions (navigation).  ...  The theme of my proposed research is to capture two aspects in a single, unified model: retrieval and navigation.  ... 
doi:10.1145/1390334.1390573 dblp:conf/sigir/Meij08 fatcat:dp7i5m7m65dyzouwh74hijr2ky

Connectivity-Driven Brain Parcellation via Consensus Clustering [chapter]

Anvar Kurmukov, Ayagoz Musabaeva, Yulia Denisova, Daniel Moyer, Boris Gutman
2018 Lecture Notes in Computer Science  
We assess the quality of our parcellations using (1) Kullback-Liebler and Jensen-Shannon divergence with respect to the dense connectome representation, (2) interhemispheric symmetry, and (3) performance  ...  The proposed methods exploit a previously proposed dense connectivity representation, termed continuous connectivity, by first performing graph-based hierarchical clustering of individual brains, and subsequently  ...  Classification perfomance is measured in terms of ROC AUC score, which is typical for binary classification tasks.  ... 
doi:10.1007/978-3-030-00755-3_13 fatcat:nrpoutguknbtvoe5nkbt7zirge

A unified statistical approach to non-negative matrix factorization and probabilistic latent semantic indexing

Karthik Devarajan, Guoli Wang, Nader Ebrahimi
2014 Machine Learning  
In this paper, we present a generalized statistical approach to NMF and PLSI based on Renyi's divergence between two non-negative matrices, stemming from the Poisson likelihood.  ...  We propose a unified algorithm for NMF and provide a rigorous proof of monotonicity of multiplicative updates for W and H .  ...  The work of GW was done while he was a member of the High-Performance Computing Facility at Fox Chase Cancer Center. The authors thank Prof.  ... 
doi:10.1007/s10994-014-5470-z pmid:25821345 pmcid:PMC4371760 fatcat:r3oqfmqufneevl3iadf4bc456q

The disunity of neuroeconomics: a methodological appraisal

Roberto Fumagalli
2010 Journal of Economic Methodology  
McKenzie Alexander and Ivan Moscati for the insightful criticisms and suggestions they formulated on earlier versions of this paper.  ...  I also wish to thank Richard Bradley, Don Ross and Chris Starmer for their comments and observations. Notes  ...  ones typically considered by economists.  ... 
doi:10.1080/13501781003756493 fatcat:wqrypq7fzvfgpif6c23usojzte

Trading Off Privacy, Utility, and Efficiency in Federated Learning

Xiaojin Zhang, Yan Kang, Kai Chen, Lixin Fan, Qiang Yang
2023 ACM Transactions on Intelligent Systems and Technology  
We propose a unified federated learning framework that reconciles horizontal and vertical federated learning.  ...  Federated learning (FL) enables participating parties to collaboratively build a global model with boosted utility without disclosing private data information.  ...  This work was partially supported by the National Key Research and Development Program of China under Grant 2018AAA0101100 and Hong Kong RGC TRS T41-603/20-R.  ... 
doi:10.1145/3595185 fatcat:xqfja4antvgbhl7lmqkbyffolu

An objective prior that unifies objective Bayes and information-based inference [article]

Colin H. LaMont, Paul A. Wiggins
2015 arXiv   pre-print
We describe an objective prior (the weighting or w-prior) which unifies objective Bayes and information-based inference.  ...  There are three principle paradigms of statistical inference: (i) Bayesian, (ii) information-based and (iii) frequentist inference.  ...  Criterion (AIC) [7] [8] [9] , unifying objective-Bayes and information-based inference.  ... 
arXiv:1506.00745v2 fatcat:isfont2ozfcuhd4dueg7ikkm54

Page 7069 of Mathematical Reviews Vol. , Issue 93m [page]

1993 Mathematical Reviews  
On unified (r, s)-weighted information measures. (English summary) Soochow J. Math. 19 (1993), no. 1, 11-30.  ...  [“Coding for a discrete information source with a distortion measure”, Ph.D. Thesis, Massachusetts Inst. Tech., Cambridge, MA, 1962; per bibl.] and T.  ... 
« Previous Showing results 1 — 15 out of 100,272 results