Parametric Bayesian Estimation of Differential Entropy and Relative Entropy
Gupta; Srivastava
2010-01-01
Given iid samples drawn from a distribution with known parametric form, we propose the minimization of expected Bregman divergence to form Bayesian estimates of differential entropy and relative entropy, and derive such estimators for the uniform, Gaussian, Wishart, and inverse Wishart distributions. Additionally, formulas are given for a log gamma Bregman divergence and the differential entropy and relative entropy for the Wishart and inverse Wishart. The results, as always with Bayesian est...
Anisimov, D. N.; Dang, Thai Son; Banerjee, Santo; Mai, The Anh
2017-07-01
In this paper, an intelligent system use fuzzy-PD controller based on relation models is developed for a two-wheeled self-balancing robot. Scaling factors of the fuzzy-PD controller are optimized by a Cross-Entropy optimization method. A linear Quadratic Regulator is designed to bring a comparison with the fuzzy-PD controller by control quality parameters. The controllers are ported and run on STM32F4 Discovery Kit based on the real-time operating system. The experimental results indicate that the proposed fuzzy-PD controller runs exactly on embedded system and has desired performance in term of fast response, good balance and stabilize.
Parametric Bayesian Estimation of Differential Entropy and Relative Entropy
Directory of Open Access Journals (Sweden)
Maya Gupta
2010-04-01
Full Text Available Given iid samples drawn from a distribution with known parametric form, we propose the minimization of expected Bregman divergence to form Bayesian estimates of differential entropy and relative entropy, and derive such estimators for the uniform, Gaussian, Wishart, and inverse Wishart distributions. Additionally, formulas are given for a log gamma Bregman divergence and the differential entropy and relative entropy for the Wishart and inverse Wishart. The results, as always with Bayesian estimates, depend on the accuracy of the prior parameters, but example simulations show that the performance can be substantially improved compared to maximum likelihood or state-of-the-art nonparametric estimators.
The concept of entropy. Relation between action and entropy
Directory of Open Access Journals (Sweden)
J.-P.Badiali
2005-01-01
Full Text Available The Boltzmann expression for entropy represents the traditional link between thermodynamics and statistical mechanics. New theoretical developments like the Unruh effect or the black hole theory suggest a new definition of entropy. In this paper we consider the thermodynamics of black holes as seriously founded and we try to see what we can learn from it in the case of ordinary systems for which a pre-relativistic description is sufficient. We introduce a space-time model and a new definition of entropy considering the thermal equilibrium from a dynamic point of view. Then we show that for black hole and ordinary systems we have the same relation relating a change of entropy to a change of action.
Comprehensive entropy weight observability-controllability risk ...
African Journals Online (AJOL)
Decision making for water resource planning is often related to social, economic and environmental factors. There are various methods for making decisions about water resource planning alternatives and measures with various shortcomings. A comprehensive entropy weight observability-controllability risk analysis ...
Controlling the Shannon Entropy of Quantum Systems
Xing, Yifan; Wu, Jun
2013-01-01
This paper proposes a new quantum control method which controls the Shannon entropy of quantum systems. For both discrete and continuous entropies, controller design methods are proposed based on probability density function control, which can drive the quantum state to any target state. To drive the entropy to any target at any prespecified time, another discretization method is proposed for the discrete entropy case, and the conditions under which the entropy can be increased or decreased are discussed. Simulations are done on both two- and three-dimensional quantum systems, where division and prediction are used to achieve more accurate tracking. PMID:23818819
Controlling the Shannon Entropy of Quantum Systems
Directory of Open Access Journals (Sweden)
Yifan Xing
2013-01-01
Full Text Available This paper proposes a new quantum control method which controls the Shannon entropy of quantum systems. For both discrete and continuous entropies, controller design methods are proposed based on probability density function control, which can drive the quantum state to any target state. To drive the entropy to any target at any prespecified time, another discretization method is proposed for the discrete entropy case, and the conditions under which the entropy can be increased or decreased are discussed. Simulations are done on both two- and three-dimensional quantum systems, where division and prediction are used to achieve more accurate tracking.
Relative entropy and the RG flow
Energy Technology Data Exchange (ETDEWEB)
Casini, Horacio; Testé, Eduardo; Torroba, Gonzalo [Centro Atómico Bariloche and CONICET,S.C. de Bariloche, Río Negro, R8402AGP (Argentina)
2017-03-16
We consider the relative entropy between vacuum states of two different theories: a conformal field theory (CFT), and the CFT perturbed by a relevant operator. By restricting both states to the null Cauchy surface in the causal domain of a sphere, we make the relative entropy equal to the difference of entanglement entropies. As a result, this difference has the positivity and monotonicity properties of relative entropy. From this it follows a simple alternative proof of the c-theorem in d=2 space-time dimensions and, for d>2, the proof that the coefficient of the area term in the entanglement entropy decreases along the renormalization group (RG) flow between fixed points. We comment on the regimes of convergence of relative entropy, depending on the space-time dimensions and the conformal dimension Δ of the perturbation that triggers the RG flow.
All Inequalities for the Relative Entropy
Ibinson, Ben; Linden, Noah; Winter, Andreas
2007-01-01
The relative entropy of two n-party quantum states is an important quantity exhibiting, for example, the extent to which the two states are different. The relative entropy of the states formed by reducing two n-party states to a smaller number m of parties is always less than or equal to the relative entropy of the two original n-party states. This is the monotonicity of relative entropy. Using techniques from convex geometry, we prove that monotonicity under restrictions is the only general inequality satisfied by quantum relative entropies. In doing so we make a connection to secret sharing schemes with general access structures: indeed, it turns out that the extremal rays of the cone defined by monotonicity are populated by classical secret sharing schemes. A surprising outcome is that the structure of allowed relative entropy values of subsets of multiparty states is much simpler than the structure of allowed entropy values. And the structure of allowed relative entropy values (unlike that of entropies) is the same for classical probability distributions and quantum states.
Quantum entropy and special relativity.
Peres, Asher; Scudo, Petra F; Terno, Daniel R
2002-06-10
We consider a single free spin- 1 / 2 particle. The reduced density matrix for its spin is not covariant under Lorentz transformations. The spin entropy is not a relativistic scalar and has no invariant meaning.
Some relations between entropy and approximation numbers
Institute of Scientific and Technical Information of China (English)
郑志明
1999-01-01
A general result is obtained which relates the entropy numbers of compact maps on Hilbert space to its approximation numbers. Compared with previous works in this area, it is particularly convenient for dealing with the cases where the approximation numbers decay rapidly. A nice estimation between entropy and approximation numbers for noncompact maps is given.
Low Streamflow Forcasting using Minimum Relative Entropy
Cui, H.; Singh, V. P.
2013-12-01
Minimum relative entropy spectral analysis is derived in this study, and applied to forecast streamflow time series. Proposed method extends the autocorrelation in the manner that the relative entropy of underlying process is minimized so that time series data can be forecasted. Different prior estimation, such as uniform, exponential and Gaussian assumption, is taken to estimate the spectral density depending on the autocorrelation structure. Seasonal and nonseasonal low streamflow series obtained from Colorado River (Texas) under draught condition is successfully forecasted using proposed method. Minimum relative entropy determines spectral of low streamflow series with higher resolution than conventional method. Forecasted streamflow is compared to the prediction using Burg's maximum entropy spectral analysis (MESA) and Configurational entropy. The advantage and disadvantage of each method in forecasting low streamflow is discussed.
Constant conditional entropy and related hypotheses
International Nuclear Information System (INIS)
Ferrer-i-Cancho, Ramon; Dębowski, Łukasz; Moscoso del Prado Martín, Fermín
2013-01-01
Constant entropy rate (conditional entropies must remain constant as the sequence length increases) and uniform information density (conditional probabilities must remain constant as the sequence length increases) are two information theoretic principles that are argued to underlie a wide range of linguistic phenomena. Here we revise the predictions of these principles in the light of Hilberg’s law on the scaling of conditional entropy in language and related laws. We show that constant entropy rate (CER) and two interpretations for uniform information density (UID), full UID and strong UID, are inconsistent with these laws. Strong UID implies CER but the reverse is not true. Full UID, a particular case of UID, leads to costly uncorrelated sequences that are totally unrealistic. We conclude that CER and its particular cases are incomplete hypotheses about the scaling of conditional entropies. (letter)
The relative entropy in the quantum mechanics
International Nuclear Information System (INIS)
Lecomte Montes, A.
1983-06-01
Relative Entropy is a generalization of entropy which substitutes the Liouville measure from classical mechanics or the trace from quantum mechanics by an arbitrary state. There are many different defintions of it in quantum mechanics because the algebra of observables is not commutative. In this work, three known defintions of the quantum relative entropy are studied and compared but specifically their common properties are presented. The best known defintion was proposed many years ago by Umegaki and later on by Lindblad. This defintion can be realized through a functional calculus for quadratic forms introduced by Pusz and Woronowicz, for two arbitrary states on a Csup(*)-algebra. The two other definitions investigated are the Naudt's entropy and the inference function of Marchand and Wyss. The first one can be expressed through the functional calculus too, it has then almost the same properties as the Umegaki-Lindblad defintion. The inference function can be considered only as some kind of 1/2-relative entropy. The function is nevertheless very important because it can be expressed as the logarithm of the transition probability between the basis state and the actual state. A general theory which includes the three defintions is not found yet, but it is shown that the functional calculus provides a great family of relative entropies. This is important for a unified theory of all defintions and their properties. (Author)
Relation Entropy and Transferable Entropy Think of Aggregation on Group Decision Making
Institute of Scientific and Technical Information of China (English)
CHENG Qi-yue; QIU Wan-hua; LIU Xiao-feng
2002-01-01
In this paper, aggregation question based on group decision making and a single decision making is studied. The theory of entropy is applied to the sets pair analysis. The system of relation entropy and the transferable entropy notion are put. The character is studied. An potential by the relation entropy and transferable entropy are defined. It is the consistency measure on the group between a single decision making. We gained a new aggregation effective definition on the group misjudge.
Relations Among Some Fuzzy Entropy Formulae
Institute of Scientific and Technical Information of China (English)
卿铭
2004-01-01
Fuzzy entropy has been widely used to analyze and design fuzzy systems, and many fuzzy entropy formulae have been proposed. For further in-deepth analysis of fuzzy entropy, the axioms and some important formulae of fuzzy entropy are introduced. Some equivalence results among these fuzzy entropy formulae are proved, and it is shown that fuzzy entropy is a special distance measurement.
Generalization of Gibbs Entropy and Thermodynamic Relation
Park, Jun Chul
2010-01-01
In this paper, we extend Gibbs's approach of quasi-equilibrium thermodynamic processes, and calculate the microscopic expression of entropy for general non-equilibrium thermodynamic processes. Also, we analyze the formal structure of thermodynamic relation in non-equilibrium thermodynamic processes.
Machine learning with quantum relative entropy
Energy Technology Data Exchange (ETDEWEB)
Tsuda, Koji [Max Planck Institute for Biological Cybernetics, Spemannstr. 38, Tuebingen, 72076 (Germany)], E-mail: koji.tsuda@tuebingen.mpg.de
2009-12-01
Density matrices are a central tool in quantum physics, but it is also used in machine learning. A positive definite matrix called kernel matrix is used to represent the similarities between examples. Positive definiteness assures that the examples are embedded in an Euclidean space. When a positive definite matrix is learned from data, one has to design an update rule that maintains the positive definiteness. Our update rule, called matrix exponentiated gradient update, is motivated by the quantum relative entropy. Notably, the relative entropy is an instance of Bregman divergences, which are asymmetric distance measures specifying theoretical properties of machine learning algorithms. Using the calculus commonly used in quantum physics, we prove an upperbound of the generalization error of online learning.
Machine learning with quantum relative entropy
International Nuclear Information System (INIS)
Tsuda, Koji
2009-01-01
Density matrices are a central tool in quantum physics, but it is also used in machine learning. A positive definite matrix called kernel matrix is used to represent the similarities between examples. Positive definiteness assures that the examples are embedded in an Euclidean space. When a positive definite matrix is learned from data, one has to design an update rule that maintains the positive definiteness. Our update rule, called matrix exponentiated gradient update, is motivated by the quantum relative entropy. Notably, the relative entropy is an instance of Bregman divergences, which are asymmetric distance measures specifying theoretical properties of machine learning algorithms. Using the calculus commonly used in quantum physics, we prove an upperbound of the generalization error of online learning.
Mean-field approximation minimizes relative entropy
International Nuclear Information System (INIS)
Bilbro, G.L.; Snyder, W.E.; Mann, R.C.
1991-01-01
The authors derive the mean-field approximation from the information-theoretic principle of minimum relative entropy instead of by minimizing Peierls's inequality for the Weiss free energy of statistical physics theory. They show that information theory leads to the statistical mechanics procedure. As an example, they consider a problem in binary image restoration. They find that mean-field annealing compares favorably with the stochastic approach
Relative entropy as a measure of entanglement for Gaussian states
Institute of Scientific and Technical Information of China (English)
Lu Huai-Xin; Zhao Bo
2006-01-01
In this paper, we derive an explicit analytic expression of the relative entropy between two general Gaussian states. In the restriction of the set for Gaussian states and with the help of relative entropy formula and Peres-Simon separability criterion, one can conveniently obtain the relative entropy entanglement for Gaussian states. As an example,the relative entanglement for a two-mode squeezed thermal state has been obtained.
Escort entropies and divergences and related canonical distribution
International Nuclear Information System (INIS)
Bercher, J.-F.
2011-01-01
We discuss two families of two-parameter entropies and divergences, derived from the standard Renyi and Tsallis entropies and divergences. These divergences and entropies are found as divergences or entropies of escort distributions. Exploiting the nonnegativity of the divergences, we derive the expression of the canonical distribution associated to the new entropies and a observable given as an escort-mean value. We show that this canonical distribution extends, and smoothly connects, the results obtained in nonextensive thermodynamics for the standard and generalized mean value constraints. -- Highlights: → Two-parameter entropies are derived from q-entropies and escort distributions. → The related canonical distribution is derived. → This connects and extends known results in nonextensive statistics.
Entropy function and universality of entropy-area relation for small black holes
International Nuclear Information System (INIS)
Cai Ronggen; Chen, C.-M.; Maeda, Kei-ichi; Ohta, Nobuyoshi; Pang Dawei
2008-01-01
We discuss the entropy-area relation for the small black holes with higher curvature corrections by using the entropy function formalism and field redefinition method. We show that the entropy S BH of the small black hole is proportional to its horizon area A. In particular, we find a universal result that S BH =A/2G, the ratio is 2 times of Bekenstein-Hawking entropy-area formula in many cases of physical interest. In four dimensions, the universal relation is always true irrespective of the coefficients of the higher-order terms if the dilaton couplings are the same, which is the case for string effective theory, while in five dimensions, the relation again holds irrespective of the overall coefficient if the higher-order corrections are in the GB combination. We also discuss how this result generalizes to known physically interesting cases with Lovelock correction terms in various dimensions, and possible implications of the universal relation.
Relative entropy of steering: on its definition and properties
International Nuclear Information System (INIS)
Kaur, Eneet; Wilde, Mark M
2017-01-01
In Gallego and Aolita (2015 Phys. Rev . X 5 041008), the authors proposed a definition for the relative entropy of steering and showed that the resulting quantity is a convex steering monotone. Here we advocate for a different definition for relative entropy of steering, based on well grounded concerns coming from quantum Shannon theory. We prove that this modified relative entropy of steering is a convex steering monotone. Furthermore, we establish that it is uniformly continuous and faithful, in both cases giving quantitative bounds that should be useful in applications. We also consider a restricted relative entropy of steering which is relevant for the case in which the free operations in the resource theory of steering have a more restricted form (the restricted operations could be more relevant in practical scenarios). The restricted relative entropy of steering is convex, monotone with respect to these restricted operations, uniformly continuous, and faithful. (paper)
Relation between entropy functional of Keizer and information theory
International Nuclear Information System (INIS)
Freidkin, E.S.; Nettleton, R.E.
1990-01-01
An equation given by Keizer which relates the second-order functional derivative of the steady-state entropy to the inverse fluctuation correlation function is satisified by the information-theoretic entropy if the equation is extended to arbitrary nonequilibrium states
The Gibbs entropy production in general relativity
International Nuclear Information System (INIS)
Henneaux, M.
1983-01-01
The entropy production is analyzed in the case of homogeneous cosmological models of the Bianchi type. It is shown to vanish for class-A models and to be undefined for class-B ones, because of an ambiguity in the measure on the space of the true gravitational degrees of freedom. How this results extend to the full Einstein theory is discussed
Gibbs entropy production in general relativity
International Nuclear Information System (INIS)
Henneaux, M.
1983-01-01
The entropy production is analyzed in the case of homogeneous cosmological models of the Bianchi type. It is shown to vanish for class-A models and to be undefined for class-B ones, because of an ambiguity in the measure on the space of the true gravitational degrees of freedom. How this results extends to the full Einstein theory is discussed
Directory of Open Access Journals (Sweden)
Christian Corda
2018-01-01
Full Text Available In this paper we consider the metric entropies of the maps of an iterated function system deduced from a black hole which are known the Bekenstein–Hawking entropies and its subleading corrections. More precisely, we consider the recent model of a Bohr-like black hole that has been recently analysed in some papers in the literature, obtaining the intriguing result that the metric entropies of a black hole are created by the metric entropies of the functions, created by the black hole principal quantum numbers, i.e., by the black hole quantum levels. We present a new type of topological entropy for general iterated function systems based on a new kind of the inverse of covers. Then the notion of metric entropy for an Iterated Function System ( I F S is considered, and we prove that these definitions for topological entropy of IFS’s are equivalent. It is shown that this kind of topological entropy keeps some properties which are hold by the classic definition of topological entropy for a continuous map. We also consider average entropy as another type of topological entropy for an I F S which is based on the topological entropies of its elements and it is also an invariant object under topological conjugacy. The relation between Axiom A and the average entropy is investigated.
Benfenati, Francesco; Beretta, Gian Paolo
2018-04-01
We show that to prove the Onsager relations using the microscopic time reversibility one necessarily has to make an ergodic hypothesis, or a hypothesis closely linked to that. This is true in all the proofs of the Onsager relations in the literature: from the original proof by Onsager, to more advanced proofs in the context of linear response theory and the theory of Markov processes, to the proof in the context of the kinetic theory of gases. The only three proofs that do not require any kind of ergodic hypothesis are based on additional hypotheses on the macroscopic evolution: Ziegler's maximum entropy production principle (MEPP), the principle of time reversal invariance of the entropy production, or the steepest entropy ascent principle (SEAP).
Minimum relative entropy, Bayes and Kapur
Woodbury, Allan D.
2011-04-01
The focus of this paper is to illustrate important philosophies on inversion and the similarly and differences between Bayesian and minimum relative entropy (MRE) methods. The development of each approach is illustrated through the general-discrete linear inverse. MRE differs from both Bayes and classical statistical methods in that knowledge of moments are used as ‘data’ rather than sample values. MRE like Bayes, presumes knowledge of a prior probability distribution and produces the posterior pdf itself. MRE attempts to produce this pdf based on the information provided by new moments. It will use moments of the prior distribution only if new data on these moments is not available. It is important to note that MRE makes a strong statement that the imposed constraints are exact and complete. In this way, MRE is maximally uncommitted with respect to unknown information. In general, since input data are known only to within a certain accuracy, it is important that any inversion method should allow for errors in the measured data. The MRE approach can accommodate such uncertainty and in new work described here, previous results are modified to include a Gaussian prior. A variety of MRE solutions are reproduced under a number of assumed moments and these include second-order central moments. Various solutions of Jacobs & van der Geest were repeated and clarified. Menke's weighted minimum length solution was shown to have a basis in information theory, and the classic least-squares estimate is shown as a solution to MRE under the conditions of more data than unknowns and where we utilize the observed data and their associated noise. An example inverse problem involving a gravity survey over a layered and faulted zone is shown. In all cases the inverse results match quite closely the actual density profile, at least in the upper portions of the profile. The similar results to Bayes presented in are a reflection of the fact that the MRE posterior pdf, and its mean
Quantum Rényi relative entropies affirm universality of thermodynamics.
Misra, Avijit; Singh, Uttam; Bera, Manabendra Nath; Rajagopal, A K
2015-10-01
We formulate a complete theory of quantum thermodynamics in the Rényi entropic formalism exploiting the Rényi relative entropies, starting from the maximum entropy principle. In establishing the first and second laws of quantum thermodynamics, we have correctly identified accessible work and heat exchange in both equilibrium and nonequilibrium cases. The free energy (internal energy minus temperature times entropy) remains unaltered, when all the entities entering this relation are suitably defined. Exploiting Rényi relative entropies we have shown that this "form invariance" holds even beyond equilibrium and has profound operational significance in isothermal process. These results reduce to the Gibbs-von Neumann results when the Rényi entropic parameter α approaches 1. Moreover, it is shown that the universality of the Carnot statement of the second law is the consequence of the form invariance of the free energy, which is in turn the consequence of maximum entropy principle. Further, the Clausius inequality, which is the precursor to the Carnot statement, is also shown to hold based on the data processing inequalities for the traditional and sandwiched Rényi relative entropies. Thus, we find that the thermodynamics of nonequilibrium state and its deviation from equilibrium together determine the thermodynamic laws. This is another important manifestation of the concepts of information theory in thermodynamics when they are extended to the quantum realm. Our work is a substantial step towards formulating a complete theory of quantum thermodynamics and corresponding resource theory.
Entropy generation in a condenser and related correlations
Directory of Open Access Journals (Sweden)
Askowski Rafał
2015-06-01
Full Text Available The paper presents an analysis of relations describing entropy generation in a condenser of a steam unit. Connections between entropy generation, condenser ratio, and heat exchanger effectiveness, as well as relations implied by them are shown. Theoretical considerations allowed to determine limits of individual parameters which describe the condenser operation. Various relations for average temperature of the cold fluid were compared. All the proposed relations were verified against data obtained using a simulator and actual measurement data from a 200 MW unit condenser. Based on data from a simulator it was examined how the sum of entropy rates, steam condenser effectiveness, terminal temperature difference and condenser ratio vary with the change in the inlet cooling water temperature, mass flow rate of steam and the cooling water mass flow rate.
Relative information entropy in cosmology: The problem of information entanglement
Energy Technology Data Exchange (ETDEWEB)
Czinner, Viktor G., E-mail: czinner.viktor@wigner.mta.hu [Centro de Matemática, Universidade do Minho, Campus de Gualtar, 4710-057 Braga (Portugal); HAS Wigner Research Centre for Physics, H-1525 Budapest, P.O. Box 49 (Hungary); Mena, Filipe C., E-mail: fmena@math.uminho.pt [Centro de Matemática, Universidade do Minho, Campus de Gualtar, 4710-057 Braga (Portugal)
2016-07-10
The necessary information to distinguish a local inhomogeneous mass density field from its spatial average on a compact domain of the universe can be measured by relative information entropy. The Kullback–Leibler (KL) formula arises very naturally in this context, however, it provides a very complicated way to compute the mutual information between spatially separated but causally connected regions of the universe in a realistic, inhomogeneous model. To circumvent this issue, by considering a parametric extension of the KL measure, we develop a simple model to describe the mutual information which is entangled via the gravitational field equations. We show that the Tsallis relative entropy can be a good approximation in the case of small inhomogeneities, and for measuring the independent relative information inside the domain, we propose the Rényi relative entropy formula.
Relative Entropy, Interaction Energy and the Nature of Dissipation
Directory of Open Access Journals (Sweden)
Bernard Gaveau
2014-06-01
Full Text Available Many thermodynamic relations involve inequalities, with equality if a process does not involve dissipation. In this article we provide equalities in which the dissipative contribution is shown to involve the relative entropy (a.k.a. Kullback-Leibler divergence. The processes considered are general time evolutions both in classical and quantum mechanics, and the initial state is sometimes thermal, sometimes partially so. By calculating a transport coefficient we show that indeed—at least in this case—the source of dissipation in that coefficient is the relative entropy.
Relative entropy, mixed gauge-gravitational anomaly and causality
Energy Technology Data Exchange (ETDEWEB)
Bhattacharyya, Arpan [Department of Physics and Center for Field Theory and Particle Physics, Fudan University,220 Handan Road, 200433 Shanghai (China); Centre For High Energy Phsyics, Indian Institute of Science,560012 Bangalore (India); Cheng, Long [Department of Physics and Center for Field Theory and Particle Physics, Fudan University,220 Handan Road, 200433 Shanghai (China); Hung, Ling-Yan [Department of Physics and Center for Field Theory and Particle Physics, Fudan University,220 Handan Road, 200433 Shanghai (China); Collaborative Innovation Center of Advanced Microstructures, Fudan University,220 Handan Road, 200433 Shanghai (China)
2016-07-25
In this note we explored the holographic relative entropy in the presence of the 5d Chern-Simons term, which introduces a mixed gauge-gravity anomaly to the dual CFT. The theory trivially satisfies an entanglement first law. However, to quadratic order in perturbations of the stress tensor T and current density J, there is a mixed contribution to the relative entropy bi-linear in T and J, signalling a potential violation of the positivity of the relative entropy. Miraculously, the term vanishes up to linear order in a derivative expansion. This prompted a closer inspection on a different consistency check, that involves time-delay of a graviton propagating in a charged background, scattered via a coupling supplied by the Chern-Simons term. The analysis suggests that the time-delay can take either sign, potentially violating causality for any finite value of the CS coupling.
Uncertainty relations for information entropy in wave mechanics
International Nuclear Information System (INIS)
Bialynicki-Birula, I.; Pittsburgh Univ., Pa.; Mycielski, J.
1975-01-01
New uncertainty relations in quantum mechanics are derived. They express restrictions imposed by quantum theory on probability distributions of canonically conjugate variables in terms of corresponding information entropies. The Heisenberg uncertainty relation follows from those inequalities and so does the Gross-Nelson inequality. (orig.) [de
Entropy, related thermodynamic properties, and structure of methylisocyanate
International Nuclear Information System (INIS)
Davis, Phil S.; Kilpatrick, John E.
2013-01-01
Highlights: ► The thermodynamic properties of methylisocyanate have been determined by isothermal calorimetry from 15 to 298.15 K. ► The third law entropy has been compared with the entropy calculated by statistical thermodynamics. ► The comparisons are consistent with selected proposed molecular structures and vibrational frequencies. -- Abstract: The entropy and related thermodynamic properties of methylisocyanate, CH 3 NCO, have been determined by isothermal calorimetry. The entropy in the ideal gas state at 298.15 K and 1 atmosphere is S m o = 284.3 ± 0.6 J/K · mol. Other thermodynamic properties determined include: the heat capacity from 15 to 300 K, the temperature of fusion (T fus = 178.461 ± 0.024 K), the enthalpy of fusion (ΔH fus = 7455.2 ± 14.0 J/mol), the enthalpy of vaporization at 298.15 K (ΔH vap = 28768 ± 54 J/mol), and the vapor pressure from fusion to 300 K. Using statistical thermodynamics, the entropy in this same state has been calculated for various assumed structures for methylisocyante which have been proposed based on several spectroscopic and ab initio results. Comparisons between the experimental and calculated entropy have led to the following conclusions concerning historical differences among problematic structural properties: (1) The CNC/CNO angles can have the paired values of 140/180° or 135/173° respectively. It is not possible to distinguish between the two by this thermodynamic analysis. (2) The methyl group functions as a free rotor or near free rotor against the NCO rigid frame. The barrier to internal rotation is less than 2100 J/mol. (3) The CNC vibrational bending frequency is consistent with the more recently observed assignments at 165 and 172 cm −1 with some degree of anharmonicity or with a pure harmonic at about 158 cm −1
Measurement Uncertainty Relations for Discrete Observables: Relative Entropy Formulation
Barchielli, Alberto; Gregoratti, Matteo; Toigo, Alessandro
2018-02-01
We introduce a new information-theoretic formulation of quantum measurement uncertainty relations, based on the notion of relative entropy between measurement probabilities. In the case of a finite-dimensional system and for any approximate joint measurement of two target discrete observables, we define the entropic divergence as the maximal total loss of information occurring in the approximation at hand. For fixed target observables, we study the joint measurements minimizing the entropic divergence, and we prove the general properties of its minimum value. Such a minimum is our uncertainty lower bound: the total information lost by replacing the target observables with their optimal approximations, evaluated at the worst possible state. The bound turns out to be also an entropic incompatibility degree, that is, a good information-theoretic measure of incompatibility: indeed, it vanishes if and only if the target observables are compatible, it is state-independent, and it enjoys all the invariance properties which are desirable for such a measure. In this context, we point out the difference between general approximate joint measurements and sequential approximate joint measurements; to do this, we introduce a separate index for the tradeoff between the error of the first measurement and the disturbance of the second one. By exploiting the symmetry properties of the target observables, exact values, lower bounds and optimal approximations are evaluated in two different concrete examples: (1) a couple of spin-1/2 components (not necessarily orthogonal); (2) two Fourier conjugate mutually unbiased bases in prime power dimension. Finally, the entropic incompatibility degree straightforwardly generalizes to the case of many observables, still maintaining all its relevant properties; we explicitly compute it for three orthogonal spin-1/2 components.
Relative entropies in thermodynamics of complete fluid systems
Czech Academy of Sciences Publication Activity Database
Feireisl, Eduard
2012-01-01
Roč. 32, č. 9 (2012), s. 3059-3080 ISSN 1078-0947 R&D Projects: GA ČR GA201/09/0917 Institutional research plan: CEZ:AV0Z10190503 Keywords : relative entropy * Navier-Stokes-Fourier system * weak-strong uniqueness Subject RIV: BA - General Mathematics Impact factor: 1.005, year: 2012 http://www.aimsciences.org/journals/displayArticlesnew.jsp?paperID=7281
The singular minimum entropy $H_\\infty$ control problem
Stoorvogel, A.A.
1990-01-01
In this paper we search for controllers which minimize an entropy function of the closed loop transfer matrix under the constraint of internal stability and under the constraint that the closed loop transfer matrix has $H_\\infty$ norm less than some a priori given bound $\\gamma$. We find an explicit
Entropy and Its Correlations with Other Related Quantities
Directory of Open Access Journals (Sweden)
Jing Wu
2014-02-01
Full Text Available In order to find more correlations between entropy and other related quantities, an analogical analysis is conducted between thermal science and other branches of physics. Potential energy in various forms is the product of a conserved extensive quantity (for example, mass or electric charge and an intensive quantity which is its potential (for example, gravitational potential or electrical voltage, while energy in specific form is a dissipative quantity during irreversible transfer process (for example mechanical or electrical energy will be dissipated as thermal energy. However, it has been shown that heat or thermal energy, like mass or electric charge, is conserved during heat transfer processes. When a heat transfer process is for object heating or cooling, the potential of internal energy U is the temperature T and its potential “energy” is UT/2 (called entransy and it is the simplified expression of thermomass potential energy; when a heat transfer process is for heat-work conversion, the potential of internal energy U is (1 − T0/T, and the available potential energy of a system in reversible heat interaction with the environment is U − U0 − T0(S − S0, then T0/T and T0(S − S0 are the unavailable potential and the unavailable potential energy of a system respectively. Hence, entropy is related to the unavailable potential energy per unit environmental temperature for heat-work conversion during reversible heat interaction between the system and its environment. Entropy transfer, like other forms of potential energy transfer, is the product of the heat and its potential, the reciprocal of temperature, although it is in form of the quotient of the heat and the temperature. Thus, the physical essence of entropy transfer is the unavailable potential energy transfer per unit environmental temperature. Entropy is a non-conserved, extensive, state quantity of a system, and entropy generation in an irreversible heat transfer process
Entropy as a measure of the noise extent in a two-level quantum feedback controlled system
Institute of Scientific and Technical Information of China (English)
Wang Tao-Bo; Fang Mao-Fa; Hu Yao-Hua
2007-01-01
By introducing the von Neumann entropy as a measure of the extent of noise, this paper discusses the entropy evolution in a two-level quantum feedback controlled system. The results show that the feedback control can induce the reduction of the degree of noise, and different control schemes exhibit different noise controlling ability, the extent of the reduction also related with the position of the target state on the Bloch sphere. It is shown that the evolution of entropy can provide a real time noise observation and a systematic guideline to make reasonable choice of control strategy.
Chaos control in an economic model via minimum entropy strategy
Energy Technology Data Exchange (ETDEWEB)
Salarieh, Hassan [Center of Excellence in Design, Robotics and Automation, Department of Mechanical Engineering, Sharif University of Technology, P.O. Box 11365-9567, Tehran (Iran, Islamic Republic of)], E-mail: salarieh@mech.sharif.edu; Alasty, Aria [Center of Excellence in Design, Robotics and Automation, Department of Mechanical Engineering, Sharif University of Technology, P.O. Box 11365-9567, Tehran (Iran, Islamic Republic of); National Research Institute for Science Policy (NRISP), Soheil Street, Shirazi Avenue, Tehran (Iran, Islamic Republic of)], E-mail: aalasti@sharif.edu
2009-04-30
In this paper, minimum entropy algorithm for controlling chaos, is applied to a Cournot duopoly with different constant marginal costs, as a discrete-time dynamical system which shows chaotic behavior. The ME control is implemented through delayed feedback. It is assumed that the equations of the dynamical system are not known, so the feedback gain cannot be obtained analytically from the system equations. In the ME method the feedback gain is obtained adaptively in such a way that the entropy of the system converges to zero, hence a fixed point of the system will be stabilized. Application of the proposed method with different economic control strategies is numerically investigated. Simulation results show the effectiveness of the ME method for controlling chaos in economic systems with unknown equations.
Variations mechanism in entropy of wave height field and its relation with thermodynamic entropy
Institute of Scientific and Technical Information of China (English)
无
2006-01-01
This paper gives a brief description of annual period and seasonal variation in the wave height field entropy in the northeastern Pacific. A calculation of the quantity of the, received by lithosphere systems in the northern hemisphere is introduced. The wave heat field entropy is compared with the difference in the quantity of the sun's radiation heat. Analysis on the transfer method, period and lag of this seasonal variation led to the conclusion that the annual period and seasonal variation in the entropy of the wave height field in the Northwestern Pacific is due to the seasonal variation of the sun's radiation heat. Furthermore, the inconsistency between thermodynamic entropy and information entropy was studied.
Psychological Entropy: A Framework for Understanding Uncertainty-Related Anxiety
Hirsh, Jacob B.; Mar, Raymond A.; Peterson, Jordan B.
2012-01-01
Entropy, a concept derived from thermodynamics and information theory, describes the amount of uncertainty and disorder within a system. Self-organizing systems engage in a continual dialogue with the environment and must adapt themselves to changing circumstances to keep internal entropy at a manageable level. We propose the entropy model of…
The relative entropy is fundamental to adaptive resolution simulations
Kreis, Karsten; Potestio, Raffaello
2016-07-01
Adaptive resolution techniques are powerful methods for the efficient simulation of soft matter systems in which they simultaneously employ atomistic and coarse-grained (CG) force fields. In such simulations, two regions with different resolutions are coupled with each other via a hybrid transition region, and particles change their description on the fly when crossing this boundary. Here we show that the relative entropy, which provides a fundamental basis for many approaches in systematic coarse-graining, is also an effective instrument for the understanding of adaptive resolution simulation methodologies. We demonstrate that the use of coarse-grained potentials which minimize the relative entropy with respect to the atomistic system can help achieve a smoother transition between the different regions within the adaptive setup. Furthermore, we derive a quantitative relation between the width of the hybrid region and the seamlessness of the coupling. Our results do not only shed light on the what and how of adaptive resolution techniques but will also help setting up such simulations in an optimal manner.
Minimum Entropy-Based Cascade Control for Governing Hydroelectric Turbines
Directory of Open Access Journals (Sweden)
Mifeng Ren
2014-06-01
Full Text Available In this paper, an improved cascade control strategy is presented for hydroturbine speed governors. Different from traditional proportional-integral-derivative (PID control and model predictive control (MPC strategies, the performance index of the outer controller is constructed by integrating the entropy and mean value of the tracking error with the constraints on control energy. The inner controller is implemented by a proportional controller. Compared with the conventional PID-P and MPC-P cascade control methods, the proposed cascade control strategy can effectively decrease fluctuations of hydro-turbine speed under non-Gaussian disturbance conditions in practical hydropower plants. Simulation results show the advantages of the proposed cascade control method.
Maximum entropy networks are more controllable than preferential attachment networks
International Nuclear Information System (INIS)
Hou, Lvlin; Small, Michael; Lao, Songyang
2014-01-01
A maximum entropy (ME) method to generate typical scale-free networks has been recently introduced. We investigate the controllability of ME networks and Barabási–Albert preferential attachment networks. Our experimental results show that ME networks are significantly more easily controlled than BA networks of the same size and the same degree distribution. Moreover, the control profiles are used to provide insight into control properties of both classes of network. We identify and classify the driver nodes and analyze the connectivity of their neighbors. We find that driver nodes in ME networks have fewer mutual neighbors and that their neighbors have lower average degree. We conclude that the properties of the neighbors of driver node sensitively affect the network controllability. Hence, subtle and important structural differences exist between BA networks and typical scale-free networks of the same degree distribution. - Highlights: • The controllability of maximum entropy (ME) and Barabási–Albert (BA) networks is investigated. • ME networks are significantly more easily controlled than BA networks of the same degree distribution. • The properties of the neighbors of driver node sensitively affect the network controllability. • Subtle and important structural differences exist between BA networks and typical scale-free networks
Coherence and entanglement measures based on Rényi relative entropies
International Nuclear Information System (INIS)
Zhu, Huangjun; Hayashi, Masahito; Chen, Lin
2017-01-01
We study systematically resource measures of coherence and entanglement based on Rényi relative entropies, which include the logarithmic robustness of coherence, geometric coherence, and conventional relative entropy of coherence together with their entanglement analogues. First, we show that each Rényi relative entropy of coherence is equal to the corresponding Rényi relative entropy of entanglement for any maximally correlated state. By virtue of this observation, we establish a simple operational connection between entanglement measures and coherence measures based on Rényi relative entropies. We then prove that all these coherence measures, including the logarithmic robustness of coherence, are additive. Accordingly, all these entanglement measures are additive for maximally correlated states. In addition, we derive analytical formulas for Rényi relative entropies of entanglement of maximally correlated states and bipartite pure states, which reproduce a number of classic results on the relative entropy of entanglement and logarithmic robustness of entanglement in a unified framework. Several nontrivial bounds for Rényi relative entropies of coherence (entanglement) are further derived, which improve over results known previously. Moreover, we determine all states whose relative entropy of coherence is equal to the logarithmic robustness of coherence. As an application, we provide an upper bound for the exact coherence distillation rate, which is saturated for pure states. (paper)
1976-01-01
The entropy of a gas system with the number of particles subject to external control is maximized to derive relations between the thermodynamic variables that obtain at equilibrium. These relations are described in terms of the chemical potential, defined as equivalent partial derivatives of entropy, energy, enthalpy, free energy, or free enthalpy. At equilibrium, the change in total chemical potential must vanish. This fact is used to derive the equilibrium constants for chemical reactions in terms of the partition functions of the species involved in the reaction. Thus the equilibrium constants can be determined accurately, just as other thermodynamic properties, from a knowledge of the energy levels and degeneracies for the gas species involved. These equilibrium constants permit one to calculate the equilibrium concentrations or partial pressures of chemically reacting species that occur in gas mixtures at any given condition of pressure and temperature or volume and temperature.
Hypoglycemia-Related Electroencephalogram Changes Assessed by Multiscale Entropy
DEFF Research Database (Denmark)
Fabris, C.; Sparacino, G.; Sejling, A. S.
2014-01-01
derivation in the two glycemic intervals was assessed using the multiscale entropy (MSE) approach, obtaining measures of sample entropy (SampEn) at various temporal scales. The comparison of how signal irregularity measured by SampEn varies as the temporal scale increases in the two glycemic states provides...
Relative entropy differences in bacterial chromosomes, plasmids, phages and genomic islands
DEFF Research Database (Denmark)
Bohlin, Jon; van Passel, Mark W. J.; Snipen, Lars
2012-01-01
with the strongest association being in phages. Relative entropy was also found to be lower in the obligate intracellular Mycobacterium leprae than in the related M. tuberculosis when measured on a shared set of highly conserved genes. Conclusions: We argue that relative entropy differences reflect how plasmids...
Relative entropy of excited states in two dimensional conformal field theories
Energy Technology Data Exchange (ETDEWEB)
Sárosi, Gábor [Department of Theoretical Physics, Institute of Physics, Budapest University of Technology,Budapest, H-1521 (Hungary); Ugajin, Tomonori [Kavli Institute for Theoretical Physics, University of California,Santa Barbara,CA 93106 (United States)
2016-07-21
We study the relative entropy and the trace square distance, both of which measure the distance between reduced density matrices of two excited states in two dimensional conformal field theories. We find a general formula for the relative entropy between two primary states with the same conformal dimension in the limit of a single small interval and find that in this case the relative entropy is proportional to the trace square distance. We check our general formulae by calculating the relative entropy between two generalized free fields and the trace square distance between the spin and disorder operators of the critical Ising model. We also give the leading term of the relative entropy in the small interval expansion when the two operators have different conformal dimensions. This turns out to be universal when the CFT has no primaires lighter than the stress tensor. The result reproduces the previously known special cases.
Relative entropy and waiting time for continuous-time Markov processes
Chazottes, J.R.; Giardinà, C.; Redig, F.H.J.
2006-01-01
For discrete-time stochastic processes, there is a close connection between return (resp. waiting) times and entropy (resp. relative entropy). Such a connection cannot be straightforwardly extended to the continuous-time setting. Contrarily to the discrete-time case one needs a reference measure on
The Kalman Filter Revisited Using Maximum Relative Entropy
Directory of Open Access Journals (Sweden)
Adom Giffin
2014-02-01
Full Text Available In 1960, Rudolf E. Kalman created what is known as the Kalman filter, which is a way to estimate unknown variables from noisy measurements. The algorithm follows the logic that if the previous state of the system is known, it could be used as the best guess for the current state. This information is first applied a priori to any measurement by using it in the underlying dynamics of the system. Second, measurements of the unknown variables are taken. These two pieces of information are taken into account to determine the current state of the system. Bayesian inference is specifically designed to accommodate the problem of updating what we think of the world based on partial or uncertain information. In this paper, we present a derivation of the general Bayesian filter, then adapt it for Markov systems. A simple example is shown for pedagogical purposes. We also show that by using the Kalman assumptions or “constraints”, we can arrive at the Kalman filter using the method of maximum (relative entropy (MrE, which goes beyond Bayesian methods. Finally, we derive a generalized, nonlinear filter using MrE, where the original Kalman Filter is a special case. We further show that the variable relationship can be any function, and thus, approximations, such as the extended Kalman filter, the unscented Kalman filter and other Kalman variants are special cases as well.
Entropy-power uncertainty relations: towards a tight inequality for all Gaussian pure states
International Nuclear Information System (INIS)
Hertz, Anaelle; Jabbour, Michael G; Cerf, Nicolas J
2017-01-01
We show that a proper expression of the uncertainty relation for a pair of canonically-conjugate continuous variables relies on entropy power, a standard notion in Shannon information theory for real-valued signals. The resulting entropy-power uncertainty relation is equivalent to the entropic formulation of the uncertainty relation due to Bialynicki-Birula and Mycielski, but can be further extended to rotated variables. Hence, based on a reasonable assumption, we give a partial proof of a tighter form of the entropy-power uncertainty relation taking correlations into account and provide extensive numerical evidence of its validity. Interestingly, it implies the generalized (rotation-invariant) Schrödinger–Robertson uncertainty relation exactly as the original entropy-power uncertainty relation implies Heisenberg relation. It is saturated for all Gaussian pure states, in contrast with hitherto known entropic formulations of the uncertainty principle. (paper)
Relative entropy of excited states in conformal field theories of arbitrary dimensions
Energy Technology Data Exchange (ETDEWEB)
Sárosi, Gábor [Theoretische Natuurkunde, Vrije Universiteit Brussels and International Solvay Institutes,Pleinlaan 2, Brussels, B-1050 (Belgium); David Rittenhouse Laboratory, University of Pennsylvania,Philadelphia, PA 19104 (United States); Ugajin, Tomonori [Kavli Institute for Theoretical Physics, University of California, Santa Barbara, CA 93106 (United States)
2017-02-10
Extending our previous work, we study the relative entropy between the reduced density matrices obtained from globally excited states in conformal field theories of arbitrary dimensions. We find a general formula in the small subsystem size limit. When one of the states is the vacuum of the CFT, our result matches with the holographic entanglement entropy computations in the corresponding bulk geometries, including AdS black branes. We also discuss the first asymmetric part of the relative entropy and comment on some implications of the results on the distinguishability of black hole microstates in AdS/CFT.
International Nuclear Information System (INIS)
De Nicola, Sergio; Fedele, Renato; Man'ko, Margarita A; Man'ko, Vladimir I
2007-01-01
The tomographic-probability description of quantum states is reviewed. The symplectic tomography of quantum states with continuous variables is studied. The symplectic entropy of the states with continuous variables is discussed and its relation to Shannon entropy and information is elucidated. The known entropic uncertainty relations of the probability distribution in position and momentum of a particle are extended and new uncertainty relations for symplectic entropy are obtained. The partial case of symplectic entropy, which is optical entropy of quantum states, is considered. The entropy associated to optical tomogram is shown to satisfy the new entropic uncertainty relation. The example of Gaussian states of harmonic oscillator is studied and the entropic uncertainty relations for optical tomograms of the Gaussian state are shown to minimize the uncertainty relation
Parameters Tuning of Model Free Adaptive Control Based on Minimum Entropy
Institute of Scientific and Technical Information of China (English)
Chao Ji; Jing Wang; Liulin Cao; Qibing Jin
2014-01-01
Dynamic linearization based model free adaptive control(MFAC) algorithm has been widely used in practical systems, in which some parameters should be tuned before it is successfully applied to process industries. Considering the random noise existing in real processes, a parameter tuning method based on minimum entropy optimization is proposed,and the feature of entropy is used to accurately describe the system uncertainty. For cases of Gaussian stochastic noise and non-Gaussian stochastic noise, an entropy recursive optimization algorithm is derived based on approximate model or identified model. The extensive simulation results show the effectiveness of the minimum entropy optimization for the partial form dynamic linearization based MFAC. The parameters tuned by the minimum entropy optimization index shows stronger stability and more robustness than these tuned by other traditional index,such as integral of the squared error(ISE) or integral of timeweighted absolute error(ITAE), when the system stochastic noise exists.
International Nuclear Information System (INIS)
Maes, Christian
2012-01-01
In contrast to the quite unique entropy concept useful for systems in (local) thermodynamic equilibrium, there is a variety of quite distinct nonequilibrium entropies, reflecting different physical points. We disentangle these entropies as they relate to heat, fluctuations, response, time asymmetry, variational principles, monotonicity, volume contraction or statistical forces. However, not all of those extensions yield state quantities as understood thermodynamically. At the end we sketch how aspects of dynamical activity can take over for obtaining an extended Clausius relation.
Ratio of critical quantities related to Hawking temperature–entanglement entropy criticality
Directory of Open Access Journals (Sweden)
Jie-Xiong Mo
2017-10-01
Full Text Available We revisit the Hawking temperature–entanglement entropy criticality of the d-dimensional charged AdS black hole with our attention concentrated on the ratio TcδSEcQc. Comparing the results of this paper with those of the ratio TcScQc, one can find both the similarities and differences. These two ratios are independent of the characteristic length scale l and dependent on the dimension d. These similarities further enhance the relation between the entanglement entropy and the Bekenstein–Hawking entropy. However, the ratio TcδSEcQc also relies on the size of the spherical entangling region. Moreover, these two ratios take different values even under the same choices of parameters. The differences between these two ratios can be attributed to the peculiar property of the entanglement entropy since the research in this paper is far from the regime where the behavior of the entanglement entropy is dominated by the thermal entropy.
Relative entanglement entropies in 1+1-dimensional conformal field theories
Energy Technology Data Exchange (ETDEWEB)
Ruggiero, Paola; Calabrese, Pasquale [International School for Advanced Studies (SISSA) and INFN,Via Bonomea 265, 34136, Trieste (Italy)
2017-02-08
We study the relative entanglement entropies of one interval between excited states of a 1+1 dimensional conformal field theory (CFT). To compute the relative entropy S(ρ{sub 1}∥ρ{sub 0}) between two given reduced density matrices ρ{sub 1} and ρ{sub 0} of a quantum field theory, we employ the replica trick which relies on the path integral representation of Tr(ρ{sub 1}ρ{sub 0}{sup n−1}) and define a set of Rényi relative entropies S{sub n}(ρ{sub 1}∥ρ{sub 0}). We compute these quantities for integer values of the parameter n and derive via the replica limit the relative entropy between excited states generated by primary fields of a free massless bosonic field. In particular, we provide the relative entanglement entropy of the state described by the primary operator i∂ϕ, both with respect to the ground state and to the state generated by chiral vertex operators. These predictions are tested against exact numerical calculations in the XX spin-chain finding perfect agreement.
Measuring the quality of a quantum reference frame: The relative entropy of frameness
International Nuclear Information System (INIS)
Gour, Gilad; Marvian, Iman; Spekkens, Robert W.
2009-01-01
In the absence of a reference frame for transformations associated with group G, any quantum state that is noninvariant under the action of G may serve as a token of the missing reference frame. We here present a measure of the quality of such a token: the relative entropy of frameness. This is defined as the relative entropy distance between the state of interest and the nearest G-invariant state. Unlike the relative entropy of entanglement, this quantity is straightforward to calculate, and we find it to be precisely equal to the G-asymmetry, a measure of frameness introduced by Vaccaro et al. It is shown to provide an upper bound on the mutual information between the group element encoded into the token and the group element that may be extracted from it by measurement. In this sense, it quantifies the extent to which the token successfully simulates a full reference frame. We also show that despite a suggestive analogy from entanglement theory, the regularized relative entropy of frameness is zero and therefore does not quantify the rate of interconversion between the token and some standard form of quantum reference frame. Finally, we show how these investigations yield an approach to bounding the relative entropy of entanglement.
Modified Dispersion Relations: from Black-Hole Entropy to the Cosmological Constant
Garattini, Remo
2012-07-01
Quantum Field Theory is plagued by divergences in the attempt to calculate physical quantities. Standard techniques of regularization and renormalization are used to keep under control such a problem. In this paper we would like to use a different scheme based on Modified Dispersion Relations (MDR) to remove infinities appearing in one loop approximation in contrast to what happens in conventional approaches. In particular, we apply the MDR regularization to the computation of the entropy of a Schwarzschild black hole from one side and the Zero Point Energy (ZPE) of the graviton from the other side. The graviton ZPE is connected to the cosmological constant by means of of the Wheeler-DeWitt equation.
Fault Diagnosis Method Based on Information Entropy and Relative Principal Component Analysis
Directory of Open Access Journals (Sweden)
Xiaoming Xu
2017-01-01
Full Text Available In traditional principle component analysis (PCA, because of the neglect of the dimensions influence between different variables in the system, the selected principal components (PCs often fail to be representative. While the relative transformation PCA is able to solve the above problem, it is not easy to calculate the weight for each characteristic variable. In order to solve it, this paper proposes a kind of fault diagnosis method based on information entropy and Relative Principle Component Analysis. Firstly, the algorithm calculates the information entropy for each characteristic variable in the original dataset based on the information gain algorithm. Secondly, it standardizes every variable’s dimension in the dataset. And, then, according to the information entropy, it allocates the weight for each standardized characteristic variable. Finally, it utilizes the relative-principal-components model established for fault diagnosis. Furthermore, the simulation experiments based on Tennessee Eastman process and Wine datasets demonstrate the feasibility and effectiveness of the new method.
Christoforou, Cleopatra
2017-12-10
We extend the relative entropy identity to the class of hyperbolic-parabolic systems whose hyperbolic part is symmetrizable. The resulting identity is useful to provide measure valued weak versus strong uniqueness theorems for the hyperbolic problem. Also, it yields a convergence result in the zero-viscosity limit to smooth solutions in an Lp framework. The relative entropy identity is also developed for the system of gas dynamics for viscous and heat conducting gases, and for the system of thermoviscoelasticity with viscosity and heat-conduction. Existing differences between the example and the general hyperbolic theory are underlined.
Christoforou, Cleopatra; Tzavaras, Athanasios
2017-01-01
We extend the relative entropy identity to the class of hyperbolic-parabolic systems whose hyperbolic part is symmetrizable. The resulting identity is useful to provide measure valued weak versus strong uniqueness theorems for the hyperbolic problem. Also, it yields a convergence result in the zero-viscosity limit to smooth solutions in an Lp framework. The relative entropy identity is also developed for the system of gas dynamics for viscous and heat conducting gases, and for the system of thermoviscoelasticity with viscosity and heat-conduction. Existing differences between the example and the general hyperbolic theory are underlined.
An estimator for the relative entropy rate of path measures for stochastic differential equations
Energy Technology Data Exchange (ETDEWEB)
Opper, Manfred, E-mail: manfred.opper@tu-berlin.de
2017-02-01
We address the problem of estimating the relative entropy rate (RER) for two stochastic processes described by stochastic differential equations. For the case where the drift of one process is known analytically, but one has only observations from the second process, we use a variational bound on the RER to construct an estimator.
Stabilizing unstable fixed points of chaotic maps via minimum entropy control
Energy Technology Data Exchange (ETDEWEB)
Salarieh, Hassan [Center of Excellence in Design, Robotics and Automation, Department of Mechanical Engineering, Sharif University of Technology, P.O. Box 11365-9567, Tehran (Iran, Islamic Republic of)], E-mail: salarieh@mech.sharif.edu; Alasty, Aria [Center of Excellence in Design, Robotics and Automation, Department of Mechanical Engineering, Sharif University of Technology, P.O. Box 11365-9567, Tehran (Iran, Islamic Republic of)
2008-08-15
In this paper the problem of chaos control in nonlinear maps using minimization of entropy function is investigated. Invariant probability measure of a chaotic dynamics can be used to produce an entropy function in the sense of Shannon. In this paper it is shown that how the entropy control technique is utilized for chaos elimination. Using only the measured states of a chaotic map the probability measure of the system is numerically estimated and this estimated measure is used to obtain an estimation for the entropy of the chaotic map. The control variable of the chaotic system is determined in such a way that the entropy function descends until the chaotic trajectory of the map is replaced with a regular one. The proposed idea is applied for stabilizing the fixed points of the logistic and the Henon maps as some cases of study. Simulation results show the effectiveness of the method in chaos rejection when only the statistical information is available from the under-study systems.
International Nuclear Information System (INIS)
Dobbertin, R.
1976-01-01
Functional relations are derived which link the reduced distribution functions of a classical N-particle system through the entropy production due to microscopic deviations from hamiltonian dynamics. These relations have been used in an earlier paper for the closure of the BBGKY-hierarchy and may be useful for the establishment of collective particle models in particular and the understanding of irreversibility in general. (Auth.)
Zamri, Nurnadiah; Abdullah, Lazim
2014-06-01
Flood control project is a complex issue which takes economic, social, environment and technical attributes into account. Selection of the best flood control project requires the consideration of conflicting quantitative and qualitative evaluation criteria. When decision-makers' judgment are under uncertainty, it is relatively difficult for them to provide exact numerical values. The interval type-2 fuzzy set (IT2FS) is a strong tool which can deal with the uncertainty case of subjective, incomplete, and vague information. Besides, it helps to solve for some situations where the information about criteria weights for alternatives is completely unknown. Therefore, this paper is adopted the information interval type-2 entropy concept into the weighting process of interval type-2 fuzzy TOPSIS. This entropy weight is believed can effectively balance the influence of uncertainty factors in evaluating attribute. Then, a modified ranking value is proposed in line with the interval type-2 entropy weight. Quantitative and qualitative factors that normally linked with flood control project are considered for ranking. Data in form of interval type-2 linguistic variables were collected from three authorised personnel of three Malaysian Government agencies. Study is considered for the whole of Malaysia. From the analysis, it shows that diversion scheme yielded the highest closeness coefficient at 0.4807. A ranking can be drawn using the magnitude of closeness coefficient. It was indicated that the diversion scheme recorded the first rank among five causes.
Toward efficient computation of the expected relative entropy for nonlinear experimental design
International Nuclear Information System (INIS)
Coles, Darrell; Prange, Michael
2012-01-01
The expected relative entropy between prior and posterior model-parameter distributions is a Bayesian objective function in experimental design theory that quantifies the expected gain in information of an experiment relative to a previous state of knowledge. The expected relative entropy is a preferred measure of experimental quality because it can handle nonlinear data-model relationships, an important fact due to the ubiquity of nonlinearity in science and engineering and its effects on post-inversion parameter uncertainty. This objective function does not necessarily yield experiments that mediate well-determined systems, but, being a Bayesian quality measure, it rigorously accounts for prior information which constrains model parameters that may be only weakly constrained by the optimized dataset. Historically, use of the expected relative entropy has been limited by the computing and storage requirements associated with high-dimensional numerical integration. Herein, a bifocal algorithm is developed that makes these computations more efficient. The algorithm is demonstrated on a medium-sized problem of sampling relaxation phenomena and on a large problem of source–receiver selection for a 2D vertical seismic profile. The method is memory intensive but workarounds are discussed. (paper)
Indian Academy of Sciences (India)
Abstract. It is shown that (i) every probability density is the unique maximizer of relative entropy in an appropriate class and (ii) in the class of all pdf f that satisfy. ∫ fhi dμ = λi for i = 1, 2,...,...k the maximizer of entropy is an f0 that is pro- portional to exp(. ∑ ci hi ) for some choice of ci . An extension of this to a continuum of.
Indian Academy of Sciences (India)
It is shown that (i) every probability density is the unique maximizer of relative entropy in an appropriate class and (ii) in the class of all pdf that satisfy ∫ f h i d = i for i = 1 , 2 , … , … k the maximizer of entropy is an f 0 that is proportional to exp ( ∑ c i h i ) for some choice of c i . An extension of this to a continuum of ...
Directory of Open Access Journals (Sweden)
Sheng Lin
2015-07-01
Full Text Available On the basis of analyzing high-voltage direct current (HVDC transmission system and its fault superimposed circuit, the direction of the fault components of the voltage and the current measured at one end of transmission line is certified to be different for internal faults and external faults. As an estimate of the differences between two signals, relative entropy is an effective parameter for recognizing transient signals in HVDC transmission lines. In this paper, the relative entropy of wavelet energy is applied to distinguish internal fault from external fault. For internal faults, the directions of fault components of voltage and current are opposite at the two ends of the transmission line, indicating a huge difference of wavelet energy relative entropy; for external faults, the directions are identical, indicating a small difference. The simulation results based on PSCAD/EMTDC show that the proposed pilot protection system acts accurately for faults under different conditions, and its performance is not affected by fault type, fault location, fault resistance and noise.
Validity of the Stokes-Einstein relation in liquids: simple rules from the excess entropy.
Pasturel, A; Jakse, N
2016-12-07
It is becoming common practice to consider that the Stokes-Einstein relation D/T~ η -1 usually works for liquids above their melting temperatures although there is also experimental evidence for its failure. Here we investigate numerically this commonly-invoked assumption for simple liquid metals as well as for their liquid alloys. Using ab initio molecular dynamics simulations we show how entropy scaling relationships developed by Rosenfeld can be used to predict the conditions for the validity of the Stokes-Einstein relation in the liquid phase. Specifically, we demonstrate the Stokes-Einstein relation may break down in the liquid phase of some liquid alloys mainly due to the presence of local structural ordering as evidenced in their partial two-body excess entropies. Our findings shed new light on the understanding of transport properties of liquid materials and will trigger more experimental and theoretical studies since excess entropy and its two-body approximation are readily obtainable from standard experiments and simulations.
Non-Gaussian Systems Control Performance Assessment Based on Rational Entropy
Directory of Open Access Journals (Sweden)
Jinglin Zhou
2018-05-01
Full Text Available Control loop Performance Assessment (CPA plays an important role in system operations. Stochastic statistical CPA index, such as a minimum variance controller (MVC-based CPA index, is one of the most widely used CPA indices. In this paper, a new minimum entropy controller (MEC-based CPA method of linear non-Gaussian systems is proposed. In this method, probability density function (PDF and rational entropy (RE are respectively used to describe the characteristics and the uncertainty of random variables. To better estimate the performance benchmark, an improved EDA algorithm, which is used to estimate the system parameters and noise PDF, is given. The effectiveness of the proposed method is illustrated through case studies on an ARMAX system.
Kuramochi, Yui; Ueda, Masahito
2015-03-01
We consider the information flow on a system observable X corresponding to a positive-operator-valued measure under a quantum measurement process Y described by a completely positive instrument from the viewpoint of the relative entropy. We establish a sufficient condition for the relative-entropy conservation law which states that the average decrease in the relative entropy of the system observable X equals the relative entropy of the measurement outcome of Y , i.e., the information gain due to measurement. This sufficient condition is interpreted as an assumption of classicality in the sense that there exists a sufficient statistic in a joint successive measurement of Y followed by X such that the probability distribution of the statistic coincides with that of a single measurement of X for the premeasurement state. We show that in the case when X is a discrete projection-valued measure and Y is discrete, the classicality condition is equivalent to the relative-entropy conservation for arbitrary states. The general theory on the relative-entropy conservation is applied to typical quantum measurement models, namely, quantum nondemolition measurement, destructive sharp measurements on two-level systems, a photon counting, a quantum counting, homodyne and heterodyne measurements. These examples except for the nondemolition and photon-counting measurements do not satisfy the known Shannon-entropy conservation law proposed by Ban [M. Ban, J. Phys. A: Math. Gen. 32, 1643 (1999), 10.1088/0305-4470/32/9/012], implying that our approach based on the relative entropy is applicable to a wider class of quantum measurements.
An 18 Moments Model for Dense Gases: Entropy and Galilean Relativity Principles without Expansions
Directory of Open Access Journals (Sweden)
M. Cristina Carrisi
2015-01-01
Full Text Available The 14 moments model for dense gases, introduced in the last few years by Arima, Taniguchi, Ruggeri and Sugiyama, is here extended up to 18 moments. They have found the closure of the balance equations up to a finite order with respect to equilibrium; it is also possible to impose for that model the entropy and Galilean relativity principles up to whatever order with respect to equilibrium, but by using Taylor’s expansion. Here, the exact solution is found, without expansions, but a bigger number of moments has to be considered and reasons will be shown suggesting that this number is at least 18.
Directory of Open Access Journals (Sweden)
Kemal Vatansever
2017-07-01
Full Text Available The revolutionary alterations and conversions occurring in information and communication technologies, have triggered an increase in the electronic commerce applications. Airline tickets are one of the most popular items purchased on the internet. The airline websites have become a big distribution channel for the companies to sustain their competitiveness. At this moment, the competition is increasing as airlines try to acquire and retain customers in the airline industry. To acquire and retain customers in such a highly competitive market, it is important for airlines to understand their relative levels of quality in terms of critical elements affecting their competitive advantages. In this study, an integrated two-stage multi-criteria decision-making techniques were used for the measurement of the performance of the airline websites using the Entropy Weight Method and the Grey Relational Analysis approach. The performance of 11 airline companies’ websites operating in Turkey was evaluated in terms of seven criteria. The data of quality website from airlines websites were taken more than 30 trails on various occasions on different periods of times. The data has been taken from 1 December 2016 to 31 December 2016. The weights of the attributes were calculated by Entropy Weight Method, the evaluation of the alternatives using the Grey Relational Analysis method were given ranking of websites.
Surface single-molecule dynamics controlled by entropy at low temperatures
Gehrig, J. C.; Penedo, M.; Parschau, M.; Schwenk, J.; Marioni, M. A.; Hudson, E. W.; Hug, H. J.
2017-02-01
Configuration transitions of individual molecules and atoms on surfaces are traditionally described using an Arrhenius equation with energy barrier and pre-exponential factor (attempt rate) parameters. Characteristic parameters can vary even for identical systems, and pre-exponential factors sometimes differ by orders of magnitude. Using low-temperature scanning tunnelling microscopy (STM) to measure an individual dibutyl sulfide molecule on Au(111), we show that the differences arise when the relative position of tip apex and molecule changes by a fraction of the molecule size. Altering the tip position on that scale modifies the transition's barrier and attempt rate in a highly correlated fashion, which results in a single-molecular enthalpy-entropy compensation. Conversely, appropriately positioning the STM tip allows selecting the operating point on the compensation line and modifying the transition rates. The results highlight the need to consider entropy in transition rates of single molecules, even at low temperatures.
An Automatic Multilevel Image Thresholding Using Relative Entropy and Meta-Heuristic Algorithms
Directory of Open Access Journals (Sweden)
Josue R. Cuevas
2013-06-01
Full Text Available Multilevel thresholding has been long considered as one of the most popular techniques for image segmentation. Multilevel thresholding outputs a gray scale image in which more details from the original picture can be kept, while binary thresholding can only analyze the image in two colors, usually black and white. However, two major existing problems with the multilevel thresholding technique are: it is a time consuming approach, i.e., finding appropriate threshold values could take an exceptionally long computation time; and defining a proper number of thresholds or levels that will keep most of the relevant details from the original image is a difficult task. In this study a new evaluation function based on the Kullback-Leibler information distance, also known as relative entropy, is proposed. The property of this new function can help determine the number of thresholds automatically. To offset the expensive computational effort by traditional exhaustive search methods, this study establishes a procedure that combines the relative entropy and meta-heuristics. From the experiments performed in this study, the proposed procedure not only provides good segmentation results when compared with a well known technique such as Otsu’s method, but also constitutes a very efficient approach.
Dirmeyer, Paul A.; Wei, Jiangfeng; Bosilovich, Michael G.; Mocko, David M.
2014-01-01
A quasi-isentropic back trajectory scheme is applied to output from the Modern Era Retrospective-analysis for Research and Applications and a land-only replay with corrected precipitation to estimate surface evaporative sources of moisture supplying precipitation over every ice-free land location for the period 1979-2005. The evaporative source patterns for any location and time period are effectively two dimensional probability distributions. As such, the evaporative sources for extreme situations like droughts or wet intervals can be compared to the corresponding climatological distributions using the method of relative entropy. Significant differences are found to be common and widespread for droughts, but not wet periods, when monthly data are examined. At pentad temporal resolution, which is more able to isolate floods and situations of atmospheric rivers, values of relative entropy over North America are typically 50-400 larger than at monthly time scales. Significant differences suggest that moisture transport may be the key to precipitation extremes. Where evaporative sources do not change significantly, it implies other local causes may underlie the extreme events.
Chaos control of ferroresonance system based on RBF-maximum entropy clustering algorithm
International Nuclear Information System (INIS)
Liu Fan; Sun Caixin; Sima Wenxia; Liao Ruijin; Guo Fei
2006-01-01
With regards to the ferroresonance overvoltage of neutral grounded power system, a maximum-entropy learning algorithm based on radial basis function neural networks is used to control the chaotic system. The algorithm optimizes the object function to derive learning rule of central vectors, and uses the clustering function of network hidden layers. It improves the regression and learning ability of neural networks. The numerical experiment of ferroresonance system testifies the effectiveness and feasibility of using the algorithm to control chaos in neutral grounded system
Entropy of Baker's Transformation
Institute of Scientific and Technical Information of China (English)
栾长福
2003-01-01
Four theorems about four different kinds of entropies for Baker's transformation are presented. The Kolmogorov entropy of Baker's transformation is sensitive to the initial flips by the time. The topological entropy of Baker's transformation is found to be log k. The conditions for the state of Baker's transformation to be forbidden are also derived. The relations among the Shanonn, Kolmogorov, topological and Boltzmann entropies are discussed in details.
Quantum dynamical entropy revisited
International Nuclear Information System (INIS)
Hudetz, T.
1996-10-01
We define a new quantum dynamical entropy, which is a 'hybrid' of the closely related, physically oriented entropy introduced by Alicki and Fannes in 1994, and of the mathematically well-developed, single-argument entropy introduced by Connes, Narnhofer and Thirring in 1987. We show that this new quantum dynamical entropy has many properties similar to the ones of the Alicki-Fannes entropy, and also inherits some additional properties from the CNT entropy. In particular, the 'hybrid' entropy interpolates between the two different ways in which both the AF and the CNT entropy of the shift automorphism on the quantum spin chain agree with the usual quantum entropy density, resulting in even better agreement. Also, the new quantum dynamical entropy generalizes the classical dynamical entropy of Kolmogorov and Sinai in the same way as does the AF entropy. Finally, we estimate the 'hybrid' entropy both for the Powers-Price shift systems and for the noncommutative Arnold map on the irrational rotation C * -algebra, leaving some interesting open problems. (author)
Directory of Open Access Journals (Sweden)
M. E. Haji Abadi
2013-09-01
Full Text Available In this paper, the continuous optimal control theory is used to model and solve the maximum entropy problem for a continuous random variable. The maximum entropy principle provides a method to obtain least-biased probability density function (Pdf estimation. In this paper, to find a closed form solution for the maximum entropy problem with any number of moment constraints, the entropy is considered as a functional measure and the moment constraints are considered as the state equations. Therefore, the Pdf estimation problem can be reformulated as the optimal control problem. Finally, the proposed method is applied to estimate the Pdf of the hourly electricity prices of New England and Ontario electricity markets. Obtained results show the efficiency of the proposed method.
Constructing a Measurement Method of Differences in Group Preferences Based on Relative Entropy
Directory of Open Access Journals (Sweden)
Shiyu Zhang
2017-01-01
Full Text Available In the research and data analysis of the differences involved in group preferences, conventional statistical methods cannot reflect the integrity and preferences of human minds; in particular, it is difficult to exclude humans’ irrational factors. This paper introduces a preference amount model based on relative entropy theory. A related expansion is made based on the characteristics of the questionnaire data, and we also construct the parameters to measure differences in the data distribution of different groups on the whole. In this paper, this parameter is called the center distance, and it effectively reflects the preferences of human minds. Using the survey data of securities market participants as an example, this paper analyzes differences in market participants’ attitudes toward the effectiveness of securities regulation. Based on this method, differences between groups that were overlooked by analysis of variance are found, and certain aspects obscured by general data characteristics are also found.
Digital Image Stabilization Method Based on Variational Mode Decomposition and Relative Entropy
Directory of Open Access Journals (Sweden)
Duo Hao
2017-11-01
Full Text Available Cameras mounted on vehicles frequently suffer from image shake due to the vehicles’ motions. To remove jitter motions and preserve intentional motions, a hybrid digital image stabilization method is proposed that uses variational mode decomposition (VMD and relative entropy (RE. In this paper, the global motion vector (GMV is initially decomposed into several narrow-banded modes by VMD. REs, which exhibit the difference of probability distribution between two modes, are then calculated to identify the intentional and jitter motion modes. Finally, the summation of the jitter motion modes constitutes jitter motions, whereas the subtraction of the resulting sum from the GMV represents the intentional motions. The proposed stabilization method is compared with several known methods, namely, medium filter (MF, Kalman filter (KF, wavelet decomposition (MD method, empirical mode decomposition (EMD-based method, and enhanced EMD-based method, to evaluate stabilization performance. Experimental results show that the proposed method outperforms the other stabilization methods.
International Nuclear Information System (INIS)
Urniezius, Renaldas
2011-01-01
The principle of Maximum relative Entropy optimization was analyzed for dead reckoning localization of a rigid body when observation data of two attached accelerometers was collected. Model constraints were derived from the relationships between the sensors. The experiment's results confirmed that accelerometers each axis' noise can be successfully filtered utilizing dependency between channels and the dependency between time series data. Dependency between channels was used for a priori calculation, and a posteriori distribution was derived utilizing dependency between time series data. There was revisited data of autocalibration experiment by removing the initial assumption that instantaneous rotation axis of a rigid body was known. Performance results confirmed that such an approach could be used for online dead reckoning localization.
Porta, Alberto; Marchi, Andrea; Bari, Vlasta; De Maria, Beatrice; Esler, Murray; Lambert, Elisabeth; Baumert, Mathias
2017-05-01
The study assesses the strength of the causal relation along baroreflex (BR) in humans during an incremental postural challenge soliciting the BR. Both cardiac BR (cBR) and sympathetic BR (sBR) were characterized via BR sequence approaches from spontaneous fluctuations of heart period (HP), systolic arterial pressure (SAP), diastolic arterial pressure (DAP) and muscle sympathetic nerve activity (MSNA). A model-based transfer entropy method was applied to quantify the strength of the coupling from SAP to HP and from DAP to MSNA. The confounding influences of respiration were accounted for. Twelve young healthy subjects (20-36 years, nine females) were sequentially tilted at 0°, 20°, 30° and 40°. We found that (i) the strength of the causal relation along the cBR increases with tilt table inclination, while that along the sBR is unrelated to it; (ii) the strength of the causal coupling is unrelated to the gain of the relation; (iii) transfer entropy indexes are significantly and positively associated with simplified causality indexes derived from BR sequence analysis. The study proves that causality indexes are complementary to traditional characterization of the BR and suggests that simple markers derived from BR sequence analysis might be fruitfully exploited to estimate causality along the BR. This article is part of the themed issue `Mathematical methods in medicine: neuroscience, cardiology and pathology'.
Effect of entropy on anomalous transport in ITG-modes of magneto-plasma
Yaqub Khan, M.; Qaiser Manzoor, M.; Haq, A. ul; Iqbal, J.
2017-04-01
The ideal gas equation and S={{c}v}log ≤ft(P/ρ \\right) (where S is entropy, P is pressure and ρ is the mass density) define the interconnection of entropy with the temperature and density of plasma. Therefore, different phenomena relating to plasma and entropy need to be investigated. By employing the Braginskii transport equations for a nonuniform electron-ion magnetoplasma, two new parameters—the entropy distribution function and the entropy gradient drift—are defined, a new dispersion relation is obtained, and the dependence of anomalous transport on entropy is also proved. Some results, like monotonicity, the entropy principle and the second law of thermodynamics, are proved with a new definition of entropy. This work will open new horizons in fusion processes, not only by controlling entropy in tokamak plasmas—particularly in the pedestal regions of the H-mode and space plasmas—but also in engineering sciences.
Volkenstein, Mikhail V
2009-01-01
The book "Entropy and Information" deals with the thermodynamical concept of entropy and its relationship to information theory. It is successful in explaining the universality of the term "Entropy" not only as a physical phenomenon, but reveals its existence also in other domains. E.g., Volkenstein discusses the "meaning" of entropy in a biological context and shows how entropy is related to artistic activities. Written by the renowned Russian bio-physicist Mikhail V. Volkenstein, this book on "Entropy and Information" surely serves as a timely introduction to understand entropy from a thermodynamic perspective and is definitely an inspiring and thought-provoking book that should be read by every physicist, information-theorist, biologist, and even artist.
Apol, M.E F; Amadei, A; Berendsen, H.J.C.
1996-01-01
In an analogous way as was done previously in the canonical ensemble, we derived for dilute gases an approximated thermodynamic closure relation in the isothermal-isobaric ensemble using quasi-Gaussian entropy theory. For the Gamma state, we formulated equations for the temperature dependence of
Quantum chaos: entropy signatures
International Nuclear Information System (INIS)
Miller, P.A.; Sarkar, S.; Zarum, R.
1998-01-01
A definition of quantum chaos is given in terms of entropy production rates for a quantum system coupled weakly to a reservoir. This allows the treatment of classical and quantum chaos on the same footing. In the quantum theory the entropy considered is the von Neumann entropy and in classical systems it is the Gibbs entropy. The rate of change of the coarse-grained Gibbs entropy of the classical system with time is given by the Kolmogorov-Sinai (KS) entropy. The relation between KS entropy and the rate of change of von Neumann entropy is investigated for the kicked rotator. For a system which is classically chaotic there is a linear relationship between these two entropies. Moreover it is possible to construct contour plots for the local KS entropy and compare it with the corresponding plots for the rate of change of von Neumann entropy. The quantitative and qualitative similarities of these plots are discussed for the standard map (kicked rotor) and the generalised cat maps. (author)
Energy Technology Data Exchange (ETDEWEB)
Liu, Yunlong; Wang, Aiping; Guo, Lei; Wang, Hong
2017-07-09
This paper presents an error-entropy minimization tracking control algorithm for a class of dynamic stochastic system. The system is represented by a set of time-varying discrete nonlinear equations with non-Gaussian stochastic input, where the statistical properties of stochastic input are unknown. By using Parzen windowing with Gaussian kernel to estimate the probability densities of errors, recursive algorithms are then proposed to design the controller such that the tracking error can be minimized. The performance of the error-entropy minimization criterion is compared with the mean-square-error minimization in the simulation results.
Transplanckian entanglement entropy
International Nuclear Information System (INIS)
Chang, Darwin; Chu, C.-S.; Lin Fengli
2004-01-01
The entanglement entropy of the event horizon is known to be plagued by the UV divergence due to the infinitely blue-shifted near horizon modes. In this Letter we calculate the entanglement entropy using the transplanckian dispersion relation, which has been proposed to model the quantum gravity effects. We show that, very generally, the entropy is rendered UV finite due to the suppression of high energy modes effected by the transplanckian dispersion relation
LQG and maximum entropy control design for the Hubble Space Telescope
Collins, Emmanuel G., Jr.; Richter, Stephen
Solar array vibrations are responsible for serious pointing control problems on the Hubble Space Telescope (HST). The original HST control law was not designed to attenuate these disturbances because they were not perceived to be a problem prior to launch. However, significant solar array vibrations do occur due to large changes in the thermal environment as the HST orbits the earth. Using classical techniques, Marshall Space Flight Center in conjunction with Lockheed Missiles and Space Company developed modified HST controllers that were able to suppress the influence of the vibrations of the solar arrays on the line-of-sight (LOS) performance. Substantial LOS improvement was observed when two of these controllers were implemented on orbit. This paper describes the development of modified HST controllers by using modern control techniques, particularly linear-quadratic-gaussian (LQG) design and Maximum Entropy robust control design, a generalization of LQG that incorporates robustness constraints with respect to modal errors. The fundamental issues are discussed candidly and controllers designed using these modern techniques are described.
Entropy-based critical reaction time for mixing-controlled reactive transport
DEFF Research Database (Denmark)
Chiogna, Gabriele; Rolle, Massimo
2017-01-01
Entropy-based metrics, such as the dilution index, have been proposed to quantify dilution and reactive mixing in solute transport problems. In this work, we derive the transient advection dispersion equation for the entropy density of a reactive plume. We restrict our analysis to the case where...... the concentration distribution of the transported species is Gaussian and we observe that, even in case of an instantaneous complete bimolecular reaction, dilution caused by dispersive processes dominates the entropy balance at early times and results in the net increase of the entropy density of a reactive species...
Adjoint entropy vs topological entropy
Giordano Bruno, Anna
2012-01-01
Recently the adjoint algebraic entropy of endomorphisms of abelian groups was introduced and studied. We generalize the notion of adjoint entropy to continuous endomorphisms of topological abelian groups. Indeed, the adjoint algebraic entropy is defined using the family of all finite-index subgroups, while we take only the subfamily of all open finite-index subgroups to define the topological adjoint entropy. This allows us to compare the (topological) adjoint entropy with the known topologic...
Coarse-graining using the relative entropy and simplex-based optimization methods in VOTCA
Rühle, Victor; Jochum, Mara; Koschke, Konstantin; Aluru, N. R.; Kremer, Kurt; Mashayak, S. Y.; Junghans, Christoph
2014-03-01
Coarse-grained (CG) simulations are an important tool to investigate systems on larger time and length scales. Several methods for systematic coarse-graining were developed, varying in complexity and the property of interest. Thus, the question arises which method best suits a specific class of system and desired application. The Versatile Object-oriented Toolkit for Coarse-graining Applications (VOTCA) provides a uniform platform for coarse-graining methods and allows for their direct comparison. We present recent advances of VOTCA, namely the implementation of the relative entropy method and downhill simplex optimization for coarse-graining. The methods are illustrated by coarse-graining SPC/E bulk water and a water-methanol mixture. Both CG models reproduce the pair distributions accurately. SYM is supported by AFOSR under grant 11157642 and by NSF under grant 1264282. CJ was supported in part by the NSF PHY11-25915 at KITP. K. Koschke acknowledges funding by the Nestle Research Center.
Maximum Quantum Entropy Method
Sim, Jae-Hoon; Han, Myung Joon
2018-01-01
Maximum entropy method for analytic continuation is extended by introducing quantum relative entropy. This new method is formulated in terms of matrix-valued functions and therefore invariant under arbitrary unitary transformation of input matrix. As a result, the continuation of off-diagonal elements becomes straightforward. Without introducing any further ambiguity, the Bayesian probabilistic interpretation is maintained just as in the conventional maximum entropy method. The applications o...
2015-09-29
antiferroelectrics. Phys. Rev. Lett. 110, 017603 (2013). 22. Cantor , B., Chang, I., Knight, P. & Vincent, A. Microstructural development in equiatomic...Science 345, 1153–1158 (2014). 24. Gali, A. & George , E. Tensile properties of high- and medium-entropy alloys. Intermetallics 39, 74–78 (2013). 25...148–153 (2014). 26. Otto, F., Yang, Y., Bei, H. & George , E. Relative effects of enthalpy and entropy on the phase stability of equiatomic high-entropy
Entropy concentration and the empirical coding game
Grünwald, P.D.
2008-01-01
We give a characterization of maximum entropy/minimum relative entropy inference by providing two 'strong entropy concentration' theorems. These theorems unify and generalize Jaynes''concentration phenomenon' and Van Campenhout and Cover's 'conditional limit theorem'. The theorems characterize
Bullwhip Entropy Analysis and Chaos Control in the Supply Chain with Sales Game and Consumer Returns
Directory of Open Access Journals (Sweden)
Wandong Lou
2017-02-01
Full Text Available In this paper, we study a supply chain system which consists of one manufacturer and two retailers including a traditional retailer and an online retailer. In order to gain a larger market share, the retailers often take the sales as a decision-making variable in the competition game. We devote ourselves to analyze the bullwhip effect in the supply chain with sales game and consumer returns via the theory of entropy and complexity and take the delayed feedback control method to control the system’s chaotic state. The impact of a statutory 7-day no reason for return policy for online retailers is also investigated. The bounded rational expectation is adopt to forecast the future demand in the sales game system with weak noise. Our results show that high return rates will hurt the profits of both the retailers and the adjustment speed of the bounded rational sales expectation has an important impact on the bullwhip effect. There is a stable area for retailers where the bullwhip effect doesn’t appear. The supply chain system suffers a great bullwhip effect in the quasi-periodic state and the quasi-chaotic state. The purpose of chaos control on the sales game can be achieved and the bullwhip effect would be effectively mitigated by using the delayed feedback control method.
Wu, Jun; Li, Chengbing; Huo, Yueying
2014-01-01
Safety of dangerous goods transport is directly related to the operation safety of dangerous goods transport enterprise. Aiming at the problem of the high accident rate and large harm in dangerous goods logistics transportation, this paper took the group decision making problem based on integration and coordination thought into a multiagent multiobjective group decision making problem; a secondary decision model was established and applied to the safety assessment of dangerous goods transport enterprise. First of all, we used dynamic multivalue background and entropy theory building the first level multiobjective decision model. Secondly, experts were to empower according to the principle of clustering analysis, and combining with the relative entropy theory to establish a secondary rally optimization model based on relative entropy in group decision making, and discuss the solution of the model. Then, after investigation and analysis, we establish the dangerous goods transport enterprise safety evaluation index system. Finally, case analysis to five dangerous goods transport enterprises in the Inner Mongolia Autonomous Region validates the feasibility and effectiveness of this model for dangerous goods transport enterprise recognition, which provides vital decision making basis for recognizing the dangerous goods transport enterprises.
Directory of Open Access Journals (Sweden)
Cassio Neri
2014-05-01
Full Text Available We study the problem of finding probability densities that match given European call option prices. To allow prior information about such a density to be taken into account, we generalise the algorithm presented in Neri and Schneider (Appl. Math. Finance 2013 to find the maximum entropy density of an asset price to the relative entropy case. This is applied to study the impact of the choice of prior density in two market scenarios. In the first scenario, call option prices are prescribed at only a small number of strikes, and we see that the choice of prior, or indeed its omission, yields notably different densities. The second scenario is given by CBOE option price data for S&P500 index options at a large number of strikes. Prior information is now considered to be given by calibrated Heston, Schöbel–Zhu or Variance Gamma models. We find that the resulting digital option prices are essentially the same as those given by the (non-relative Buchen–Kelly density itself. In other words, in a sufficiently liquid market, the influence of the prior density seems to vanish almost completely. Finally, we study variance swaps and derive a simple formula relating the fair variance swap rate to entropy. Then we show, again, that the prior loses its influence on the fair variance swap rate as the number of strikes increases.
Directory of Open Access Journals (Sweden)
Adom Giffin
2014-09-01
Full Text Available In this paper, we continue our efforts to show how maximum relative entropy (MrE can be used as a universal updating algorithm. Here, our purpose is to tackle a joint state and parameter estimation problem where our system is nonlinear and in a non-equilibrium state, i.e., perturbed by varying external forces. Traditional parameter estimation can be performed by using filters, such as the extended Kalman filter (EKF. However, as shown with a toy example of a system with first order non-homogeneous ordinary differential equations, assumptions made by the EKF algorithm (such as the Markov assumption may not be valid. The problem can be solved with exponential smoothing, e.g., exponentially weighted moving average (EWMA. Although this has been shown to produce acceptable filtering results in real exponential systems, it still cannot simultaneously estimate both the state and its parameters and has its own assumptions that are not always valid, for example when jump discontinuities exist. We show that by applying MrE as a filter, we can not only develop the closed form solutions, but we can also infer the parameters of the differential equation simultaneously with the means. This is useful in real, physical systems, where we want to not only filter the noise from our measurements, but we also want to simultaneously infer the parameters of the dynamics of a nonlinear and non-equilibrium system. Although there were many assumptions made throughout the paper to illustrate that EKF and exponential smoothing are special cases ofMrE, we are not “constrained”, by these assumptions. In other words, MrE is completely general and can be used in broader ways.
Energy Technology Data Exchange (ETDEWEB)
Molotkov, S. N., E-mail: sergei.molotkov@gmail.com [Russian Federation, Academy of Cryptography (Russian Federation)
2012-12-15
Any key-generation session contains a finite number of quantum-state messages, and it is there-fore important to understand the fundamental restrictions imposed on the minimal length of a string required to obtain a secret key with a specified length. The entropy uncertainty relations for smooth min and max entropies considerably simplify and shorten the proof of security. A proof of security of quantum key distribution with phase-temporal encryption is presented. This protocol provides the maximum critical error compared to other protocols up to which secure key distribution is guaranteed. In addition, unlike other basic protocols (of the BB84 type), which are vulnerable with respect to an attack by 'blinding' of avalanche photodetectors, this protocol is stable with respect to such an attack and guarantees key security.
International Nuclear Information System (INIS)
Molotkov, S. N.
2012-01-01
Any key-generation session contains a finite number of quantum-state messages, and it is there-fore important to understand the fundamental restrictions imposed on the minimal length of a string required to obtain a secret key with a specified length. The entropy uncertainty relations for smooth min and max entropies considerably simplify and shorten the proof of security. A proof of security of quantum key distribution with phase-temporal encryption is presented. This protocol provides the maximum critical error compared to other protocols up to which secure key distribution is guaranteed. In addition, unlike other basic protocols (of the BB84 type), which are vulnerable with respect to an attack by “blinding” of avalanche photodetectors, this protocol is stable with respect to such an attack and guarantees key security.
Directory of Open Access Journals (Sweden)
Mifeng Ren
2014-01-01
Full Text Available This paper considers the neural network controller design problem for variable pitch wind energy conversion systems (WECS with non-Gaussian wind speed disturbances in the stochastic distribution control framework. The approach here is used to directly model the unknown control law based on a fixed neural network (the number of layers and nodes in a neural network is fixed without the need to construct a separate model for the WECS. In order to characterize the randomness of the WECS, a generalized minimum entropy criterion is established to train connection weights of the neural network. For the train purpose, both kernel density estimation method and sliding window technique are adopted to estimate the PDF of tracking error and entropies. Due to the unknown process dynamics, the gradient of the objective function in a gradient-descent-type algorithm is estimated using an incremental perturbation method. The proposed approach is illustrated on a simulated WECS with non-Gaussian wind speed.
Nonsymmetric entropy and maximum nonsymmetric entropy principle
International Nuclear Information System (INIS)
Liu Chengshi
2009-01-01
Under the frame of a statistical model, the concept of nonsymmetric entropy which generalizes the concepts of Boltzmann's entropy and Shannon's entropy, is defined. Maximum nonsymmetric entropy principle is proved. Some important distribution laws such as power law, can be derived from this principle naturally. Especially, nonsymmetric entropy is more convenient than other entropy such as Tsallis's entropy in deriving power laws.
Energy Technology Data Exchange (ETDEWEB)
Bao, Ning [Institute for Quantum Information and Matter, California Institute of Technology,Pasadena, CA 91125 (United States); Walter Burke Institute for Theoretical Physics, California Institute of Technology,452-48, Pasadena, CA 91125 (United States); Nezami, Sepehr [Stanford Institute for Theoretical Physics, Stanford University,Stanford, CA 94305 (United States); Ooguri, Hirosi [Walter Burke Institute for Theoretical Physics, California Institute of Technology,452-48, Pasadena, CA 91125 (United States); Kavli Institute for the Physics and Mathematics of the Universe, University of Tokyo,Kashiwa 277-8583 (Japan); Stoica, Bogdan [Walter Burke Institute for Theoretical Physics, California Institute of Technology,452-48, Pasadena, CA 91125 (United States); Sully, James [Theory Group, SLAC National Accelerator Laboratory, Stanford University,Menlo Park, CA 94025 (United States); Walter, Michael [Stanford Institute for Theoretical Physics, Stanford University,Stanford, CA 94305 (United States)
2015-09-21
We initiate a systematic enumeration and classification of entropy inequalities satisfied by the Ryu-Takayanagi formula for conformal field theory states with smooth holographic dual geometries. For 2, 3, and 4 regions, we prove that the strong subadditivity and the monogamy of mutual information give the complete set of inequalities. This is in contrast to the situation for generic quantum systems, where a complete set of entropy inequalities is not known for 4 or more regions. We also find an infinite new family of inequalities applicable to 5 or more regions. The set of all holographic entropy inequalities bounds the phase space of Ryu-Takayanagi entropies, defining the holographic entropy cone. We characterize this entropy cone by reducing geometries to minimal graph models that encode the possible cutting and gluing relations of minimal surfaces. We find that, for a fixed number of regions, there are only finitely many independent entropy inequalities. To establish new holographic entropy inequalities, we introduce a combinatorial proof technique that may also be of independent interest in Riemannian geometry and graph theory.
International Nuclear Information System (INIS)
Bao, Ning; Nezami, Sepehr; Ooguri, Hirosi; Stoica, Bogdan; Sully, James; Walter, Michael
2015-01-01
We initiate a systematic enumeration and classification of entropy inequalities satisfied by the Ryu-Takayanagi formula for conformal field theory states with smooth holographic dual geometries. For 2, 3, and 4 regions, we prove that the strong subadditivity and the monogamy of mutual information give the complete set of inequalities. This is in contrast to the situation for generic quantum systems, where a complete set of entropy inequalities is not known for 4 or more regions. We also find an infinite new family of inequalities applicable to 5 or more regions. The set of all holographic entropy inequalities bounds the phase space of Ryu-Takayanagi entropies, defining the holographic entropy cone. We characterize this entropy cone by reducing geometries to minimal graph models that encode the possible cutting and gluing relations of minimal surfaces. We find that, for a fixed number of regions, there are only finitely many independent entropy inequalities. To establish new holographic entropy inequalities, we introduce a combinatorial proof technique that may also be of independent interest in Riemannian geometry and graph theory.
A Critical Review of High Entropy Alloys and Related Concepts (Postprint)
2016-10-21
1301e1305. [306] C. Huang, Y.Z. Zhang, R. Vilar, J.Y. Shen, Dry sliding wear behavior of laser clad TiVCrAlSi high entropy alloy coatings on Ti-6Al...Res. 652e654 (2013) 1115e1118. [313] C. Huang, Y. Zhang, J. Shen, R. Vilar, Thermal stability and oxidation resis- tance of laser clad TiVCrAlSi high...Section 7.1.3). Finally, it is not always true that SS alloys are ductile. Well-known examples include b- titanium alloys, a- titanium alloys with small
Tsallis-like entropies in quantum scattering
International Nuclear Information System (INIS)
Ion, D.B.; Ion, M.L.
1998-01-01
In this work, the following entropies in quantum scattering are defined: the informational angular entropy, S θ ; Tsallis-like angular entropies, S q (θ); the angular momentum entropy, S L ; the Tsallis-like angular momentum entropies, S q (L); the angle-angular momentum entropy, S θL . These entropies are defined as natural measures of the uncertainties corresponding to the distribution probabilities. If we are interested in obtaining a measure of uncertainty of the simultaneous realization of the probability distributions, than, we have to calculate the entropy corresponding to these distributions. The expression of angle-angular momentum entropy is given. The relation between the Tsallis entropies and the angle-angular momentum entropy is derived
DEFF Research Database (Denmark)
Müller-Lennert, Martin; Dupont-Dupuis, Fréderic; Szehr, Oleg
2013-01-01
The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in in...
International Nuclear Information System (INIS)
Elloumi, I.; Bouhdima, M.S.
2002-01-01
A new approach in the survey of the performances of gamma camera based on the entropy associated to the scintigraphic acquisition is presented. We take into account the sensitivity, the variation of the collimator response in function of the depth, the uncertainty on the number of counts, the multiplex effect and the spatial uncertainty. This entropy function is expressed in function of all the acquisition parameters: intrinsic crystal resolution, collimator characteristics, emitter object parameters and the source activity. The application of this method to the study of the influence of the collimation shows that the entropy associated to a collimator permits a best appreciation of the quality of the acquisition and therefore a better analysis of collimator performances. Likewise, the evolution of the entropy associated to the acquisition of a uniform source image is in agreement with the variation of the quality of image histogram. One shows, thus, that nor the spatial resolution, nor the sensitivity and nor the signal to noise ratio are able detect a variation of the image quality, when analysed one by one. (author)
Directory of Open Access Journals (Sweden)
Leonid M. Martyushev
2015-06-01
Full Text Available The entropy production (inside the volume bounded by a photosphere of main-sequence stars, subgiants, giants, and supergiants is calculated based on B–V photometry data. A non-linear inverse relationship of thermodynamic fluxes and forces as well as an almost constant specific (per volume entropy production of main-sequence stars (for 95% of stars, this quantity lies within 0.5 to 2.2 of the corresponding solar magnitude is found. The obtained results are discussed from the perspective of known extreme principles related to entropy production.
Entropy equilibrium equation and dynamic entropy production in environment liquid
Institute of Scientific and Technical Information of China (English)
无
2002-01-01
The entropy equilibrium equation is the basis of the nonequilibrium state thermodynamics. But the internal energy implies the kinetic energy of the fluid micelle relative to mass center in the classical entropy equilibrium equation at present. This internal energy is not the mean kinetic energy of molecular movement in thermodynamics. Here a modified entropy equilibrium equation is deduced, based on the concept that the internal energy is just the mean kinetic energy of the molecular movement. A dynamic entropy production is introduced into the entropy equilibrium equation to describe the dynamic process distinctly. This modified entropy equilibrium equation can describe not only the entropy variation of the irreversible processes but also the reversible processes in a thermodynamic system. It is more reasonable and suitable for wider applications.
Black hole thermodynamical entropy
International Nuclear Information System (INIS)
Tsallis, Constantino; Cirto, Leonardo J.L.
2013-01-01
As early as 1902, Gibbs pointed out that systems whose partition function diverges, e.g. gravitation, lie outside the validity of the Boltzmann-Gibbs (BG) theory. Consistently, since the pioneering Bekenstein-Hawking results, physically meaningful evidence (e.g., the holographic principle) has accumulated that the BG entropy S BG of a (3+1) black hole is proportional to its area L 2 (L being a characteristic linear length), and not to its volume L 3 . Similarly it exists the area law, so named because, for a wide class of strongly quantum-entangled d-dimensional systems, S BG is proportional to lnL if d=1, and to L d-1 if d>1, instead of being proportional to L d (d ≥ 1). These results violate the extensivity of the thermodynamical entropy of a d-dimensional system. This thermodynamical inconsistency disappears if we realize that the thermodynamical entropy of such nonstandard systems is not to be identified with the BG additive entropy but with appropriately generalized nonadditive entropies. Indeed, the celebrated usefulness of the BG entropy is founded on hypothesis such as relatively weak probabilistic correlations (and their connections to ergodicity, which by no means can be assumed as a general rule of nature). Here we introduce a generalized entropy which, for the Schwarzschild black hole and the area law, can solve the thermodynamic puzzle. (orig.)
The different paths to entropy
International Nuclear Information System (INIS)
Benguigui, L
2013-01-01
In order to understand how the complex concept of entropy emerged, we propose a trip into the past, reviewing the works of Clausius, Boltzmann, Gibbs and Planck. In particular, since Gibbs's work is not very well known we present a detailed analysis, recalling the three definitions of entropy that Gibbs gives. The introduction of entropy in quantum mechanics gives in a compact form all the classical definitions of entropy. Perhaps one of the most important aspects of entropy is to see it as a thermodynamic potential like the others proposed by Callen. The calculation of fluctuations in thermodynamic quantities is thus naturally related to entropy. We close with some remarks on entropy and irreversibility. (paper)
Gulamsarwar, Syazwani; Salleh, Zabidin
2017-08-01
The purpose of this paper is to generalize the notions of Adler's topological entropy along with their several fundamental properties. A function f : X → Y is said to be R-map if f-1 (V) is regular open in X for every regular open set V in Y. Thus, we initiated a notion of topological nearly entropy for topological R-dynamical systems which is based on nearly compact relative to the space by using R-map.
Yang, Robin C K; Huang, Jonathan T B; Chien, Shih-Chuan; Huang, Roy; Jeng, Kee-Ching G; Chen, Yen-Chung; Liao, Mokai; Wu, Jia-Rong; Hung, Wei-Kang; Hung, Chia-Chun; Chen, Yu-Ling; Waring, Michael J; Sheh, Leung
2013-01-07
This study aims to interpret the energetic basis of complex DNA-peptide interactions according to a novel allosteric interaction network approach. In common with other designed peptides, five new conjugates incorporating the XPRK or XHypRK motif (Hyp = hydroxyproline) attached to a N-methylpyrrole (Py) tract with a basic tail have been found to display cooperative binding to DNA involving multiple monodentate as well as interstrand bidentate interactions. Using quantitative DNase I footprinting it appears that allosteric communication via cooperative binding to multiple sites on complementary DNA strands corresponds to two different types of DNA-peptide interaction network. Temperature variation experiments using a dodecapeptide RY-12 show that lower temperature (25 °C) favor a circuit type of allosteric interaction network, whereas higher temperatures (31 and 37 °C) afford only a partial-circuit type of network. Circular dichroism studies show that our five peptides induce significant local conformational changes in DNA via the minor groove, with apparently dimeric binding stoichiometry. Isothermal titration calorimetry reveals that these peptides, together with another seven for comparison, are strongly exothermic upon binding to a model 13-mer DNA duplex, characterized by ΔH ranging from -14.7 to -74.4 kcal mol(-1), and also high TΔS ranging from -6.5 to -65.9 kcal mol(-1). Multiple monodentate and bidentate interactions, as well as ionic forces that mediate positive cooperativity in sequence recognition, are consistent with a dramatic decrease in entropy and a 'tightening' effect of DNA conformation. Distinctive enthalpy-entropy compensation (EEC) relationships are demonstrated for the interaction of all twelve designed peptides with DNA, affording a straight line of slope close to unity when ΔH is plotted versus TΔS, with a y-axis intercept (average ΔG) corresponding to -8.5 kcal mol(-1), while the observed ΔG ranges from -8.2 to -9.1 kcal mol(-1) for
Directory of Open Access Journals (Sweden)
Tommaso Toffoli
2016-06-01
Full Text Available Here we deconstruct, and then in a reasoned way reconstruct, the concept of “entropy of a system”, paying particular attention to where the randomness may be coming from. We start with the core concept of entropy as a count associated with a description; this count (traditionally expressed in logarithmic form for a number of good reasons is in essence the number of possibilities—specific instances or “scenarios”—that match that description. Very natural (and virtually inescapable generalizations of the idea of description are the probability distribution and its quantum mechanical counterpart, the density operator. We track the process of dynamically updating entropy as a system evolves. Three factors may cause entropy to change: (1 the system’s internal dynamics; (2 unsolicited external influences on it; and (3 the approximations one has to make when one tries to predict the system’s future state. The latter task is usually hampered by hard-to-quantify aspects of the original description, limited data storage and processing resource, and possibly algorithmic inadequacy. Factors 2 and 3 introduce randomness—often huge amounts of it—into one’s predictions and accordingly degrade them. When forecasting, as long as the entropy bookkeping is conducted in an honest fashion, this degradation will always lead to an entropy increase. To clarify the above point we introduce the notion of honest entropy, which coalesces much of what is of course already done, often tacitly, in responsible entropy-bookkeping practice. This notion—we believe—will help to fill an expressivity gap in scientific discourse. With its help, we shall prove that any dynamical system—not just our physical universe—strictly obeys Clausius’s original formulation of the second law of thermodynamics if and only if it is invertible. Thus this law is a tautological property of invertible systems!
Directory of Open Access Journals (Sweden)
Oliver Faugeras
2014-12-01
Full Text Available In this paper we derive an integral (with respect to time representation of the relative entropy (or Kullback–Leibler Divergence R(μ||P, where μ and P are measures on C([0,T];Rd. The underlying measure P is a weak solution to a martingale problem with continuous coefficients. Our representation is in the form of an integral with respect to its infinitesimal generator. This representation is of use in statistical inference (particularly involving medical imaging. Since R(μ||P governs the exponential rate of convergence of the empirical measure (according to Sanov’s theorem, this representation is also of use in the numerical and analytical investigation of finite-size effects in systems of interacting diffusions.
Entropy, matter, and cosmology.
Prigogine, I; Géhéniau, J
1986-09-01
The role of irreversible processes corresponding to creation of matter in general relativity is investigated. The use of Landau-Lifshitz pseudotensors together with conformal (Minkowski) coordinates suggests that this creation took place in the early universe at the stage of the variation of the conformal factor. The entropy production in this creation process is calculated. It is shown that these dissipative processes lead to the possibility of cosmological models that start from empty conditions and gradually build up matter and entropy. Gravitational entropy takes a simple meaning as associated to the entropy that is necessary to produce matter. This leads to an extension of the third law of thermodynamics, as now the zero point of entropy becomes the space-time structure out of which matter is generated. The theory can be put into a convenient form using a supplementary "C" field in Einstein's field equations. The role of the C field is to express the coupling between gravitation and matter leading to irreversible entropy production.
Directory of Open Access Journals (Sweden)
Li Pan
2016-03-01
Full Text Available Virtualization technologies make it possible for cloud providers to consolidate multiple IaaS provisions into a single server in the form of virtual machines (VMs. Additionally, in order to fulfill the divergent service requirements from multiple users, a cloud provider needs to offer several types of VM instances, which are associated with varying configurations and performance, as well as different prices. In such a heterogeneous virtual machine placement process, one significant problem faced by a cloud provider is how to optimally accept and place multiple VM service requests into its cloud data centers to achieve revenue maximization. To address this issue, in this paper, we first formulate such a revenue maximization problem during VM admission control as a multiple-dimensional knapsack problem, which is known to be NP-hard to solve. Then, we propose to use a cross-entropy-based optimization approach to address this revenue maximization problem, by obtaining a near-optimal eligible set for the provider to accept into its data centers, from the waiting VM service requests in the system. Finally, through extensive experiments and measurements in a simulated environment with the settings of VM instance classes derived from real-world cloud systems, we show that our proposed cross-entropy-based admission control optimization algorithm is efficient and effective in maximizing cloud providers’ revenue in a public cloud computing environment.
Entropy for Mechanically Vibrating Systems
Tufano, Dante
The research contained within this thesis deals with the subject of entropy as defined for and applied to mechanically vibrating systems. This work begins with an overview of entropy as it is understood in the fields of classical thermodynamics, information theory, statistical mechanics, and statistical vibroacoustics. Khinchin's definition of entropy, which is the primary definition used for the work contained in this thesis, is introduced in the context of vibroacoustic systems. The main goal of this research is to to establish a mathematical framework for the application of Khinchin's entropy in the field of statistical vibroacoustics by examining the entropy context of mechanically vibrating systems. The introduction of this thesis provides an overview of statistical energy analysis (SEA), a modeling approach to vibroacoustics that motivates this work on entropy. The objective of this thesis is given, and followed by a discussion of the intellectual merit of this work as well as a literature review of relevant material. Following the introduction, an entropy analysis of systems of coupled oscillators is performed utilizing Khinchin's definition of entropy. This analysis develops upon the mathematical theory relating to mixing entropy, which is generated by the coupling of vibroacoustic systems. The mixing entropy is shown to provide insight into the qualitative behavior of such systems. Additionally, it is shown that the entropy inequality property of Khinchin's entropy can be reduced to an equality using the mixing entropy concept. This equality can be interpreted as a facet of the second law of thermodynamics for vibroacoustic systems. Following this analysis, an investigation of continuous systems is performed using Khinchin's entropy. It is shown that entropy analyses using Khinchin's entropy are valid for continuous systems that can be decomposed into a finite number of modes. The results are shown to be analogous to those obtained for simple oscillators
Ricotta, Carlo
2003-01-01
Traditional diversity measures such as the Shannon entropy are generally computed from the species' relative abundance vector of a given community to the exclusion of species' absolute abundances. In this paper, I first mention some examples where the total information content associated with a given community may be more adequate than Shannon's average information content for a better understanding of ecosystem functioning. Next, I propose a parametric measure of statistical information that contains both Shannon's entropy and total information content as special cases of this more general function.
Directory of Open Access Journals (Sweden)
Matthias Weippert
2014-10-01
Full Text Available Nonlinear parameters of heart rate variability (HRV have proven their prognostic value in clinical settings, but their physiological background is not very well established. We assessed the effects of low intensity isometric (ISO and dynamic (DYN exercise of the lower limbs on heart rate matched intensity on traditional and entropy measures of HRV. Due to changes of afferent feedback under DYN and ISO a distinct autonomic response, mirrored by HRV measures, was hypothesized. Five-minute inter-beat interval measurements of 43 healthy males (26.0 ± 3.1 years were performed during rest, DYN and ISO in a randomized order. Blood pressures and rate pressure product were higher during ISO vs. DYN (p < 0.001. HRV indicators SDNN as well as low and high frequency power were significantly higher during ISO (p < 0.001 for all measures. Compared to DYN, sample entropy (SampEn was lower during ISO (p < 0.001. Concluding, contraction mode itself is a significant modulator of the autonomic cardiovascular response to exercise. Compared to DYN, ISO evokes a stronger blood pressure response and an enhanced interplay between both autonomic branches. Non-linear HRV measures indicate a more regular behavior under ISO. Results support the view of the reciprocal antagonism being only one of many modes of autonomic heart rate control. Under different conditions; the identical “end product” heart rate might be achieved by other modes such as sympathovagal co-activation as well.
Directory of Open Access Journals (Sweden)
Junhai Ma
2016-11-01
Full Text Available In this research, a model is established to represent a supply chain, which consists of one manufacturer and two retailers. The price-sensitive demand model is considered and the price game system is built according to the rule of bounded rationality as well as the entropy theory. With the increase of the price adjustment speed, the game system may go into chaos from the stable and periodic state. The bullwhip effect and inventory variance ratio of different stages that the system falls in are compared in real time. We also employ the delayed feedback control method to control the system and succeed in mitigating the bullwhip effect of the system. On the whole, the bullwhip effect and inventory variance ratio in the stable state are smaller than those in period-doubling and chaos. In the stable state, there is an optimal price adjustment speed to obtain both the lowest bullwhip effect and inventory variance ratio.
Wavelet entropy of BOLD time series: An application to Rolandic epilepsy.
Gupta, Lalit; Jansen, Jacobus F A; Hofman, Paul A M; Besseling, René M H; de Louw, Anton J A; Aldenkamp, Albert P; Backes, Walter H
2017-12-01
To assess the wavelet entropy for the characterization of intrinsic aberrant temporal irregularities in the time series of resting-state blood-oxygen-level-dependent (BOLD) signal fluctuations. Further, to evaluate the temporal irregularities (disorder/order) on a voxel-by-voxel basis in the brains of children with Rolandic epilepsy. The BOLD time series was decomposed using the discrete wavelet transform and the wavelet entropy was calculated. Using a model time series consisting of multiple harmonics and nonstationary components, the wavelet entropy was compared with Shannon and spectral (Fourier-based) entropy. As an application, the wavelet entropy in 22 children with Rolandic epilepsy was compared to 22 age-matched healthy controls. The images were obtained by performing resting-state functional magnetic resonance imaging (fMRI) using a 3T system, an 8-element receive-only head coil, and an echo planar imaging pulse sequence ( T2*-weighted). The wavelet entropy was also compared to spectral entropy, regional homogeneity, and Shannon entropy. Wavelet entropy was found to identify the nonstationary components of the model time series. In Rolandic epilepsy patients, a significantly elevated wavelet entropy was observed relative to controls for the whole cerebrum (P = 0.03). Spectral entropy (P = 0.41), regional homogeneity (P = 0.52), and Shannon entropy (P = 0.32) did not reveal significant differences. The wavelet entropy measure appeared more sensitive to detect abnormalities in cerebral fluctuations represented by nonstationary effects in the BOLD time series than more conventional measures. This effect was observed in the model time series as well as in Rolandic epilepsy. These observations suggest that the brains of children with Rolandic epilepsy exhibit stronger nonstationary temporal signal fluctuations than controls. 2 Technical Efficacy: Stage 3 J. Magn. Reson. Imaging 2017;46:1728-1737. © 2017 International Society for Magnetic
Entropy Production in Stochastics
Directory of Open Access Journals (Sweden)
Demetris Koutsoyiannis
2017-10-01
Full Text Available While the modern definition of entropy is genuinely probabilistic, in entropy production the classical thermodynamic definition, as in heat transfer, is typically used. Here we explore the concept of entropy production within stochastics and, particularly, two forms of entropy production in logarithmic time, unconditionally (EPLT or conditionally on the past and present having been observed (CEPLT. We study the theoretical properties of both forms, in general and in application to a broad set of stochastic processes. A main question investigated, related to model identification and fitting from data, is how to estimate the entropy production from a time series. It turns out that there is a link of the EPLT with the climacogram, and of the CEPLT with two additional tools introduced here, namely the differenced climacogram and the climacospectrum. In particular, EPLT and CEPLT are related to slopes of log-log plots of these tools, with the asymptotic slopes at the tails being most important as they justify the emergence of scaling laws of second-order characteristics of stochastic processes. As a real-world application, we use an extraordinary long time series of turbulent velocity and show how a parsimonious stochastic model can be identified and fitted using the tools developed.
Upper entropy axioms and lower entropy axioms
International Nuclear Information System (INIS)
Guo, Jin-Li; Suo, Qi
2015-01-01
The paper suggests the concepts of an upper entropy and a lower entropy. We propose a new axiomatic definition, namely, upper entropy axioms, inspired by axioms of metric spaces, and also formulate lower entropy axioms. We also develop weak upper entropy axioms and weak lower entropy axioms. Their conditions are weaker than those of Shannon–Khinchin axioms and Tsallis axioms, while these conditions are stronger than those of the axiomatics based on the first three Shannon–Khinchin axioms. The subadditivity and strong subadditivity of entropy are obtained in the new axiomatics. Tsallis statistics is a special case of satisfying our axioms. Moreover, different forms of information measures, such as Shannon entropy, Daroczy entropy, Tsallis entropy and other entropies, can be unified under the same axiomatics
On S-mixing entropy of quantum channels
Mukhamedov, Farrukh; Watanabe, Noboru
2018-06-01
In this paper, an S-mixing entropy of quantum channels is introduced as a generalization of Ohya's S-mixing entropy. We investigate several properties of the introduced entropy. Moreover, certain relations between the S-mixing entropy and the existing map and output entropies of quantum channels are investigated as well. These relations allowed us to find certain connections between separable states and the introduced entropy. Hence, there is a sufficient condition to detect entangled states. Moreover, several properties of the introduced entropy are investigated. Besides, entropies of qubit and phase-damping channels are calculated.
The Wehrl entropy has Gaussian optimizers
DEFF Research Database (Denmark)
De Palma, Giacomo
2018-01-01
We determine the minimum Wehrl entropy among the quantum states with a given von Neumann entropy and prove that it is achieved by thermal Gaussian states. This result determines the relation between the von Neumann and the Wehrl entropies. The key idea is proving that the quantum-classical channel...
Thermostatistical aspects of generalized entropies
International Nuclear Information System (INIS)
Fa, K.S.; Lenzi, E.K.
2004-01-01
We investigate the properties concerning a class of generalized entropies given by S q,r =k{1-[Σ i p i q ] r }/[r(q-1)] which include Tsallis' entropy (r=1), the usual Boltzmann-Gibbs entropy (q=1), Renyi's entropy (r=0) and normalized Tsallis' entropy (r=-1). In order to obtain the generalized thermodynamic relations we use the laws of thermodynamics and considering the hypothesis that the joint probability of two independent systems is given by p ij A c upB =p i A p j B . We show that the transmutation which occurs from Tsallis' entropy to Renyi's entropy also occur with S q,r . In this scenario, we also analyze the generalized variance, covariance and correlation coefficient of a non-interacting system by using extended optimal Lagrange multiplier approach. We show that the correlation coefficient tends to zero in the thermodynamic limit. However, Renyi's entropy related to this non-interacting system presents a certain degree of non-extensivity
International Nuclear Information System (INIS)
Sanyal, Tanmoy; Shell, M. Scott
2016-01-01
Bottom-up multiscale techniques are frequently used to develop coarse-grained (CG) models for simulations at extended length and time scales but are often limited by a compromise between computational efficiency and accuracy. The conventional approach to CG nonbonded interactions uses pair potentials which, while computationally efficient, can neglect the inherently multibody contributions of the local environment of a site to its energy, due to degrees of freedom that were coarse-grained out. This effect often causes the CG potential to depend strongly on the overall system density, composition, or other properties, which limits its transferability to states other than the one at which it was parameterized. Here, we propose to incorporate multibody effects into CG potentials through additional nonbonded terms, beyond pair interactions, that depend in a mean-field manner on local densities of different atomic species. This approach is analogous to embedded atom and bond-order models that seek to capture multibody electronic effects in metallic systems. We show that the relative entropy coarse-graining framework offers a systematic route to parameterizing such local density potentials. We then characterize this approach in the development of implicit solvation strategies for interactions between model hydrophobes in an aqueous environment.
Anomalies of the entanglement entropy in chiral theories
Energy Technology Data Exchange (ETDEWEB)
Iqbal, Nabil [Institute for Theoretical Physics, University of Amsterdam,Science Park 904, Postbus 94485, 1090 GL Amsterdam (Netherlands); Wall, Aron C. [School of Natural Sciences, Institute for Advanced Study,Princeton, New Jersey 08540 (United States)
2016-10-20
We study entanglement entropy in theories with gravitational or mixed U(1) gauge-gravitational anomalies in two, four and six dimensions. In such theories there is an anomaly in the entanglement entropy: it depends on the choice of reference frame in which the theory is regulated. We discuss subtleties regarding regulators and entanglement entropies in anomalous theories. We then study the entanglement entropy of free chiral fermions and self-dual bosons and show that in sufficiently symmetric situations this entanglement anomaly comes from an imbalance in the flux of modes flowing through the boundary, controlled by familiar index theorems. In two and four dimensions we use anomalous Ward identities to find general expressions for the transformation of the entanglement entropy under a diffeomorphism. (In the case of a mixed anomaly there is an alternative presentation of the theory in which the entanglement entropy is not invariant under a U(1) gauge transformation. The free-field manifestation of this phenomenon involves a novel kind of fermion zero mode on a gravitational background with a twist in the normal bundle to the entangling surface.) We also study d-dimensional anomalous systems as the boundaries of d+1 dimensional gapped Hall phases. Here the full system is non-anomalous, but the boundary anomaly manifests itself in a change in the entanglement entropy when the boundary metric is sheared relative to the bulk.
Directory of Open Access Journals (Sweden)
F. TopsÃƒÂ¸e
2001-09-01
Full Text Available Abstract: In its modern formulation, the Maximum Entropy Principle was promoted by E.T. Jaynes, starting in the mid-fifties. The principle dictates that one should look for a distribution, consistent with available information, which maximizes the entropy. However, this principle focuses only on distributions and it appears advantageous to bring information theoretical thinking more prominently into play by also focusing on the "observer" and on coding. This view was brought forward by the second named author in the late seventies and is the view we will follow-up on here. It leads to the consideration of a certain game, the Code Length Game and, via standard game theoretical thinking, to a principle of Game Theoretical Equilibrium. This principle is more basic than the Maximum Entropy Principle in the sense that the search for one type of optimal strategies in the Code Length Game translates directly into the search for distributions with maximum entropy. In the present paper we offer a self-contained and comprehensive treatment of fundamentals of both principles mentioned, based on a study of the Code Length Game. Though new concepts and results are presented, the reading should be instructional and accessible to a rather wide audience, at least if certain mathematical details are left aside at a rst reading. The most frequently studied instance of entropy maximization pertains to the Mean Energy Model which involves a moment constraint related to a given function, here taken to represent "energy". This type of application is very well known from the literature with hundreds of applications pertaining to several different elds and will also here serve as important illustration of the theory. But our approach reaches further, especially regarding the study of continuity properties of the entropy function, and this leads to new results which allow a discussion of models with so-called entropy loss. These results have tempted us to speculate over
Entropy inequalities from reflection positivity
International Nuclear Information System (INIS)
Casini, H
2010-01-01
We investigate the question of whether the entropy and the Renyi entropies of the vacuum state reduced to a region of space can be represented in terms of correlators in quantum field theory. In this case, the positivity relations for the correlators are mapped into inequalities for the entropies. We write them using a real-time version of reflection positivity, which can be generalized to general quantum systems. Using this generalization we can prove an infinite sequence of inequalities which are obeyed by the Renyi entropies of integer index. There is one independent inequality involving any number of different subsystems. In quantum field theory the inequalities acquire a simple geometrical form and are consistent with the integer index Renyi entropies being given by vacuum expectation values of twisting operators in the Euclidean formulation. Several possible generalizations and specific examples are analyzed
Entropy-Corrected Holographic Dark Energy
International Nuclear Information System (INIS)
Wei Hao
2009-01-01
The holographic dark energy (HDE) is now an interesting candidate of dark energy, which has been studied extensively in the literature. In the derivation of HDE, the black hole entropy plays an important role. In fact, the entropy-area relation can be modified due to loop quantum gravity or other reasons. With the modified entropy-area relation, we propose the so-called 'entropy-corrected holographic dark energy' (ECHDE) in the present work. We consider many aspects of ECHDE and find some interesting results. In addition, we briefly consider the so-called 'entropy-corrected agegraphic dark energy' (ECADE). (geophysics, astronomy, and astrophysics)
A new entropy based method for computing software structural complexity
Roca, J L
2002-01-01
In this paper a new methodology for the evaluation of software structural complexity is described. It is based on the entropy evaluation of the random uniform response function associated with the so called software characteristic function SCF. The behavior of the SCF with the different software structures and their relationship with the number of inherent errors is investigated. It is also investigated how the entropy concept can be used to evaluate the complexity of a software structure considering the SCF as a canonical representation of the graph associated with the control flow diagram. The functions, parameters and algorithms that allow to carry out this evaluation are also introduced. After this analytic phase follows the experimental phase, verifying the consistency of the proposed metric and their boundary conditions. The conclusion is that the degree of software structural complexity can be measured as the entropy of the random uniform response function of the SCF. That entropy is in direct relation...
Using Tranformation Group Priors and Maximum Relative Entropy for Bayesian Glaciological Inversions
Arthern, R. J.; Hindmarsh, R. C. A.; Williams, C. R.
2014-12-01
One of the key advances that has allowed better simulations of the large ice sheets of Greenland and Antarctica has been the use of inverse methods. These have allowed poorly known parameters such as the basal drag coefficient and ice viscosity to be constrained using a wide variety of satellite observations. Inverse methods used by glaciologists have broadly followed one of two related approaches. The first is minimization of a cost function that describes the misfit to the observations, often accompanied by some kind of explicit or implicit regularization that promotes smallness or smoothness in the inverted parameters. The second approach is a probabilistic framework that makes use of Bayes' theorem to update prior assumptions about the probability of parameters, making use of data with known error estimates. Both approaches have much in common and questions of regularization often map onto implicit choices of prior probabilities that are made explicit in the Bayesian framework. In both approaches questions can arise that seem to demand subjective input. What should the functional form of the cost function be if there are alternatives? What kind of regularization should be applied, and how much? How should the prior probability distribution for a parameter such as basal slipperiness be specified when we know so little about the details of the subglacial environment? Here we consider some approaches that have been used to address these questions and discuss ways that probabilistic prior information used for regularizing glaciological inversions might be specified with greater objectivity.
Aur, Dorian; Vila-Rodriguez, Fidel
2017-01-01
Complexity measures for time series have been used in many applications to quantify the regularity of one dimensional time series, however many dynamical systems are spatially distributed multidimensional systems. We introduced Dynamic Cross-Entropy (DCE) a novel multidimensional complexity measure that quantifies the degree of regularity of EEG signals in selected frequency bands. Time series generated by discrete logistic equations with varying control parameter r are used to test DCE measures. Sliding window DCE analyses are able to reveal specific period doubling bifurcations that lead to chaos. A similar behavior can be observed in seizures triggered by electroconvulsive therapy (ECT). Sample entropy data show the level of signal complexity in different phases of the ictal ECT. The transition to irregular activity is preceded by the occurrence of cyclic regular behavior. A significant increase of DCE values in successive order from high frequencies in gamma to low frequencies in delta band reveals several phase transitions into less ordered states, possible chaos in the human brain. To our knowledge there are no reliable techniques able to reveal the transition to chaos in case of multidimensional times series. In addition, DCE based on sample entropy appears to be robust to EEG artifacts compared to DCE based on Shannon entropy. The applied technique may offer new approaches to better understand nonlinear brain activity. Copyright Â© 2016 Elsevier B.V. All rights reserved.
McGregor, Stephen J; Busa, Michael A; Skufca, Joseph; Yaggie, James A; Bollt, Erik M
2009-06-01
Regularity statistics have been previously applied to walking gait measures in the hope of gaining insight into the complexity of gait under different conditions and in different populations. Traditional regularity statistics are subject to the requirement of stationarity, a limitation for examining changes in complexity under dynamic conditions such as exhaustive exercise. Using a novel measure, control entropy (CE), applied to triaxial continuous accelerometry, we report changes in complexity of walking and running during increasing speeds up to exhaustion in highly trained runners. We further apply Karhunen-Loeve analysis in a new and novel way to the patterns of CE responses in each of the three axes to identify dominant modes of CE responses in the vertical, mediolateral, and anterior/posterior planes. The differential CE responses observed between the different axes in this select population provide insight into the constraints of walking and running in those who may have optimized locomotion. Future comparisons between athletes, healthy untrained, and clinical populations using this approach may help elucidate differences between optimized and diseased locomotor control.
Lim, Jongil; Kwon, Ji Young; Song, Juhee; Choi, Hosoon; Shin, Jong Chul; Park, In Yang
2014-02-01
The interpretation of the fetal heart rate (FHR) signal considering labor progression may improve perinatal morbidity and mortality. However, there have been few studies that evaluate the fetus in each labor stage quantitatively. To evaluate whether the entropy indices of FHR are different according to labor progression. A retrospective comparative study of FHR recordings in three groups: 280 recordings in the second stage of labor before vaginal delivery, 31 recordings in the first stage of labor before emergency cesarean delivery, and 23 recordings in the pre-labor before elective cesarean delivery. The stored FHR recordings of external cardiotocography during labor. Approximate entropy (ApEn) and sample entropy (SampEn) for the final 2000 RR intervals. The median ApEn and SampEn for the 2000 RR intervals showed the lowest values in the second stage of labor, followed by the emergency cesarean group and the elective cesarean group for all time segments (all PEntropy indices of FHR were significantly different according to labor progression. This result supports the necessity of considering labor progression when developing intrapartum fetal monitoring using the entropy indices of FHR. Copyright © 2013 Elsevier Ltd. All rights reserved.
q-entropy for symbolic dynamical systems
International Nuclear Information System (INIS)
Zhao, Yun; Pesin, Yakov
2015-01-01
For symbolic dynamical systems we use the Carathéodory construction as described in (Pesin 1997 Dimension Theory in Dynamical Systems, ConTemporary Views and Applications (Chicago: University of Chicago Press)) to introduce the notions of q-topological and q-metric entropies. We describe some basic properties of these entropies and in particular, discuss relations between q-metric entropy and local metric entropy. Both q-topological and q-metric entropies are new invariants respectively under homeomorphisms and metric isomorphisms of dynamical systems. (paper)
Holographic charged Rényi entropies
Belin, Alexandre; Hung, Ling-Yan; Maloney, Alexander; Matsuura, Shunji; Myers, Robert C.; Sierens, Todd
2013-12-01
We construct a new class of entanglement measures by extending the usual definition of Rényi entropy to include a chemical potential. These charged Rényi entropies measure the degree of entanglement in different charge sectors of the theory and are given by Euclidean path integrals with the insertion of a Wilson line encircling the entangling surface. We compute these entropies for a spherical entangling surface in CFT's with holographic duals, where they are related to entropies of charged black holes with hyperbolic horizons. We also compute charged Rényi entropies in free field theories.
Hsia, Wei-Shen
1986-01-01
In the Control Systems Division of the Systems Dynamics Laboratory of the NASA/MSFC, a Ground Facility (GF), in which the dynamics and control system concepts being considered for Large Space Structures (LSS) applications can be verified, was designed and built. One of the important aspects of the GF is to design an analytical model which will be as close to experimental data as possible so that a feasible control law can be generated. Using Hyland's Maximum Entropy/Optimal Projection Approach, a procedure was developed in which the maximum entropy principle is used for stochastic modeling and the optimal projection technique is used for a reduced-order dynamic compensator design for a high-order plant.
Wavelet entropy characterization of elevated intracranial pressure.
Xu, Peng; Scalzo, Fabien; Bergsneider, Marvin; Vespa, Paul; Chad, Miller; Hu, Xiao
2008-01-01
Intracranial Hypertension (ICH) often occurs for those patients with traumatic brain injury (TBI), stroke, tumor, etc. Pathology of ICH is still controversial. In this work, we used wavelet entropy and relative wavelet entropy to study the difference existed between normal and hypertension states of ICP for the first time. The wavelet entropy revealed the similar findings as the approximation entropy that entropy during ICH state is smaller than that in normal state. Moreover, with wavelet entropy, we can see that ICH state has the more focused energy in the low wavelet frequency band (0-3.1 Hz) than the normal state. The relative wavelet entropy shows that the energy distribution in the wavelet bands between these two states is actually different. Based on these results, we suggest that ICH may be formed by the re-allocation of oscillation energy within brain.
Robinett III, Rush D
2011-01-01
Nonlinear Powerflow Control Design presents an innovative control system design process motivated by renewable energy electric grid integration problems. The concepts developed result from the convergence of three research and development goals: • to create a unifying metric to compare the value of different energy sources – coal-burning power plant, wind turbines, solar photovoltaics, etc. – to be integrated into the electric power grid and to replace the typical metric of costs/profit; • to develop a new nonlinear control tool that applies power flow control, thermodynamics, and complex adaptive systems theory to the energy grid in a consistent way; and • to apply collective robotics theories to the creation of high-performance teams of people and key individuals in order to account for human factors in controlling and selling power into a distributed, decentralized electric power grid. All three of these goals have important concepts in common: exergy flow, limit cycles, and balance between compe...
Excess Entropy and Diffusivity
Indian Academy of Sciences (India)
First page Back Continue Last page Graphics. Excess Entropy and Diffusivity. Excess entropy scaling of diffusivity (Rosenfeld,1977). Analogous relationships also exist for viscosity and thermal conductivity.
Directory of Open Access Journals (Sweden)
Zongrun Wang
2014-01-01
Full Text Available We set information disclosure of internal control as a starting point to explore the relationship between the quality of internal control and accounting conservatism, and then adopt the entropy testing model to calculate the index of the internal control quality with the sample data of Chinese listed companies in financial industry from 2007–2011. Regression results show that earnings conservatism exists. The stronger the internal control is, the higher the accounting conservatism can be. Companies which have enhanced their internal control are more conservative, and these results make no difference with other industries.
Explaining the entropy concept and entropy components
Directory of Open Access Journals (Sweden)
Marko Popovic
2018-04-01
Full Text Available Total entropy of a thermodynamic system consists of two components: thermal entropy due to energy, and residual entropy due to molecular orientation. In this article, a three-step method for explaining entropy is suggested. Step one is to use a classical method to introduce thermal entropy STM as a function of temperature T and heat capacity at constant pressure Cp: STM = ∫(Cp/T dT. Thermal entropy is the entropy due to uncertainty in motion of molecules and vanishes at absolute zero (zero-point energy state. It is also the measure of useless thermal energy that cannot be converted into useful work. The next step is to introduce residual entropy S0 as a function of the number of molecules N and the number of distinct orientations available to them in a crystal m: S0 = N kB ln m, where kB is the Boltzmann constant. Residual entropy quantifies the uncertainty in molecular orientation. Residual entropy, unlike thermal entropy, is independent of temperature and remains present at absolute zero. The third step is to show that thermal entropy and residual entropy add up to the total entropy of a thermodynamic system S: S = S0 + STM. This method of explanation should result in a better comprehension of residual entropy and thermal entropy, as well as of their similarities and differences. The new method was tested in teaching at Faculty of Chemistry University of Belgrade, Serbia. The results of the test show that the new method has a potential to improve the quality of teaching.
On the entropy variation in the scenario of entropic gravity
Xiao, Yong; Bai, Shi-Yang
2018-05-01
In the scenario of entropic gravity, entropy varies as a function of the location of the matter, while the tendency to increase entropy appears as gravity. We concentrate on studying the entropy variation of a typical gravitational system with different relative positions between the mass and the gravitational source. The result is that the entropy of the system doesn't increase when the mass is displaced closer to the gravitational source. In this way it disproves the proposal of entropic gravity from thermodynamic entropy. It doesn't exclude the possibility that gravity originates from non-thermodynamic entropy like entanglement entropy.
Quantum Entropy of Black Hole with Internal Global Monopole
Institute of Scientific and Technical Information of China (English)
HAN Yi-Wen; YANG Shu-Zheng; LIU Wen-Biao
2005-01-01
Using the generalized uncertainty relation, the new equation of state density is obtained, and then the entropy of black hole with an internal global monopole is discussed. The divergence that appears in black hole entropy calculation through original brick-wall model is overcome. The result of the direct proportion between black hole entropy and its event horizon area is drawn and given. The result shows that the black hole entropy must be the entropy of quantum state near the event horizon.
New Definition and Properties of Fuzzy Entropy
Institute of Scientific and Technical Information of China (English)
Qing Ming; Qin Yingbing
2006-01-01
Let X = (x1,x2 ,…,xn ) and F(X) be a fuzzy set on a universal set X. A new definition of fuzzy entropy about a fuzzy set A on F(X), e*, is defined based on the order relation "≤" on [0,1/2] n. It is proved that e* is a σ-entropy under an additional requirement. Besides, some entropy formulas are presented and related properties are discussed.
On quantum Rényi entropies: A new generalization and some properties
Energy Technology Data Exchange (ETDEWEB)
Müller-Lennert, Martin [Department of Mathematics, ETH Zurich, 8092 Zürich (Switzerland); Dupuis, Frédéric [Department of Computer Science, Aarhus University, 8200 Aarhus (Denmark); Szehr, Oleg [Department of Mathematics, Technische Universität München, 85748 Garching (Germany); Fehr, Serge [CWI (Centrum Wiskunde and Informatica), 1090 Amsterdam (Netherlands); Tomamichel, Marco [Centre for Quantum Technologies, National University of Singapore, Singapore 117543 (Singapore)
2013-12-15
The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation.
On quantum Rényi entropies: A new generalization and some properties
International Nuclear Information System (INIS)
Müller-Lennert, Martin; Dupuis, Frédéric; Szehr, Oleg; Fehr, Serge; Tomamichel, Marco
2013-01-01
The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation
Caticha, Ariel
2007-11-01
What is information? Is it physical? We argue that in a Bayesian theory the notion of information must be defined in terms of its effects on the beliefs of rational agents. Information is whatever constrains rational beliefs and therefore it is the force that induces us to change our minds. This problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting method of Maximum relative Entropy (ME), which is designed for updating from arbitrary priors given information in the form of arbitrary constraints, includes as special cases both MaxEnt (which allows arbitrary constraints) and Bayes' rule (which allows arbitrary priors). Thus, ME unifies the two themes of these workshops—the Maximum Entropy and the Bayesian methods—into a single general inference scheme that allows us to handle problems that lie beyond the reach of either of the two methods separately. I conclude with a couple of simple illustrative examples.
SpatEntropy: Spatial Entropy Measures in R
Altieri, Linda; Cocchi, Daniela; Roli, Giulia
2018-01-01
This article illustrates how to measure the heterogeneity of spatial data presenting a finite number of categories via computation of spatial entropy. The R package SpatEntropy contains functions for the computation of entropy and spatial entropy measures. The extension to spatial entropy measures is a unique feature of SpatEntropy. In addition to the traditional version of Shannon's entropy, the package includes Batty's spatial entropy, O'Neill's entropy, Li and Reynolds' contagion index, Ka...
Curvature Entropy for Curved Profile Generation
Ujiie, Yoshiki; Kato, Takeo; Sato, Koichiro; Matsuoka, Yoshiyuki
2012-01-01
In a curved surface design, the overall shape features that emerge from combinations of shape elements are important. However, controlling the features of the overall shape in curved profiles is difficult using conventional microscopic shape information such as dimension. Herein two types of macroscopic shape information, curvature entropy and quadrature curvature entropy, quantitatively represent the features of the overall shape. The curvature entropy is calculated by the curvature distribu...
Algorithmic randomness and physical entropy
International Nuclear Information System (INIS)
Zurek, W.H.
1989-01-01
Algorithmic randomness provides a rigorous, entropylike measure of disorder of an individual, microscopic, definite state of a physical system. It is defined by the size (in binary digits) of the shortest message specifying the microstate uniquely up to the assumed resolution. Equivalently, algorithmic randomness can be expressed as the number of bits in the smallest program for a universal computer that can reproduce the state in question (for instance, by plotting it with the assumed accuracy). In contrast to the traditional definitions of entropy, algorithmic randomness can be used to measure disorder without any recourse to probabilities. Algorithmic randomness is typically very difficult to calculate exactly but relatively easy to estimate. In large systems, probabilistic ensemble definitions of entropy (e.g., coarse-grained entropy of Gibbs and Boltzmann's entropy H=lnW, as well as Shannon's information-theoretic entropy) provide accurate estimates of the algorithmic entropy of an individual system or its average value for an ensemble. One is thus able to rederive much of thermodynamics and statistical mechanics in a setting very different from the usual. Physical entropy, I suggest, is a sum of (i) the missing information measured by Shannon's formula and (ii) of the algorithmic information content---algorithmic randomness---present in the available data about the system. This definition of entropy is essential in describing the operation of thermodynamic engines from the viewpoint of information gathering and using systems. These Maxwell demon-type entities are capable of acquiring and processing information and therefore can ''decide'' on the basis of the results of their measurements and computations the best strategy for extracting energy from their surroundings. From their internal point of view the outcome of each measurement is definite
Equipartition of entropy production
International Nuclear Information System (INIS)
Tondeur, D.
1990-01-01
This paper deals with the optimal design or operation of heat and mass transfer processes and develops the following conjecture: for a given duty, the best configuration of the process is that in which the entropy production rate is most uniformly distributed. This principle is first analyzed in detail on the simple example of tubular heat exchangers, and within the framework of linear irreversible thermodynamics. A main result is established, which states that the total entropy production is minimal when the local production is uniformly distributed (equipartition). Corollaries then result, which relate the entropy production and the variance of its distribution to economic factors such as the duty, the exchange area, the fluid flow-rates, and the temperature changes. The equipartition principle is then extended to multiple independent variables (time and space), multicomponent transfer, and non-linear but concave flux vs force relationship. Chemical Engineering examples are discussed, where the equipartition property has been applied implicitly or explicitly: design of distillation plates, cyclic distillation, optimal state of feed, and flow-sheets in chromatographic separations. Finally, a generalization of the equipartition principle is proposed, for systems with a distributed design variable (such as the size of the various elements of a system). The optimal distribution of investment is such that the investment in each element (properly amortized) is equal to the cost of irreversible energy degradation in this element. This is equivalent to saying that the ratio of these two quantities is uniformly distributed over the system, and reduces to equipartition of entropy production when the cost factors are constant over the whole system
Arithmetic of quantum entropy function
International Nuclear Information System (INIS)
Sen, Ashoke
2009-01-01
Quantum entropy function is a proposal for computing the entropy associated with the horizon of a black hole in the extremal limit, and is related via AdS/CFT correspondence to the dimension of the Hilbert space in a dual quantum mechanics. We show that in N = 4 supersymmetric string theories, quantum entropy function formalism naturally explains the origin of the subtle differences between the microscopic degeneracies of quarter BPS dyons carrying different torsion, i.e. different arithmetical properties. These arise from additional saddle points in the path integral - whose existence depends on the arithmetical properties of the black hole charges - constructed as freely acting orbifolds of the original AdS 2 x S 2 near horizon geometry. During this analysis we demonstrate that the quantum entropy function is insensitive to the details of the infrared cutoff used in the computation, and the details of the boundary terms added to the action. We also discuss the role of the asymptotic symmetries of AdS 2 in carrying out the path integral in the definition of quantum entropy function. Finally we show that even though quantum entropy function is expected to compute the absolute degeneracy in a given charge and angular momentum sector, it can also be used to compute the index. This can then be compared with the microscopic computation of the index.
Statistical mechanical theory of liquid entropy
International Nuclear Information System (INIS)
Wallace, D.C.
1993-01-01
The multiparticle correlation expansion for the entropy of a classical monatomic liquid is presented. This entropy expresses the physical picture in which there is no free particle motion, but rather, each atom moves within a cage formed by its neighbors. The liquid expansion, including only pair correlations, gives an excellent account of the experimental entropy of most liquid metals, of liquid argon, and the hard sphere liquid. The pair correlation entropy is well approximated by a universal function of temperature. Higher order correlation entropy, due to n-particle irreducible correlations for n≥3, is significant in only a few liquid metals, and its occurrence suggests the presence of n-body forces. When the liquid theory is applied to the study of melting, the author discovers the important classification of normal and anomalous melting, according to whether there is not or is a significant change in the electronic structure upon melting, and he discovers the universal disordering entropy for melting of a monatomic crystal. Interesting directions for future research are: extension to include orientational correlations of molecules, theoretical calculation of the entropy of water, application to the entropy of the amorphous state, and correlational entropy of compressed argon. The author clarifies the relation among different entropy expansions in the recent literature
Curvature Entropy for Curved Profile Generation
Directory of Open Access Journals (Sweden)
Koichiro Sato
2012-03-01
Full Text Available In a curved surface design, the overall shape features that emerge from combinations of shape elements are important. However, controlling the features of the overall shape in curved profiles is difficult using conventional microscopic shape information such as dimension. Herein two types of macroscopic shape information, curvature entropy and quadrature curvature entropy, quantitatively represent the features of the overall shape. The curvature entropy is calculated by the curvature distribution, and represents the complexity of a shape (one of the overall shape features. The quadrature curvature entropy is an improvement of the curvature entropy by introducing a Markov process to evaluate the continuity of a curvature and to approximate human cognition of the shape. Additionally, a shape generation method using a genetic algorithm as a calculator and the entropy as a shape generation index is presented. Finally, the applicability of the proposed method is demonstrated using the side view of an automobile as a design example.
On Thermodynamic Interpretation of Transfer Entropy
Directory of Open Access Journals (Sweden)
Don C. Price
2013-02-01
Full Text Available We propose a thermodynamic interpretation of transfer entropy near equilibrium, using a specialised Boltzmann’s principle. The approach relates conditional probabilities to the probabilities of the corresponding state transitions. This in turn characterises transfer entropy as a difference of two entropy rates: the rate for a resultant transition and another rate for a possibly irreversible transition within the system affected by an additional source. We then show that this difference, the local transfer entropy, is proportional to the external entropy production, possibly due to irreversibility. Near equilibrium, transfer entropy is also interpreted as the difference in equilibrium stabilities with respect to two scenarios: a default case and the case with an additional source. Finally, we demonstrated that such a thermodynamic treatment is not applicable to information flow, a measure of causal effect.
Black hole entropy functions and attractor equations
International Nuclear Information System (INIS)
Lopes Cardoso, Gabriel; Wit, Bernard de; Mahapatra, Swapna
2007-01-01
The entropy and the attractor equations for static extremal black hole solutions follow from a variational principle based on an entropy function. In the general case such an entropy function can be derived from the reduced action evaluated in a near-horizon geometry. BPS black holes constitute special solutions of this variational principle, but they can also be derived directly from a different entropy function based on supersymmetry enhancement at the horizon. Both functions are consistent with electric/magnetic duality and for BPS black holes their corresponding OSV-type integrals give identical results at the semi-classical level. We clarify the relation between the two entropy functions and the corresponding attractor equations for N = 2 supergravity theories with higher-derivative couplings in four space-time dimensions. We discuss how non-holomorphic corrections will modify these entropy functions
Entropy type complexity of quantum processes
International Nuclear Information System (INIS)
Watanabe, Noboru
2014-01-01
von Neumann entropy represents the amount of information in the quantum state, and this was extended by Ohya for general quantum systems [10]. Umegaki first defined the quantum relative entropy for σ-finite von Neumann algebras, which was extended by Araki, and Uhlmann, for general von Neumann algebras and *-algebras, respectively. In 1983 Ohya introduced the quantum mutual entropy by using compound states; this describes the amount of information correctly transmitted through the quantum channel, which was also extended by Ohya for general quantum systems. In this paper, we briefly explain Ohya's S-mixing entropy and the quantum mutual entropy for general quantum systems. By using structure equivalent class, we will introduce entropy type functionals based on quantum information theory to improve treatment for the Gaussian communication process. (paper)
Directory of Open Access Journals (Sweden)
SAURABH KUMAR GUPTA
2015-01-01
Full Text Available The present research focus on optimization of Friction Stir Welding (FSW process parameters for joining of AA6061 aluminium alloy using hybrid approach. The FSW process parameters considered are tool rotational speed, welding speed and axial force. The quality characteristics considered are tensile strength (TS and percentage of tensile elongation (TE. Taguchi based experimental design L9 orthogonal array is used for determining the experimental results. The value of weights corresponding to each quality characteristic is determined by using the entropy measurement method so that their importance can be properly explained. Analysis of Variance (ANOVA is used to determine the contribution of FSW process parameters. The confirmation tests also have been done for verifying the results.
Pesin’s entropy formula for stochastic flows of diffeomorphisms
Institute of Scientific and Technical Information of China (English)
刘培东
1996-01-01
Pesin’s entropy formula relating entropy and Lyapunov exponents within the context of random dynamical systems generated by (discrete or continuous) stochastic flows of diffeomorphisms (including solution flows of stochastic differential equations on manifolds) is proved.
Directory of Open Access Journals (Sweden)
Urban Kordes
2005-10-01
Full Text Available The paper tries to tackle the question of connection between entropy and the living. Definitions of life as the phenomenon that defies entropy are overviewed and the conclusion is reached that life is in a way dependant on entropy - it couldn't exist without it. Entropy is a sort of medium, a fertile soil, that gives life possibility to blossom. Paper ends with presenting some consequences for the field of artificial intelligence.
Physical entropy, information entropy and their evolution equations
Institute of Scientific and Technical Information of China (English)
无
2001-01-01
Inspired by the evolution equation of nonequilibrium statistical physics entropy and the concise statistical formula of the entropy production rate, we develop a theory of the dynamic information entropy and build a nonlinear evolution equation of the information entropy density changing in time and state variable space. Its mathematical form and physical meaning are similar to the evolution equation of the physical entropy: The time rate of change of information entropy density originates together from drift, diffusion and production. The concise statistical formula of information entropy production rate is similar to that of physical entropy also. Furthermore, we study the similarity and difference between physical entropy and information entropy and the possible unification of the two statistical entropies, and discuss the relationship among the principle of entropy increase, the principle of equilibrium maximum entropy and the principle of maximum information entropy as well as the connection between them and the entropy evolution equation.
Entropy and Entanglement of the Electromagnetically Induced Transparency System
Institute of Scientific and Technical Information of China (English)
LIU Xiao-Juan; FANG Mao-Fa; ZHOU Qing-Ping
2004-01-01
@@ We study the entropy and the entanglement of an electromagnetically induced transparency system. The quantum entanglement between the atom and the two quantized laser fields is discussed by using quantum reduced entropy and that between the two quantized laser fields by using quantum relative entropy. We also examine whether influences of EIT on entropy and quantum entanglement of the system considered occur or not. Our results show that the minimum value of the atomic reduced entropy may be regarded as an entropy criterion on the electromagnetically induced transparency occurring.
Hanel, Rudolf; Thurner, Stefan; Gell-Mann, Murray
2014-05-13
The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and Markovian systems in statistical mechanics, information theory, and statistics. For several decades there has been an ongoing controversy over whether the notion of the maximum entropy principle can be extended in a meaningful way to nonextensive, nonergodic, and complex statistical systems and processes. In this paper we start by reviewing how Boltzmann-Gibbs-Shannon entropy is related to multiplicities of independent random processes. We then show how the relaxation of independence naturally leads to the most general entropies that are compatible with the first three Shannon-Khinchin axioms, the (c,d)-entropies. We demonstrate that the MEP is a perfectly consistent concept for nonergodic and complex statistical systems if their relative entropy can be factored into a generalized multiplicity and a constraint term. The problem of finding such a factorization reduces to finding an appropriate representation of relative entropy in a linear basis. In a particular example we show that path-dependent random processes with memory naturally require specific generalized entropies. The example is to our knowledge the first exact derivation of a generalized entropy from the microscopic properties of a path-dependent random process.
Properties of Risk Measures of Generalized Entropy in Portfolio Selection
Directory of Open Access Journals (Sweden)
Rongxi Zhou
2017-12-01
Full Text Available This paper systematically investigates the properties of six kinds of entropy-based risk measures: Information Entropy and Cumulative Residual Entropy in the probability space, Fuzzy Entropy, Credibility Entropy and Sine Entropy in the fuzzy space, and Hybrid Entropy in the hybridized uncertainty of both fuzziness and randomness. We discover that none of the risk measures satisfy all six of the following properties, which various scholars have associated with effective risk measures: Monotonicity, Translation Invariance, Sub-additivity, Positive Homogeneity, Consistency and Convexity. Measures based on Fuzzy Entropy, Credibility Entropy, and Sine Entropy all exhibit the same properties: Sub-additivity, Positive Homogeneity, Consistency, and Convexity. These measures based on Information Entropy and Hybrid Entropy, meanwhile, only exhibit Sub-additivity and Consistency. Cumulative Residual Entropy satisfies just Sub-additivity, Positive Homogeneity, and Convexity. After identifying these properties, we develop seven portfolio models based on different risk measures and made empirical comparisons using samples from both the Shenzhen Stock Exchange of China and the New York Stock Exchange of America. The comparisons show that the Mean Fuzzy Entropy Model performs the best among the seven models with respect to both daily returns and relative cumulative returns. Overall, these results could provide an important reference for both constructing effective risk measures and rationally selecting the appropriate risk measure under different portfolio selection conditions.
Ben-Naim, Arieh
2011-01-01
Changes in entropy can "sometimes" be interpreted in terms of changes in disorder. On the other hand, changes in entropy can "always" be interpreted in terms of changes in Shannon's measure of information. Mixing and demixing processes are used to highlight the pitfalls in the association of entropy with disorder. (Contains 3 figures.)
Problems in black-hole entropy interpretation
International Nuclear Information System (INIS)
Liberati, S.
1997-01-01
In this work some proposals for black-hole entropy interpretation are exposed and investigated. In particular, the author will firstly consider the so-called 'entanglement entropy' interpretation, in the framework of the brick wall model and the divergence problem arising in the one-loop calculations of various thermodynamical quantities, like entropy, internal energy and heat capacity. It is shown that the assumption of equality of entanglement entropy and Bekenstein-Hawking one appears to give inconsistent results. These will be a starting point for a different interpretation of black.hole entropy based on peculiar topological structures of manifolds with 'intrinsic' thermodynamical features. It is possible to show an exact relation between black-hole gravitational entropy and topology of these Euclidean space-times. the expression for the Euler characteristic, through the Gauss-Bonnet integral, and the one for entropy for gravitational instantons are proposed in a form which makes the relation between these self-evident. Using this relation he propose a generalization of the Bekenstein-Hawking entropy in which the former and Euler characteristic are related in the equation S = χA / 8. Finally, he try to expose some conclusions and hypotheses about possible further development of this research
Clausius entropy for arbitrary bifurcate null surfaces
International Nuclear Information System (INIS)
Baccetti, Valentina; Visser, Matt
2014-01-01
Jacobson’s thermodynamic derivation of the Einstein equations was originally applied only to local Rindler horizons. But at least some parts of that construction can usefully be extended to give meaningful results for arbitrary bifurcate null surfaces. As presaged in Jacobson’s original article, this more general construction sharply brings into focus the questions: is entropy objectively ‘real’? Or is entropy in some sense subjective and observer-dependent? These innocent questions open a Pandora’s box of often inconclusive debate. A consensus opinion, though certainly not universally held, seems to be that Clausius entropy (thermodynamic entropy, defined via a Clausius relation dS=đQ/T) should be objectively real, but that the ontological status of statistical entropy (Shannon or von Neumann entropy) is much more ambiguous, and much more likely to be observer-dependent. This question is particularly pressing when it comes to understanding Bekenstein entropy (black hole entropy). To perhaps further add to the confusion, we shall argue that even the Clausius entropy can often be observer-dependent. In the current article we shall conclusively demonstrate that one can meaningfully assign a notion of Clausius entropy to arbitrary bifurcate null surfaces—effectively defining a ‘virtual Clausius entropy’ for arbitrary ‘virtual (local) causal horizons’. As an application, we see that we can implement a version of the generalized second law (GSL) for this virtual Clausius entropy. This version of GSL can be related to certain (nonstandard) integral variants of the null energy condition. Because the concepts involved are rather subtle, we take some effort in being careful and explicit in developing our framework. In future work we will apply this construction to generalize Jacobson’s derivation of the Einstein equations. (paper)
Quantum Statistical Entropy of Five-Dimensional Black Hole
Institute of Scientific and Technical Information of China (English)
ZHAO Ren; WU Yue-Qin; ZHANG Sheng-Li
2006-01-01
The generalized uncertainty relation is introduced to calculate quantum statistic entropy of a black hole.By using the new equation of state density motivated by the generalized uncertainty relation, we discuss entropies of Bose field and Fermi field on the background of the five-dimensional spacetime. In our calculation, we need not introduce cutoff. There is not the divergent logarithmic term as in the original brick-wall method. And it is obtained that the quantum statistic entropy corresponding to black hole horizon is proportional to the area of the horizon. Further it is shown that the entropy of black hole is the entropy of quantum state on the surface of horizon. The black hole's entropy is the intrinsic property of the black hole. The entropy is a quantum effect. It makes people further understand the quantum statistic entropy.
Quantum Statistical Entropy of Five-Dimensional Black Hole
International Nuclear Information System (INIS)
Zhao Ren; Zhang Shengli; Wu Yueqin
2006-01-01
The generalized uncertainty relation is introduced to calculate quantum statistic entropy of a black hole. By using the new equation of state density motivated by the generalized uncertainty relation, we discuss entropies of Bose field and Fermi field on the background of the five-dimensional spacetime. In our calculation, we need not introduce cutoff. There is not the divergent logarithmic term as in the original brick-wall method. And it is obtained that the quantum statistic entropy corresponding to black hole horizon is proportional to the area of the horizon. Further it is shown that the entropy of black hole is the entropy of quantum state on the surface of horizon. The black hole's entropy is the intrinsic property of the black hole. The entropy is a quantum effect. It makes people further understand the quantum statistic entropy.
RNA Thermodynamic Structural Entropy.
Garcia-Martin, Juan Antonio; Clote, Peter
2015-01-01
Conformational entropy for atomic-level, three dimensional biomolecules is known experimentally to play an important role in protein-ligand discrimination, yet reliable computation of entropy remains a difficult problem. Here we describe the first two accurate and efficient algorithms to compute the conformational entropy for RNA secondary structures, with respect to the Turner energy model, where free energy parameters are determined from UV absorption experiments. An algorithm to compute the derivational entropy for RNA secondary structures had previously been introduced, using stochastic context free grammars (SCFGs). However, the numerical value of derivational entropy depends heavily on the chosen context free grammar and on the training set used to estimate rule probabilities. Using data from the Rfam database, we determine that both of our thermodynamic methods, which agree in numerical value, are substantially faster than the SCFG method. Thermodynamic structural entropy is much smaller than derivational entropy, and the correlation between length-normalized thermodynamic entropy and derivational entropy is moderately weak to poor. In applications, we plot the structural entropy as a function of temperature for known thermoswitches, such as the repression of heat shock gene expression (ROSE) element, we determine that the correlation between hammerhead ribozyme cleavage activity and total free energy is improved by including an additional free energy term arising from conformational entropy, and we plot the structural entropy of windows of the HIV-1 genome. Our software RNAentropy can compute structural entropy for any user-specified temperature, and supports both the Turner'99 and Turner'04 energy parameters. It follows that RNAentropy is state-of-the-art software to compute RNA secondary structure conformational entropy. Source code is available at https://github.com/clotelab/RNAentropy/; a full web server is available at http
RNA Thermodynamic Structural Entropy.
Directory of Open Access Journals (Sweden)
Juan Antonio Garcia-Martin
Full Text Available Conformational entropy for atomic-level, three dimensional biomolecules is known experimentally to play an important role in protein-ligand discrimination, yet reliable computation of entropy remains a difficult problem. Here we describe the first two accurate and efficient algorithms to compute the conformational entropy for RNA secondary structures, with respect to the Turner energy model, where free energy parameters are determined from UV absorption experiments. An algorithm to compute the derivational entropy for RNA secondary structures had previously been introduced, using stochastic context free grammars (SCFGs. However, the numerical value of derivational entropy depends heavily on the chosen context free grammar and on the training set used to estimate rule probabilities. Using data from the Rfam database, we determine that both of our thermodynamic methods, which agree in numerical value, are substantially faster than the SCFG method. Thermodynamic structural entropy is much smaller than derivational entropy, and the correlation between length-normalized thermodynamic entropy and derivational entropy is moderately weak to poor. In applications, we plot the structural entropy as a function of temperature for known thermoswitches, such as the repression of heat shock gene expression (ROSE element, we determine that the correlation between hammerhead ribozyme cleavage activity and total free energy is improved by including an additional free energy term arising from conformational entropy, and we plot the structural entropy of windows of the HIV-1 genome. Our software RNAentropy can compute structural entropy for any user-specified temperature, and supports both the Turner'99 and Turner'04 energy parameters. It follows that RNAentropy is state-of-the-art software to compute RNA secondary structure conformational entropy. Source code is available at https://github.com/clotelab/RNAentropy/; a full web server is available at http
MAXIMUM-LIKELIHOOD-ESTIMATION OF THE ENTROPY OF AN ATTRACTOR
SCHOUTEN, JC; TAKENS, F; VANDENBLEEK, CM
In this paper, a maximum-likelihood estimate of the (Kolmogorov) entropy of an attractor is proposed that can be obtained directly from a time series. Also, the relative standard deviation of the entropy estimate is derived; it is dependent on the entropy and on the number of samples used in the
Maximum-entropy clustering algorithm and its global convergence analysis
Institute of Scientific and Technical Information of China (English)
无
2001-01-01
Constructing a batch of differentiable entropy functions touniformly approximate an objective function by means of the maximum-entropy principle, a new clustering algorithm, called maximum-entropy clustering algorithm, is proposed based on optimization theory. This algorithm is a soft generalization of the hard C-means algorithm and possesses global convergence. Its relations with other clustering algorithms are discussed.
Gravitational entropies in LTB dust models
International Nuclear Information System (INIS)
Sussman, Roberto A; Larena, Julien
2014-01-01
We consider generic Lemaître–Tolman–Bondi (LTB) dust models to probe the gravitational entropy proposals of Clifton, Ellis and Tavakol (CET) and of Hosoya and Buchert (HB). We also consider a variant of the HB proposal based on a suitable quasi-local scalar weighted average. We show that the conditions for entropy growth for all proposals are directly related to a negative correlation of similar fluctuations of the energy density and Hubble scalar. While this correlation is evaluated locally for the CET proposal, it must be evaluated in a non-local domain dependent manner for the two HB proposals. By looking at the fulfilment of these conditions at the relevant asymptotic limits we are able to provide a well grounded qualitative description of the full time evolution and radial asymptotic scaling of the three entropies in generic models. The following rigorous analytic results are obtained for the three proposals: (i) entropy grows when the density growing mode is dominant, (ii) all ever-expanding hyperbolic models reach a stable terminal equilibrium characterized by an inhomogeneous entropy maximum in their late time evolution; (iii) regions with decaying modes and collapsing elliptic models exhibit unstable equilibria associated with an entropy minimum (iv) near singularities the CET entropy diverges while the HB entropies converge; (v) the CET entropy converges for all models in the radial asymptotic range, whereas the HB entropies only converge for models asymptotic to a Friedmann–Lemaître–Robertson–Walker background. The fact that different independent proposals yield fairly similar conditions for entropy production, time evolution and radial scaling in generic LTB models seems to suggest that their common notion of a ‘gravitational entropy’ may be a theoretically robust concept applicable to more general spacetimes. (paper)
What is the entropy of the universe?
International Nuclear Information System (INIS)
Frampton, Paul H; Hsu, Stephen D H; Reeb, David; Kephart, Thomas W
2009-01-01
Standard calculations suggest that the entropy of our universe is dominated by black holes, whose entropy is of order their area in Planck units, although they comprise only a tiny fraction of its total energy. Statistical entropy is the logarithm of the number of microstates consistent with the observed macroscopic properties of a system, hence a measure of uncertainty about its precise state. Therefore, assuming unitarity in black hole evaporation, the standard results suggest that the largest uncertainty in the future quantum state of the universe is due to the Hawking radiation from evaporating black holes. However, the entropy of the matter precursors to astrophysical black holes is enormously less than that given by area entropy. If unitarity relates the future radiation states to the black hole precursor states, then the standard results are highly misleading, at least for an observer that can differentiate the individual states of the Hawking radiation.
What is the entropy of the universe?
Energy Technology Data Exchange (ETDEWEB)
Frampton, Paul H [Department of Physics and Astronomy, UNC-Chapel Hill, NC 27599 (United States); Hsu, Stephen D H; Reeb, David [Institute of Theoretical Science, University of Oregon, Eugene, OR 97403 (United States); Kephart, Thomas W, E-mail: frampton@physics.unc.ed, E-mail: hsu@uoregon.ed, E-mail: tom.kephart@gmail.co, E-mail: dreeb@uoregon.ed [Department of Physics and Astronomy, Vanderbilt University, Nashville, TN 37235 (United States)
2009-07-21
Standard calculations suggest that the entropy of our universe is dominated by black holes, whose entropy is of order their area in Planck units, although they comprise only a tiny fraction of its total energy. Statistical entropy is the logarithm of the number of microstates consistent with the observed macroscopic properties of a system, hence a measure of uncertainty about its precise state. Therefore, assuming unitarity in black hole evaporation, the standard results suggest that the largest uncertainty in the future quantum state of the universe is due to the Hawking radiation from evaporating black holes. However, the entropy of the matter precursors to astrophysical black holes is enormously less than that given by area entropy. If unitarity relates the future radiation states to the black hole precursor states, then the standard results are highly misleading, at least for an observer that can differentiate the individual states of the Hawking radiation.
Parshad, Rana D; McGregor, Stephen J; Busa, Michael A; Skufca, Joseph D; Bollt, Erik
2012-01-01
Control entropy (CE) is a complexity analysis suitable for dynamic, non-stationary conditions which allows the inference of the control effort of a dynamical system generating the signal. These characteristics make CE a highly relevant time varying quantity relevant to the dynamic physiological responses associated with running. Using High Resolution Accelerometry (HRA) signals we evaluate here constraints of running gait, from two different groups of runners, highly trained collegiate and untrained runners. To this end,we further develop the control entropy (CE) statistic to allow for group analysis to examine the non-linear characteristics of movement patterns in highly trained runners with those of untrained runners, to gain insight regarding gaits that are optimal for running. Specifically, CE develops response time series of individuals descriptive of the control effort; a group analysis of these shapes developed here uses Karhunen Loeve Analysis (KL) modes of these time series which are compared between groups by application of a Hotelling T² test to these group response shapes. We find that differences in the shape of the CE response exist within groups, between axes for untrained runners (vertical vs anterior-posterior and mediolateral vs anterior-posterior) and trained runners (mediolateral vs anterior-posterior). Also shape differences exist between groups by axes (vertical vs mediolateral). Further, the CE, as a whole, was higher in each axis in trained vs untrained runners. These results indicate that the approach can provide unique insight regarding the differing constraints on running gait in highly trained and untrained runners when running under dynamic conditions. Further, the final point indicates trained runners are less constrained than untrained runners across all running speeds.
Çankaya, Mehmet Niyazi; Déli, Eva
2017-07-01
of the brain's electric activities that parallel changes in thoughts or evolution of concepts. Within the framework of operational architectonics, Tozzi et al. applied the methods of the Bursuk-Ulam theorem (BUT) to uncover the detailed dynamics of brain activities, such as dimensionality, entropy changes, and information accumulation. The authors find that ripples of rapid transitional periods, with sudden changes and reorganization of the information and entropy, parallels shifts both in dimensionality of temporal dynamics, as well as in cognitive processes. The method therefore can uncover how entropic and dimensionality changes are interconnected with emerging mental concepts. It also highlights the differences between lower conceptual processes, such as sensory processing, and higher cognitive synthesis, such as semantics, for example. In physical systems, information, dimensionality and entropy are related according to well-established formulas. In this direction, the entropy values of the volume and surface area are added into the evaluation of brain functionings [5-7]. If the same relationship is true in the wet and constantly changing biological complexity of the brain, then it would give us predictive capability toward the understanding of cognition, aid the treatment of mental problems and diseases in psychiatry and psychology, and facilitate the design of a new generation of artificial intelligent machines.
Information Entropy Squeezing of a Two-Level Atom Interacting with Two-Mode Coherent Fields
Institute of Scientific and Technical Information of China (English)
LIU Xiao-Juan; FANG Mao-Fa
2004-01-01
From a quantum information point of view we investigate the entropy squeezing properties for a two-level atom interacting with the two-mode coherent fields via the two-photon transition. We discuss the influences of the initial state of the system on the atomic information entropy squeezing. Our results show that the squeezed component number,squeezed direction, and time of the information entropy squeezing can be controlled by choosing atomic distribution angle,the relative phase between the atom and the two-mode field, and the difference of the average photon number of the two field modes, respectively. Quantum information entropy is a remarkable precision measure for the atomic squeezing.
International Nuclear Information System (INIS)
Kolb, E.W.; Lindley, D.; Seckel, D.
1984-01-01
For a cosmological model with d noncompact and D compact spatial dimensions and symmetry R 1 x S/sup d/ x S/sup D/, we calculate the entropy produced in d dimensions due to the compactification of D dimensions and show it too small to be of cosmological interest. Although insufficient entropy is produced in the model we study, the contraction of extra dimensions does lead to entropy production. We discuss modifications of our assumptions, including changing our condition for decoupling of the extra dimensions, which may lead to a large entropy production and change our conclusions
ENTROPY FUNCTIONAL FOR CONTINUOUS SYSTEMS OF FINITE ENTROPY
Institute of Scientific and Technical Information of China (English)
M. Rahimi A. Riazi
2012-01-01
In this article,we introduce the concept of entropy functional for continuous systems on compact metric spaces,and prove some of its properties.We also extract the Kolmogorov entropy from the entropy functional.
Chain rules for smooth min-and max-entropies
DEFF Research Database (Denmark)
Vitanov, Alexande; Dupont-Dupuis, Fréderic; Tomamichel, Marco
2013-01-01
The chain rule for the Shannon and von Neumann en- tropy, which relates the total entropy of a system to the entropies of its parts, is of central importance to information theory. Here, we consider the chain rule for the more general smooth min- and max-entropies, used in one-shot in formation...... theory. For these en- tropy measures, the chain rule no longer holds as an equality. How- ever, the standard chain rule for the von Neum ann entropy is re- trieved asymptotically when evaluating the smooth entropies for many identical and independently distributed states....
A note on entanglement entropy and quantum geometry
International Nuclear Information System (INIS)
Bodendorfer, N
2014-01-01
It has been argued that the entropy computed in the isolated horizon framework of loop quantum gravity is closely related to the entanglement entropy of the gravitational field, and that the calculation performed is not restricted to horizons. We recall existing work on this issue and explain how recent work on generalizing these computations to arbitrary spacetime dimensions D+1⩾3 supports this point of view and makes the duality between entanglement entropy and the entropy computed from counting boundary states manifest. In a certain semiclassical regime in 3+1 dimensions, this entropy is given by the Bekenstein–Hawking formula. (paper)
Indian Academy of Sciences (India)
Enthalpy–entropy compensation is the name given to the correlation sometimes observed between the estimates of the enthalpy and entropy of a reaction obtained from temperature-dependence data. Although the mainly artefactual nature of this correlation has been known for many years, the subject enjoys periodical ...
Indian Academy of Sciences (India)
During the process of ageing, the balance shifts in the direction of anarchy. Death is ... tion of life and the laws of statistieal physics and entropy, both of which ... capable of doing work. ... defined by Ludwig Boltzmann in 1877, the entropy of the.
Kiessling, Michael Karl-Heinz
2017-10-01
Let z\\in C, let σ ^2>0 be a variance, and for N\\in N define the integrals E_N^{}(z;σ ) := {1/σ } \\int _R\\ (x^2+z^2) e^{-{1/2σ^2 x^2}}{√{2π }}/dx \\quad if N=1, {1/σ } \\int _{R^N} \\prod \\prod \\limits _{1≤ k1. These are expected values of the polynomials P_N^{}(z)=\\prod _{1≤ n≤ N}(X_n^2+z^2) whose 2 N zeros ± i X_k^{}_{k=1,\\ldots ,N} are generated by N identically distributed multi-variate mean-zero normal random variables {X_k}N_{k=1} with co-variance {Cov}_N^{}(X_k,X_l)=(1+σ ^2-1/N)δ _{k,l}+σ ^2-1/N(1-δ _{k,l}). The E_N^{}(z;σ ) are polynomials in z^2, explicitly computable for arbitrary N, yet a list of the first three E_N^{}(z;σ ) shows that the expressions become unwieldy already for moderate N—unless σ = 1, in which case E_N^{}(z;1) = (1+z^2)^N for all z\\in C and N\\in N. (Incidentally, commonly available computer algebra evaluates the integrals E_N^{}(z;σ ) only for N up to a dozen, due to memory constraints). Asymptotic evaluations are needed for the large- N regime. For general complex z these have traditionally been limited to analytic expansion techniques; several rigorous results are proved for complex z near 0. Yet if z\\in R one can also compute this "infinite-degree" limit with the help of the familiar relative entropy principle for probability measures; a rigorous proof of this fact is supplied. Computer algebra-generated evidence is presented in support of a conjecture that a generalization of the relative entropy principle to signed or complex measures governs the N→ ∞ asymptotics of the regime iz\\in R. Potential generalizations, in particular to point vortex ensembles and the prescribed Gauss curvature problem, and to random matrix ensembles, are emphasized.
Entropy and Digital Installation
Directory of Open Access Journals (Sweden)
Susan Ballard
2005-01-01
Full Text Available This paper examines entropy as a process which introduces ideas of distributed materiality to digital installation. Beginning from an analysis of entropy as both force and probability measure within information theory and it’s extension in Ruldof Arnheim’s text ‘Entropy and Art” it develops an argument for the positive rather thannegative forces of entropy. The paper centres on a discussion of two recent works by New Zealand artists Ronnie van Hout (“On the Run”, Wellington City Gallery, NZ, 2004 and Alex Monteith (“Invisible Cities”, Physics Room Contemporary Art Space, Christchurch, NZ, 2004. Ballard suggests that entropy, rather than being a hindrance to understanding or a random chaotic force, discloses a necessary and material politics of noise present in digital installation.
Towards operational interpretations of generalized entropies
Topsøe, Flemming
2010-12-01
The driving force behind our study has been to overcome the difficulties you encounter when you try to extend the clear and convincing operational interpretations of classical Boltzmann-Gibbs-Shannon entropy to other notions, especially to generalized entropies as proposed by Tsallis. Our approach is philosophical, based on speculations regarding the interplay between truth, belief and knowledge. The main result demonstrates that, accepting philosophically motivated assumptions, the only possible measures of entropy are those suggested by Tsallis - which, as we know, include classical entropy. This result constitutes, so it seems, a more transparent interpretation of entropy than previously available. However, further research to clarify the assumptions is still needed. Our study points to the thesis that one should never consider the notion of entropy in isolation - in order to enable a rich and technically smooth study, further concepts, such as divergence, score functions and descriptors or controls should be included in the discussion. This will clarify the distinction between Nature and Observer and facilitate a game theoretical discussion. The usefulness of this distinction and the subsequent exploitation of game theoretical results - such as those connected with the notion of Nash equilibrium - is demonstrated by a discussion of the Maximum Entropy Principle.
Towards operational interpretations of generalized entropies
International Nuclear Information System (INIS)
Topsoee, Flemming
2010-01-01
The driving force behind our study has been to overcome the difficulties you encounter when you try to extend the clear and convincing operational interpretations of classical Boltzmann-Gibbs-Shannon entropy to other notions, especially to generalized entropies as proposed by Tsallis. Our approach is philosophical, based on speculations regarding the interplay between truth, belief and knowledge. The main result demonstrates that, accepting philosophically motivated assumptions, the only possible measures of entropy are those suggested by Tsallis - which, as we know, include classical entropy. This result constitutes, so it seems, a more transparent interpretation of entropy than previously available. However, further research to clarify the assumptions is still needed. Our study points to the thesis that one should never consider the notion of entropy in isolation - in order to enable a rich and technically smooth study, further concepts, such as divergence, score functions and descriptors or controls should be included in the discussion. This will clarify the distinction between Nature and Observer and facilitate a game theoretical discussion. The usefulness of this distinction and the subsequent exploitation of game theoretical results - such as those connected with the notion of Nash equilibrium - is demonstrated by a discussion of the Maximum Entropy Principle.
On the Conditional Entropy of Wireless Networks
DEFF Research Database (Denmark)
Coon, Justin P.; Badiu, Mihai Alin; Gündüz, Deniz
2018-01-01
The characterization of topological uncertainty in wireless networks using the formalism of graph entropy has received interest in the spatial networks community. In this paper, we develop lower bounds on the entropy of a wireless network by conditioning on potential network observables. Two...... approaches are considered: 1) conditioning on subgraphs, and 2) conditioning on node positions. The first approach is shown to yield a relatively tight bound on the network entropy. The second yields a loose bound, in general, but it provides insight into the dependence between node positions (modelled using...
Remarks on Bousso's covariant entropy bound
Mayo, A E
2002-01-01
Bousso's covariant entropy bound is put to the test in the context of a non-singular cosmological solution of general relativity found by Bekenstein. Although the model complies with every assumption made in Bousso's original conjecture, the entropy bound is violated due to the occurrence of negative energy density associated with the interaction of some the matter components in the model. We demonstrate how this property allows for the test model to 'elude' a proof of Bousso's conjecture which was given recently by Flanagan, Marolf and Wald. This corroborates the view that the covariant entropy bound should be applied only to stable systems for which every matter component carries positive energy density.
Density estimation by maximum quantum entropy
International Nuclear Information System (INIS)
Silver, R.N.; Wallstrom, T.; Martz, H.F.
1993-01-01
A new Bayesian method for non-parametric density estimation is proposed, based on a mathematical analogy to quantum statistical physics. The mathematical procedure is related to maximum entropy methods for inverse problems and image reconstruction. The information divergence enforces global smoothing toward default models, convexity, positivity, extensivity and normalization. The novel feature is the replacement of classical entropy by quantum entropy, so that local smoothing is enforced by constraints on differential operators. The linear response of the estimate is proportional to the covariance. The hyperparameters are estimated by type-II maximum likelihood (evidence). The method is demonstrated on textbook data sets
Entropy of self-gravitating radiation
International Nuclear Information System (INIS)
Sorkin, R.D.; Wald, R.M.; Jiu, Z.Z.
1981-01-01
The entropy of self-gravitating radiation confined to a spherical box of radius R is examined in the context of general relativity. It is expected that configurations (i.e., initial data) which extremize total entropy will be spherically symmetric, time symmetric distributions of radiation in local thermodynamic equilibrium. Assuming this is the case, it is proved that extrema of S coincide precisely with static equilibrium configurations of the radiation fluid. Furthermore, dynamically stable equilibrium configurations are shown to coincide with local maxima of S. The equilibrium configurations and their entropies are calculated and their properties are discussed. However, it is shown that entropies higher than these local extrema can be achieved and, indeed, arbitrarily high entropies can be attained by configurations inside of or outside but arbitrarily near their own Schwarzschild radius. However, consideration is limited to configurations which are outside their own Schwarzschild radius by at least one radiation wavelength, then the entropy is bounded and it is found Ssub(max) < is approximately equal to MR, where M is the total mass. This supports the validity for self-gravitating systems of the Bekenstein upper limit on the entropy to energy ratio of material bodies. (author)
Entropy Generation Analysis of Desalination Technologies
Directory of Open Access Journals (Sweden)
John H. Lienhard V
2011-09-01
Full Text Available Increasing global demand for fresh water is driving the development and implementation of a wide variety of seawater desalination technologies. Entropy generation analysis, and specifically, Second Law efficiency, is an important tool for illustrating the influence of irreversibilities within a system on the required energy input. When defining Second Law efficiency, the useful exergy output of the system must be properly defined. For desalination systems, this is the minimum least work of separation required to extract a unit of water from a feed stream of a given salinity. In order to evaluate the Second Law efficiency, entropy generation mechanisms present in a wide range of desalination processes are analyzed. In particular, entropy generated in the run down to equilibrium of discharge streams must be considered. Physical models are applied to estimate the magnitude of entropy generation by component and individual processes. These formulations are applied to calculate the total entropy generation in several desalination systems including multiple effect distillation, multistage flash, membrane distillation, mechanical vapor compression, reverse osmosis, and humidification-dehumidification. Within each technology, the relative importance of each source of entropy generation is discussed in order to determine which should be the target of entropy generation minimization. As given here, the correct application of Second Law efficiency shows which systems operate closest to the reversible limit and helps to indicate which systems have the greatest potential for improvement.
Nonsymmetric entropy I: basic concepts and results
Liu, Chengshi
2006-01-01
A new concept named nonsymmetric entropy which generalizes the concepts of Boltzman's entropy and shannon's entropy, was introduced. Maximal nonsymmetric entropy principle was proven. Some important distribution laws were derived naturally from maximal nonsymmetric entropy principle.
Entropy of the Mixture of Sources and Entropy Dimension
Smieja, Marek; Tabor, Jacek
2011-01-01
We investigate the problem of the entropy of the mixture of sources. There is given an estimation of the entropy and entropy dimension of convex combination of measures. The proof is based on our alternative definition of the entropy based on measures instead of partitions.
Entropy coherent and entropy convex measures of risk
Laeven, Roger; Stadje, M.A.
2010-01-01
We introduce entropy coherent and entropy convex measures of risk and prove a collection of axiomatic characterization and duality results. We show in particular that entropy coherent and entropy convex measures of risk emerge as negative certainty equivalents in (the regular and a generalized
Entropy coherent and entropy convex measures of risk
Laeven, R.J.A.; Stadje, M.
2013-01-01
We introduce two subclasses of convex measures of risk, referred to as entropy coherent and entropy convex measures of risk. Entropy coherent and entropy convex measures of risk are special cases of φ-coherent and φ-convex measures of risk. Contrary to the classical use of coherent and convex
Entropy Coherent and Entropy Convex Measures of Risk
Laeven, R.J.A.; Stadje, M.A.
2011-01-01
We introduce two subclasses of convex measures of risk, referred to as entropy coherent and entropy convex measures of risk. We prove that convex, entropy convex and entropy coherent measures of risk emerge as certainty equivalents under variational, homothetic and multiple priors preferences,
Gradient Dynamics and Entropy Production Maximization
Janečka, Adam; Pavelka, Michal
2018-01-01
We compare two methods for modeling dissipative processes, namely gradient dynamics and entropy production maximization. Both methods require similar physical inputs-how energy (or entropy) is stored and how it is dissipated. Gradient dynamics describes irreversible evolution by means of dissipation potential and entropy, it automatically satisfies Onsager reciprocal relations as well as their nonlinear generalization (Maxwell-Onsager relations), and it has statistical interpretation. Entropy production maximization is based on knowledge of free energy (or another thermodynamic potential) and entropy production. It also leads to the linear Onsager reciprocal relations and it has proven successful in thermodynamics of complex materials. Both methods are thermodynamically sound as they ensure approach to equilibrium, and we compare them and discuss their advantages and shortcomings. In particular, conditions under which the two approaches coincide and are capable of providing the same constitutive relations are identified. Besides, a commonly used but not often mentioned step in the entropy production maximization is pinpointed and the condition of incompressibility is incorporated into gradient dynamics.
International Nuclear Information System (INIS)
Baccetti, Valentina; Visser, Matt
2013-01-01
Even if a probability distribution is properly normalizable, its associated Shannon (or von Neumann) entropy can easily be infinite. We carefully analyze conditions under which this phenomenon can occur. Roughly speaking, this happens when arbitrarily small amounts of probability are dispersed into an infinite number of states; we shall quantify this observation and make it precise. We develop several particularly simple, elementary, and useful bounds, and also provide some asymptotic estimates, leading to necessary and sufficient conditions for the occurrence of infinite Shannon entropy. We go to some effort to keep technical computations as simple and conceptually clear as possible. In particular, we shall see that large entropies cannot be localized in state space; large entropies can only be supported on an exponentially large number of states. We are for the time being interested in single-channel Shannon entropy in the information theoretic sense, not entropy in a stochastic field theory or quantum field theory defined over some configuration space, on the grounds that this simple problem is a necessary precursor to understanding infinite entropy in a field theoretic context. (paper)
Tsallis Entropy Theory for Modeling in Water Engineering: A Review
Directory of Open Access Journals (Sweden)
Vijay P. Singh
2017-11-01
Full Text Available Water engineering is an amalgam of engineering (e.g., hydraulics, hydrology, irrigation, ecosystems, environment, water resources and non-engineering (e.g., social, economic, political aspects that are needed for planning, designing and managing water systems. These aspects and the associated issues have been dealt with in the literature using different techniques that are based on different concepts and assumptions. A fundamental question that still remains is: Can we develop a unifying theory for addressing these? The second law of thermodynamics permits us to develop a theory that helps address these in a unified manner. This theory can be referred to as the entropy theory. The thermodynamic entropy theory is analogous to the Shannon entropy or the information theory. Perhaps, the most popular generalization of the Shannon entropy is the Tsallis entropy. The Tsallis entropy has been applied to a wide spectrum of problems in water engineering. This paper provides an overview of Tsallis entropy theory in water engineering. After some basic description of entropy and Tsallis entropy, a review of its applications in water engineering is presented, based on three types of problems: (1 problems requiring entropy maximization; (2 problems requiring coupling Tsallis entropy theory with another theory; and (3 problems involving physical relations.
Some remarks on conditional entropy
Nijst, A.G.P.M.
1969-01-01
Using a definition of conditional entropy given by Hanen and Neveu [5, 10, 11] we discuss in this paper some properties of conditional entropy and mean entropy, in particular an integral representation of conditional entropy (§ 2), and the decomposition theorem of the KolmogorovSina¯i invariant (§
Safety-related control air systems
International Nuclear Information System (INIS)
Anon.
1977-01-01
This Standard applies to those portions of the control air system that furnish air required to support, control, or operate systems or portions of systems that are safety related in nuclear power plants. This Standard relates only to the air supply system(s) for safety-related air operated devices and does not apply to the safety-related air operated device or to air operated actuators for such devices. The objectives of this Standard are to provide (1) minimum system design requirements for equipment, piping, instruments, controls, and wiring that constitute the air supply system; and (2) the system and component testing and maintenance requirements
Thermoeconomic diagnosis and entropy generation paradox
DEFF Research Database (Denmark)
Sigthorsson, Oskar; Ommen, Torben Schmidt; Elmegaard, Brian
2017-01-01
In the entropy generation paradox, the entropy generation number, as a function of heat exchanger effectiveness, counter-intuitively approaches zero in two limits symmetrically from a single maximum. In thermoeconomic diagnosis, namely in the characteristic curve method, the exergy destruction...... to the entropy generation paradox, as a decreased heat exchanger effectiveness (as in the case of an operation anomaly in the component) can counter-intuitively result in decreased exergy destruction rate of the component. Therefore, along with an improper selection of independent variables, the heat exchanger...... increases in case of an operation anomaly in a component. The normalised exergy destruction rate as the dependent variable therefore resolves the relation of the characteristic curve method with the entropy generation paradox....
Applications of quantum entropy to statistics
International Nuclear Information System (INIS)
Silver, R.N.; Martz, H.F.
1994-01-01
This paper develops two generalizations of the maximum entropy (ME) principle. First, Shannon classical entropy is replaced by von Neumann quantum entropy to yield a broader class of information divergences (or penalty functions) for statistics applications. Negative relative quantum entropy enforces convexity, positivity, non-local extensivity and prior correlations such as smoothness. This enables the extension of ME methods from their traditional domain of ill-posed in-verse problems to new applications such as non-parametric density estimation. Second, given a choice of information divergence, a combination of ME and Bayes rule is used to assign both prior and posterior probabilities. Hyperparameters are interpreted as Lagrange multipliers enforcing constraints. Conservation principles are proposed to act statistical regularization and other hyperparameters, such as conservation of information and smoothness. ME provides an alternative to heirarchical Bayes methods
Entropy Evaluation Based on Value Validity
Directory of Open Access Journals (Sweden)
Tarald O. Kvålseth
2014-09-01
Full Text Available Besides its importance in statistical physics and information theory, the Boltzmann-Shannon entropy S has become one of the most widely used and misused summary measures of various attributes (characteristics in diverse fields of study. It has also been the subject of extensive and perhaps excessive generalizations. This paper introduces the concept and criteria for value validity as a means of determining if an entropy takes on values that reasonably reflect the attribute being measured and that permit different types of comparisons to be made for different probability distributions. While neither S nor its relative entropy equivalent S* meet the value-validity conditions, certain power functions of S and S* do to a considerable extent. No parametric generalization offers any advantage over S in this regard. A measure based on Euclidean distances between probability distributions is introduced as a potential entropy that does comply fully with the value-validity requirements and its statistical inference procedure is discussed.
Entropy of international trades
Oh, Chang-Young; Lee, D.-S.
2017-05-01
The organization of international trades is highly complex under the collective efforts towards economic profits of participating countries given inhomogeneous resources for production. Considering the trade flux as the probability of exporting a product from a country to another, we evaluate the entropy of the world trades in the period 1950-2000. The trade entropy has increased with time, and we show that it is mainly due to the extension of trade partnership. For a given number of trade partners, the mean trade entropy is about 60% of the maximum possible entropy, independent of time, which can be regarded as a characteristic of the trade fluxes' heterogeneity and is shown to be derived from the scaling and functional behaviors of the universal trade-flux distribution. The correlation and time evolution of the individual countries' gross-domestic products and the number of trade partners show that most countries achieved their economic growth partly by extending their trade relationship.
International Nuclear Information System (INIS)
Estes, John; Jensen, Kristan; O’Bannon, Andy; Tsatis, Efstratios; Wrase, Timm
2014-01-01
We study a number of (3+1)- and (2+1)-dimensional defect and boundary conformal field theories holographically dual to supergravity theories. In all cases the defects or boundaries are planar, and the defects are codimension-one. Using holography, we compute the entanglement entropy of a (hemi-)spherical region centered on the defect (boundary). We define defect and boundary entropies from the entanglement entropy by an appropriate background subtraction. For some (3+1)-dimensional theories we find evidence that the defect/boundary entropy changes monotonically under certain renormalization group flows triggered by operators localized at the defect or boundary. This provides evidence that the g-theorem of (1+1)-dimensional field theories generalizes to higher dimensions
Minimum entropy production principle
Czech Academy of Sciences Publication Activity Database
Maes, C.; Netočný, Karel
2013-01-01
Roč. 8, č. 7 (2013), s. 9664-9677 ISSN 1941-6016 Institutional support: RVO:68378271 Keywords : MINEP Subject RIV: BE - Theoretical Physics http://www.scholarpedia.org/article/Minimum_entropy_production_principle
Katan, Claudine; Mohite, Aditya D.; Even, Jacky
2018-05-01
Claudine Katan, Aditya D. Mohite and Jacky Even discuss the possible impact of various entropy contributions (stochastic structural fluctuations, anharmonicity and lattice softness) on the optoelectronic properties of halide perovskite materials and devices.
Sze, Vivienne; Marpe, Detlev
2014-01-01
Context-Based Adaptive Binary Arithmetic Coding (CABAC) is a method of entropy coding first introduced in H.264/AVC and now used in the latest High Efficiency Video Coding (HEVC) standard. While it provides high coding efficiency, the data dependencies in H.264/AVC CABAC make it challenging to parallelize and thus limit its throughput. Accordingly, during the standardization of entropy coding for HEVC, both aspects of coding efficiency and throughput were considered. This chapter describes th...
Manfredi; Feix
2000-10-01
The properties of an alternative definition of quantum entropy, based on Wigner functions, are discussed. Such a definition emerges naturally from the Wigner representation of quantum mechanics, and can easily quantify the amount of entanglement of a quantum state. It is shown that smoothing of the Wigner function induces an increase in entropy. This fact is used to derive some simple rules to construct positive-definite probability distributions which are also admissible Wigner functions.
Manfredi, G.; Feix, M. R.
2002-01-01
The properties of an alternative definition of quantum entropy, based on Wigner functions, are discussed. Such definition emerges naturally from the Wigner representation of quantum mechanics, and can easily quantify the amount of entanglement of a quantum state. It is shown that smoothing of the Wigner function induces an increase in entropy. This fact is used to derive some simple rules to construct positive definite probability distributions which are also admissible Wigner functions
Feasible Histories, Maximum Entropy
International Nuclear Information System (INIS)
Pitowsky, I.
1999-01-01
We consider the broadest possible consistency condition for a family of histories, which extends all previous proposals. A family that satisfies this condition is called feasible. On each feasible family of histories we choose a probability measure by maximizing entropy, while keeping the probabilities of commuting histories to their quantum mechanical values. This procedure is justified by the assumption that decoherence increases entropy. Finally, a criterion for identifying the nearly classical families is proposed
Relative controllability and null controllability of linear delay systems ...
African Journals Online (AJOL)
Necessary and sufficient conditions are established for the relative, absolute controllability and null controllability of the generalized linear delay system and its discrete prototype. The paper presents illuminating examples on previous controllability results by Manitius and Olbrot [7] and carries over the results of Onwuatu [8] ...
International Nuclear Information System (INIS)
Lemos, Jose P. S.; Zaslavskii, Oleg B.
2010-01-01
We trace the origin of the black hole entropy S, replacing a black hole by a quasiblack hole. Let the boundary of a static body approach its own gravitational radius, in such a way that a quasihorizon forms. We show that if the body is thermal with the temperature taking the Hawking value at the quasihorizon limit, it follows, in the nonextremal case, from the first law of thermodynamics that the entropy approaches the Bekenstein-Hawking value S=A/4. In this setup, the key role is played by the surface stresses on the quasihorizon and one finds that the entropy comes from the quasihorizon surface. Any distribution of matter inside the surface leads to the same universal value for the entropy in the quasihorizon limit. This can be of some help in the understanding of black hole entropy. Other similarities between black holes and quasiblack holes such as the mass formulas for both objects had been found previously. We also discuss the entropy for extremal quasiblack holes, a more subtle issue.
Asymptotics of the information entropy of the Airy function
Energy Technology Data Exchange (ETDEWEB)
Sanchez-Moreno, P [Departamento de Fisica Moderna, Universidad de Granada, Granada (Spain); Instituto ' Carlos I' de Fisica Teorica y Computacional, Universidad de Granada, Granada (Spain); Yanez, R J [Instituto ' Carlos I' de Fisica Teorica y Computacional, Universidad de Granada, Granada (Spain); Departamento de Matematica Aplicada, Universidad de Granada, Granada (Spain); Buyarov, V [Moscow State University (Russian Federation)
2005-11-18
The Boltzmann-Shannon information entropy of linear potential wavefunctions is known to be controlled by the information entropy of the Airy function Ai(x). Here, the entropy asymptotics is analysed so that the first two leading terms (previously calculated in the WKB approximation) as well as the following term (already conjectured) are derived by using only the specific properties of the Airy function.
On the Conditional Rényi Entropy
S. Fehr (Serge); S. Berens (Stefan)
2014-01-01
htmlabstractThe Rényi entropy of general order unifies the well-known Shannon entropy with several other entropy notions, like the min-entropy or the collision entropy. In contrast to the Shannon entropy, there seems to be no commonly accepted definition for the conditional Rényi entropy: several
EEG entropy measures in anesthesia
Directory of Open Access Journals (Sweden)
Zhenhu eLiang
2015-02-01
Full Text Available Objective: Entropy algorithms have been widely used in analyzing EEG signals during anesthesia. However, a systematic comparison of these entropy algorithms in assessing anesthesia drugs’ effect is lacking. In this study, we compare the capability of twelve entropy indices for monitoring depth of anesthesia (DoA and detecting the burst suppression pattern (BSP, in anesthesia induced by GA-BAergic agents.Methods: Twelve indices were investigated, namely Response Entropy (RE and State entropy (SE, three wavelet entropy (WE measures (Shannon WE (SWE, Tsallis WE (TWE and Renyi WE (RWE, Hilbert-Huang spectral entropy (HHSE, approximate entropy (ApEn, sample entropy (SampEn, Fuzzy entropy, and three permutation entropy (PE measures (Shannon PE (SPE, Tsallis PE (TPE and Renyi PE (RPE. Two EEG data sets from sevoflurane-induced and isoflu-rane-induced anesthesia respectively were selected to assess the capability of each entropy index in DoA monitoring and BSP detection. To validate the effectiveness of these entropy algorithms, phar-macokinetic / pharmacodynamic (PK/PD modeling and prediction probability analysis were applied. The multifractal detrended fluctuation analysis (MDFA as a non-entropy measure was compared.Results: All the entropy and MDFA indices could track the changes in EEG pattern during different anesthesia states. Three PE measures outperformed the other entropy indices, with less baseline vari-ability, higher coefficient of determination and prediction probability, and RPE performed best; ApEn and SampEn discriminated BSP best. Additionally, these entropy measures showed an ad-vantage in computation efficiency compared with MDFA.Conclusion: Each entropy index has its advantages and disadvantages in estimating DoA. Overall, it is suggested that the RPE index was a superior measure.Significance: Investigating the advantages and disadvantages of these entropy indices could help improve current clinical indices for monitoring DoA.
Entropy-Based Algorithm for Supply-Chain Complexity Assessment
Directory of Open Access Journals (Sweden)
Boris Kriheli
2018-03-01
Full Text Available This paper considers a graph model of hierarchical supply chains. The goal is to measure the complexity of links between different components of the chain, for instance, between the principal equipment manufacturer (a root node and its suppliers (preceding supply nodes. The information entropy is used to serve as a measure of knowledge about the complexity of shortages and pitfalls in relationship between the supply chain components under uncertainty. The concept of conditional (relative entropy is introduced which is a generalization of the conventional (non-relative entropy. An entropy-based algorithm providing efficient assessment of the supply chain complexity as a function of the SC size is developed.
Entropy in an expanding universe
International Nuclear Information System (INIS)
Frautschi, S.
1982-01-01
The question of how the observed evolution of organized structures from initial chaos in the expanding universe can be reconciled with the laws of statistical mechanics is studied, with emphasis on effects of the expansion and gravity. Some major sources of entropy increase are listed. An expanding causal region is defined in which the entropy, though increasing, tends to fall further and further behind its maximum possible value, thus allowing for the development of order. The related questions of whether entropy will continue increasing without limit in the future, and whether such increase in the form of Hawking radiation or radiation from positronium might enable life to maintain itself permanently, are considered. Attempts to find a scheme for preserving life based on solid structures fail because events such as quantum tunneling recurrently disorganize matter on a very long but fixed time scale, whereas all energy sources slow down progressively in an expanding universe. However, there remains hope that other modes of life capable of maintaining themselves permanently can be found
Mixing, entropy and competition
International Nuclear Information System (INIS)
Klimenko, A Y
2012-01-01
Non-traditional thermodynamics, applied to random behaviour associated with turbulence, mixing and competition, is reviewed and analysed. Competitive mixing represents a general framework for the study of generic properties of competitive systems and can be used to model a wide class of non-equilibrium phenomena ranging from turbulent premixed flames and invasion waves to complex competitive systems. We demonstrate consistency of the general principles of competition with thermodynamic description, review and analyse the related entropy concepts and introduce the corresponding competitive H-theorem. A competitive system can be characterized by a thermodynamic quantity—competitive potential—which determines the likely direction of evolution of the system. Contested resources tend to move between systems from lower to higher values of the competitive potential. There is, however, an important difference between conventional thermodynamics and competitive thermodynamics. While conventional thermodynamics is constrained by its zeroth law and is fundamentally transitive, the transitivity of competitive thermodynamics depends on the transitivity of the competition rules. Intransitivities are common in the real world and are responsible for complex behaviour in competitive systems. This work follows ideas and methods that have originated from the analysis of turbulent combustion, but reviews a much broader scope of issues linked to mixing and competition, including thermodynamic characterization of complex competitive systems with self-organization. The approach presented here is interdisciplinary and is addressed to the general educated readers, whereas the mathematical details can be found in the appendices. (comment)
The Conditional Entropy Power Inequality for Bosonic Quantum Systems
De Palma, Giacomo; Trevisan, Dario
2018-06-01
We prove the conditional Entropy Power Inequality for Gaussian quantum systems. This fundamental inequality determines the minimum quantum conditional von Neumann entropy of the output of the beam-splitter or of the squeezing among all the input states where the two inputs are conditionally independent given the memory and have given quantum conditional entropies. We also prove that, for any couple of values of the quantum conditional entropies of the two inputs, the minimum of the quantum conditional entropy of the output given by the conditional Entropy Power Inequality is asymptotically achieved by a suitable sequence of quantum Gaussian input states. Our proof of the conditional Entropy Power Inequality is based on a new Stam inequality for the quantum conditional Fisher information and on the determination of the universal asymptotic behaviour of the quantum conditional entropy under the heat semigroup evolution. The beam-splitter and the squeezing are the central elements of quantum optics, and can model the attenuation, the amplification and the noise of electromagnetic signals. This conditional Entropy Power Inequality will have a strong impact in quantum information and quantum cryptography. Among its many possible applications there is the proof of a new uncertainty relation for the conditional Wehrl entropy.
Frequency-Weighted Balancing Related Controller Reduction
Varga, Andras; Anderson, Brian D.O.
2002-01-01
The efficient solution of a class of controller approximation problems by using frequency-weighted balancing related model reduction approaches is considered. It is shown that for certain standard performance and stability enforcing frequency-weights, the computation of the frequency-weighted controllability and observability grammians can be done by solving reduced order Lyapunov equations regardless the controller itself is stable or unstable. The new approach can be used in conjunction wit...
Entropy Generation and Human Aging: Lifespan Entropy and Effect of Physical Activity Level
Silva, Carlos; Annamalai, Kalyan
2008-06-01
The first and second laws of thermodynamics were applied to biochemical reactions typical of human metabolism. An open-system model was used for a human body. Energy conservation, availability and entropy balances were performed to obtain the entropy generated for the main food components. Quantitative results for entropy generation were obtained as a function of age using the databases from the U.S. Food and Nutrition Board (FNB) and Centers for Disease Control and Prevention (CDC), which provide energy requirements and food intake composition as a function of age, weight and stature. Numerical integration was performed through human lifespan for different levels of physical activity. Results were presented and analyzed. Entropy generated over the lifespan of average individuals (natural death) was found to be 11,404 kJ/ºK per kg of body mass with a rate of generation three times higher on infants than on the elderly. The entropy generated predicts a life span of 73.78 and 81.61 years for the average U.S. male and female individuals respectively, which are values that closely match the average lifespan from statistics (74.63 and 80.36 years). From the analysis of the effect of different activity levels, it is shown that entropy generated increases with physical activity, suggesting that exercise should be kept to a “healthy minimum” if entropy generation is to be minimized.
Entropy Generation and Human Aging: Lifespan Entropy and Effect of Physical Activity Level
Directory of Open Access Journals (Sweden)
Kalyan Annamalai
2008-06-01
Full Text Available The first and second laws of thermodynamics were applied to biochemical reactions typical of human metabolism. An open-system model was used for a human body. Energy conservation, availability and entropy balances were performed to obtain the entropy generated for the main food components. Quantitative results for entropy generation were obtained as a function of age using the databases from the U.S. Food and Nutrition Board (FNB and Centers for Disease Control and Prevention (CDC, which provide energy requirements and food intake composition as a function of age, weight and stature. Numerical integration was performed through human lifespan for different levels of physical activity. Results were presented and analyzed. Entropy generated over the lifespan of average individuals (natural death was found to be 11,404 kJ/Ã‚ÂºK per kg of body mass with a rate of generation three times higher on infants than on the elderly. The entropy generated predicts a life span of 73.78 and 81.61 years for the average U.S. male and female individuals respectively, which are values that closely match the average lifespan from statistics (74.63 and 80.36 years. From the analysis of the effect of different activity levels, it is shown that entropy generated increases with physical activity, suggesting that exercise should be kept to a Ã¢Â€Âœhealthy minimumÃ¢Â€Â if entropy generation is to be minimized.
Extensitivity of entropy and modern form of Gibbs paradox
International Nuclear Information System (INIS)
Home, D.; Sengupta, S.
1981-01-01
The extensivity property of entropy is clarified in the light of a critical examination of the entropy formula based on quantum statistics and the relevant thermodynamic requirement. The modern form of the Gibbs paradox, related to the discontinuous jump in entropy due to identity or non-identity of particles, is critically investigated. Qualitative framework of a new resolution of this paradox, which analyses the general effect of distinction mark on the Hamiltonian of a system of identical particles, is outlined. (author)
Calculation of Configurational Entropy in Complex Landscapes
Directory of Open Access Journals (Sweden)
Samuel A Cushman
2018-04-01
Full Text Available Entropy and the second law of thermodynamics are fundamental concepts that underlie all natural processes and patterns. Recent research has shown how the entropy of a landscape mosaic can be calculated using the Boltzmann equation, with the entropy of a lattice mosaic equal to the logarithm of the number of ways a lattice with a given dimensionality and number of classes can be arranged to produce the same total amount of edge between cells of different classes. However, that work seemed to also suggest that the feasibility of applying this method to real landscapes was limited due to intractably large numbers of possible arrangements of raster cells in large landscapes. Here I extend that work by showing that: (1 the proportion of arrangements rather than the number with a given amount of edge length provides a means to calculate unbiased relative configurational entropy, obviating the need to compute all possible configurations of a landscape lattice; (2 the edge lengths of randomized landscape mosaics are normally distributed, following the central limit theorem; and (3 given this normal distribution it is possible to fit parametric probability density functions to estimate the expected proportion of randomized configurations that have any given edge length, enabling the calculation of configurational entropy on any landscape regardless of size or number of classes. I evaluate the boundary limits (4 for this normal approximation for small landscapes with a small proportion of a minority class and show it holds under all realistic landscape conditions. I further (5 demonstrate that this relationship holds for a sample of real landscapes that vary in size, patch richness, and evenness of area in each cover type, and (6 I show that the mean and standard deviation of the normally distributed edge lengths can be predicted nearly perfectly as a function of the size, patch richness and diversity of a landscape. Finally, (7 I show that the
Entropy generation impact on peristaltic motion in a rotating frame
Directory of Open Access Journals (Sweden)
H. Zahir
Full Text Available Outcome of entropy generation in peristalsis of Casson fluid in a rotating frame is intended. Formulation is based upon thermal radiation, viscous dissipation and slip conditions of velocity and temperature. Lubrication approach is followed. The velocity components, temperature and trapping are examined. Specifically the outcomes of Taylor number, fluid parameter, slip parameters, Brinkman, radiation and compliant wall effects are focused. In addition entropy generation and Bejan numbers are examined. It is observed that entropy is controlled through slip effects. Keywords: Casson fluid, Radiative heat flux, Entropy generation, Rotating frame, Slip conditions, Wall properties
Bianconi, Ginestra
2009-03-01
In this paper we generalize the concept of random networks to describe network ensembles with nontrivial features by a statistical mechanics approach. This framework is able to describe undirected and directed network ensembles as well as weighted network ensembles. These networks might have nontrivial community structure or, in the case of networks embedded in a given space, they might have a link probability with a nontrivial dependence on the distance between the nodes. These ensembles are characterized by their entropy, which evaluates the cardinality of networks in the ensemble. In particular, in this paper we define and evaluate the structural entropy, i.e., the entropy of the ensembles of undirected uncorrelated simple networks with given degree sequence. We stress the apparent paradox that scale-free degree distributions are characterized by having small structural entropy while they are so widely encountered in natural, social, and technological complex systems. We propose a solution to the paradox by proving that scale-free degree distributions are the most likely degree distribution with the corresponding value of the structural entropy. Finally, the general framework we present in this paper is able to describe microcanonical ensembles of networks as well as canonical or hidden-variable network ensembles with significant implications for the formulation of network-constructing algorithms.
Dynamical entropy, quantum K-systems and clustering
International Nuclear Information System (INIS)
Narnhofer, H.
1989-01-01
The two possibilities to define a quantum K-system, either using algebraic relations or using properties of the dynamical entropy, are compared. It is shown that under the additional assumption of strong asymptotic abelianess the algebraic relations imply the properties of the dynamical entropy. 14 refs. (Author)
Left-right entanglement entropy of Dp-branes
Energy Technology Data Exchange (ETDEWEB)
Zayas, Leopoldo A. Pando [The Abdus Salam International Centre for Theoretical Physics,Strada Costiera 11, 34014 Trieste (Italy); Michigan Center for Theoretical Physics, Randall Laboratory of Physics,The University of Michigan,450 Church Street, Ann Arbor, MI 48109-1120 (United States); Quiroz, Norma [Departamento de Ciencias Exactas, Tecnología y Metodología,Centro Universitario del Sur, Universidad de Guadalajara,Enrique Arreola Silva 883, C.P. 49000, Cd. Guzmán, Jalisco (Mexico)
2016-11-04
We compute the left-right entanglement entropy for Dp-branes in string theory. We employ the CFT approach to string theory Dp-branes, in particular, its presentation as coherent states of the closed string sector. The entanglement entropy is computed as the von Neumann entropy for a density matrix resulting from integration over the left-moving degrees of freedom. We discuss various crucial ambiguities related to sums over spin structures and argue that different choices capture different physics; however, we advance a themodynamic argument that seems to favor a particular choice of replica. We also consider Dp branes on compact dimensions and verify that the effects of T-duality act covariantly on the Dp brane entanglement entropy. We find that generically the left-right entanglement entropy provides a suitable generalization of boundary entropy and of the D-brane tension.
A gravitational entropy proposal
International Nuclear Information System (INIS)
Clifton, Timothy; Tavakol, Reza; Ellis, George F R
2013-01-01
We propose a thermodynamically motivated measure of gravitational entropy based on the Bel–Robinson tensor, which has a natural interpretation as the effective super-energy–momentum tensor of free gravitational fields. The specific form of this measure differs depending on whether the gravitational field is Coulomb-like or wave-like, and reduces to the Bekenstein–Hawking value when integrated over the interior of a Schwarzschild black hole. For scalar perturbations of a Robertson–Walker geometry we find that the entropy goes like the Hubble weighted anisotropy of the gravitational field, and therefore increases as structure formation occurs. This is in keeping with our expectations for the behaviour of gravitational entropy in cosmology, and provides a thermodynamically motivated arrow of time for cosmological solutions of Einstein’s field equations. It is also in keeping with Penrose’s Weyl curvature hypothesis. (paper)
Microscopic entropy and nonlocality
International Nuclear Information System (INIS)
Karpov, E.; Ordonets, G.; Petroskij, T.; Prigozhin, I.
2003-01-01
We have obtained a microscopic expression for entropy in terms of H function based on nonunitary Λ transformation which leads from the time evolution as a unitary group to a Markovian dynamics and unifies the reversible and irreversible aspects of quantum mechanics. This requires a new representation outside the Hilbert space. In terms of H, we show the entropy production and the entropy flow during the emission and absorption of radiation by an atom. Analyzing the time inversion experiment, we emphasize the importance of pre- and postcollisional correlations, which break the symmetry between incoming and outgoing waves. We consider the angle dependence of the H function in a three-dimensional situation. A model including virtual transitions is discussed in a subsequent paper
EEG entropy measures in anesthesia
Liang, Zhenhu; Wang, Yinghua; Sun, Xue; Li, Duan; Voss, Logan J.; Sleigh, Jamie W.; Hagihira, Satoshi; Li, Xiaoli
2015-01-01
Highlights: ► Twelve entropy indices were systematically compared in monitoring depth of anesthesia and detecting burst suppression.► Renyi permutation entropy performed best in tracking EEG changes associated with different anesthesia states.► Approximate Entropy and Sample Entropy performed best in detecting burst suppression. Objective: Entropy algorithms have been widely used in analyzing EEG signals during anesthesia. However, a systematic comparison of these entropy algorithms in assessing anesthesia drugs' effect is lacking. In this study, we compare the capability of 12 entropy indices for monitoring depth of anesthesia (DoA) and detecting the burst suppression pattern (BSP), in anesthesia induced by GABAergic agents. Methods: Twelve indices were investigated, namely Response Entropy (RE) and State entropy (SE), three wavelet entropy (WE) measures [Shannon WE (SWE), Tsallis WE (TWE), and Renyi WE (RWE)], Hilbert-Huang spectral entropy (HHSE), approximate entropy (ApEn), sample entropy (SampEn), Fuzzy entropy, and three permutation entropy (PE) measures [Shannon PE (SPE), Tsallis PE (TPE) and Renyi PE (RPE)]. Two EEG data sets from sevoflurane-induced and isoflurane-induced anesthesia respectively were selected to assess the capability of each entropy index in DoA monitoring and BSP detection. To validate the effectiveness of these entropy algorithms, pharmacokinetic/pharmacodynamic (PK/PD) modeling and prediction probability (Pk) analysis were applied. The multifractal detrended fluctuation analysis (MDFA) as a non-entropy measure was compared. Results: All the entropy and MDFA indices could track the changes in EEG pattern during different anesthesia states. Three PE measures outperformed the other entropy indices, with less baseline variability, higher coefficient of determination (R2) and prediction probability, and RPE performed best; ApEn and SampEn discriminated BSP best. Additionally, these entropy measures showed an advantage in computation
Gravitational entropy and thermodynamics away from the horizon
Energy Technology Data Exchange (ETDEWEB)
Brustein, Ram, E-mail: ramyb@bgu.ac.il [Department of Physics, Ben-Gurion University, Beer-Sheva 84105 (Israel); CAS, Ludwig-Maximilians-Universitaet Muenchen, 80333 Muenchen (Germany); Medved, A.J.M., E-mail: j.medved@ru.ac.za [Department of Physics and Electronics, Rhodes University, Grahamstown 6140 (South Africa)
2012-08-29
We define, by an integral of geometric quantities over a spherical shell of arbitrary radius, an invariant gravitational entropy. This definition relies on defining a gravitational energy and pressure, and it reduces at the horizon of both black branes and black holes to Wald's Noether charge entropy. We support the thermodynamic interpretation of the proposed entropy by showing that, for some cases, the field theory duals of the entropy, energy and pressure are the same as the corresponding quantities in the field theory. In this context, the Einstein equations are equivalent to the field theory thermodynamic relation TdS=dE+PdV supplemented by an equation of state.
International Nuclear Information System (INIS)
Hudetz, T.
1989-01-01
As a 'by-product' of the Connes-Narnhofer-Thirring theory of dynamical entropy for (originally non-Abelian) nuclear C * -algebras, the well-known variational principle for topological entropy is eqivalently reformulated in purly algebraically defined terms for (separable) Abelian C * -algebras. This 'algebraic variational principle' should not only nicely illustrate the 'feed-back' of methods developed for quantum dynamical systems to the classical theory, but it could also be proved directly by 'algebraic' methods and could thus further simplify the original proof of the variational principle (at least 'in principle'). 23 refs. (Author)
DEFF Research Database (Denmark)
Yuri, Shtarkov; Justesen, Jørn
1997-01-01
The concept of entropy for an image on a discrete two dimensional grid is introduced. This concept is used as an information theoretic bound on the coding rate for the image. It is proved that this quantity exists as a limit for arbitrary sets satisfying certain conditions.......The concept of entropy for an image on a discrete two dimensional grid is introduced. This concept is used as an information theoretic bound on the coding rate for the image. It is proved that this quantity exists as a limit for arbitrary sets satisfying certain conditions....
International Nuclear Information System (INIS)
Ponman, T.J.
1984-01-01
For some years now two different expressions have been in use for maximum entropy image restoration and there has been some controversy over which one is appropriate for a given problem. Here two further entropies are presented and it is argued that there is no single correct algorithm. The properties of the four different methods are compared using simple 1D simulations with a view to showing how they can be used together to gain as much information as possible about the original object. (orig.)
Entanglement entropy and duality
Energy Technology Data Exchange (ETDEWEB)
Radičević, Ðorđe [Stanford Institute for Theoretical Physics and Department of Physics, Stanford University, Stanford, CA 94305-4060 (United States)
2016-11-22
Using the algebraic approach to entanglement entropy, we study several dual pairs of lattice theories and show how the entropy is completely preserved across each duality. Our main result is that a maximal algebra of observables in a region typically dualizes to a non-maximal algebra in a dual region. In particular, we show how the usual notion of tracing out external degrees of freedom dualizes to a tracing out coupled to an additional summation over superselection sectors. We briefly comment on possible extensions of our results to more intricate dualities, including holographic ones.
Maximum entropy tokamak configurations
International Nuclear Information System (INIS)
Minardi, E.
1989-01-01
The new entropy concept for the collective magnetic equilibria is applied to the description of the states of a tokamak subject to ohmic and auxiliary heating. The condition for the existence of steady state plasma states with vanishing entropy production implies, on one hand, the resilience of specific current density profiles and, on the other, severe restrictions on the scaling of the confinement time with power and current. These restrictions are consistent with Goldston scaling and with the existence of a heat pinch. (author)
Entropy of balance - some recent results
Directory of Open Access Journals (Sweden)
Laxåback Gerd
2010-07-01
Full Text Available Abstract Background Entropy when applied to biological signals is expected to reflect the state of the biological system. However the physiological interpretation of the entropy is not always straightforward. When should high entropy be interpreted as a healthy sign, and when as marker of deteriorating health? We address this question for the particular case of human standing balance and the Center of Pressure data. Methods We have measured and analyzed balance data of 136 participants (young, n = 45; elderly, n = 91 comprising in all 1085 trials, and calculated the Sample Entropy (SampEn for medio-lateral (M/L and anterior-posterior (A/P Center of Pressure (COP together with the Hurst self-similariy (ss exponent α using Detrended Fluctuation Analysis (DFA. The COP was measured with a force plate in eight 30 seconds trials with eyes closed, eyes open, foam, self-perturbation and nudge conditions. Results 1 There is a significant difference in SampEn for the A/P-direction between the elderly and the younger groups Old > young. 2 For the elderly we have in general A/P > M/L. 3 For the younger group there was no significant A/P-M/L difference with the exception for the nudge trials where we had the reverse situation, A/P Eyes Open. 5 In case of the Hurst ss-exponent we have for the elderly, M/L > A/P. Conclusions These results seem to be require some modifications of the more or less established attention-constraint interpretation of entropy. This holds that higher entropy correlates with a more automatic and a less constrained mode of balance control, and that a higher entropy reflects, in this sense, a more efficient balancing.
Algebraic entropy for algebraic maps
International Nuclear Information System (INIS)
Hone, A N W; Ragnisco, Orlando; Zullo, Federico
2016-01-01
We propose an extension of the concept of algebraic entropy, as introduced by Bellon and Viallet for rational maps, to algebraic maps (or correspondences) of a certain kind. The corresponding entropy is an index of the complexity of the map. The definition inherits the basic properties from the definition of entropy for rational maps. We give an example with positive entropy, as well as two examples taken from the theory of Bäcklund transformations. (letter)
Excess Entropy Production in Quantum System: Quantum Master Equation Approach
Nakajima, Satoshi; Tokura, Yasuhiro
2017-12-01
For open systems described by the quantum master equation (QME), we investigate the excess entropy production under quasistatic operations between nonequilibrium steady states. The average entropy production is composed of the time integral of the instantaneous steady entropy production rate and the excess entropy production. We propose to define average entropy production rate using the average energy and particle currents, which are calculated by using the full counting statistics with QME. The excess entropy production is given by a line integral in the control parameter space and its integrand is called the Berry-Sinitsyn-Nemenman (BSN) vector. In the weakly nonequilibrium regime, we show that BSN vector is described by ln \\breve{ρ }_0 and ρ _0 where ρ _0 is the instantaneous steady state of the QME and \\breve{ρ }_0 is that of the QME which is given by reversing the sign of the Lamb shift term. If the system Hamiltonian is non-degenerate or the Lamb shift term is negligible, the excess entropy production approximately reduces to the difference between the von Neumann entropies of the system. Additionally, we point out that the expression of the entropy production obtained in the classical Markov jump process is different from our result and show that these are approximately equivalent only in the weakly nonequilibrium regime.
Entanglement entropy of excited states
International Nuclear Information System (INIS)
Alba, Vincenzo; Fagotti, Maurizio; Calabrese, Pasquale
2009-01-01
We study the entanglement entropy of a block of contiguous spins in excited states of spin chains. We consider the XY model in a transverse field and the XXZ Heisenberg spin chain. For the latter, we developed a numerical application of the algebraic Bethe ansatz. We find two main classes of states with logarithmic and extensive behavior in the dimension of the block, characterized by the properties of excitations of the state. This behavior can be related to the locality properties of the Hamiltonian having a given state as the ground state. We also provide several details of the finite size scaling
International Nuclear Information System (INIS)
Hansen, Frank
2016-01-01
Incremental information, as measured by the quantum entropy, is increasing when two ensembles are united. This result was proved by Lieb and Ruskai, and it is the foundation for the proof of strong subadditivity of quantum entropy. We present a truly elementary proof of this fact in the context of the broader family of matrix entropies introduced by Chen and Tropp.
Energy Technology Data Exchange (ETDEWEB)
Hansen, Frank, E-mail: frank.hansen@m.tohoku.ac.jp [Tohoku University, Institute for Excellence in Higher Education (Japan)
2016-06-15
Incremental information, as measured by the quantum entropy, is increasing when two ensembles are united. This result was proved by Lieb and Ruskai, and it is the foundation for the proof of strong subadditivity of quantum entropy. We present a truly elementary proof of this fact in the context of the broader family of matrix entropies introduced by Chen and Tropp.
An entropy model for artificial grammar learning
Directory of Open Access Journals (Sweden)
Emmanuel Pothos
2010-06-01
Full Text Available A model is proposed to characterize the type of knowledge acquired in Artificial Grammar Learning (AGL. In particular, Shannon entropy is employed to compute the complexity of different test items in an AGL task, relative to the training items. According to this model, the more predictable a test item is from the training items, the more likely it is that this item should be selected as compatible with the training items. The predictions of the entropy model are explored in relation to the results from several previous AGL datasets and compared to other AGL measures. This particular approach in AGL resonates well with similar models in categorization and reasoning which also postulate that cognitive processing is geared towards the reduction of entropy.
Indian Academy of Sciences (India)
Home; Journals; Resonance – Journal of Science Education; Volume 6; Issue 9. Entropy à la Boltzmann. Jayanta K Bhattacharjee. General Article Volume 6 Issue 9 September 2001 pp 19-34. Fulltext. Click here to view fulltext PDF. Permanent link: https://www.ias.ac.in/article/fulltext/reso/006/09/0019-0034 ...
Indian Academy of Sciences (India)
Consider the integral. taken over a reversible transformation. We shall call this function the entropy of state A.” 'Thermodynamics' by Enrico Fermi. “Let Γ be the volume of the region of motion of the states, and. This is the basic assumption of ...
Rescaling Temperature and Entropy
Olmsted, John, III
2010-01-01
Temperature and entropy traditionally are expressed in units of kelvin and joule/kelvin. These units obscure some important aspects of the natures of these thermodynamic quantities. Defining a rescaled temperature using the Boltzmann constant, T' = k[subscript B]T, expresses temperature in energy units, thereby emphasizing the close relationship…
Optimized Kernel Entropy Components.
Izquierdo-Verdiguier, Emma; Laparra, Valero; Jenssen, Robert; Gomez-Chova, Luis; Camps-Valls, Gustau
2017-06-01
This brief addresses two main issues of the standard kernel entropy component analysis (KECA) algorithm: the optimization of the kernel decomposition and the optimization of the Gaussian kernel parameter. KECA roughly reduces to a sorting of the importance of kernel eigenvectors by entropy instead of variance, as in the kernel principal components analysis. In this brief, we propose an extension of the KECA method, named optimized KECA (OKECA), that directly extracts the optimal features retaining most of the data entropy by means of compacting the information in very few features (often in just one or two). The proposed method produces features which have higher expressive power. In particular, it is based on the independent component analysis framework, and introduces an extra rotation to the eigen decomposition, which is optimized via gradient-ascent search. This maximum entropy preservation suggests that OKECA features are more efficient than KECA features for density estimation. In addition, a critical issue in both the methods is the selection of the kernel parameter, since it critically affects the resulting performance. Here, we analyze the most common kernel length-scale selection criteria. The results of both the methods are illustrated in different synthetic and real problems. Results show that OKECA returns projections with more expressive power than KECA, the most successful rule for estimating the kernel parameter is based on maximum likelihood, and OKECA is more robust to the selection of the length-scale parameter in kernel density estimation.
Thul, Alexander; Lechinger, Julia; Donis, Johann; Michitsch, Gabriele; Pichler, Gerald; Kochs, Eberhard F; Jordan, Denis; Ilg, Rüdiger; Schabus, Manuel
2016-02-01
Clinical assessments that rely on behavioral responses to differentiate Disorders of Consciousness are at times inapt because of some patients' motor disabilities. To objectify patients' conditions of reduced consciousness the present study evaluated the use of electroencephalography to measure residual brain activity. We analyzed entropy values of 18 scalp EEG channels of 15 severely brain-damaged patients with clinically diagnosed Minimally-Conscious-State (MCS) or Unresponsive-Wakefulness-Syndrome (UWS) and compared the results to a sample of 24 control subjects. Permutation entropy (PeEn) and symbolic transfer entropy (STEn), reflecting information processes in the EEG, were calculated for all subjects. Participants were tested on a modified active own-name paradigm to identify correlates of active instruction following. PeEn showed reduced local information content in the EEG in patients, that was most pronounced in UWS. STEn analysis revealed altered directed information flow in the EEG of patients, indicating impaired feed-backward connectivity. Responses to auditory stimulation yielded differences in entropy measures, indicating reduced information processing in MCS and UWS. Local EEG information content and information flow are affected in Disorders of Consciousness. This suggests local cortical information capacity and feedback information transfer as neural correlates of consciousness. The utilized EEG entropy analyses were able to relate to patient groups with different Disorders of Consciousness. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.
Entropy for the Complexity of Physiological Signal Dynamics.
Zhang, Xiaohua Douglas
2017-01-01
Recently, the rapid development of large data storage technologies, mobile network technology, and portable medical devices makes it possible to measure, record, store, and track analysis of biological dynamics. Portable noninvasive medical devices are crucial to capture individual characteristics of biological dynamics. The wearable noninvasive medical devices and the analysis/management of related digital medical data will revolutionize the management and treatment of diseases, subsequently resulting in the establishment of a new healthcare system. One of the key features that can be extracted from the data obtained by wearable noninvasive medical device is the complexity of physiological signals, which can be represented by entropy of biological dynamics contained in the physiological signals measured by these continuous monitoring medical devices. Thus, in this chapter I present the major concepts of entropy that are commonly used to measure the complexity of biological dynamics. The concepts include Shannon entropy, Kolmogorov entropy, Renyi entropy, approximate entropy, sample entropy, and multiscale entropy. I also demonstrate an example of using entropy for the complexity of glucose dynamics.
Zucker, M. H.
This paper is a critical analysis and reassessment of entropic functioning as it applies to the question of whether the ultimate fate of the universe will be determined in the future to be "open" (expanding forever to expire in a big chill), "closed" (collapsing to a big crunch), or "flat" (balanced forever between the two). The second law of thermodynamics declares that entropy can only increase and that this principle extends, inevitably, to the universe as a whole. This paper takes the position that this extension is an unwarranted projection based neither on experience nonfact - an extrapolation that ignores the powerful effect of a gravitational force acting within a closed system. Since it was originally presented by Clausius, the thermodynamic concept of entropy has been redefined in terms of "order" and "disorder" - order being equated with a low degree of entropy and disorder with a high degree. This revised terminology more subjective than precise, has generated considerable confusion in cosmology in several critical instances. For example - the chaotic fireball of the big bang, interpreted by Stephen Hawking as a state of disorder (high entropy), is infinitely hot and, thermally, represents zero entropy (order). Hawking, apparently focusing on the disorderly "chaotic" aspect, equated it with a high degree of entropy - overlooking the fact that the universe is a thermodynamic system and that the key factor in evaluating the big-bang phenomenon is the infinitely high temperature at the early universe, which can only be equated with zero entropy. This analysis resolves this confusion and reestablishes entropy as a cosmological function integrally linked to temperature. The paper goes on to show that, while all subsystems contained within the universe require external sources of energization to have their temperatures raised, this requirement does not apply to the universe as a whole. The universe is the only system that, by itself can raise its own
Logarithmic corrections to gravitational entropy and the null energy condition
Energy Technology Data Exchange (ETDEWEB)
Parikh, Maulik, E-mail: maulik.parikh@asu.edu; Svesko, Andrew
2016-10-10
Using a relation between the thermodynamics of local horizons and the null energy condition, we consider the effects of quantum corrections to the gravitational entropy. In particular, we find that the geometric form of the null energy condition is not affected by the inclusion of logarithmic corrections to the Bekenstein–Hawking entropy.
Logarithmic corrections to gravitational entropy and the null energy condition
Directory of Open Access Journals (Sweden)
Maulik Parikh
2016-10-01
Full Text Available Using a relation between the thermodynamics of local horizons and the null energy condition, we consider the effects of quantum corrections to the gravitational entropy. In particular, we find that the geometric form of the null energy condition is not affected by the inclusion of logarithmic corrections to the Bekenstein–Hawking entropy.
Controllability and synchronizability: Are they related?
International Nuclear Information System (INIS)
Aguirre, Luis A.; Letellier, Christophe
2016-01-01
Highlights: • We investigate if controllability coefficients correlate with measures of synchronization performance. • We use two toy-models: the Rössler and cord systems. • We considered four different synchronization schemes. • We did not find any general relation between controllability coefficients and synchronizability for the investigated systems. - Abstract: In the two last decades the concept of observability has been formally linked to that of embedding in the context of nonlinear dynamics. Such a concept has been shown to play an important role in global modeling, data analysis and filtering, to mention a few examples. Preliminary results suggested that observability, at least in some cases, has some influence in synchronization problems. Could the dual concept of controllability also be important in such problems? In the context of synchronization, in general, the role played by controllability properties may not be as relevant as observability is for data analysis. In this work we compute controllability coefficients analogous to the observability ones, now established in the literature, and evaluate their importance in synchronization problems. Two benchmarks have been used in the simulations: the Rössler and the cord systems. The following schemes were investigated: synchronization to external sinusoidal force, complete replacement, uni- and bi-directional coupling of identical oscillators. The results discussed in this work show that controllability and synchronizability are not related in general.
Entropy, neutro-entropy and anti-entropy for neutrosophic information
Vasile Patrascu
2017-01-01
This approach presents a multi-valued representation of the neutrosophic information. It highlights the link between the bifuzzy information and neutrosophic one. The constructed deca-valued structure shows the neutrosophic information complexity. This deca-valued structure led to construction of two new concepts for the neutrosophic information: neutro-entropy and anti-entropy. These two concepts are added to the two existing: entropy and non-entropy. Thus, we obtained the following triad: e...
Maximum entropy production rate in quantum thermodynamics
Energy Technology Data Exchange (ETDEWEB)
Beretta, Gian Paolo, E-mail: beretta@ing.unibs.i [Universita di Brescia, via Branze 38, 25123 Brescia (Italy)
2010-06-01
In the framework of the recent quest for well-behaved nonlinear extensions of the traditional Schroedinger-von Neumann unitary dynamics that could provide fundamental explanations of recent experimental evidence of loss of quantum coherence at the microscopic level, a recent paper [Gheorghiu-Svirschevski 2001 Phys. Rev. A 63 054102] reproposes the nonlinear equation of motion proposed by the present author [see Beretta G P 1987 Found. Phys. 17 365 and references therein] for quantum (thermo)dynamics of a single isolated indivisible constituent system, such as a single particle, qubit, qudit, spin or atomic system, or a Bose-Einstein or Fermi-Dirac field. As already proved, such nonlinear dynamics entails a fundamental unifying microscopic proof and extension of Onsager's reciprocity and Callen's fluctuation-dissipation relations to all nonequilibrium states, close and far from thermodynamic equilibrium. In this paper we propose a brief but self-contained review of the main results already proved, including the explicit geometrical construction of the equation of motion from the steepest-entropy-ascent ansatz and its exact mathematical and conceptual equivalence with the maximal-entropy-generation variational-principle formulation presented in Gheorghiu-Svirschevski S 2001 Phys. Rev. A 63 022105. Moreover, we show how it can be extended to the case of a composite system to obtain the general form of the equation of motion, consistent with the demanding requirements of strong separability and of compatibility with general thermodynamics principles. The irreversible term in the equation of motion describes the spontaneous attraction of the state operator in the direction of steepest entropy ascent, thus implementing the maximum entropy production principle in quantum theory. The time rate at which the path of steepest entropy ascent is followed has so far been left unspecified. As a step towards the identification of such rate, here we propose a possible
Entropy, neutro-entropy and anti-entropy for neutrosophic information
Vasile Patrascu
2017-01-01
This article shows a deca-valued representation of neutrosophic information in which are defined the following features: truth, falsity, weak truth, weak falsity, ignorance, contradiction, saturation, neutrality, ambiguity and hesitation. Using these features, there are constructed computing formulas for entropy, neutro-entropy and anti-entropy.
Remarks on entanglement entropy in string theory
Balasubramanian, Vijay; Parrikar, Onkar
2018-03-01
Entanglement entropy for spatial subregions is difficult to define in string theory because of the extended nature of strings. Here we propose a definition for bosonic open strings using the framework of string field theory. The key difference (compared to ordinary quantum field theory) is that the subregion is chosen inside a Cauchy surface in the "space of open string configurations." We first present a simple calculation of this entanglement entropy in free light-cone string field theory, ignoring subtleties related to the factorization of the Hilbert space. We reproduce the answer expected from an effective field theory point of view, namely a sum over the one-loop entanglement entropies corresponding to all the particle-excitations of the string, and further show that the full string theory regulates ultraviolet divergences in the entanglement entropy. We then revisit the question of factorization of the Hilbert space by analyzing the covariant phase-space associated with a subregion in Witten's covariant string field theory. We show that the pure gauge (i.e., BRST exact) modes in the string field become dynamical at the entanglement cut. Thus, a proper definition of the entropy must involve an extended Hilbert space, with new stringy edge modes localized at the entanglement cut.
Differential effects of gender on entropy perception
Satcharoen, Kleddao
2017-12-01
The purpose of this research is to examine differences in perception of entropy (color intensity) between male and female computer users. The objectives include identifying gender-based differences in entropy intention and exploring the potential effects of these differences (if any) on user interface design. The research is an effort to contribute to an emerging field of interest in gender as it relates to science, engineering and technology (SET), particularly user interface design. Currently, there is limited evidence on the role of gender in user interface design and in use of technology generally, with most efforts at gender-differentiated or customized design based on stereotypes and assumptions about female use of technology or the assumption of a default position based on male preferences. Image entropy was selected as a potential characteristic where gender could be a factor in perception because of known differences in color perception acuity between male and female individuals, even where there is no known color perception abnormality (which is more common with males). Although the literature review suggested that training could offset differences in color perception and identification, tests in untrained subject groups routinely show that females are more able to identify, match, and differentiate colors, and that there is a stronger emotional and psychosocial association of color for females. Since image entropy is associated with information content and image salience, the ability to identify areas of high entropy could make a difference in user perception and technological capabilities.
Directory of Open Access Journals (Sweden)
Shuyu Dai
2017-10-01
Full Text Available As an important implementing body of the national energy strategy, grid enterprises bear the important responsibility of optimizing the allocation of energy resources and serving the economic and social development, and their levels of sustainable development have a direct impact on the national economy and social life. In this paper, the model of fuzzy group ideal point method and combination weighting method with improved group order relation method and entropy weight method is proposed to evaluate the sustainable development of power grid enterprises. Firstly, on the basis of consulting a large amount of literature, the important criteria of the comprehensive evaluation of the sustainable development of power grid enterprises are preliminarily selected. The opinions of the industry experts are consulted and fed back for many rounds through the Delphi method and the evaluation criteria system for sustainable development of power grid enterprises is determined, then doing the consistent and non dimensional processing of the evaluation criteria. After that, based on the basic order relation method, the weights of each expert judgment matrix are synthesized to construct the compound matter elements. By using matter element analysis, the subjective weights of the criteria are obtained. And entropy weight method is used to determine the objective weights of the preprocessed criteria. Then, combining the subjective and objective information with the combination weighting method based on the subjective and objective weighted attribute value consistency, a more comprehensive, reasonable and accurate combination weight is calculated. Finally, based on the traditional TOPSIS method, the triangular fuzzy numbers are introduced to better realize the scientific processing of the data information which is difficult to quantify, and the queuing indication value of each object and the ranking result are obtained. A numerical example is taken to prove that the
Entropy and the Typicality of Universes
Barbour, Julian; Koslowski, Tim; Mercati, Flavio
2015-01-01
The universal validity of the second law of thermodynamics is widely attributed to a finely tuned initial condition of the universe. This creates a problem: why is the universe atypical? We suggest that the problem is an artefact created by inappropriate transfer of the traditional concept of entropy to the whole universe. Use of what we call the relational $N$-body problem as a model indicates the need to employ two distinct entropy-type concepts to describe the universe. One, which we call ...
Implication of Negative Entropy Flow for Local Rainfall
Directory of Open Access Journals (Sweden)
Zhaohui Li
2013-08-01
Full Text Available The relation between the atmospheric entropy flow field and local rainfall is examined in terms of the theory of dissipative structures. In this paper, the entropy balance equation in a form suitable for describing the entropy budget of the Earth’s atmosphere is derived starting from the Gibbs relation, and, as examples, the entropy flows of the two severe weather events associated with the development of an extratropical cyclone and a tropical storm are calculated, respectively. The results show that negative entropy flow (NEF has a significant effect on the precipitation intensity and scope with an apparent matching of the NEF’s pattern with the rainfall distribution revealed and, that the diagnosis of NEF is able to provide a good indicator for precipitation forecasting.
Entropy - Some Cosmological Questions Answered by Model of Expansive Nondecelerative Universe
Directory of Open Access Journals (Sweden)
Miroslav Sukenik
2003-01-01
Full Text Available Abstract: The paper summarizes the background of Expansive Nondecelerative Universe model and its potential to offer answers to some open cosmological questions related to entropy. Three problems are faced in more detail, namely that of Hawkings phenomenon of black holes evaporation, maximum entropy of the Universe during its evolution, and time evolution of specific entropy.
Quantum Entropy and Its Applications to Quantum Communication and Statistical Physics
Directory of Open Access Journals (Sweden)
Masanori Ohya
2010-05-01
Full Text Available Quantum entropy is a fundamental concept for quantum information recently developed in various directions. We will review the mathematical aspects of quantum entropy (entropies and discuss some applications to quantum communication, statistical physics. All topics taken here are somehow related to the quantum entropy that the present authors have been studied. Many other fields recently developed in quantum information theory, such as quantum algorithm, quantum teleportation, quantum cryptography, etc., are totally discussed in the book (reference number 60.
Scaling-Laws of Flow Entropy with Topological Metrics of Water Distribution Networks
Giovanni Francesco Santonastaso; Armando Di Nardo; Michele Di Natale; Carlo Giudicianni; Roberto Greco
2018-01-01
Robustness of water distribution networks is related to their connectivity and topological structure, which also affect their reliability. Flow entropy, based on Shannon’s informational entropy, has been proposed as a measure of network redundancy and adopted as a proxy of reliability in optimal network design procedures. In this paper, the scaling properties of flow entropy of water distribution networks with their size and other topological metrics are studied. To such aim, flow entropy, ma...
The information entropy of a static dilaton black hole
Institute of Scientific and Technical Information of China (English)
2008-01-01
In accordance with holographic principle, by calculating the statistical entropy of the quantum field just at the event horizon of the Garfinkle-Horowitz-Strominger dilaton black hole, the information entropy of the black hole was investigated and the Bekenstein-Hawking formula was obtained. The results show that black hole entropy is identical with the statistical entropy of the quantum field at the horizon. Using the generalized uncertainty relation, the divergence of the state density near the event horizon in usual quantum field theory was removed, and the cutoffs and the little mass approximation in the heat gas method of black hole entropy were avoided. Thus, the microstates of the massive scalar field just at the event horizon of the static dilaton black hole were studied directly and a description on holograph principle was presented. By using residue theorem, the integral difficulty in the calculation was overcome, and the information entropy and the Bekenstein-Hawking formula were obtained quantitatively. Compared with the black hole entropy from the loop quantum gravity, the consistency of methods and results of calculating black hole entropy in non-commutative quantum field theory and loop quantum gravity was investigated. By this, the gravity correction constant in the generalized uncertainty relation was suggested and the sense of holographic principle was discussed.
Holographic Entanglement Entropy
Rangamani, Mukund
2016-01-01
We review the developments in the past decade on holographic entanglement entropy, a subject that has garnered much attention owing to its potential to teach us about the emergence of spacetime in holography. We provide an introduction to the concept of entanglement entropy in quantum field theories, review the holographic proposals for computing the same, providing some justification for where these proposals arise from in the first two parts. The final part addresses recent developments linking entanglement and geometry. We provide an overview of the various arguments and technical developments that teach us how to use field theory entanglement to detect geometry. Our discussion is by design eclectic; we have chosen to focus on developments that appear to us most promising for further insights into the holographic map. This is a preliminary draft of a few chapters of a book which will appear sometime in the near future, to be published by Springer. The book in addition contains a discussion of application o...
Entanglement entropy and the colored Jones polynomial
Balasubramanian, Vijay; DeCross, Matthew; Fliss, Jackson; Kar, Arjun; Leigh, Robert G.; Parrikar, Onkar
2018-05-01
We study the multi-party entanglement structure of states in Chern-Simons theory created by performing the path integral on 3-manifolds with linked torus boundaries, called link complements. For gauge group SU(2), the wavefunctions of these states (in a particular basis) are the colored Jones polynomials of the corresponding links. We first review the case of U(1) Chern-Simons theory where these are stabilizer states, a fact we use to re-derive an explicit formula for the entanglement entropy across a general link bipartition. We then present the following results for SU(2) Chern-Simons theory: (i) The entanglement entropy for a bipartition of a link gives a lower bound on the genus of surfaces in the ambient S 3 separating the two sublinks. (ii) All torus links (namely, links which can be drawn on the surface of a torus) have a GHZ-like entanglement structure — i.e., partial traces leave a separable state. By contrast, through explicit computation, we test in many examples that hyperbolic links (namely, links whose complements admit hyperbolic structures) have W-like entanglement — i.e., partial traces leave a non-separable state. (iii) Finally, we consider hyperbolic links in the complexified SL(2,C) Chern-Simons theory, which is closely related to 3d Einstein gravity with a negative cosmological constant. In the limit of small Newton constant, we discuss how the entanglement structure is controlled by the Neumann-Zagier potential on the moduli space of hyperbolic structures on the link complement.
Entropy region and convolution
Czech Academy of Sciences Publication Activity Database
Matúš, František; Csirmaz, L.
2016-01-01
Roč. 62, č. 11 (2016), s. 6007-6018 ISSN 0018-9448 R&D Projects: GA ČR GA13-20012S Institutional support: RVO:67985556 Keywords : entropy region * information-theoretic inequality * polymatroid Subject RIV: BD - Theory of Information Impact factor: 2.679, year: 2016 http://library.utia.cas.cz/separaty/2016/MTR/matus-0465564.pdf
Hyperspherical entanglement entropy
International Nuclear Information System (INIS)
Dowker, J S
2010-01-01
The coefficient of the log term in the entanglement entropy associated with hyperspherical surfaces in flat spacetime is shown to equal the conformal anomaly by conformally transforming Euclideanized spacetime to a sphere and using already existing formulae for the relevant heat-kernel coefficients after cyclic factoring. The result follows from the fact that the conformal anomaly on this lune has an extremum at the ordinary sphere limit. A proof is given. Agreement with a recent evaluation of the coefficient is found.
Hyperspherical entanglement entropy
Energy Technology Data Exchange (ETDEWEB)
Dowker, J S, E-mail: dowker@man.ac.u [Theory Group, School of Physics and Astronomy, University of Manchester, Manchester (United Kingdom)
2010-11-05
The coefficient of the log term in the entanglement entropy associated with hyperspherical surfaces in flat spacetime is shown to equal the conformal anomaly by conformally transforming Euclideanized spacetime to a sphere and using already existing formulae for the relevant heat-kernel coefficients after cyclic factoring. The result follows from the fact that the conformal anomaly on this lune has an extremum at the ordinary sphere limit. A proof is given. Agreement with a recent evaluation of the coefficient is found.
Preimage entropy dimension of topological dynamical systems
Liu, Lei; Zhou, Xiaomin; Zhou, Xiaoyao
2014-01-01
We propose a new definition of preimage entropy dimension for continuous maps on compact metric spaces, investigate fundamental properties of the preimage entropy dimension, and compare the preimage entropy dimension with the topological entropy dimension. The defined preimage entropy dimension holds various basic properties of topological entropy dimension, for example, the preimage entropy dimension of a subsystem is bounded by that of the original system and topologically conjugated system...
Directory of Open Access Journals (Sweden)
Bernard S. Kay
2015-12-01
Full Text Available We give a review, in the style of an essay, of the author’s 1998 matter-gravity entanglement hypothesis which, unlike the standard approach to entropy based on coarse-graining, offers a definition for the entropy of a closed system as a real and objective quantity. We explain how this approach offers an explanation for the Second Law of Thermodynamics in general and a non-paradoxical understanding of information loss during black hole formation and evaporation in particular. It also involves a radically different from usual description of black hole equilibrium states in which the total state of a black hole in a box together with its atmosphere is a pure state—entangled in just such a way that the reduced state of the black hole and of its atmosphere are each separately approximately thermal. We also briefly recall some recent work of the author which involves a reworking of the string-theory understanding of black hole entropy consistent with this alternative description of black hole equilibrium states and point out that this is free from some unsatisfactory features of the usual string theory understanding. We also recall the author’s recent arguments based on this alternative description which suggest that the Anti de Sitter space (AdS/conformal field theory (CFT correspondence is a bijection between the boundary CFT and just the matter degrees of freedom of the bulk theory.
Entanglement entropy and differential entropy for massive flavors
International Nuclear Information System (INIS)
Jones, Peter A.R.; Taylor, Marika
2015-01-01
In this paper we compute the holographic entanglement entropy for massive flavors in the D3-D7 system, for arbitrary mass and various entangling region geometries. We show that the universal terms in the entanglement entropy exactly match those computed in the dual theory using conformal perturbation theory. We derive holographically the universal terms in the entanglement entropy for a CFT perturbed by a relevant operator, up to second order in the coupling; our results are valid for any entangling region geometry. We present a new method for computing the entanglement entropy of any top-down brane probe system using Kaluza-Klein holography and illustrate our results with massive flavors at finite density. Finally we discuss the differential entropy for brane probe systems, emphasising that the differential entropy captures only the effective lower-dimensional Einstein metric rather than the ten-dimensional geometry.
Enthalpy-entropy compensation: the role of solvation.
Dragan, Anatoliy I; Read, Christopher M; Crane-Robinson, Colyn
2017-05-01
Structural modifications to interacting systems frequently lead to changes in both the enthalpy (heat) and entropy of the process that compensate each other, so that the Gibbs free energy is little changed: a major barrier to the development of lead compounds in drug discovery. The conventional explanation for such enthalpy-entropy compensation (EEC) is that tighter contacts lead to a more negative enthalpy but increased molecular constraints, i.e., a compensating conformational entropy reduction. Changes in solvation can also contribute to EEC but this contribution is infrequently discussed. We review long-established and recent cases of EEC and conclude that the large fluctuations in enthalpy and entropy observed are too great to be a result of only conformational changes and must result, to a considerable degree, from variations in the amounts of water immobilized or released on forming complexes. Two systems exhibiting EEC show a correlation between calorimetric entropies and local mobilities, interpreted to mean conformational control of the binding entropy/free energy. However, a substantial contribution from solvation gives the same effect, as a consequence of a structural link between the amount of bound water and the protein flexibility. Only by assuming substantial changes in solvation-an intrinsically compensatory process-can a more complete understanding of EEC be obtained. Faced with such large, and compensating, changes in the enthalpies and entropies of binding, the best approach to engineering elevated affinities must be through the addition of ionic links, as they generate increased entropy without affecting the enthalpy.
An entropy generation metric for non-energy systems assessments
International Nuclear Information System (INIS)
Sekulic, Dusan P.
2009-01-01
Processes in non-energy systems have not been as frequent a subject of sustainability studies based on Thermodynamics as have processes in energy systems. This paper offers insight into thermodynamic thinking devoted to selection of a sustainability energy-related metric based on entropy balancing of a non-energy system. An underlying objective in this sustainability oriented study is product quality involving thermal processing during manufacturing vs. resource utilization (say, energy). The product quality for the considered family of materials processing for manufacturing is postulated as inherently controlled by the imposed temperature non-uniformity margins. These temperature non-uniformities can be converted into a thermodynamic metric which can be related to either destruction of exergy of the available resource or, on a more fundamental level of process quality, to entropy generation inherent to the considered manufacturing system. Hence, a manufacturing system can be considered as if it were an energy system, although in the later case the system objective would be quite different. In a non-energy process, a metric may indicate the level of perfection of the process (not necessarily energy efficiency) and may be related to the sustainability footprint or, as advocated in this paper, it may be related to product quality. Controlled atmosphere brazing (CAB) of aluminum, a state-of-the-art manufacturing process involving mass production of compact heat exchangers for automotive, aerospace and process industries, has been used as an example.
Logarithmic black hole entropy corrections and holographic Renyi entropy
Energy Technology Data Exchange (ETDEWEB)
Mahapatra, Subhash [The Institute of Mathematical Sciences, Chennai (India); KU Leuven - KULAK, Department of Physics, Kortrijk (Belgium)
2018-01-15
The entanglement and Renyi entropies for spherical entangling surfaces in CFTs with gravity duals can be explicitly calculated by mapping these entropies first to the thermal entropy on hyperbolic space and then, using the AdS/CFT correspondence, to the Wald entropy of topological black holes. Here we extend this idea by taking into account corrections to the Wald entropy. Using the method based on horizon symmetries and the asymptotic Cardy formula, we calculate corrections to the Wald entropy and find that these corrections are proportional to the logarithm of the area of the horizon. With the corrected expression for the entropy of the black hole, we then find corrections to the Renyi entropies. We calculate these corrections for both Einstein and Gauss-Bonnet gravity duals. Corrections with logarithmic dependence on the area of the entangling surface naturally occur at the order G{sub D}{sup 0}. The entropic c-function and the inequalities of the Renyi entropy are also satisfied even with the correction terms. (orig.)
Logarithmic black hole entropy corrections and holographic Renyi entropy
International Nuclear Information System (INIS)
Mahapatra, Subhash
2018-01-01
The entanglement and Renyi entropies for spherical entangling surfaces in CFTs with gravity duals can be explicitly calculated by mapping these entropies first to the thermal entropy on hyperbolic space and then, using the AdS/CFT correspondence, to the Wald entropy of topological black holes. Here we extend this idea by taking into account corrections to the Wald entropy. Using the method based on horizon symmetries and the asymptotic Cardy formula, we calculate corrections to the Wald entropy and find that these corrections are proportional to the logarithm of the area of the horizon. With the corrected expression for the entropy of the black hole, we then find corrections to the Renyi entropies. We calculate these corrections for both Einstein and Gauss-Bonnet gravity duals. Corrections with logarithmic dependence on the area of the entangling surface naturally occur at the order G D 0 . The entropic c-function and the inequalities of the Renyi entropy are also satisfied even with the correction terms. (orig.)
Entropy Error Model of Planar Geometry Features in GIS
Institute of Scientific and Technical Information of China (English)
LI Dajun; GUAN Yunlan; GONG Jianya; DU Daosheng
2003-01-01
Positional error of line segments is usually described by using "g-band", however, its band width is in relation to the confidence level choice. In fact, given different confidence levels, a series of concentric bands can be obtained. To overcome the effect of confidence level on the error indicator, by introducing the union entropy theory, we propose an entropy error ellipse index of point, then extend it to line segment and polygon,and establish an entropy error band of line segment and an entropy error donut of polygon. The research shows that the entropy error index can be determined uniquely and is not influenced by confidence level, and that they are suitable for positional uncertainty of planar geometry features.
Additivity of the entropies of black holes and matter
International Nuclear Information System (INIS)
Martinez, E.A.; York, J.W. Jr.
1989-01-01
The principal object of this work is to address two related questions about thermodynamic equilibrium between black holes and matter: is there gravitational entropy other than that for black holes? In particular, is there gravitational entropy associated with matter in addition to its usual thermodynamic entropy? The authors treat here the case when the black hole and matter are minimally coupled and in equilibrium; nonequilibrium creation of entropy will not be considered and if black holes and matter are in thermal equilibrium, in what sense are their entropies additive? In order to answer these questions, the authors present a model in which a black hole is surrounded by a thin shell of matter and construct the thermodynamics of the system based on the current approach to black hole thermodynamics. The authors review the essential aspects of this approach and then apply it to the present example. Finally, some further thermodynamical properties of the system are presented
Entropy in the Critical Zone: A Comprehensive Review
Directory of Open Access Journals (Sweden)
Juan Quijano
2014-06-01
Full Text Available Thermodynamic entropy was initially proposed by Clausius in 1865. Since then it has been implemented in the analysis of different systems, and is seen as a promising concept to understand the evolution of open systems in non-equilibrium conditions. Information entropy was proposed by Shannon in 1948, and has become an important concept to measure information in different systems. Both thermodynamic entropy and information entropy have been extensively applied in different fields related to the Critical Zone, such as hydrology, ecology, pedology, and geomorphology. In this study, we review the most important applications of these concepts in those fields, including how they are calculated, and how they have been utilized to analyze different processes. We then synthesize the link between thermodynamic and information entropies in the light of energy dissipation and organizational patterns, and discuss how this link may be used to enhance the understanding of the Critical Zone.
ENTROPY FLOW CHARACTERISTICS ANALYSIS OF TYPHOON MATSA (0509)
Institute of Scientific and Technical Information of China (English)
XU Hui; LIU Chong-jian
2008-01-01
The evolution of Typhoon Matsa (0509) is examined in terms of entropy flow through an entropy balance equation derived from the Gibbs relation, according to the second law of thermodynamics. The entropy flows in the various significant stages of (genesis, development and decaying) during its evolution are diagnosed based on the outputs of the PSU/NCAR mesoscale model (known as MM5). The results show that: (1) the vertical spatial distribution of entropy flow for Matsa is characterized by a predominantly negative entropy flow in a large portion of the troposphere and a positive flow in the upper levels; (2) the fields of entropy flows at the middle troposphere (500 hPa) show that the growth of the typhoon is greatly dependent on the negative entropy flows from its surroundings; and (3) the simulated centres of heavy rainfall associated with the typhoon match well with the zones of large negative entropy flows, suggesting that they may be a significant indicator for severe weather events.
Linking entropy flow with typhoon evolution: a case-study
International Nuclear Information System (INIS)
Liu, C; Xu, H; Liu, Y
2007-01-01
This paper is mainly aimed at investigating the relationship of entropy flow with an atmospheric system (typhoon), based on the observational analyses covering its whole life-cycle. The formula for calculating entropy flow is derived starting with the Gibbs relation with data from the NCEP/NCAR reanalysis. The results show that: (i) entropy flow characteristics at different vertical layers of the system are heterogeneous with predominant negative entropy flow in the large portion of the troposphere and positive ones at upper levels during its development; (ii) changes in the maximum surface wind velocity or the intensity of a typhoon are synchronous with the total entropy flow around the typhoon centre and its neighbourhood, suggesting that the growth of a severe atmospheric system relies greatly upon the negative entropy flow being strong enough, and that entropy flow analysis might provide a particular point of view and a powerful tool to understand the mechanism responsible for the life-cycle of an atmospheric system and associated weather events; and (iii) the horizontal pattern of negative entropy flow near the surface might contain some significant information conducive to the track forecast of typhoons
Renormalization group flow of entanglement entropy on spheres
Energy Technology Data Exchange (ETDEWEB)
Ben-Ami, Omer; Carmi, Dean [Raymond and Beverly Sackler Faculty of Exact Sciences School of Physics and Astronomy,Tel-Aviv University, Ramat-Aviv 69978 (Israel); Smolkin, Michael [Center for Theoretical Physics and Department of Physics,University of California, Berkeley, CA 94720 (United States)
2015-08-12
We explore entanglement entropy of a cap-like region for a generic quantum field theory residing in the Bunch-Davies vacuum on de Sitter space. Entanglement entropy in our setup is identical with the thermal entropy in the static patch of de Sitter, and we derive a simple relation between the vacuum expectation value of the energy-momentum tensor trace and the RG flow of entanglement entropy. In particular, renormalization of the bare couplings and logarithmic divergence of the entanglement entropy are interrelated in our setup. We confirm our findings by recovering known universal contributions for a free field theory deformed by a mass operator as well as obtain correct universal behaviour at the fixed points. Simple examples of entanglement entropy flows are elaborated in d=2,3,4. In three dimensions we find that while the renormalized entanglement entropy is stationary at the fixed points, it is not monotonic. We provide a computational evidence that the universal ‘area law’ for a conformally coupled scalar is different from the known result in the literature, and argue that this difference survives in the limit of flat space. Finally, we carry out the spectral decomposition of entanglement entropy flow and discuss its application to the F-theorem.
Application of entropy measurement technique in grey based ...
African Journals Online (AJOL)
For this study, four control variables are selected current, voltage, gas flow rate and ... Keywords: Metal Inert Gas (MIG) Welding, Grey-Taguchi Method, Entropy ...... of metal inert gas welding on the corrosion and mechanical behaviour of.
Entropy: From Thermodynamics to Hydrology
Directory of Open Access Journals (Sweden)
Demetris Koutsoyiannis
2014-02-01
Full Text Available Some known results from statistical thermophysics as well as from hydrology are revisited from a different perspective trying: (a to unify the notion of entropy in thermodynamic and statistical/stochastic approaches of complex hydrological systems and (b to show the power of entropy and the principle of maximum entropy in inference, both deductive and inductive. The capability for deductive reasoning is illustrated by deriving the law of phase change transition of water (Clausius-Clapeyron from scratch by maximizing entropy in a formal probabilistic frame. However, such deductive reasoning cannot work in more complex hydrological systems with diverse elements, yet the entropy maximization framework can help in inductive inference, necessarily based on data. Several examples of this type are provided in an attempt to link statistical thermophysics with hydrology with a unifying view of entropy.
Credal Networks under Maximum Entropy
Lukasiewicz, Thomas
2013-01-01
We apply the principle of maximum entropy to select a unique joint probability distribution from the set of all joint probability distributions specified by a credal network. In detail, we start by showing that the unique joint distribution of a Bayesian tree coincides with the maximum entropy model of its conditional distributions. This result, however, does not hold anymore for general Bayesian networks. We thus present a new kind of maximum entropy models, which are computed sequentially. ...
Directory of Open Access Journals (Sweden)
Hang Liu
2016-08-01
Full Text Available In this paper, we investigate the angular momentum independence of the entropy sum and product for AdS rotating black holes based on the first law of thermodynamics and a mathematical lemma related to Vandermonde determinant. The advantage of this method is that the explicit forms of the spacetime metric, black hole mass and charge are not needed but the Hawking temperature and entropy formula on the horizons are necessary for static black holes, while our calculations require the expressions of metric and angular velocity formula. We find that the entropy sum is always independent of angular momentum for all dimensions and the angular momentum-independence of entropy product only holds for the dimensions d>4 with at least one rotation parameter ai=0, while the mass-free of entropy sum and entropy product for rotating black holes only stand for higher dimensions (d>4 and for all dimensions, respectively. On the other hand, we find that the introduction of a negative cosmological constant does not affect the angular momentum-free of entropy sum and product but the criterion for angular momentum-independence of entropy product will be affected.
Editorial: Entropy in Landscape Ecology
Directory of Open Access Journals (Sweden)
Samuel A. Cushman
2018-04-01
Full Text Available Entropy and the second law of thermodynamics are the central organizing principles of nature, but the ideas and implications of the second law are poorly developed in landscape ecology. The purpose of this Special Issue “Entropy in Landscape Ecology” in Entropy is to bring together current research on applications of thermodynamics in landscape ecology, to consolidate current knowledge and identify key areas for future research. The special issue contains six articles, which cover a broad range of topics including relationships between entropy and evolution, connections between fractal geometry and entropy, new approaches to calculate configurational entropy of landscapes, example analyses of computing entropy of landscapes, and using entropy in the context of optimal landscape planning. Collectively these papers provide a broad range of contributions to the nascent field of ecological thermodynamics. Formalizing the connections between entropy and ecology are in a very early stage, and that this special issue contains papers that address several centrally important ideas, and provides seminal work that will be a foundation for the future development of ecological and evolutionary thermodynamics.
Entropy and transverse section reconstruction
International Nuclear Information System (INIS)
Gullberg, G.T.
1976-01-01
A new approach to the reconstruction of a transverse section using projection data from multiple views incorporates the concept of maximum entropy. The principle of maximizing information entropy embodies the assurance of minimizing bias or prejudice in the reconstruction. Using maximum entropy is a necessary condition for the reconstructed image. This entropy criterion is most appropriate for 3-D reconstruction of objects from projections where the system is underdetermined or the data are limited statistically. This is the case in nuclear medicine time limitations in patient studies do not yield sufficient projections
Factors controlling upper tropospheric relative humidity
Directory of Open Access Journals (Sweden)
B. Kärcher
2004-03-01
Full Text Available Factors controlling the distribution of relative humidity in the absence of clouds are examined, with special emphasis on relative humidity over ice (RHI under upper tropospheric and lower stratospheric conditions. Variations of temperature are the key determinant for the distribution of RHI, followed by variations of the water vapor mixing ratio. Multiple humidity modes, generated by mixing of different air masses, may contribute to the overall distribution of RHI, in particular below ice saturation. The fraction of air that is supersaturated with respect to ice is mainly determined by the distribution of temperature. The nucleation of ice in cirrus clouds determines the highest relative humdity that can be measured outside of cirrus clouds. While vertical air motion and ice microphysics determine the slope of the distributions of RHI, as shown in a separate study companion (Haag et al., 2003, clouds are not required to explain the main features of the distributions of RHI below the ice nucleation threshold. Key words. Atmospheric composition and structure (pressure, density and temperature; troposphere – composition and chemistry; general or miscellaneous
Factors controlling upper tropospheric relative humidity
Directory of Open Access Journals (Sweden)
B. Kärcher
2004-03-01
Full Text Available Factors controlling the distribution of relative humidity in the absence of clouds are examined, with special emphasis on relative humidity over ice (RHI under upper tropospheric and lower stratospheric conditions. Variations of temperature are the key determinant for the distribution of RHI, followed by variations of the water vapor mixing ratio. Multiple humidity modes, generated by mixing of different air masses, may contribute to the overall distribution of RHI, in particular below ice saturation. The fraction of air that is supersaturated with respect to ice is mainly determined by the distribution of temperature. The nucleation of ice in cirrus clouds determines the highest relative humdity that can be measured outside of cirrus clouds. While vertical air motion and ice microphysics determine the slope of the distributions of RHI, as shown in a separate study companion (Haag et al., 2003, clouds are not required to explain the main features of the distributions of RHI below the ice nucleation threshold.
Key words. Atmospheric composition and structure (pressure, density and temperature; troposphere – composition and chemistry; general or miscellaneous
Nonextensive entropy interdisciplinary applications
Tsallis, Constantino
2004-01-01
A great variety of complex phenomena in many scientific fields exhibit power-law behavior, reflecting a hierarchical or fractal structure. Many of these phenomena seem to be susceptible to description using approaches drawn from thermodynamics or statistical mechanics, particularly approaches involving the maximization of entropy and of Boltzmann-Gibbs statistical mechanics and standard laws in a natural way. The book addresses the interdisciplinary applications of these ideas, and also on various phenomena that could possibly be quantitatively describable in terms of these ideas.
Minimum Error Entropy Classification
Marques de Sá, Joaquim P; Santos, Jorge M F; Alexandre, Luís A
2013-01-01
This book explains the minimum error entropy (MEE) concept applied to data classification machines. Theoretical results on the inner workings of the MEE concept, in its application to solving a variety of classification problems, are presented in the wider realm of risk functionals. Researchers and practitioners also find in the book a detailed presentation of practical data classifiers using MEE. These include multi‐layer perceptrons, recurrent neural networks, complexvalued neural networks, modular neural networks, and decision trees. A clustering algorithm using a MEE‐like concept is also presented. Examples, tests, evaluation experiments and comparison with similar machines using classic approaches, complement the descriptions.
Maximum Entropy: Clearing up Mysteries
Directory of Open Access Journals (Sweden)
Marian GrendÃƒÂ¡r
2001-04-01
Full Text Available Abstract: There are several mystifications and a couple of mysteries pertinent to MaxEnt. The mystifications, pitfalls and traps are set up mainly by an unfortunate formulation of Jaynes' die problem, the cause cÃƒÂ©lÃƒÂ¨bre of MaxEnt. After discussing the mystifications a new formulation of the problem is proposed. Then we turn to the mysteries. An answer to the recurring question 'Just what are we accomplishing when we maximize entropy?' [8], based on MaxProb rationale of MaxEnt [6], is recalled. A brief view on the other mystery: 'What is the relation between MaxEnt and the Bayesian method?' [9], in light of the MaxProb rationale of MaxEnt suggests that there is not and cannot be a conflict between MaxEnt and Bayes Theorem.
Information Entropy Measures for Stand Structural Diversity:Joint Entropy
Institute of Scientific and Technical Information of China (English)
Lei Xiangdong; Lu Yuanchang
2004-01-01
Structural diversity is the key attribute of a stand. A set of biodiversity measures in ecology was introduced in forest management for describing stand structure, of which Shannon information entropy (Shannon index) has been the most widely used measure of species diversity. It is generally thought that tree size diversity could serve as a good proxy for height diversity. However, tree size diversity and height diversity for stand structure is not completely consistent. Stand diameter cannot reflect height information completely. Either tree size diversity or height diversity is one-dimensional information entropy measure. This paper discussed the method of multiple-dimensional information entropy measure with the concept of joint entropy. It is suggested that joint entropy is a good measure for describing overall stand structural diversity.
Weak entropy inequalities and entropic convergence
Institute of Scientific and Technical Information of China (English)
2008-01-01
A criterion for algebraic convergence of the entropy is presented and an algebraic convergence result for the entropy of an exclusion process is improved. A weak entropy inequality is considered and its relationship to entropic convergence is discussed.
Force-Time Entropy of Isometric Impulse.
Hsieh, Tsung-Yu; Newell, Karl M
2016-01-01
The relation between force and temporal variability in discrete impulse production has been viewed as independent (R. A. Schmidt, H. Zelaznik, B. Hawkins, J. S. Frank, & J. T. Quinn, 1979 ) or dependent on the rate of force (L. G. Carlton & K. M. Newell, 1993 ). Two experiments in an isometric single finger force task investigated the joint force-time entropy with (a) fixed time to peak force and different percentages of force level and (b) fixed percentage of force level and different times to peak force. The results showed that the peak force variability increased either with the increment of force level or through a shorter time to peak force that also reduced timing error variability. The peak force entropy and entropy of time to peak force increased on the respective dimension as the parameter conditions approached either maximum force or a minimum rate of force production. The findings show that force error and timing error are dependent but complementary when considered in the same framework with the joint force-time entropy at a minimum in the middle parameter range of discrete impulse.
Generalized Entanglement Entropies of Quantum Designs
Liu, Zi-Wen; Lloyd, Seth; Zhu, Elton Yechao; Zhu, Huangjun
2018-03-01
The entanglement properties of random quantum states or dynamics are important to the study of a broad spectrum of disciplines of physics, ranging from quantum information to high energy and many-body physics. This Letter investigates the interplay between the degrees of entanglement and randomness in pure states and unitary channels. We reveal strong connections between designs (distributions of states or unitaries that match certain moments of the uniform Haar measure) and generalized entropies (entropic functions that depend on certain powers of the density operator), by showing that Rényi entanglement entropies averaged over designs of the same order are almost maximal. This strengthens the celebrated Page's theorem. Moreover, we find that designs of an order that is logarithmic in the dimension maximize all Rényi entanglement entropies and so are completely random in terms of the entanglement spectrum. Our results relate the behaviors of Rényi entanglement entropies to the complexity of scrambling and quantum chaos in terms of the degree of randomness, and suggest a generalization of the fast scrambling conjecture.
Directory of Open Access Journals (Sweden)
John Scales Avery
2012-04-01
Full Text Available In this essay, human society is regarded as a “superorganism”, analogous to colonies of social insects. The digestive system of the human superorganism is the global economy, which ingests both free energy and resources, and later excretes them in a degraded form. This process involves an increase in entropy. Early in the 20th century, both Frederick Soddy and Nicholas Georgescu-Roegen discussed the relationship between entropy and economics. Soddy called for an index system to regulate the money supply and a reform of the fractional reserve banking system, while Georgescu-Roegen pointed to the need for Ecological Economics, a steady-state economy, and population stabilization. As we reach the end of the fossil fuel era and as industrial growth falters, massive unemployment can only be avoided by responsible governmental action. The necessary steps include shifting labor to projects needed for a sustainable economy, dividing the available work fairly among those seeking employment, and reforming the practices of the financial sector.
International Nuclear Information System (INIS)
Steinmeyer, D.
1992-01-01
When we talk about saving energy what we usually mean is not wasting work. What we try to do when we design a process, is to use work as effectively as possible. It's hard to do that if we can't see it clearly. This paper illustrates how work can be seen (or calculated) without imposing entropy as a screen in front of it. We've all heard that the second law tells us that the entropy of the universe is increasing, and we are left with the feeling that the universe is ultimately headed for chaos, but receive little other information from this statement. A slightly more useful statement of the second law is the work potential of the universe is decreasing. However, this statement carries a needlessly negative ring. A simplified definition of the second law is: It takes work to change things. With these two corollaries: We can calculate the theoretical minimum work needed for a given change; and We can express the value of all changes in terms of work
Second Law Analysis of the Optimal Fin by Minimum Entropy Generation
Institute of Scientific and Technical Information of China (English)
无
2005-01-01
Based on the entropy generation concept of thermodynamics, this paper established a general theoretical model for the analysis of entropy generation to optimize fms, in which the minimum entropy generation was selected as the object to be studied. The irreversibility due to heat transfer and friction was taken into account so that the minimum entropygeneration number has been analyzed with respect to second law of thermodynamics in the forced cross-flow. The optimum dimensions of cylinder pins were discussed. It's found that the minimum entropy generation number depends on parameters related to the fluid and fin physical parameters. Variations of the minimum entropy generation number with different parameters were analyzed.
The Nernst theorem and statistical entropy in a (1+1)-dimensional charged black hole
International Nuclear Information System (INIS)
Ren, Z.; Junfang, Z.; Lichun, Z.
2001-01-01
It was derived that the bosonic and fermionic entropies in (1+1)-dimensional charged black hole directly by using the quantum statistical method. The result is the same as the integral expression obtained by solving the wave equation approximately. Then it is obtained the statistical entropy of the black hole by integration via the improved brick-wall method, membrane model. The derived entropy satisfies the thermodynamic relation. When the radiation temperature of the black hole tends to zero, so does the entropy. It obeys Nernst theorem. So it can be taken as Planck absolute entropy
Numerical viscosity of entropy stable schemes for systems of conservation laws. Final Report
International Nuclear Information System (INIS)
Tadmor, E.
1985-11-01
Discrete approximations to hyperbolic systems of conservation laws are studied. The amount of numerical viscosity present in such schemes is quantified and related to their entropy stability by means of comparison. To this end conservative schemes which are also entropy conservative are constructed. These entropy conservative schemes enjoy second-order accuracy; moreover, they admit a particular interpretation within the finite-element frameworks, and hence can be formulated on various mesh configurations. It is then shown that conservative schemes are entropy stable if and only if they contain more viscosity than the mentioned above entropy conservative ones
Pilge, Stefanie; Kreuzer, Matthias; Karatchiviev, Veliko; Kochs, Eberhard F; Malcharek, Michael; Schneider, Gerhard
2015-05-01
It is claimed that bispectral index (BIS) and state entropy reflect an identical clinical spectrum, the hypnotic component of anaesthesia. So far, it is not known to what extent different devices display similar index values while processing identical electroencephalogram (EEG) signals. To compare BIS and state entropy during analysis of identical EEG data. Inspection of raw EEG input to detect potential causes of erroneous index calculation. Offline re-analysis of EEG data from a randomised, single-centre controlled trial using the Entropy Module and an Aspect A-2000 monitor. Klinikum rechts der Isar, Technische Universität München, Munich. Forty adult patients undergoing elective surgery under general anaesthesia. Blocked randomisation of 20 patients per anaesthetic group (sevoflurane/remifentanil or propofol/remifentanil). Isolated forearm technique for differentiation between consciousness and unconsciousness. Prediction probability (PK) of state entropy to discriminate consciousness from unconsciousness. Correlation and agreement between state entropy and BIS from deep to light hypnosis. Analysis of raw EEG compared with index values that are in conflict with clinical examination, with frequency measures (frequency bands/Spectral Edge Frequency 95) and visual inspection for physiological EEG patterns (e.g. beta or delta arousal), pathophysiological features such as high-frequency signals (electromyogram/high-frequency EEG or eye fluttering/saccades), different types of electro-oculogram or epileptiform EEG and technical artefacts. PK of state entropy was 0.80 and of BIS 0.84; correlation coefficient of state entropy with BIS 0.78. Nine percent BIS and 14% state entropy values disagreed with clinical examination. Highest incidence of disagreement occurred after state transitions, in particular for state entropy after loss of consciousness during sevoflurane anaesthesia. EEG sequences which led to false 'conscious' index values often showed high
Connections between classical and parametric network entropies.
Directory of Open Access Journals (Sweden)
Matthias Dehmer
Full Text Available This paper explores relationships between classical and parametric measures of graph (or network complexity. Classical measures are based on vertex decompositions induced by equivalence relations. Parametric measures, on the other hand, are constructed by using information functions to assign probabilities to the vertices. The inequalities established in this paper relating classical and parametric measures lay a foundation for systematic classification of entropy-based measures of graph complexity.
Possible extended forms of thermodynamic entropy
International Nuclear Information System (INIS)
Sasa, Shin-ichi
2014-01-01
Thermodynamic entropy is determined by a heat measurement through the Clausius equality. The entropy then formalizes a fundamental limitation of operations by the second law of thermodynamics. The entropy is also expressed as the Shannon entropy of the microscopic degrees of freedom. Whenever an extension of thermodynamic entropy is attempted, we must pay special attention to how its three different aspects just mentioned are altered. In this paper, we discuss possible extensions of the thermodynamic entropy. (paper)
Configurational entropy of glueball states
Energy Technology Data Exchange (ETDEWEB)
Bernardini, Alex E., E-mail: alexeb@ufscar.br [Departamento de Física, Universidade Federal de São Carlos, PO Box 676, 13565-905, São Carlos, SP (Brazil); Braga, Nelson R.F., E-mail: braga@if.ufrj.br [Instituto de Física, Universidade Federal do Rio de Janeiro, Caixa Postal 68528, RJ 21941-972 (Brazil); Rocha, Roldão da, E-mail: roldao.rocha@ufabc.edu.br [CMCC, Universidade Federal do ABC, UFABC, 09210-580, Santo André (Brazil)
2017-02-10
The configurational entropy of glueball states is calculated using a holographic description. Glueball states are represented by a supergravity dual picture, consisting of a 5-dimensional graviton–dilaton action of a dynamical holographic AdS/QCD model. The configurational entropy is studied as a function of the glueball spin and of the mass, providing information about the stability of the glueball states.
Entropy statistics and information theory
Frenken, K.; Hanusch, H.; Pyka, A.
2007-01-01
Entropy measures provide important tools to indicate variety in distributions at particular moments in time (e.g., market shares) and to analyse evolutionary processes over time (e.g., technical change). Importantly, entropy statistics are suitable to decomposition analysis, which renders the
Black brane entropy and hydrodynamics
Booth, I.; Heller, M.P.; Spaliński, M.
2010-01-01
A generalization of entropy to near-equilibrium phenomena is provided by the notion of a hydrodynamic entropy current. Recent advances in holography have lead to the formulation of fluid-gravity duality, a remarkable connection between the hydrodynamics of certain strongly coupled media and dynamics
Black brane entropy and hydrodynamics
Booth, I.; Heller, M.P.; Spaliński, M.
2011-01-01
A generalization of entropy to near-equilibrium phenomena is provided by the notion of a hydrodynamic entropy current. Recent advances in holography have lead to the formulation of fluid-gravity duality, a remarkable connection between the hydrodynamics of certain strongly coupled media and dynamics
High Entropy Random Selection Protocols
H. Buhrman (Harry); M. Christandl (Matthias); M. Koucky (Michal); Z. Lotker (Zvi); B. Patt-Shamir; M. Charikar; K. Jansen; O. Reingold; J. Rolim
2007-01-01
textabstractIn this paper, we construct protocols for two parties that do not trust each other, to generate random variables with high Shannon entropy. We improve known bounds for the trade off between the number of rounds, length of communication and the entropy of the outcome.
Directory of Open Access Journals (Sweden)
Beretta, Gian Paolo
2008-02-01
complete and coherent resolution of the century-old dilemma on the meaning of entropy and the origin of irreversibility, including Onsager reciprocity relations and maximal-entropy-generation nonequilibrium dynamics, which we believe provides the microscopic foundations of heat, mass and momentum transfer theories, including all their implications such as Bejan's Constructal Theory of natural phenomena.
Absolute entropy of ions in methanol
International Nuclear Information System (INIS)
Abakshin, V.A.; Kobenin, V.A.; Krestov, G.A.
1978-01-01
By measuring the initial thermoelectromotive forces of chains with bromo-silver electrodes in tetraalkylammonium bromide solutions the absolute entropy of bromide-ion in methanol is determined in the 298.15-318.15 K range. The anti Ssub(Brsup(-))sup(0) = 9.8 entropy units value is used for calculation of the absolute partial molar entropy of alkali metal ions and halogenide ions. It has been found that, absolute entropy of Cs + =12.0 entropy units, I - =14.0 entropy units. The obtained ion absolute entropies in methanol at 298.15 K within 1-2 entropy units is in an agreement with published data
Entropy and equilibrium via games of complexity
Topsøe, Flemming
2004-09-01
It is suggested that thermodynamical equilibrium equals game theoretical equilibrium. Aspects of this thesis are discussed. The philosophy is consistent with maximum entropy thinking of Jaynes, but goes one step deeper by deriving the maximum entropy principle from an underlying game theoretical principle. The games introduced are based on measures of complexity. Entropy is viewed as minimal complexity. It is demonstrated that Tsallis entropy ( q-entropy) and Kaniadakis entropy ( κ-entropy) can be obtained in this way, based on suitable complexity measures. A certain unifying effect is obtained by embedding these measures in a two-parameter family of entropy functions.
Entropy Budget for Hawking Evaporation
Directory of Open Access Journals (Sweden)
Ana Alonso-Serrano
2017-07-01
Full Text Available Blackbody radiation, emitted from a furnace and described by a Planck spectrum, contains (on average an entropy of 3 . 9 ± 2 . 5 bits per photon. Since normal physical burning is a unitary process, this amount of entropy is compensated by the same amount of “hidden information” in correlations between the photons. The importance of this result lies in the posterior extension of this argument to the Hawking radiation from black holes, demonstrating that the assumption of unitarity leads to a perfectly reasonable entropy/information budget for the evaporation process. In order to carry out this calculation, we adopt a variant of the “average subsystem” approach, but consider a tripartite pure system that includes the influence of the rest of the universe, and which allows “young” black holes to still have a non-zero entropy; which we identify with the standard Bekenstein entropy.
Symbolic transfer entropy-based premature signal analysis
International Nuclear Information System (INIS)
Wang Jun; Yu Zheng-Feng
2012-01-01
In this paper, we use symbolic transfer entropy to study the coupling strength between premature signals. Numerical experiments show that three types of signal couplings are in the same direction. Among them, normal signal coupling is the strongest, followed by that of premature ventricular contractions, and that of atrial premature beats is the weakest. The T test shows that the entropies of the three signals are distinct. Symbolic transfer entropy requires less data, can distinguish the three types of signals and has very good computational efficiency. (interdisciplinary physics and related areas of science and technology)
Permutation entropy of fractional Brownian motion and fractional Gaussian noise
International Nuclear Information System (INIS)
Zunino, L.; Perez, D.G.; Martin, M.T.; Garavaglia, M.; Plastino, A.; Rosso, O.A.
2008-01-01
We have worked out theoretical curves for the permutation entropy of the fractional Brownian motion and fractional Gaussian noise by using the Bandt and Shiha [C. Bandt, F. Shiha, J. Time Ser. Anal. 28 (2007) 646] theoretical predictions for their corresponding relative frequencies. Comparisons with numerical simulations show an excellent agreement. Furthermore, the entropy-gap in the transition between these processes, observed previously via numerical results, has been here theoretically validated. Also, we have analyzed the behaviour of the permutation entropy of the fractional Gaussian noise for different time delays
Suggestion of a Management Model: Total Entropy Management
Goksel Alpan,; Ismail Efil
2011-01-01
“Entropy” can be defined as the measure of disorder, uncertainty and consumed energy in a system or in the Universe. In the study, entropy concept is used as metaphor and it is aimed to construct the conceptual basis of a new management model which can be utilized to manage all entropy sources effectively. The study is conveyed with a multidisciplinary and holistic approach and by the use of qualitative research techniques. In the study, it is examined the relations of the entropy concept wit...
Entropy of Kerr-de Sitter black hole
Li, Huai-Fan; Ma, Meng-Sen; Zhang, Li-Chun; Zhao, Ren
2017-07-01
Based on the consideration that the black hole horizon and the cosmological horizon of Kerr-de Sitter black hole are not independent of each other, we conjecture the total entropy of the system should have an extra term contributed from the correlations between the two horizons, except for the sum of the two horizon entropies. By employing globally effective first law and effective thermodynamic quantities, we obtain the corrected total entropy and find that the region of stable state for Kerr-de Sitter is related to the angular velocity parameter a, i.e., the region of stable state becomes bigger as the rotating parameters a is increases.
Energy Technology Data Exchange (ETDEWEB)
Zunino, Luciano, E-mail: lucianoz@ciop.unlp.edu.ar [Centro de Investigaciones Ópticas (CONICET La Plata – CIC), C.C. 3, 1897 Gonnet (Argentina); Departamento de Ciencias Básicas, Facultad de Ingeniería, Universidad Nacional de La Plata (UNLP), 1900 La Plata (Argentina); Olivares, Felipe, E-mail: olivaresfe@gmail.com [Instituto de Física, Pontificia Universidad Católica de Valparaíso (PUCV), 23-40025 Valparaíso (Chile); Scholkmann, Felix, E-mail: Felix.Scholkmann@gmail.com [Research Office for Complex Physical and Biological Systems (ROCoS), Mutschellenstr. 179, 8038 Zurich (Switzerland); Biomedical Optics Research Laboratory, Department of Neonatology, University Hospital Zurich, University of Zurich, 8091 Zurich (Switzerland); Rosso, Osvaldo A., E-mail: oarosso@gmail.com [Instituto de Física, Universidade Federal de Alagoas (UFAL), BR 104 Norte km 97, 57072-970, Maceió, Alagoas (Brazil); Instituto Tecnológico de Buenos Aires (ITBA) and CONICET, C1106ACD, Av. Eduardo Madero 399, Ciudad Autónoma de Buenos Aires (Argentina); Complex Systems Group, Facultad de Ingeniería y Ciencias Aplicadas, Universidad de los Andes, Av. Mons. Álvaro del Portillo 12.455, Las Condes, Santiago (Chile)
2017-06-15
A symbolic encoding scheme, based on the ordinal relation between the amplitude of neighboring values of a given data sequence, should be implemented before estimating the permutation entropy. Consequently, equalities in the analyzed signal, i.e. repeated equal values, deserve special attention and treatment. In this work, we carefully study the effect that the presence of equalities has on permutation entropy estimated values when these ties are symbolized, as it is commonly done, according to their order of appearance. On the one hand, the analysis of computer-generated time series is initially developed to understand the incidence of repeated values on permutation entropy estimations in controlled scenarios. The presence of temporal correlations is erroneously concluded when true pseudorandom time series with low amplitude resolutions are considered. On the other hand, the analysis of real-world data is included to illustrate how the presence of a significant number of equal values can give rise to false conclusions regarding the underlying temporal structures in practical contexts. - Highlights: • Impact of repeated values in a signal when estimating permutation entropy is studied. • Numerical and experimental tests are included for characterizing this limitation. • Non-negligible temporal correlations can be spuriously concluded by repeated values. • Data digitized with low amplitude resolutions could be especially affected. • Analysis with shuffled realizations can help to overcome this limitation.
Deconstructing Cross-Entropy for Probabilistic Binary Classifiers
Directory of Open Access Journals (Sweden)
Daniel Ramos
2018-03-01
Full Text Available In this work, we analyze the cross-entropy function, widely used in classifiers both as a performance measure and as an optimization objective. We contextualize cross-entropy in the light of Bayesian decision theory, the formal probabilistic framework for making decisions, and we thoroughly analyze its motivation, meaning and interpretation from an information-theoretical point of view. In this sense, this article presents several contributions: First, we explicitly analyze the contribution to cross-entropy of (i prior knowledge; and (ii the value of the features in the form of a likelihood ratio. Second, we introduce a decomposition of cross-entropy into two components: discrimination and calibration. This decomposition enables the measurement of different performance aspects of a classifier in a more precise way; and justifies previously reported strategies to obtain reliable probabilities by means of the calibration of the output of a discriminating classifier. Third, we give different information-theoretical interpretations of cross-entropy, which can be useful in different application scenarios, and which are related to the concept of reference probabilities. Fourth, we present an analysis tool, the Empirical Cross-Entropy (ECE plot, a compact representation of cross-entropy and its aforementioned decomposition. We show the power of ECE plots, as compared to other classical performance representations, in two diverse experimental examples: a speaker verification system, and a forensic case where some glass findings are present.
Entropy Measures as Geometrical Tools in the Study of Cosmology
Directory of Open Access Journals (Sweden)
Gilbert Weinstein
2017-12-01
Full Text Available Classical chaos is often characterized as exponential divergence of nearby trajectories. In many interesting cases these trajectories can be identified with geodesic curves. We define here the entropy by S = ln χ ( x with χ ( x being the distance between two nearby geodesics. We derive an equation for the entropy, which by transformation to a Riccati-type equation becomes similar to the Jacobi equation. We further show that the geodesic equation for a null geodesic in a double-warped spacetime leads to the same entropy equation. By applying a Robertson–Walker metric for a flat three-dimensional Euclidean space expanding as a function of time, we again reach the entropy equation stressing the connection between the chosen entropy measure and time. We finally turn to the Raychaudhuri equation for expansion, which also is a Riccati equation similar to the transformed entropy equation. Those Riccati-type equations have solutions of the same form as the Jacobi equation. The Raychaudhuri equation can be transformed to a harmonic oscillator equation, and it has been shown that the geodesic deviation equation of Jacobi is essentially equivalent to that of a harmonic oscillator. The Raychaudhuri equations are strong geometrical tools in the study of general relativity and cosmology. We suggest a refined entropy measure applicable in cosmology and defined by the average deviation of the geodesics in a congruence.
Fractal Structure and Entropy Production within the Central Nervous System
Directory of Open Access Journals (Sweden)
Andrew J. E. Seely
2014-08-01
Full Text Available Our goal is to explore the relationship between two traditionally unrelated concepts, fractal structure and entropy production, evaluating both within the central nervous system (CNS. Fractals are temporal or spatial structures with self-similarity across scales of measurement; whereas entropy production represents the necessary exportation of entropy to our environment that comes with metabolism and life. Fractals may be measured by their fractal dimension; and human entropy production may be estimated by oxygen and glucose metabolism. In this paper, we observe fractal structures ubiquitously present in the CNS, and explore a hypothetical and unexplored link between fractal structure and entropy production, as measured by oxygen and glucose metabolism. Rapid increase in both fractal structures and metabolism occur with childhood and adolescent growth, followed by slow decrease during aging. Concomitant increases and decreases in fractal structure and metabolism occur with cancer vs. Alzheimer’s and multiple sclerosis, respectively. In addition to fractals being related to entropy production, we hypothesize that the emergence of fractal structures spontaneously occurs because a fractal is more efficient at dissipating energy gradients, thus maximizing entropy production. Experimental evaluation and further understanding of limitations and necessary conditions are indicated to address broad scientific and clinical implications of this work.
International Nuclear Information System (INIS)
Johannessen, Eivind; Rosjorde, Audun
2007-01-01
We show that the theorem of equipartition of entropy production is important for the understanding of the state of minimum entropy production in diabatic distillation. The theorem is not valid in a strictly mathematical sense. We explain why, when and in what sense this theorem is a good approximation to the optimal state in diabatic distillation. In order to make these predictions, we use a hypothesis for the state of minimum entropy production of an optimally controlled system, which was formulated on the basis of results of entropy production minimisation in chemical reactors. The hypothesis says that the state of minimum entropy production is characterised by approximately constant local entropy production and thermodynamic forces, given that there is sufficient freedom in the system. We present numerical results which are in agreement with the predictions. The results show that a column with constant tray entropy production in the stripping section and in the rectifying section is a good approximation to the optimal column, except when the total heat transfer area is low. The agreement between the two columns becomes better and better as the total heat transfer area and the number of trays increase. The fact that the predictions and the numerical results agree very well gives support to the validity of the hypothesis
Introduction to maximum entropy
International Nuclear Information System (INIS)
Sivia, D.S.
1988-01-01
The maximum entropy (MaxEnt) principle has been successfully used in image reconstruction in a wide variety of fields. We review the need for such methods in data analysis and show, by use of a very simple example, why MaxEnt is to be preferred over other regularizing functions. This leads to a more general interpretation of the MaxEnt method, and its use is illustrated with several different examples. Practical difficulties with non-linear problems still remain, this being highlighted by the notorious phase problem in crystallography. We conclude with an example from neutron scattering, using data from a filter difference spectrometer to contrast MaxEnt with a conventional deconvolution. 12 refs., 8 figs., 1 tab
Introduction to maximum entropy
International Nuclear Information System (INIS)
Sivia, D.S.
1989-01-01
The maximum entropy (MaxEnt) principle has been successfully used in image reconstruction in a wide variety of fields. The author reviews the need for such methods in data analysis and shows, by use of a very simple example, why MaxEnt is to be preferred over other regularizing functions. This leads to a more general interpretation of the MaxEnt method, and its use is illustrated with several different examples. Practical difficulties with non-linear problems still remain, this being highlighted by the notorious phase problem in crystallography. He concludes with an example from neutron scattering, using data from a filter difference spectrometer to contrast MaxEnt with a conventional deconvolution. 12 refs., 8 figs., 1 tab
International Nuclear Information System (INIS)
Kandrup, H.E.
1988-01-01
The notion of a p-particle entropy Sp introduced by Kandrup (1987) is applied here to a Newtonian cosmology modeled as an expanding system of identical point masses studying the time dependence of S1 and S2 in the framework of the linearized theory considered by Fall and Saslaw (1976). It is found that if, at some initial time t0, the galaxy-galaxy correlation function vanished, then S1(t0) = S2(t0). At least for short times t - t0 thereafter, S1 and Delta S = S1 - S2 increase on a characteristic time scale. For all times t after t0, S1(t) = S2(t) or greater. 13 references
Chain rules for quantum Rényi entropies
International Nuclear Information System (INIS)
Dupuis, Frédéric
2015-01-01
We present chain rules for a new definition of the quantum Rényi conditional entropy sometimes called the “sandwiched” Rényi conditional entropy. More precisely, we prove analogues of the equation H(AB|C) = H(A|BC) + H(B|C), which holds as an identity for the von Neumann conditional entropy. In the case of the Rényi entropy, this relation no longer holds as an equality but survives as an inequality of the form H α (AB|C) ⩾ H β (A|BC) + H γ (B|C), where the parameters α, β, γ obey the relation (α)/(α−1) =(β)/(β−1) +(γ)/(γ−1) and (α − 1)(β − 1)(γ − 1) > 1; if (α − 1)(β − 1)(γ − 1) < 1, the direction of the inequality is reversed
Entropy Generation Minimization for Reverse Water Gas Shift (RWGS Reactors
Directory of Open Access Journals (Sweden)
Lei Zhang
2018-05-01
Full Text Available Thermal design and optimization for reverse water gas shift (RWGS reactors is particularly important to fuel synthesis in naval or commercial scenarios. The RWGS reactor with irreversibilities of heat transfer, chemical reaction and viscous flow is studied based on finite time thermodynamics or entropy generation minimization theory in this paper. The total entropy generation rate (EGR in the RWGS reactor with different boundary conditions is minimized subject to specific feed compositions and chemical conversion using optimal control theory, and the optimal configurations obtained are compared with three reference reactors with linear, constant reservoir temperature and constant heat flux operations, which are commonly used in engineering. The results show that a drastic EGR reduction of up to 23% can be achieved by optimizing the reservoir temperature profile, the inlet temperature of feed gas and the reactor length simultaneously, compared to that of the reference reactor with the linear reservoir temperature. These optimization efforts are mainly achieved by reducing the irreversibility of heat transfer. Optimal paths have subsections of relatively constant thermal force, chemical force and local EGR. A conceptual optimal design of sandwich structure for the compact modular reactor is proposed, without elaborate control tools or excessive interstage equipment. The results can provide guidelines for designing industrial RWGS reactors in naval or commercial scenarios.
Emergent Geometry from Entropy and Causality
Engelhardt, Netta
In this thesis, we investigate the connections between the geometry of spacetime and aspects of quantum field theory such as entanglement entropy and causality. This work is motivated by the idea that spacetime geometry is an emergent phenomenon in quantum gravity, and that the physics responsible for this emergence is fundamental to quantum field theory. Part I of this thesis is focused on the interplay between spacetime and entropy, with a special emphasis on entropy due to entanglement. In general spacetimes, there exist locally-defined surfaces sensitive to the geometry that may act as local black hole boundaries or cosmological horizons; these surfaces, known as holographic screens, are argued to have a connection with the second law of thermodynamics. Holographic screens obey an area law, suggestive of an association with entropy; they are also distinguished surfaces from the perspective of the covariant entropy bound, a bound on the total entropy of a slice of the spacetime. This construction is shown to be quite general, and is formulated in both classical and perturbatively quantum theories of gravity. The remainder of Part I uses the Anti-de Sitter/ Conformal Field Theory (AdS/CFT) correspondence to both expand and constrain the connection between entanglement entropy and geometry. The AdS/CFT correspondence posits an equivalence between string theory in the "bulk" with AdS boundary conditions and certain quantum field theories. In the limit where the string theory is simply classical General Relativity, the Ryu-Takayanagi and more generally, the Hubeny-Rangamani-Takayanagi (HRT) formulae provide a way of relating the geometry of surfaces to entanglement entropy. A first-order bulk quantum correction to HRT was derived by Faulkner, Lewkowycz and Maldacena. This formula is generalized to include perturbative quantum corrections in the bulk at any (finite) order. Hurdles to spacetime emergence from entanglement entropy as described by HRT and its quantum
Entropy generation method to quantify thermal comfort
Boregowda, S. C.; Tiwari, S. N.; Chaturvedi, S. K.
2001-01-01
The present paper presents a thermodynamic approach to assess the quality of human-thermal environment interaction and quantify thermal comfort. The approach involves development of entropy generation term by applying second law of thermodynamics to the combined human-environment system. The entropy generation term combines both human thermal physiological responses and thermal environmental variables to provide an objective measure of thermal comfort. The original concepts and definitions form the basis for establishing the mathematical relationship between thermal comfort and entropy generation term. As a result of logic and deterministic approach, an Objective Thermal Comfort Index (OTCI) is defined and established as a function of entropy generation. In order to verify the entropy-based thermal comfort model, human thermal physiological responses due to changes in ambient conditions are simulated using a well established and validated human thermal model developed at the Institute of Environmental Research of Kansas State University (KSU). The finite element based KSU human thermal computer model is being utilized as a "Computational Environmental Chamber" to conduct series of simulations to examine the human thermal responses to different environmental conditions. The output from the simulation, which include human thermal responses and input data consisting of environmental conditions are fed into the thermal comfort model. Continuous monitoring of thermal comfort in comfortable and extreme environmental conditions is demonstrated. The Objective Thermal Comfort values obtained from the entropy-based model are validated against regression based Predicted Mean Vote (PMV) values. Using the corresponding air temperatures and vapor pressures that were used in the computer simulation in the regression equation generates the PMV values. The preliminary results indicate that the OTCI and PMV values correlate well under ideal conditions. However, an experimental study
Directory of Open Access Journals (Sweden)
Christos A. Frantzidis
2014-08-01
Full Text Available Previous neuroscientific findings have linked Alzheimer’s disease (AD with less efficient information processing and brain network disorganization. However, pathological alterations of the brain networks during the preclinical phase of amnestic Mild Cognitive Impairment (aMCI remain largely unknown. The present study aimed at comparing patterns of the detection of functional disorganization in MCI relative to Mild Dementia (MD. Participants consisted of 23 cognitively healthy adults, 17 aMCI and 24 mild AD patients who underwent electroencephalographic (EEG data acquisition during a resting-state condition. Synchronization analysis through the Orthogonal Discrete Wavelet Transform (ODWT, and directional brain network analysis were applied on the EEG data. This computational model was performed for networks that have the same number of edges (N=500, 600, 700, 800 edges across all participants and groups (fixed density values. All groups exhibited a small-world (SW brain architecture. However, we found a significant reduction in the SW brain architecture in both aMCI and MD patients relative to the group of Healthy controls. This functional disorganization was also correlated with the participant’s generic cognitive status. The deterioration of the network’s organization was caused mainly by deficient local information processing as quantified by the mean cluster coefficient value. Functional hubs were identified through the normalized betweenness centrality metric. Analysis of the local characteristics showed relative hub preservation even with statistically significant reduced strength. Compensatory phenomena were also evident through the formation of additional hubs on left frontal and parietal regions. Our results indicate a declined functional network organization even during the prodromal phase. Degeneration is evident even in the preclinical phase and coexists with transient network reorganization due to compensation.
Van Assche, W.; Yáñez, R. J.; Dehesa, J. S.
1995-08-01
The information entropy of the harmonic oscillator potential V(x)=1/2λx2 in both position and momentum spaces can be expressed in terms of the so-called ``entropy of Hermite polynomials,'' i.e., the quantity Sn(H):= -∫-∞+∞H2n(x)log H2n(x) e-x2dx. These polynomials are instances of the polynomials orthogonal with respect to the Freud weights w(x)=exp(-||x||m), m≳0. Here, a very precise and general result of the entropy of Freud polynomials recently established by Aptekarev et al. [J. Math. Phys. 35, 4423-4428 (1994)], specialized to the Hermite kernel (case m=2), leads to an important refined asymptotic expression for the information entropies of very excited states (i.e., for large n) in both position and momentum spaces, to be denoted by Sρ and Sγ, respectively. Briefly, it is shown that, for large values of n, Sρ+1/2logλ≂log(π√2n/e)+o(1) and Sγ-1/2log λ≂log(π√2n/e)+o(1), so that Sρ+Sγ≂log(2π2n/e2)+o(1) in agreement with the generalized indetermination relation of Byalinicki-Birula and Mycielski [Commun. Math. Phys. 44, 129-132 (1975)]. Finally, the rate of convergence of these two information entropies is numerically analyzed. In addition, using a Rakhmanov result, we describe a totally new proof of the leading term of the entropy of Freud polynomials which, naturally, is just a weak version of the aforementioned general result.
Absence of log correction in entropy of large black holes
Energy Technology Data Exchange (ETDEWEB)
Ghosh, A., E-mail: amit.ghosh@saha.ac.in; Mitra, P., E-mail: parthasarathi.mitra@saha.ac.in
2014-06-27
Earlier calculations of black hole entropy in loop quantum gravity led to a dominant term proportional to the area, but there was a correction involving the logarithm of the area, the Chern–Simons level being assumed to be large. We find that the calculations yield an entropy proportional to the area eigenvalue with no such correction if the Chern–Simons level is finite, so that the area eigenvalue can be relatively large.
Entropy, Topological Theories and Emergent Quantum Mechanics
Directory of Open Access Journals (Sweden)
D. Cabrera
2017-02-01
Full Text Available The classical thermostatics of equilibrium processes is shown to possess a quantum mechanical dual theory with a ﬁnite dimensional Hilbert space of quantum states. Speciﬁcally, the kernel of a certain Hamiltonian operator becomes the Hilbert space of quasistatic quantum mechanics. The relation of thermostatics to topological ﬁeld theory is also discussed in the context of the approach of the emergence of quantum theory, where the concept of entropy plays a key role.
Bubble Entropy: An Entropy Almost Free of Parameters.
Manis, George; Aktaruzzaman, Md; Sassi, Roberto
2017-11-01
Objective : A critical point in any definition of entropy is the selection of the parameters employed to obtain an estimate in practice. We propose a new definition of entropy aiming to reduce the significance of this selection. Methods: We call the new definition Bubble Entropy . Bubble Entropy is based on permutation entropy, where the vectors in the embedding space are ranked. We use the bubble sort algorithm for the ordering procedure and count instead the number of swaps performed for each vector. Doing so, we create a more coarse-grained distribution and then compute the entropy of this distribution. Results: Experimental results with both real and synthetic HRV signals showed that bubble entropy presents remarkable stability and exhibits increased descriptive and discriminating power compared to all other definitions, including the most popular ones. Conclusion: The definition proposed is almost free of parameters. The most common ones are the scale factor r and the embedding dimension m . In our definition, the scale factor is totally eliminated and the importance of m is significantly reduced. The proposed method presents increased stability and discriminating power. Significance: After the extensive use of some entropy measures in physiological signals, typical values for their parameters have been suggested, or at least, widely used. However, the parameters are still there, application and dataset dependent, influencing the computed value and affecting the descriptive power. Reducing their significance or eliminating them alleviates the problem, decoupling the method from the data and the application, and eliminating subjective factors. Objective : A critical point in any definition of entropy is the selection of the parameters employed to obtain an estimate in practice. We propose a new definition of entropy aiming to reduce the significance of this selection. Methods: We call the new definition Bubble Entropy . Bubble Entropy is based on permutation
Zero modes and entanglement entropy
Energy Technology Data Exchange (ETDEWEB)
Yazdi, Yasaman K. [Perimeter Institute for Theoretical Physics,31 Caroline St. N., Waterloo, ON, N2L 2Y5 (Canada); Department of Physics and Astronomy, University of Waterloo,200 University Avenue West, Waterloo, ON, N2L 3G1 (Canada)
2017-04-26
Ultraviolet divergences are widely discussed in studies of entanglement entropy. Also present, but much less understood, are infrared divergences due to zero modes in the field theory. In this note, we discuss the importance of carefully handling zero modes in entanglement entropy. We give an explicit example for a chain of harmonic oscillators in 1D, where a mass regulator is necessary to avoid an infrared divergence due to a zero mode. We also comment on a surprising contribution of the zero mode to the UV-scaling of the entanglement entropy.
Shannon's information is not entropy
International Nuclear Information System (INIS)
Schiffer, M.
1990-01-01
In this letter we clear up the long-standing misidentification of Shannon's Information with Entropy. We show that Information, in contrast to Entropy, is not invariant under unitary transformations and that these quantities are only equivalent for representations consisting of Hamiltonian eigenstates. We illustrate this fact through a toy system consisting of a harmonic oscillator in a coherent state. It is further proved that the representations which maximize the information are those which are energy-eigenstates. This fact sets the entropy as an upper bound for Shannon's Information. (author)
Entropy Learning in Neural Network
Directory of Open Access Journals (Sweden)
Geok See Ng
2017-12-01
Full Text Available In this paper, entropy term is used in the learning phase of a neural network. As learning progresses, more hidden nodes get into saturation. The early creation of such hidden nodes may impair generalisation. Hence entropy approach is proposed to dampen the early creation of such nodes. The entropy learning also helps to increase the importance of relevant nodes while dampening the less important nodes. At the end of learning, the less important nodes can then be eliminated to reduce the memory requirements of the neural network.
Entropy in Collisionless Self-gravitating Systems
Barnes, Eric; Williams, L.
2010-01-01
Collisionless systems, like simulated dark matter halos or gas-less elliptical galaxies, often times have properties suggesting that a common physical principle controls their evolution. For example, N-body simulations of dark matter halos present nearly scale-free density/velocity-cubed profiles. In an attempt to understand the origins of such relationships, we adopt a thermodynamics approach. While it is well-known that self-gravitating systems do not have physically realizable thermal equilibrium configurations, we are interested in the behavior of entropy as mechanical equilibrium is acheived. We will discuss entropy production in these systems from a kinetic theory point of view. This material is based upon work supported by the National Aeronautics and Space Administration under grant NNX07AG86G issued through the Science Mission Directorate.
Dynamical entropy for infinite quantum systems
International Nuclear Information System (INIS)
Hudetz, T.
1990-01-01
We review the recent physical application of the so-called Connes-Narnhofer-Thirring entropy, which is the successful quantum mechanical generalization of the classical Kolmogorov-Sinai entropy and, by its very conception, is a dynamical entropy for infinite quantum systems. We thus comparingly review also the physical applications of the classical dynamical entropy for infinite classical systems. 41 refs. (Author)
Order and correlation contributions to the entropy of hydrophobic solvation
Energy Technology Data Exchange (ETDEWEB)
Liu, Maoyuan; Besford, Quinn Alexander; Mulvaney, Thomas; Gray-Weale, Angus, E-mail: gusgw@gusgw.net [School of Chemistry, The University of Melbourne, Victoria 3010 (Australia)
2015-03-21
The entropy of hydrophobic solvation has been explained as the result of ordered solvation structures, of hydrogen bonds, of the small size of the water molecule, of dispersion forces, and of solvent density fluctuations. We report a new approach to the calculation of the entropy of hydrophobic solvation, along with tests of and comparisons to several other methods. The methods are assessed in the light of the available thermodynamic and spectroscopic information on the effects of temperature on hydrophobic solvation. Five model hydrophobes in SPC/E water give benchmark solvation entropies via Widom’s test-particle insertion method, and other methods and models are tested against these particle-insertion results. Entropies associated with distributions of tetrahedral order, of electric field, and of solvent dipole orientations are examined. We find these contributions are small compared to the benchmark particle-insertion entropy. Competitive with or better than other theories in accuracy, but with no free parameters, is the new estimate of the entropy contributed by correlations between dipole moments. Dipole correlations account for most of the hydrophobic solvation entropy for all models studied and capture the distinctive temperature dependence seen in thermodynamic and spectroscopic experiments. Entropies based on pair and many-body correlations in number density approach the correct magnitudes but fail to describe temperature and size dependences, respectively. Hydrogen-bond definitions and free energies that best reproduce entropies from simulations are reported, but it is difficult to choose one hydrogen bond model that fits a variety of experiments. The use of information theory, scaled-particle theory, and related methods is discussed briefly. Our results provide a test of the Frank-Evans hypothesis that the negative solvation entropy is due to structured water near the solute, complement the spectroscopic detection of that solvation structure by
Information entropy for static spherically symmetric black holes
Institute of Scientific and Technical Information of China (English)
Jiang Ji-Jian; Li Chuan-An
2009-01-01
By using the new equation of state density derived from the generalized uncertainty relation, the number of the quantum states near event horizon is obtained, with which then the information entropy of static spherically symmetric black holes has been discussed. It is found that the divergent integral of quantum states near the event horizon can be naturally avoided if using the new equation of state density without introducing the ultraviolet cut-off. The information entropy of black holes can be obtained precisely by the residue theorem, which is shown to be proportional to the horizon area. The information entropy of black holes obtained agrees with the Bechenstein-Hawking entropy when the suitable cutoff factor is adopted.
Entropy and convexity for nonlinear partial differential equations.
Ball, John M; Chen, Gui-Qiang G
2013-12-28
Partial differential equations are ubiquitous in almost all applications of mathematics, where they provide a natural mathematical description of many phenomena involving change in physical, chemical, biological and social processes. The concept of entropy originated in thermodynamics and statistical physics during the nineteenth century to describe the heat exchanges that occur in the thermal processes in a thermodynamic system, while the original notion of convexity is for sets and functions in mathematics. Since then, entropy and convexity have become two of the most important concepts in mathematics. In particular, nonlinear methods via entropy and convexity have been playing an increasingly important role in the analysis of nonlinear partial differential equations in recent decades. This opening article of the Theme Issue is intended to provide an introduction to entropy, convexity and related nonlinear methods for the analysis of nonlinear partial differential equations. We also provide a brief discussion about the content and contributions of the papers that make up this Theme Issue.
Information entropy for static spherically symmetric black holes
International Nuclear Information System (INIS)
Ji-Jian, Jiang; Chuan-An, Li
2009-01-01
By using the new equation of state density derived from the generalized uncertainty relation, the number of the quantum states near event horizon is obtained, with which then the information entropy of static spherically symmetric black holes has been discussed. It is found that the divergent integral of quantum states near the event horizon can be naturally avoided if using the new equation of state density without introducing the ultraviolet cut-off. The information entropy of black holes can be obtained precisely by the residue theorem, which is shown to be proportional to the horizon area. The information entropy of black holes obtained agrees with the Bechenstein–Hawking entropy when the suitable cutoff factor is adopted. (general)
Phase transitions and quantum entropy
International Nuclear Information System (INIS)
Arrachea, L.; Canosa, N.; Plastino, A.; Portesi, M.; Rossignoli, R.
1990-01-01
An examination is made of the possibility to predict phase transitions of the fundamental state of finite quantum system, knowing the quantum entropy of these states, defined on the basis of the information theory. (Author). 7 refs., 3 figs
Renyi entropy and conformal defects
Energy Technology Data Exchange (ETDEWEB)
Bianchi, Lorenzo [Humboldt-Univ. Berlin (Germany). Inst. fuer Physik; Hamburg Univ. (Germany). II. Inst. fuer Theoretische Physik; Meineri, Marco [Scuola Normale Superiore, Pisa (Italy); Perimeter Institute for Theoretical Physics, Waterloo, ON (Canada); Istituto Nazionale di Fisica Nucleare, Pisa (Italy); Myers, Robert C. [Perimeter Institute for Theoretical Physics, Waterloo, ON (Canada); Smolkin, Michael [California Univ., Berkely, CA (United States). Center for Theoretical Physics and Department of Physics
2016-04-18
We propose a field theoretic framework for calculating the dependence of Renyi entropies on the shape of the entangling surface in a conformal field theory. Our approach rests on regarding the corresponding twist operator as a conformal defect and in particular, we define the displacement operator which implements small local deformations of the entangling surface. We identify a simple constraint between the coefficient defining the two-point function of the displacement operator and the conformal weight of the twist operator, which consolidates a number of distinct conjectures on the shape dependence of the Renyi entropy. As an example, using this approach, we examine a conjecture regarding the universal coefficient associated with a conical singularity in the entangling surface for CFTs in any number of spacetime dimensions. We also provide a general formula for the second order variation of the Renyi entropy arising from small deformations of a spherical entangling surface, extending Mezei's results for the entanglement entropy.
Renyi entropy and conformal defects
International Nuclear Information System (INIS)
Bianchi, Lorenzo; Myers, Robert C.; Smolkin, Michael
2016-01-01
We propose a field theoretic framework for calculating the dependence of Renyi entropies on the shape of the entangling surface in a conformal field theory. Our approach rests on regarding the corresponding twist operator as a conformal defect and in particular, we define the displacement operator which implements small local deformations of the entangling surface. We identify a simple constraint between the coefficient defining the two-point function of the displacement operator and the conformal weight of the twist operator, which consolidates a number of distinct conjectures on the shape dependence of the Renyi entropy. As an example, using this approach, we examine a conjecture regarding the universal coefficient associated with a conical singularity in the entangling surface for CFTs in any number of spacetime dimensions. We also provide a general formula for the second order variation of the Renyi entropy arising from small deformations of a spherical entangling surface, extending Mezei's results for the entanglement entropy.
Gravitational surface Hamiltonian and entropy quantization
Directory of Open Access Journals (Sweden)
Ashish Bakshi
2017-02-01
Full Text Available The surface Hamiltonian corresponding to the surface part of a gravitational action has xp structure where p is conjugate momentum of x. Moreover, it leads to TS on the horizon of a black hole. Here T and S are temperature and entropy of the horizon. Imposing the hermiticity condition we quantize this Hamiltonian. This leads to an equidistant spectrum of its eigenvalues. Using this we show that the entropy of the horizon is quantized. This analysis holds for any order of Lanczos–Lovelock gravity. For general relativity, the area spectrum is consistent with Bekenstein's observation. This provides a more robust confirmation of this earlier result as the calculation is based on the direct quantization of the Hamiltonian in the sense of usual quantum mechanics.
Configurational entropy in brane-world models
Energy Technology Data Exchange (ETDEWEB)
Correa, R.A.C. [CCNH, Universidade Federal do ABC, Santo Andre, SP (Brazil); Rocha, Roldao da [CMCC, Universidade Federal do ABC, Santo Andre, SP (Brazil); International School for Advanced Studies (SISSA), Trieste (Italy)
2015-11-15
In this work we investigate the entropic information on thick brane-world scenarios and its consequences. The brane-world entropic information is studied for the sine-Gordon model and hence the brane-world entropic information measure is shown to be an accurate way for providing the most suitable range for the bulk AdS curvature, in particular from the informational content of physical solutions. Besides, the brane-world configurational entropy is employed to demonstrate a high organisational degree in the structure of the configuration of the system, for large values of a parameter of the sine-Gordon model but the one related to the AdS curvature. The Gleiser and Stamatopoulos procedure is finally applied in order to achieve a precise correlation between the energy of the system and the brane-world configurational entropy. (orig.)
Configurational entropy in brane-world models
Energy Technology Data Exchange (ETDEWEB)
Correa, R. A. C., E-mail: fis04132@gmail.com [CCNH, Universidade Federal do ABC, 09210-580, Santo André, SP (Brazil); Rocha, Roldão da, E-mail: roldao.rocha@ufabc.edu.br [CMCC, Universidade Federal do ABC, 09210-580, Santo André, SP (Brazil); International School for Advanced Studies (SISSA), Via Bonomea 265, 34136, Trieste (Italy)
2015-11-02
In this work we investigate the entropic information on thick brane-world scenarios and its consequences. The brane-world entropic information is studied for the sine-Gordon model and hence the brane-world entropic information measure is shown to be an accurate way for providing the most suitable range for the bulk AdS curvature, in particular from the informational content of physical solutions. Besides, the brane-world configurational entropy is employed to demonstrate a high organisational degree in the structure of the configuration of the system, for large values of a parameter of the sine-Gordon model but the one related to the AdS curvature. The Gleiser and Stamatopoulos procedure is finally applied in order to achieve a precise correlation between the energy of the system and the brane-world configurational entropy.
Configurational entropy in brane-world models
International Nuclear Information System (INIS)
Correa, R. A. C.; Rocha, Roldão da
2015-01-01
In this work we investigate the entropic information on thick brane-world scenarios and its consequences. The brane-world entropic information is studied for the sine-Gordon model and hence the brane-world entropic information measure is shown to be an accurate way for providing the most suitable range for the bulk AdS curvature, in particular from the informational content of physical solutions. Besides, the brane-world configurational entropy is employed to demonstrate a high organisational degree in the structure of the configuration of the system, for large values of a parameter of the sine-Gordon model but the one related to the AdS curvature. The Gleiser and Stamatopoulos procedure is finally applied in order to achieve a precise correlation between the energy of the system and the brane-world configurational entropy
Directory of Open Access Journals (Sweden)
Prasad Radha K.
2017-09-01
Full Text Available This paper presents mathematical modelling and numerical analysis to evaluate entropy generation analysis (EGA by considering pressure drop and second law efficiency based on thermodynamics for forced convection heat transfer in rectangular duct of a solar air heater with wire as artificial roughness in the form of arc shape geometry on the absorber plate. The investigation includes evaluations of entropy generation, entropy generation number, Bejan number and irreversibilities of roughened as well as smooth absorber plate solar air heaters to compare the relative performances. Furthermore, effects of various roughness parameters and operating parameters on entropy generation have also been investigated. Entropy generation and irreversibilities (exergy destroyed has its minimum value at relative roughness height of 0.0422 and relative angle of attack of 0.33, which leads to the maximum exergetic efficiency. Entropy generation and exergy based analyses can be adopted for the evaluation of the overall performance of solar air heaters.
Applications of Entropy in Finance: A Review
Directory of Open Access Journals (Sweden)
Guanqun Tong
2013-11-01
Full Text Available Although the concept of entropy is originated from thermodynamics, its concepts and relevant principles, especially the principles of maximum entropy and minimum cross-entropy, have been extensively applied in finance. In this paper, we review the concepts and principles of entropy, as well as their applications in the field of finance, especially in portfolio selection and asset pricing. Furthermore, we review the effects of the applications of entropy and compare them with other traditional and new methods.
Spontaneous entropy decrease and its statistical formula
Xing, Xiu-San
2007-01-01
Why can the world resist the law of entropy increase and produce self-organizing structure? Does the entropy of an isolated system always only increase and never decrease? Can be thermodymamic degradation and self-organizing evolution united? How to unite? In this paper starting out from nonequilibrium entropy evolution equation we proved that a new entropy decrease could spontaneously emerge in nonequilibrium system with internal attractive interaction. This new entropy decrease coexists wit...
The entropy of the life table: A reappraisal.
Fernandez, Oscar E; Beltrán-Sánchez, Hiram
2015-09-01
The life table entropy provides useful information for understanding improvements in mortality and survival in a population. In this paper we take a closer look at the life table entropy and use advanced mathematical methods to provide additional insights for understanding how it relates to changes in mortality and survival. By studying the entropy (H) as a functional, we show that changes in the entropy depend on both the relative change in life expectancy lost due to death (e(†)) and in life expectancy at birth (e0). We also show that changes in the entropy can be further linked to improvements in premature and older deaths. We illustrate our methods with empirical data from Latin American countries, which suggests that at high mortality levels declines in H (which are associated with survival increases) linked with larger improvements in e0, whereas at low mortality levels e(†) made larger contributions to H. We additionally show that among countries with low mortality level, contributions of e(†) to changes in the life table entropy resulted from averting early deaths. These findings indicate that future increases in overall survival in low mortality countries will likely result from improvements in e(†). Copyright © 2015 Elsevier Inc. All rights reserved.
Characterization of time series via Rényi complexity-entropy curves
Jauregui, M.; Zunino, L.; Lenzi, E. K.; Mendes, R. S.; Ribeiro, H. V.
2018-05-01
One of the most useful tools for distinguishing between chaotic and stochastic time series is the so-called complexity-entropy causality plane. This diagram involves two complexity measures: the Shannon entropy and the statistical complexity. Recently, this idea has been generalized by considering the Tsallis monoparametric generalization of the Shannon entropy, yielding complexity-entropy curves. These curves have proven to enhance the discrimination among different time series related to stochastic and chaotic processes of numerical and experimental nature. Here we further explore these complexity-entropy curves in the context of the Rényi entropy, which is another monoparametric generalization of the Shannon entropy. By combining the Rényi entropy with the proper generalization of the statistical complexity, we associate a parametric curve (the Rényi complexity-entropy curve) with a given time series. We explore this approach in a series of numerical and experimental applications, demonstrating the usefulness of this new technique for time series analysis. We show that the Rényi complexity-entropy curves enable the differentiation among time series of chaotic, stochastic, and periodic nature. In particular, time series of stochastic nature are associated with curves displaying positive curvature in a neighborhood of their initial points, whereas curves related to chaotic phenomena have a negative curvature; finally, periodic time series are represented by vertical straight lines.
Locus of control in relation to flow
Directory of Open Access Journals (Sweden)
Celeste M Taylor
2006-04-01
Full Text Available The principal objective of the study was to examine the relationship between locus of control and optimal experience (flow in carrying out work and/or study activities. Two questionnaires measuring the aforementioned constructs were administered to a group of first and second-year Human Resource Management students (n=168 between the ages of 16 and 30. The results suggest that more frequent experience of flow is positively correlated with Autonomy and Internal Locus of Control. Limitations, lines of future research, implications and further contributions are discussed.
On Interrelation of Time and Entropy
Directory of Open Access Journals (Sweden)
Leonid M. Martyushev
2017-07-01
Full Text Available A measure of time is related to the number of ways by which the human correlates the past and the future for some process. On this basis, a connection between time and entropy (information, Boltzmann–Gibbs, and thermodynamic one is established. This measure gives time such properties as universality, relativity, directionality, and non-uniformity. A number of issues of the modern science related to the finding of laws describing changes in nature are discussed. A special emphasis is made on the role of evolutionary adaptation of an observer to the surrounding world.
Mohammad-Djafari, Ali
2015-01-01
The main object of this tutorial article is first to review the main inference tools using Bayesian approach, Entropy, Information theory and their corresponding geometries. This review is focused mainly on the ways these tools have been used in data, signal and image processing. After a short introduction of the different quantities related to the Bayes rule, the entropy and the Maximum Entropy Principle (MEP), relative entropy and the Kullback-Leibler divergence, Fisher information, we will study their use in different fields of data and signal processing such as: entropy in source separation, Fisher information in model order selection, different Maximum Entropy based methods in time series spectral estimation and finally, general linear inverse problems.
Thermal Expansion Anomaly Regulated by Entropy
Liu, Zi-Kui; Wang, Yi; Shang, Shunli
2014-11-01
Thermal expansion, defined as the temperature dependence of volume under constant pressure, is a common phenomenon in nature and originates from anharmonic lattice dynamics. However, it has been poorly understood how thermal expansion can show anomalies such as colossal positive, zero, or negative thermal expansion (CPTE, ZTE, or NTE), especially in quantitative terms. Here we show that changes in configurational entropy due to metastable micro(scopic)states can lead to quantitative prediction of these anomalies. We integrate the Maxwell relation, statistic mechanics, and first-principles calculations to demonstrate that when the entropy is increased by pressure, NTE occurs such as in Invar alloy (Fe3Pt, for example), silicon, ice, and water, and when the entropy is decreased dramatically by pressure, CPTE is expected such as in anti-Invar cerium, ice and water. Our findings provide a theoretic framework to understand and predict a broad range of anomalies in nature in addition to thermal expansion, which may include gigantic electrocaloric and electromechanical responses, anomalously reduced thermal conductivity, and spin distributions.
Multivariate multiscale entropy of financial markets
Lu, Yunfan; Wang, Jun
2017-11-01
In current process of quantifying the dynamical properties of the complex phenomena in financial market system, the multivariate financial time series are widely concerned. In this work, considering the shortcomings and limitations of univariate multiscale entropy in analyzing the multivariate time series, the multivariate multiscale sample entropy (MMSE), which can evaluate the complexity in multiple data channels over different timescales, is applied to quantify the complexity of financial markets. Its effectiveness and advantages have been detected with numerical simulations with two well-known synthetic noise signals. For the first time, the complexity of four generated trivariate return series for each stock trading hour in China stock markets is quantified thanks to the interdisciplinary application of this method. We find that the complexity of trivariate return series in each hour show a significant decreasing trend with the stock trading time progressing. Further, the shuffled multivariate return series and the absolute multivariate return series are also analyzed. As another new attempt, quantifying the complexity of global stock markets (Asia, Europe and America) is carried out by analyzing the multivariate returns from them. Finally we utilize the multivariate multiscale entropy to assess the relative complexity of normalized multivariate return volatility series with different degrees.
Bekenstein-Hawking Entropy and Strange Metals
Directory of Open Access Journals (Sweden)
Subir Sachdev
2015-11-01
Full Text Available We examine models of fermions with infinite-range interactions that realize non-Fermi liquids with a continuously variable U(1 charge density Q and a nonzero entropy density S at vanishing temperature. Real-time correlators of operators carrying U(1 charge q at a low temperature T are characterized by a Q-dependent frequency ω_{S}=(qT/ℏ(∂S/∂Q, which determines a spectral asymmetry. We show that the correlators match precisely with those of the two-dimensional anti–de Sitter (AdS_{2} horizons of extremal charged black holes. On the black hole side, the matching employs S as the Bekenstein-Hawking entropy density and the laws of black hole thermodynamics that relate (∂S/∂Q/(2π to the electric field strength in AdS_{2}. The fermion model entropy is computed using the microscopic degrees of freedom of a UV complete theory without supersymmetry.
Configuration Entropy Calculations for Complex Compounds Technetium
International Nuclear Information System (INIS)
Muhayatun; Susanto Imam Rahayu; Surdia, N.M.; Abdul Mutalib
2002-01-01
Recently, the study of technetium complexes is rapidly increasing, due to the benefit of 99m Tc complexes (one of Tc nuclear isomers), which are widely used for diagnostics. Study of the structure-stability relationship of Tc complexes based on solid angle has been done by Kung using a Solid Angle Factor Sum (SAS). The SAS is hypothesized to be related to stability. SAS has been used by several researchers either for synthesis or designing the reaction route of the Tc complex formation and predicting the geometry of complex structures. Although the advantages of the SAS were very gratifying, but the model does not have the theoretical basis which is able to explain the correlation of steric parameters to physicochemical properties of complexes especially to those connected to a complex's stability. To improve the SAS model, in this research the model was modified by providing a theoretical basis for SAS. The results obtained from the correlation of the SAS value to the thermodynamic stability parameters of simple complexes show the values to have a similar trend as the standard entropy (S 0 ). The entropy approximation model was created by involving some factors which are not used in Kung's model. Entropy optimization to the bond length (ML) has also been done to several complexes. The calculations of SAS value using the calculated R for more than 100 Tc complexes provide a normalized mean value of 0.8545 ± 0.0851 and have similar curve profiles as those of Kung's model. The entropy value can be obtained by multiplying the natural logarithm of the a priori degeneracy of a certain distribution (Ω) and the Boltzmann constant. The results of Ω and In Ω of the Tc complexes have a narrow range. The results of this research are able to provide a basic concept for the SAS to explain the structure-stability relationship and to improve Kung's model. (author)
Characterizing time series via complexity-entropy curves
Ribeiro, Haroldo V.; Jauregui, Max; Zunino, Luciano; Lenzi, Ervin K.
2017-06-01
The search for patterns in time series is a very common task when dealing with complex systems. This is usually accomplished by employing a complexity measure such as entropies and fractal dimensions. However, such measures usually only capture a single aspect of the system dynamics. Here, we propose a family of complexity measures for time series based on a generalization of the complexity-entropy causality plane. By replacing the Shannon entropy by a monoparametric entropy (Tsallis q entropy) and after considering the proper generalization of the statistical complexity (q complexity), we build up a parametric curve (the q -complexity-entropy curve) that is used for characterizing and classifying time series. Based on simple exact results and numerical simulations of stochastic processes, we show that these curves can distinguish among different long-range, short-range, and oscillating correlated behaviors. Also, we verify that simulated chaotic and stochastic time series can be distinguished based on whether these curves are open or closed. We further test this technique in experimental scenarios related to chaotic laser intensity, stock price, sunspot, and geomagnetic dynamics, confirming its usefulness. Finally, we prove that these curves enhance the automatic classification of time series with long-range correlations and interbeat intervals of healthy subjects and patients with heart disease.
The semiotics of control and modeling relations in complex systems.
Joslyn, C
2001-01-01
We provide a conceptual analysis of ideas and principles from the systems theory discourse which underlie Pattee's semantic or semiotic closure, which is itself foundational for a school of theoretical biology derived from systems theory and cybernetics, and is now being related to biological semiotics and explicated in the relational biological school of Rashevsky and Rosen. Atomic control systems and models are described as the canonical forms of semiotic organization, sharing measurement relations, but differing topologically in that control systems are circularly and models linearly related to their environments. Computation in control systems is introduced, motivating hierarchical decomposition, hybrid modeling and control systems, and anticipatory or model-based control. The semiotic relations in complex control systems are described in terms of relational constraints, and rules and laws are distinguished as contingent and necessary functional entailments, respectively. Finally, selection as a meta-level of constraint is introduced as the necessary condition for semantic relations in control systems and models.
Control perceptions and control appraisal: Relation to measures of ...
African Journals Online (AJOL)
Objectives: To investigate the relationship between control variables and measures of subjective wellbeing. The primary question asked was “who is happy and well, and why?” Design: A questionnaire survey and the data was analyzed by examining bivariate relationships between variables of interest. Participants: Two ...
Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing
2015-08-01
In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.
Quantum key distribution with finite resources: Smooth Min entropy vs. Smooth Renyi entropy
Energy Technology Data Exchange (ETDEWEB)
Mertz, Markus; Abruzzo, Silvestre; Bratzik, Sylvia; Kampermann, Hermann; Bruss, Dagmar [Institut fuer Theoretische Physik III, Duesseldorf (Germany)
2010-07-01
We consider different entropy measures that play an important role in the analysis of the security of QKD with finite resources. The smooth min entropy leads to an optimal bound for the length of a secure key. Another bound on the secure key length was derived by using Renyi entropies. Unfortunately, it is very hard or even impossible to calculate these entropies for realistic QKD scenarios. To estimate the security rate it becomes important to find computable bounds on these entropies. Here, we compare a lower bound for the smooth min entropy with a bound using Renyi entropies. We compare these entropies for the six-state protocol with symmetric attacks.
Carpenter, Mark H.; Fisher, Travis C.; Nielsen, Eric J.; Frankel, Steven H.
2013-01-01
Nonlinear entropy stability and a summation-by-parts framework are used to derive provably stable, polynomial-based spectral collocation methods of arbitrary order. The new methods are closely related to discontinuous Galerkin spectral collocation methods commonly known as DGFEM, but exhibit a more general entropy stability property. Although the new schemes are applicable to a broad class of linear and nonlinear conservation laws, emphasis herein is placed on the entropy stability of the compressible Navier-Stokes equations.
Entropy of nonrotating isolated horizons in Lovelock theory from loop quantum gravity
Wang, Jing-Bo; Huang, Chao-Guang; Li, Lin
2016-08-01
In this paper, the BF theory method is applied to the nonrotating isolated horizons in Lovelock theory. The final entropy matches the Wald entropy formula for this theory. We also confirm the conclusion obtained by Bodendorfer et al. that the entropy is related to the flux operator rather than the area operator in general diffeomorphic-invariant theory. Supported by National Natural Science Foundation of China (11275207)
Wu, Yue; Shang, Pengjian; Li, Yilong
2018-03-01
A modified multiscale sample entropy measure based on symbolic representation and similarity (MSEBSS) is proposed in this paper to research the complexity of stock markets. The modified algorithm reduces the probability of inducing undefined entropies and is confirmed to be robust to strong noise. Considering the validity and accuracy, MSEBSS is more reliable than Multiscale entropy (MSE) for time series mingled with much noise like financial time series. We apply MSEBSS to financial markets and results show American stock markets have the lowest complexity compared with European and Asian markets. There are exceptions to the regularity that stock markets show a decreasing complexity over the time scale, indicating a periodicity at certain scales. Based on MSEBSS, we introduce the modified multiscale cross-sample entropy measure based on symbolic representation and similarity (MCSEBSS) to consider the degree of the asynchrony between distinct time series. Stock markets from the same area have higher synchrony than those from different areas. And for stock markets having relative high synchrony, the entropy values will decrease with the increasing scale factor. While for stock markets having high asynchrony, the entropy values will not decrease with the increasing scale factor sometimes they tend to increase. So both MSEBSS and MCSEBSS are able to distinguish stock markets of different areas, and they are more helpful if used together for studying other features of financial time series.
Relative controllability of nonlinear neutral systems with distributed ...
African Journals Online (AJOL)
In this paper we study the relative controllability of nonlinear neutral system with distributed and multiple lumped time varying delays in control. Using Schauder's fixed point theorem sufficient conditions for relative controllability in a given time interval are formulated and proved. Journal of the Nigerian Association of ...
Maximum Entropy in Drug Discovery
Directory of Open Access Journals (Sweden)
Chih-Yuan Tseng
2014-07-01
Full Text Available Drug discovery applies multidisciplinary approaches either experimentally, computationally or both ways to identify lead compounds to treat various diseases. While conventional approaches have yielded many US Food and Drug Administration (FDA-approved drugs, researchers continue investigating and designing better approaches to increase the success rate in the discovery process. In this article, we provide an overview of the current strategies and point out where and how the method of maximum entropy has been introduced in this area. The maximum entropy principle has its root in thermodynamics, yet since Jaynes’ pioneering work in the 1950s, the maximum entropy principle has not only been used as a physics law, but also as a reasoning tool that allows us to process information in hand with the least bias. Its applicability in various disciplines has been abundantly demonstrated. We give several examples of applications of maximum entropy in different stages of drug discovery. Finally, we discuss a promising new direction in drug discovery that is likely to hinge on the ways of utilizing maximum entropy.
Standard entropy for borides of non-transition metals, rare-earth metals and actinides
International Nuclear Information System (INIS)
Borovikova, M.S.
1986-01-01
Using as initial data the most reliable values of standard entropy for 10 compounds, the entropies for 40 compounds of non-transition metals, rare-earth metals and actinides have been evaluated by the method of comparative calculation. Taking into account the features of boride structures, two methods, i.e. additive and proportional, have been selected for the entropy calculations. For the range of borides the entropies were calculated from the linear relation of the latter to the number of boron atoms in the boride. For borides of rare-earth metals allowance has been made for magnetic contributions in conformity with the multiplicity of the corresponding ions. Insignificant differences in the electronic contributions to the entropy for borides and metals have been neglected. For dodecaborides only the additive method has been used. This is specified by the most rigid network that provides the same contribution to compound entropy. (orig.)
ENTROPY PRODUCTION IN COLLISIONLESS SYSTEMS. I. LARGE PHASE-SPACE OCCUPATION NUMBERS
International Nuclear Information System (INIS)
Barnes, Eric I.; Williams, Liliya L. R.
2011-01-01
Certain thermal non-equilibrium situations, outside of the astrophysical realm, suggest that entropy production extrema, instead of entropy extrema, are related to stationary states. In an effort to better understand the evolution of collisionless self-gravitating systems, we investigate the role of entropy production and develop expressions for the entropy production rate in two particular statistical families that describe self-gravitating systems. From these entropy production descriptions, we derive the requirements for extremizing the entropy production rate in terms of specific forms for the relaxation function in the Boltzmann equation. We discuss some implications of these relaxation functions and point to future work that will further test this novel thermodynamic viewpoint of collisionless relaxation.
CFD Prediction of Airfoil Drag in Viscous Flow Using the Entropy Generation Method
Directory of Open Access Journals (Sweden)
Wei Wang
2018-01-01
Full Text Available A new aerodynamic force of drag prediction approach was developed to compute the airfoil drag via entropy generation rate in the flow field. According to the momentum balance, entropy generation and its relationship to drag were derived for viscous flow. Model equations for the calculation of the local entropy generation in turbulent flows were presented by extending the RANS procedure to the entropy balance equation. The accuracy of algorithm and programs was assessed by simulating the pressure coefficient distribution and dragging coefficient of different airfoils under different Reynolds number at different attack angle. Numerical data shows that the total entropy generation rate in the flow field and the drag coefficient of the airfoil can be related by linear equation, which indicates that the total drag could be resolved into entropy generation based on its physical mechanism of energy loss.
Entropy and complexity analysis of hydrogenic Rydberg atoms
Energy Technology Data Exchange (ETDEWEB)
Lopez-Rosa, S. [Instituto Carlos I de Fisica Teorica y Computacional, Universidad de Granada, 18071-Granada (Spain); Departamento de Fisica Aplicada II, Universidad de Sevilla, 41012-Sevilla (Spain); Toranzo, I. V.; Dehesa, J. S. [Instituto Carlos I de Fisica Teorica y Computacional, Universidad de Granada, 18071-Granada (Spain); Departamento de Fisica Atomica, Molecular y Nuclear, Universidad de Granada, 18071-Granada (Spain); Sanchez-Moreno, P. [Instituto Carlos I de Fisica Teorica y Computacional, Universidad de Granada, 18071-Granada (Spain); Departamento de Matematica Aplicada, Universidad de Granada, 18071-Granada (Spain)
2013-05-15
The internal disorder of hydrogenic Rydberg atoms as contained in their position and momentum probability densities is examined by means of the following information-theoretic spreading quantities: the radial and logarithmic expectation values, the Shannon entropy, and the Fisher information. As well, the complexity measures of Cramer-Rao, Fisher-Shannon, and Lopez Ruiz-Mancini-Calvet types are investigated in both reciprocal spaces. The leading term of these quantities is rigorously calculated by use of the asymptotic properties of the concomitant entropic functionals of the Laguerre and Gegenbauer orthogonal polynomials which control the wavefunctions of the Rydberg states in both position and momentum spaces. The associated generalized Heisenberg-like, logarithmic and entropic uncertainty relations are also given. Finally, application to linear (l= 0), circular (l=n- 1), and quasicircular (l=n- 2) states is explicitly done.
Entropy and complexity analysis of hydrogenic Rydberg atoms
International Nuclear Information System (INIS)
López-Rosa, S.; Toranzo, I. V.; Dehesa, J. S.; Sánchez-Moreno, P.
2013-01-01
The internal disorder of hydrogenic Rydberg atoms as contained in their position and momentum probability densities is examined by means of the following information-theoretic spreading quantities: the radial and logarithmic expectation values, the Shannon entropy, and the Fisher information. As well, the complexity measures of Crámer-Rao, Fisher-Shannon, and López Ruiz-Mancini-Calvet types are investigated in both reciprocal spaces. The leading term of these quantities is rigorously calculated by use of the asymptotic properties of the concomitant entropic functionals of the Laguerre and Gegenbauer orthogonal polynomials which control the wavefunctions of the Rydberg states in both position and momentum spaces. The associated generalized Heisenberg-like, logarithmic and entropic uncertainty relations are also given. Finally, application to linear (l= 0), circular (l=n− 1), and quasicircular (l=n− 2) states is explicitly done.
Related regulation of quality control of industrial products
International Nuclear Information System (INIS)
1983-04-01
This book introduce related regulation of quality control of industrial products, which includes regulations of industrial products quality control, enforcement ordinance of industrial products quality control, enforcement regulation of quality control of industrial products, designated items with industrial production quality indication, industrial production quality test, and industrial production quality test organization and management tips of factory quality by grade.
Relational databases for SSC design and control
International Nuclear Information System (INIS)
Barr, E.; Peggs, S.; Saltmarsh, C.
1989-01-01
Most people agree that a database is A Good Thing, but there is much confusion in the jargon used, and in what jobs a database management system and its peripheral software can and cannot do. During the life cycle of an enormous project like the SSC, from conceptual and theoretical design, through research and development, to construction, commissioning and operation, an enormous amount of data will be generated. Some of these data, originating in the early parts of the project, will be needed during commissioning or operation, many years in the future. Two of these pressing data management needs-from the magnet research and industrialization programs and the lattice design-have prompted work on understanding and adapting commercial database practices for scientific projects. Modern relational database management systems (rDBMS's) cope naturally with a large proportion of the requirements of data structures, like the SSC database structure built for the superconduction cable supplies, uses, and properties. This application is similar to the commercial applications for which these database systems were developed. The SSC application has further requirements not immediately satisfied by the commercial systems. These derive from the diversity of the data structures to be managed, the changing emphases and uses during the project lifetime, and the large amount of scientific data processing to be expected. 4 refs., 5 figs
Lemons, Don S
2013-01-01
Striving to explore the subject in as simple a manner as possible, this book helps readers understand the elusive concept of entropy. Innovative aspects of the book include the construction of statistical entropy, the derivation of the entropy of classical systems from purely classical assumptions, and a statistical thermodynamics approach to the ideal Fermi and ideal Bose gases. Derivations are worked through step-by-step and important applications are highlighted in over 20 worked examples. Nearly 50 end-of-chapter exercises test readers' understanding. The book also features a glossary giving definitions for all essential terms, a time line showing important developments, and list of books for further study. It is an ideal supplement to undergraduate courses in physics, engineering, chemistry and mathematics.
Analysis of crack propagation in concrete structures with structural information entropy
Institute of Scientific and Technical Information of China (English)
无
2010-01-01
The propagation of cracks in concrete structures causes energy dissipation and release, and also causes energy redistribution in the structures. Entropy can characterize the energy redistribution. To investigate the relation between the propagation of cracks and the entropy in concrete structures, cracked concrete structures are treated as dissipative structures. Structural information entropy is defined for concrete structures. A compact tension test is conducted. Meanwhile, numerical simulations are also carried out. Both the test and numerical simulation results show that the structural information entropy in the structures can characterize the propagation of cracks in concrete structures.
MINIMUM ENTROPY DECONVOLUTION OF ONE-AND MULTI-DIMENSIONAL NON-GAUSSIAN LINEAR RANDOM PROCESSES
Institute of Scientific and Technical Information of China (English)
程乾生
1990-01-01
The minimum entropy deconvolution is considered as one of the methods for decomposing non-Gaussian linear processes. The concept of peakedness of a system response sequence is presented and its properties are studied. With the aid of the peakedness, the convergence theory of the minimum entropy deconvolution is established. The problem of the minimum entropy deconvolution of multi-dimensional non-Gaussian linear random processes is first investigated and the corresponding theory is given. In addition, the relation between the minimum entropy deconvolution and parameter method is discussed.
Shannon entropy and particle decays
Carrasco Millán, Pedro; García-Ferrero, M. Ángeles; Llanes-Estrada, Felipe J.; Porras Riojano, Ana; Sánchez García, Esteban M.
2018-05-01
We deploy Shannon's information entropy to the distribution of branching fractions in a particle decay. This serves to quantify how important a given new reported decay channel is, from the point of view of the information that it adds to the already known ones. Because the entropy is additive, one can subdivide the set of channels and discuss, for example, how much information the discovery of a new decay branching would add; or subdivide the decay distribution down to the level of individual quantum states (which can be quickly counted by the phase space). We illustrate the concept with some examples of experimentally known particle decay distributions.
Text mining by Tsallis entropy
Jamaati, Maryam; Mehri, Ali
2018-01-01
Long-range correlations between the elements of natural languages enable them to convey very complex information. Complex structure of human language, as a manifestation of natural languages, motivates us to apply nonextensive statistical mechanics in text mining. Tsallis entropy appropriately ranks the terms' relevance to document subject, taking advantage of their spatial correlation length. We apply this statistical concept as a new powerful word ranking metric in order to extract keywords of a single document. We carry out an experimental evaluation, which shows capability of the presented method in keyword extraction. We find that, Tsallis entropy has reliable word ranking performance, at the same level of the best previous ranking methods.
Methods for calculating nonconcave entropies
International Nuclear Information System (INIS)
Touchette, Hugo
2010-01-01
Five different methods which can be used to analytically calculate entropies that are nonconcave as functions of the energy in the thermodynamic limit are discussed and compared. The five methods are based on the following ideas and techniques: (i) microcanonical contraction, (ii) metastable branches of the free energy, (iii) generalized canonical ensembles with specific illustrations involving the so-called Gaussian and Betrag ensembles, (iv) the restricted canonical ensemble, and (v) the inverse Laplace transform. A simple long-range spin model having a nonconcave entropy is used to illustrate each method
Directory of Open Access Journals (Sweden)
Milivoje M. Kostic
2016-01-01
Full Text Available There is a growing trend in recently-submitted manuscripts and publications to present calculated results of entropy generation, also known as entropy production, as field quantities in a system or device control volume, based on prior calculation of velocity and temperature fields, frequently using CFD numerical methods. [...
Examples of Entropy-driven Ordering
Indian Academy of Sciences (India)
driven Ordering. Orientational ordering of long objects. Entropy of sliding increases. Freezing in hard-sphere systems. Vibrational entropy increases. Phase separation in hard-sphere binary mixtures with disparate sizes. More room for smaller ...
Using entropy measures to characterize human locomotion.
Leverick, Graham; Szturm, Tony; Wu, Christine Q
2014-12-01
Entropy measures have been widely used to quantify the complexity of theoretical and experimental dynamical systems. In this paper, the value of using entropy measures to characterize human locomotion is demonstrated based on their construct validity, predictive validity in a simple model of human walking and convergent validity in an experimental study. Results show that four of the five considered entropy measures increase meaningfully with the increased probability of falling in a simple passive bipedal walker model. The same four entropy measures also experienced statistically significant increases in response to increasing age and gait impairment caused by cognitive interference in an experimental study. Of the considered entropy measures, the proposed quantized dynamical entropy (QDE) and quantization-based approximation of sample entropy (QASE) offered the best combination of sensitivity to changes in gait dynamics and computational efficiency. Based on these results, entropy appears to be a viable candidate for assessing the stability of human locomotion.
On thermodynamic limits of entropy densities
Moriya, H; Van Enter, A
We give some sufficient conditions which guarantee that the entropy density in the thermodynamic limit is equal to the thermodynamic limit of the entropy densities of finite-volume (local) Gibbs states.
Multivariate refined composite multiscale entropy analysis
International Nuclear Information System (INIS)
Humeau-Heurtier, Anne
2016-01-01
Multiscale entropy (MSE) has become a prevailing method to quantify signals complexity. MSE relies on sample entropy. However, MSE may yield imprecise complexity estimation at large scales, because sample entropy does not give precise estimation of entropy when short signals are processed. A refined composite multiscale entropy (RCMSE) has therefore recently been proposed. Nevertheless, RCMSE is for univariate signals only. The simultaneous analysis of multi-channel (multivariate) data often over-performs studies based on univariate signals. We therefore introduce an extension of RCMSE to multivariate data. Applications of multivariate RCMSE to simulated processes reveal its better performances over the standard multivariate MSE. - Highlights: • Multiscale entropy quantifies data complexity but may be inaccurate at large scale. • A refined composite multiscale entropy (RCMSE) has therefore recently been proposed. • Nevertheless, RCMSE is adapted to univariate time series only. • We herein introduce an extension of RCMSE to multivariate data. • It shows better performances than the standard multivariate multiscale entropy.
The entropy principle thermodynamics for the unsatisfied
Thess, André
2011-01-01
Entropy is the most important and the most difficult to understand term of thermodynamics. This book helps make this key concept understandable. It includes seven illustrative examples of applications of entropy, which are presented step by step.
A brief introduction to sofic entropy theory
Bowen, Lewis
2017-01-01
Sofic entropy theory is a generalization of the classical Kolmogorov-Sinai entropy theory to actions of large class of non-amenable groups called sofic groups. This is a short introduction with a guide to the literature.
Notes on entanglement entropy in string theory
International Nuclear Information System (INIS)
He, Song; Numasawa, Tokiro; Takayanagi, Tadashi; Watanabe, Kento
2015-01-01
In this paper, we study the conical entropy in string theory in the simplest setup of dividing the nine dimensional space into two halves. This corresponds to the leading quantum correction to the horizon entropy in string theory on the Rindler space. This entropy is also called the conical entropy and includes surface term contributions. We first derive a new simple formula of the conical entropy for any free higher spin fields. Then we apply this formula to computations of conical entropy in open and closed superstring. In our analysis of closed string, we study the twisted conical entropy defined by making use of string theory on Melvin backgrounds. This quantity is easier to calculate owing to the folding trick. Our analysis shows that the conical entropy in closed superstring is UV finite owing to the string scale cutoff.
Configurational entropy of anti-de Sitter black holes
International Nuclear Information System (INIS)
Braga, Nelson R.F.; Rocha, Roldão da
2017-01-01
Recent studies indicate that the configurational entropy is an useful tool to investigate the stability and (or) the relative dominance of states for diverse physical systems. Recent examples comprise the connection between the variation of this quantity and the relative fraction of light mesons and glueballs observed in hadronic processes. Here we develop a technique for defining a configurational entropy for an AdS-Schwarzschild black hole. The achieved result corroborates consistency with the Hawking–Page phase transition. Namely, the dominance of the black hole configurational entropy will be shown to increase with the temperature. In order to verify the consistency of the new procedure developed here, we also consider the case of black holes in flat space-time. For such a black hole, it is known that evaporation leads to instability. The configurational entropy obtained for the flat space case is thoroughly consistent with the physical expectation. In fact, we show that the smaller the black holes, the more unstable they are. So, the configurational entropy furnishes a reliable measure for stability of black holes.
Dissecting Protein Configurational Entropy into Conformational and Vibrational Contributions.
Chong, Song-Ho; Ham, Sihyun
2015-10-01
Quantifying how the rugged nature of the underlying free-energy landscape determines the entropic cost a protein must incur upon folding and ligand binding is a challenging problem. Here, we present a novel computational approach that dissects the protein configurational entropy on the basis of the classification of protein dynamics on the landscape into two separate components: short-term vibrational dynamics related to individual free-energy wells and long-term conformational dynamics associated with transitions between wells. We apply this method to separate the configurational entropy of the protein villin headpiece subdomain into its conformational and vibrational components. We find that the change in configurational entropy upon folding is dominated by the conformational entropy despite the fact that the magnitude of the vibrational entropy is the significantly larger component in each of the folded and unfolded states, which is in accord with the previous empirical estimations. The straightforward applicability of our method to unfolded proteins promises a wide range of applications, including those related to intrinsically disordered proteins.
Entropy, pricing and macroeconomics of pumped-storage systems
Karakatsanis, Georgios; Mamassis, Nikos; Koutsoyiannis, Demetris; Efstratiadis, Andreas
2014-05-01
We propose a pricing scheme for the enhancement of macroeconomic performance of pumped-storage systems, based on the statistical properties of both geophysical and economic variables. The main argument consists in the need of a context of economic values concerning the hub energy resource; defined as the resource that comprises the reference energy currency for all involved renewable energy sources (RES) and discounts all related uncertainty. In the case of pumped-storage systems the hub resource is the reservoir's water, as a benchmark for all connected intermittent RES. The uncertainty of all involved natural and economic processes is statistically quantifiable by entropy. It is the relation between the entropies of all involved RES that shapes the macroeconomic state of the integrated pumped-storage system. Consequently, there must be consideration on the entropy of wind, solar and precipitation patterns, as well as on the entropy of economic processes -such as demand preferences on either current energy use or storage for future availability. For pumped-storage macroeconomics, a price on the reservoir's capacity scarcity should also be imposed in order to shape a pricing field with upper and lower limits for the long-term stability of the pricing range and positive net energy benefits, which is the primary issue of the generalized deployment of pumped-storage technology. Keywords: Entropy, uncertainty, pricing, hub energy resource, RES, energy storage, capacity scarcity, macroeconomics
Configurational entropy of anti-de Sitter black holes
Energy Technology Data Exchange (ETDEWEB)
Braga, Nelson R.F., E-mail: braga@if.ufrj.br [Instituto de Física, Universidade Federal do Rio de Janeiro, Caixa Postal 68528, RJ 21941-972 (Brazil); Rocha, Roldão da, E-mail: roldao.rocha@ufabc.edu.br [Centro de Matemática, Computação e Cognição, Universidade Federal do ABC – UFABC, 09210-580, Santo André (Brazil)
2017-04-10
Recent studies indicate that the configurational entropy is an useful tool to investigate the stability and (or) the relative dominance of states for diverse physical systems. Recent examples comprise the connection between the variation of this quantity and the relative fraction of light mesons and glueballs observed in hadronic processes. Here we develop a technique for defining a configurational entropy for an AdS-Schwarzschild black hole. The achieved result corroborates consistency with the Hawking–Page phase transition. Namely, the dominance of the black hole configurational entropy will be shown to increase with the temperature. In order to verify the consistency of the new procedure developed here, we also consider the case of black holes in flat space-time. For such a black hole, it is known that evaporation leads to instability. The configurational entropy obtained for the flat space case is thoroughly consistent with the physical expectation. In fact, we show that the smaller the black holes, the more unstable they are. So, the configurational entropy furnishes a reliable measure for stability of black holes.
Monte Carlo power iteration: Entropy and spatial correlations
International Nuclear Information System (INIS)
Nowak, Michel; Miao, Jilang; Dumonteil, Eric; Forget, Benoit; Onillon, Anthony; Smith, Kord S.; Zoia, Andrea
2016-01-01
Highlights: • We show that the entropy function might be misleading in criticality simulations. • We interpret the spatial fluctuations of the fission chains in terms of the key parameters of the simulated system. • We show that the behavior of the entropy function is related to the theory of neutron clustering. - Abstract: The behavior of Monte Carlo criticality simulations is often assessed by examining the convergence of the so-called entropy function. In this work, we shall show that the entropy function may lead to a misleading interpretation, and that potential issues occur when spatial correlations induced by fission events are important. We will support our analysis by examining the higher-order moments of the entropy function and the center of mass of the neutron population. Within the framework of a simplified model based on branching processes, we will relate the behavior of the spatial fluctuations of the fission chains to the key parameters of the simulated system, namely, the number of particles per generation, the reactor size and the migration area. Numerical simulations of a fuel rod and of a whole core suggest that the obtained results are quite general and hold true also for real-world applications.
Universal role of correlation entropy in critical phenomena
International Nuclear Information System (INIS)
Gu Shijian; Sun Changpu; Lin Haiqing
2008-01-01
In statistical physics, if we divide successively an equilibrium system into two parts, we will face a situation that, to a certain length ξ, the physics of a subsystem is no longer the same as the original one. The extensive property of the thermal entropy S(A union B) = S(A) + S(B) is then violated. This observation motivates us to introduce a concept of correlation entropy between two points, as measured by the mutual information in information theory, to study the critical phenomena. A rigorous relation is established to display some drastic features of the non-vanishing correlation entropy of a subsystem formed by any two distant particles with long-range correlation. This relation actually indicates a universal role played by the correlation entropy for understanding the critical phenomena. We also verify these analytical studies in terms of two well-studied models for both the thermal and quantum phase transitions: the two-dimensional Ising model and the one-dimensional transverse-field Ising model. Therefore, the correlation entropy provides us with a new physical intuition of the critical phenomena from the point of view of information theory
From Suitable Weak Solutions to Entropy Viscosity
Guermond, Jean-Luc
2010-12-16
This paper focuses on the notion of suitable weak solutions for the three-dimensional incompressible Navier-Stokes equations and discusses the relevance of this notion to Computational Fluid Dynamics. The purpose of the paper is twofold (i) to recall basic mathematical properties of the three-dimensional incompressible Navier-Stokes equations and to show how they might relate to LES (ii) to introduce an entropy viscosity technique based on the notion of suitable weak solution and to illustrate numerically this concept. © 2010 Springer Science+Business Media, LLC.
Entropy in Spacetime and Topological Hair
Hyun, Young-Hwan; Kim, Yoonbai
2018-01-01
Global topological soliton of the hedgehog ansatz is added to de Sitter spacetime in arbitrary dimensions larger than three, and then thermodynamic law is checked at the cosmological horizon. All geometric and thermodynamic quantities are varied in the presence of a long-range interacting matter distribution with negative pressure, however the entropy-area relation is satisfied in the exact form. Its geometry involves deficit solid angle but maintains a single horizon which allows unique temperature normalization, different from the case of Schwarzschild-de Sitter spacetime.
Entropy Production and Fluctuation Theorems for Active Matter
Mandal, Dibyendu; Klymko, Katherine; DeWeese, Michael R.
2017-12-01
Active biological systems reside far from equilibrium, dissipating heat even in their steady state, thus requiring an extension of conventional equilibrium thermodynamics and statistical mechanics. In this Letter, we have extended the emerging framework of stochastic thermodynamics to active matter. In particular, for the active Ornstein-Uhlenbeck model, we have provided consistent definitions of thermodynamic quantities such as work, energy, heat, entropy, and entropy production at the level of single, stochastic trajectories and derived related fluctuation relations. We have developed a generalization of the Clausius inequality, which is valid even in the presence of the non-Hamiltonian dynamics underlying active matter systems. We have illustrated our results with explicit numerical studies.
The Elusive Nature of Entropy and Its Physical Meaning
Directory of Open Access Journals (Sweden)
Milivoje M. Kostic
2014-02-01
Full Text Available Entropy is the most used and often abused concept in science, but also in philosophy and society. Further confusions are produced by some attempts to generalize entropy with similar but not the same concepts in other disciplines. The physical meaning of phenomenological, thermodynamic entropy is reasoned and elaborated by generalizing Clausius definition with inclusion of generated heat, since it is irrelevant if entropy is changed due to reversible heat transfer or irreversible heat generation. Irreversible, caloric heat transfer is introduced as complementing reversible heat transfer. It is also reasoned and thus proven why entropy cannot be destroyed but is always generated (and thus over-all increased locally and globally, at every space and time scales, without any exception. It is concluded that entropy is a thermal displacement (dynamic thermal-volume of thermal energy due to absolute temperature as a thermal potential (dQ = TdS, and thus associated with thermal heat and absolute temperature, i.e., distribution of thermal energy within thermal micro-particles in space. Entropy is an integral measure of (random thermal energy redistribution (due to heat transfer and/or irreversible heat generation within a material system structure in space, per absolute temperature level: dS = dQSys/T = mCSysdT/T, thus logarithmic integral function, with J/K unit. It may be also expressed as a measure of “thermal disorder”, being related to logarithm of number of all thermal, dynamic microstates W (their position and momenta, S = kBlnW, or to the sum of their logarithmic probabilities S = −kB∑pilnpi, that correspond to, or are consistent with the given thermodynamic macro-state. The number of thermal microstates W, is correlated with macro-properties temperature T and volume V for ideal gases. A system form and/or functional order or disorder are not (thermal energy order/disorder and the former is not related to Thermodynamic entropy. Expanding
Semiotic aspects of control and modeling relations in complex systems
Energy Technology Data Exchange (ETDEWEB)
Joslyn, C.
1996-08-01
A conceptual analysis of the semiotic nature of control is provided with the goal of elucidating its nature in complex systems. Control is identified as a canonical form of semiotic relation of a system to its environment. As a form of constraint between a system and its environment, its necessary and sufficient conditions are established, and the stabilities resulting from control are distinguished from other forms of stability. These result from the presence of semantic coding relations, and thus the class of control systems is hypothesized to be equivalent to that of semiotic systems. Control systems are contrasted with models, which, while they have the same measurement functions as control systems, do not necessarily require semantic relations because of the lack of the requirement of an interpreter. A hybrid construction of models in control systems is detailed. Towards the goal of considering the nature of control in complex systems, the possible relations among collections of control systems are considered. Powers arguments on conflict among control systems and the possible nature of control in social systems are reviewed, and reconsidered based on our observations about hierarchical control. Finally, we discuss the necessary semantic functions which must be present in complex systems for control in this sense to be present at all.
Information loss in effective field theory: Entanglement and thermal entropies
Boyanovsky, Daniel
2018-03-01
Integrating out high energy degrees of freedom to yield a low energy effective field theory leads to a loss of information with a concomitant increase in entropy. We obtain the effective field theory of a light scalar field interacting with heavy fields after tracing out the heavy degrees of freedom from the time evolved density matrix. The initial density matrix describes the light field in its ground state and the heavy fields in equilibrium at a common temperature T . For T =0 , we obtain the reduced density matrix in a perturbative expansion; it reveals an emergent mixed state as a consequence of the entanglement between light and heavy fields. We obtain the effective action that determines the time evolution of the reduced density matrix for the light field in a nonperturbative Dyson resummation of one-loop correlations of the heavy fields. The Von-Neumann entanglement entropy associated with the reduced density matrix is obtained for the nonresonant and resonant cases in the asymptotic long time limit. In the nonresonant case the reduced density matrix displays an incipient thermalization albeit with a wave-vector, time and coupling dependent effective temperature as a consequence of memory of initial conditions. The entanglement entropy is time independent and is the thermal entropy for this effective, nonequilibrium temperature. In the resonant case the light field fully thermalizes with the heavy fields, the reduced density matrix loses memory of the initial conditions and the entanglement entropy becomes the thermal entropy of the light field. We discuss the relation between the entanglement entropy ultraviolet divergences and renormalization.
Definition of Nonequilibrium Entropy of General Systems
Mei, Xiaochun
1999-01-01
The definition of nonequilibrium entropy is provided for the general nonequilibrium processes by connecting thermodynamics with statistical physics, and the principle of entropy increment in the nonequilibrium processes is also proved in the paper. The result shows that the definition of nonequilibrium entropy is not unique.
Logical entropy of quantum dynamical systems
Directory of Open Access Journals (Sweden)
Ebrahimzadeh Abolfazl
2016-01-01
Full Text Available This paper introduces the concepts of logical entropy and conditional logical entropy of hnite partitions on a quantum logic. Some of their ergodic properties are presented. Also logical entropy of a quantum dynamical system is dehned and ergodic properties of dynamical systems on a quantum logic are investigated. Finally, the version of Kolmogorov-Sinai theorem is proved.
Algebraic entropy for differential-delay equations
Viallet, Claude M.
2014-01-01
We extend the definition of algebraic entropy to a class of differential-delay equations. The vanishing of the entropy, as a structural property of an equation, signals its integrability. We suggest a simple way to produce differential-delay equations with vanishing entropy from known integrable differential-difference equations.
Universal canonical entropy for gravitating systems
Indian Academy of Sciences (India)
Similar to this is the case of ref. [12] which also uses the saddle point approximation to express the microcanonical entropy in terms of the canonical entropy [12a]. Recalling that there is at least 'circumstantial' evidence that the microcanonical entropy has a 'universal' form [13–15], identical to that obtained in ref. [6] quoted.
Regularities of changes of metal melting entropy
International Nuclear Information System (INIS)
Kats, S.A.; Chekhovskoj, V.Ya.
1980-01-01
Most trustworthy data on temperatures, heats and entropies of fusion of metals have been used as a basis to throw light on the laws governing variations of the entropy of metals fusion. The elaborated procedure is used to predict the entropies of the metals fusion whose thermodynamic properties under high temperatures have not yet been investigated
Single Particle Entropy in Heated Nuclei
International Nuclear Information System (INIS)
Guttormsen, M.; Chankova, R.; Hjorth-Jensen, M.; Rekstad, J.; Siem, S.; Sunde, A. C.; Syed, N. U. H.; Agvaanluvsan, U.; Schiller, A.; Voinov, A.
2006-01-01
The thermal motion of single particles represents the largest contribution to level density (or entropy) in atomic nuclei. The concept of single particle entropy is presented and shown to be an approximate extensive (additive) quantity for mid-shell nuclei. A few applications of single particle entropy are demonstrated
The dynamical entropy of quantum systems
International Nuclear Information System (INIS)
Connes, A.; Narnhofer, H.; Thirring, W.
1987-01-01
The definition of the dynamical entropy for automorphisms of C * - algebras is represented. Several properties are discussed; especially it is argued that the entropy of the shift can be shown in special cases to be equal with the entropy density. (Author)
Entropy-driven phase transitions
Frenkel, D.
1999-01-01
Increase in visible order can be associated with an increase in microscopic disorder. This phenomenon leads to many counter-intuitive phenomena such as entropy driven crystallization and phase separation. I devote special attention to the entropic depletion interaction as a means to tune the range
Properties of von Neumann entropy
Indian Academy of Sciences (India)
disentangled) as seen by moving observers, is used to investigate the properties of von Neumann entropy, as a measure of spin–momentum entanglement. To do so, we partition the total Hilbert space into momentum and spin subspaces so that the ...
Entropy, Coding and Data Compression
Indian Academy of Sciences (India)
Home; Journals; Resonance – Journal of Science Education; Volume 6; Issue 9. Entropy, Coding and Data Compression. S Natarajan. General Article Volume 6 Issue 9 September 2001 pp 35-45. Fulltext. Click here to view fulltext PDF. Permanent link: https://www.ias.ac.in/article/fulltext/reso/006/09/0035-0045 ...
Entropy of dynamical social networks
Zhao, Kun; Karsai, Marton; Bianconi, Ginestra
2012-02-01
Dynamical social networks are evolving rapidly and are highly adaptive. Characterizing the information encoded in social networks is essential to gain insight into the structure, evolution, adaptability and dynamics. Recently entropy measures have been used to quantify the information in email correspondence, static networks and mobility patterns. Nevertheless, we still lack methods to quantify the information encoded in time-varying dynamical social networks. In this talk we present a model to quantify the entropy of dynamical social networks and use this model to analyze the data of phone-call communication. We show evidence that the entropy of the phone-call interaction network changes according to circadian rhythms. Moreover we show that social networks are extremely adaptive and are modified by the use of technologies such as mobile phone communication. Indeed the statistics of duration of phone-call is described by a Weibull distribution and is significantly different from the distribution of duration of face-to-face interactions in a conference. Finally we investigate how much the entropy of dynamical social networks changes in realistic models of phone-call or face-to face interactions characterizing in this way different type human social behavior.
Maximum entropy beam diagnostic tomography
International Nuclear Information System (INIS)
Mottershead, C.T.
1985-01-01
This paper reviews the formalism of maximum entropy beam diagnostic tomography as applied to the Fusion Materials Irradiation Test (FMIT) prototype accelerator. The same formalism has also been used with streak camera data to produce an ultrahigh speed movie of the beam profile of the Experimental Test Accelerator (ETA) at Livermore. 11 refs., 4 figs
Maximum entropy beam diagnostic tomography
International Nuclear Information System (INIS)
Mottershead, C.T.
1985-01-01
This paper reviews the formalism of maximum entropy beam diagnostic tomography as applied to the Fusion Materials Irradiation Test (FMIT) prototype accelerator. The same formalism has also been used with streak camera data to produce an ultrahigh speed movie of the beam profile of the Experimental Test Accelerator (ETA) at Livermore
Hidden states and hidden entropy
International Nuclear Information System (INIS)
Betak, E.
1993-06-01
We study the properties of master equations of the pre-equilibrium exciton model. For the case when the emission is included, we have proved the entropy to be a nondecreasing function of time. The opposite statement in the recent paper of Pan et al. has been caused mainly by neglecting a part of the exciton states. (author). 17 refs
Vibrational entropies in metallic alloys
Ozolins, Vidvuds; Asta, Mark; Wolverton, Christopher
2000-03-01
Recently, it has been recognized that vibrational entropy can have significant effects on the phase stability of metallic alloys. Using density functional linear response calculations and molecular dynamics simulations we study three representative cases: (i) phase diagram of Al-rich Al-Sc alloys, (ii) stability of precipitate phases in CuAl_2, and (iii) phonon dynamics in bcc Zr. We find large vibrational entropy effects in all cases. In the Al-Sc system, vibrations increase the solid solubility of Sc in Al by decreasing the stability of the L12 (Al_3Sc) phase. This leads to a nearly ten-fold increase in the solid solubility of Sc in Al at T=800 K. In the Cu-Al system, our calculations predict that the tetragonal Laves phase of CuAl2 has 0.35 kB/atom higher vibrational entropy than the cubic CaF_2-type phase (the latter is predicted to be the T=0 K ground state of CuAl_2). This entropy difference causes a structural transformation in CuAl2 precipitates from the fluorite to the tetragonal Laves phase around T=500 K. Finally, we analyze the highly unusual dynamics of anharmonically stabilized bcc Zr, finding large diffuse-scattering intensity streaks between the bcc Bragg peaks.
Connectivity in the human brain dissociates entropy and complexity of auditory inputs.
Nastase, Samuel A; Iacovella, Vittorio; Davis, Ben; Hasson, Uri
2015-03-01
Complex systems are described according to two central dimensions: (a) the randomness of their output, quantified via entropy; and (b) their complexity, which reflects the organization of a system's generators. Whereas some approaches hold that complexity can be reduced to uncertainty or entropy, an axiom of complexity science is that signals with very high or very low entropy are generated by relatively non-complex systems, while complex systems typically generate outputs with entropy peaking between these two extremes. In understanding their environment, individuals would benefit from coding for both input entropy and complexity; entropy indexes uncertainty and can inform probabilistic coding strategies, whereas complexity reflects a concise and abstract representation of the underlying environmental configuration, which can serve independent purposes, e.g., as a template for generalization and rapid comparisons between environments. Using functional neuroimaging, we demonstrate that, in response to passively processed auditory inputs, functional integration patterns in the human brain track both the entropy and complexity of the auditory signal. Connectivity between several brain regions scaled monotonically with input entropy, suggesting sensitivity to uncertainty, whereas connectivity between other regions tracked entropy in a convex manner consistent with sensitivity to input complexity. These findings suggest that the human brain simultaneously tracks the uncertainty of sensory data and effectively models their environmental generators. Copyright © 2014. Published by Elsevier Inc.
Brain entropy and human intelligence: A resting-state fMRI study.
Saxe, Glenn N; Calderone, Daniel; Morales, Leah J
2018-01-01
Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns.
Application of the entropy concept to describe the quality of a X-ray beam
International Nuclear Information System (INIS)
Oliveira, A.D.
2002-01-01
In a previous work (Oliveira and Pedroso de Lima, 2000), we introduced the concept of entropy to describe the degradation of the energy of a photon beam incident in a material. We pointed out the relation between both, the entropy of the distribution of the energy deposited in matter and the traditional quality factor of the radiation protection. From the point of view of the entropy, we showed that, in what concerns to the monoenergetic approximation to a polyenergetic beam, we can hardly speak in an approximation (Oliveira 2001). In fact, the behaviour of the entropy is very different for both, an X-ray and a monoenergetic beam. In this work we developed further the study of the degradation of the energy of X-ray photons, from the point of view of the entropy, introducing the concepts of surface entropy, S surf , equilibrium entropy, S eq , and concepts of entropy variation, namely, primary to surface variation, S ps , and total entropy variation, S T . These are characteristic parameters of the X-ray beams describing the degradation of the primary photons while they interact with matter
Brain entropy and human intelligence: A resting-state fMRI study
Calderone, Daniel; Morales, Leah J.
2018-01-01
Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns. PMID:29432427
Scaling-Laws of Flow Entropy with Topological Metrics of Water Distribution Networks
Directory of Open Access Journals (Sweden)
Giovanni Francesco Santonastaso
2018-01-01
Full Text Available Robustness of water distribution networks is related to their connectivity and topological structure, which also affect their reliability. Flow entropy, based on Shannon’s informational entropy, has been proposed as a measure of network redundancy and adopted as a proxy of reliability in optimal network design procedures. In this paper, the scaling properties of flow entropy of water distribution networks with their size and other topological metrics are studied. To such aim, flow entropy, maximum flow entropy, link density and average path length have been evaluated for a set of 22 networks, both real and synthetic, with different size and topology. The obtained results led to identify suitable scaling laws of flow entropy and maximum flow entropy with water distribution network size, in the form of power–laws. The obtained relationships allow comparing the flow entropy of water distribution networks with different size, and provide an easy tool to define the maximum achievable entropy of a specific water distribution network. An example of application of the obtained relationships to the design of a water distribution network is provided, showing how, with a constrained multi-objective optimization procedure, a tradeoff between network cost and robustness is easily identified.
Costa, A.C.; Bijlsma-Frankema, K.M.
2007-01-01
This article introduces the special issue on New Perspectives on the Trust-Control Nexus in Organizational Relations. Trust and control are interlinked processes commonly seen as key to reach effectiveness in inter- and intraorganizational relations. The relation between trust and control is,
Relative controllability of nonlinear systems with delays in state and ...
African Journals Online (AJOL)
In this work, sufficient conditions are developed for the relative controllability of perturbed nonlinear systems with time varying multiple delays in control with the perturbation function having implicit derivative with delays depending on both state and control variable, using Darbo's fixed points theorem. Journal of the Nigerian ...
Irreversible thermodynamics of dark energy on the entropy-corrected apparent horizon
Energy Technology Data Exchange (ETDEWEB)
Karami, K; Sahraei, N [Department of Physics, University of Kurdistan, Pasdaran Street, Sanandaj (Iran, Islamic Republic of); Jamil, M, E-mail: KKarami@uok.ac.i, E-mail: mjamil@camp.nust.edu.p [Center for Advanced Mathematics and Physics (CAMP), National University of Sciences and Technology (NUST), Islamabad (Pakistan)
2010-10-15
We study the irreversible (non-equilibrium) thermodynamics of the Friedmann-Robertson-Walker (FRW) universe containing only dark energy. Using the modified entropy-area relation that is motivated by loop quantum gravity, we calculate the entropy-corrected form of the apparent horizon of the FRW universe.
Connecting diffusion and entropy of bulk water at the single particle ...
Indian Academy of Sciences (India)
The relation between the dynamic (e.g., diffusion) and thermodynamic (e.g., entropy) properties of water and water-like liquids has been an active area of research for a long time. Although several studies have investigated the diffusivity and entropy for different systems, these studies have probed either the configurational ...
Safety-related control air systems - approved 1977
International Nuclear Information System (INIS)
Anon.
1978-01-01
This standard applies to those portions of the control air system that furnish air required to support, control, or operate systems or portions of systems that are safety related in nuclear power plants. This standard relates only to the air supply system(s) for safety-related air operated devices and does not apply to the safety-related air operated device or to air operated actuators for such devices. The objectives of this standard are to provide (1) minimum system design requirements for equipment, piping, instruments, controls, and wiring that constitute the air supply system; and (2) the system and component testing and maintenance requirements
Misuse of thermodynamic entropy in economics
International Nuclear Information System (INIS)
Kovalev, Andrey V.
2016-01-01
The direct relationship between thermodynamic entropy and economic scarcity is only valid for a thermodynamically isolated economy. References to the second law of thermodynamics in economics within the context of scarcity ignore the fact that the earth is not an isolated system. The earth interacts with external sources and sinks of entropy and the resulting total entropy fluctuates around a constant. Even if the mankind finally proves unable to recycle industrial waste and close the technological cycle, the economic disruption caused by the depletion of natural resources may happen while the total thermodynamic entropy of the ecosystem remains essentially at the present level, because the transfer of chemically refined products may not increase significantly the total entropy, but it may decrease their recyclability. The inutility of industrial waste is not connected with its entropy, which may be exemplified with the case of alumina production. The case also demonstrates that industrially generated entropy is discharged into surroundings without being accumulated in ‘thermodynamically unavailable matter’. Material entropy, as a measure of complexity and economic dispersal of resources, can be a recyclability metric, but it is not a thermodynamic parameter, and its growth is not equivalent to the growth of thermodynamic entropy. - Highlights: • Entropy cannot be used as a measure of economic scarcity. • There is no anthropogenic entropy separate from the entropy produced naturally. • Inutility of industrial waste is not connected with its thermodynamic entropy. • Industrially generated entropy may or may not be accumulated in industrial waste. • Recyclability is more important than thermodynamic entropy of a product.
Black hole entropy and the problem of universality
International Nuclear Information System (INIS)
Carlip, Steven
2007-01-01
A key test of any quantum theory of gravity is its ability to reproduce the known thermodynamic properties of black holes. A statistical mechanical description of the Bekenstein-Hawking entropy once seemed remote, but today we suffer an embarrassment of riches: many different approaches to quantum gravity yield the same entropy, despite counting very different states. This 'universality' suggests that some underlying feature of the classical theory may control the quantum density of states. I discuss the possibility that this feature is an approximate two-dimensional conformal symmetry near the horizon
Black hole entropy and the problem of universality
Energy Technology Data Exchange (ETDEWEB)
Carlip, Steven [Physics Department, 1 Shields Ave., University of California at Davis, Davis, CA 95616 (United States)
2007-05-15
A key test of any quantum theory of gravity is its ability to reproduce the known thermodynamic properties of black holes. A statistical mechanical description of the Bekenstein-Hawking entropy once seemed remote, but today we suffer an embarrassment of riches: many different approaches to quantum gravity yield the same entropy, despite counting very different states. This 'universality' suggests that some underlying feature of the classical theory may control the quantum density of states. I discuss the possibility that this feature is an approximate two-dimensional conformal symmetry near the horizon.
Entropy Generation in Natural Convection Under an Evanescent Magnetic Field
International Nuclear Information System (INIS)
Magherbi, Mourad; El Jery, Atef; Ben Brahim, Ammar
2009-01-01
We numerically study the effect of an externally-evanescent magnetic field on total entropy generation in conducting and non-reactive fluid enclosed in a square cavity. The horizontal walls of the enclosure are assumed to be insulated while the vertical walls are kept isothermal. A control volume finite element method is used to solve the conservation equations at Prandtl number of 0.71. The values of relaxation time of the magnetic field are chosen, so that the Lorentz force acts only in the transient state of entropy generation in natural convection. The total entropy generation was calculated for fixed value of irreversibility distribution ratio, different relaxation time varying from 0 to 1/5 and Grashof number equal to 10 5
Symmetry Analysis of Gait between Left and Right Limb Using Cross-Fuzzy Entropy
Directory of Open Access Journals (Sweden)
Yi Xia
2016-01-01
Full Text Available The purpose of this paper is the investigation of gait symmetry problem by using cross-fuzzy entropy (C-FuzzyEn, which is a recently proposed cross entropy that has many merits as compared to the frequently used cross sample entropy (C-SampleEn. First, we used several simulation signals to test its performance regarding the relative consistency and dependence on data length. Second, the gait time series of the left and right stride interval were used to calculate the C-FuzzyEn values for gait symmetry analysis. Besides the statistical analysis, we also realized a support vector machine (SVM classifier to perform the classification of normal and abnormal gaits. The gait dataset consists of 15 patients with Parkinson’s disease (PD and 16 control (CO subjects. The results show that the C-FuzzyEn values of the PD patients’ gait are significantly higher than that of the CO subjects with a p value of less than 10-5, and the best classification performance evaluated by a leave-one-out (LOO cross-validation method is an accuracy of 96.77%. Such encouraging results imply that the C-FuzzyEn-based gait symmetry measure appears as a suitable tool for analyzing abnormal gaits.
Hacisuleyman, Aysima; Erman, Burak
2017-06-01
A fast and approximate method of generating allosteric communication landscapes in proteins is presented by using Schreiber's entropy transfer concept in combination with the Gaussian Network Model of proteins. Predictions of the model and the allosteric communication landscapes generated show that information transfer in proteins does not necessarily take place along a single path, but an ensemble of pathways is possible. The model emphasizes that knowledge of entropy only is not sufficient for determining allosteric communication and additional information based on time delayed correlations should be introduced, which leads to the presence of causality in proteins. The model provides a simple tool for mapping entropy sink-source relations into pairs of residues. By this approach, residues that should be manipulated to control protein activity may be determined. This should be of great importance for allosteric drug design and for understanding the effects of mutations on function. The model is applied to determine allosteric communication in three proteins, Ubiquitin, Pyruvate Kinase, and the PDZ domain. Predictions are in agreement with molecular dynamics simulations and experimental evidence. Proteins 2017; 85:1056-1064. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.
Enthalpy-entropy compensation in protein unfolding
Institute of Scientific and Technical Information of China (English)
无
2000-01-01
Enthalpy-entropy compensation was found to be a universal law in protein unfolding based on over 3 000 experimental data. Water molecular reorganization accompanying the protein unfolding was suggested as the origin of the enthalpy-entropy compensation in protein unfolding. It is indicated that the enthalpy-entropy compensation constitutes the physical foundation that satisfies the biological need of the small free energy changes in protein unfolding, without the sacrifice of the bio-diversity of proteins. The enthalpy-entropy compensation theory proposed herein also provides valuable insights into the Privalov's puzzle of enthalpy and entropy convergence in protein unfolding.
Receiver function estimated by maximum entropy deconvolution
Institute of Scientific and Technical Information of China (English)
吴庆举; 田小波; 张乃铃; 李卫平; 曾融生
2003-01-01
Maximum entropy deconvolution is presented to estimate receiver function, with the maximum entropy as the rule to determine auto-correlation and cross-correlation functions. The Toeplitz equation and Levinson algorithm are used to calculate the iterative formula of error-predicting filter, and receiver function is then estimated. During extrapolation, reflective coefficient is always less than 1, which keeps maximum entropy deconvolution stable. The maximum entropy of the data outside window increases the resolution of receiver function. Both synthetic and real seismograms show that maximum entropy deconvolution is an effective method to measure receiver function in time-domain.
Entropy evaporated by a black hole
International Nuclear Information System (INIS)
Zurek, W.H.
1982-01-01
It is shown that the entropy of the radiation evaporated by an uncharged, nonrotating black hole into vacuum in the course of its lifetime is approximately (4/3) times the initial entropy of this black hole. Also considered is a thermodynamically reversible process in which an increase of black-hole entropy is equal to the decrease of the entropy of its surroundings. Implications of these results for the generalized second law of thermodynamics and for the interpretation of black-hole entropy are pointed out
An exploration for the macroscopic physical meaning of entropy
Institute of Scientific and Technical Information of China (English)
无
2010-01-01
The macroscopic physical meaning of entropy is analyzed based on the exergy (availability) of a combined system (a closed system and its environment), which is the maximum amount of useful work obtainable from the system and the environment as the system is brought into equilibrium with the environment. The process the system experiences can be divided in two sequent sub-processes, the process at constant volume, which represents the heat interaction of the system with the environment, and the adiabatic process, which represents the work interaction of the system with the environment. It is shown that the macroscopic physical meaning of entropy is a measure of the unavailable energy of a closed system for doing useful work through heat interaction. This statement is more precise than those reported in prior literature. The unavailability function of a closed system can be defined as T0S and p0V in volume constant process and adiabatic process, respectively. Their changes, that is, AiTgS) and A (p0V) represent the unusable parts of the internal energy of a closed system for doing useful work in corresponding processes. Finally, the relation between Clausius entropy and Boltzmann entropy is discussed based on the comparison of their expressions for absolute entropy.
Proof of the holographic formula for entanglement entropy
International Nuclear Information System (INIS)
Fursaev, Dmitri V.
2006-01-01
Entanglement entropy for a spatial partition of a quantum system is studied in theories which admit a dual description in terms of the anti-de Sitter (AdS) gravity one dimension higher. A general proof of the holographic formula which relates the entropy to the area of a codimension 2 minimal hypersurface embedded in the bulk AdS space is given. The entanglement entropy is determined by a partition function which is defined as a path integral over Riemannian AdS geometries with non-trivial boundary conditions. The topology of the Riemannian spaces puts restrictions on the choice of the minimal hypersurface for a given boundary conditions. The entanglement entropy is also considered in Randall-Sundrum braneworld models where its asymptotic expansion is derived when the curvature radius of the brane is much larger than the AdS radius. Special attention is paid to the geometrical structure of anomalous terms in the entropy in four dimensions. Modification of the holographic formula by the higher curvature terms in the bulk is briefly discussed
Shannon information entropy in heavy-ion collisions
Ma, Chun-Wang; Ma, Yu-Gang
2018-03-01
The general idea of information entropy provided by C.E. Shannon "hangs over everything we do" and can be applied to a great variety of problems once the connection between a distribution and the quantities of interest is found. The Shannon information entropy essentially quantify the information of a quantity with its specific distribution, for which the information entropy based methods have been deeply developed in many scientific areas including physics. The dynamical properties of heavy-ion collisions (HICs) process make it difficult and complex to study the nuclear matter and its evolution, for which Shannon information entropy theory can provide new methods and observables to understand the physical phenomena both theoretically and experimentally. To better understand the processes of HICs, the main characteristics of typical models, including the quantum molecular dynamics models, thermodynamics models, and statistical models, etc., are briefly introduced. The typical applications of Shannon information theory in HICs are collected, which cover the chaotic behavior in branching process of hadron collisions, the liquid-gas phase transition in HICs, and the isobaric difference scaling phenomenon for intermediate mass fragments produced in HICs of neutron-rich systems. Even though the present applications in heavy-ion collision physics are still relatively simple, it would shed light on key questions we are seeking for. It is suggested to further develop the information entropy methods in nuclear reactions models, as well as to develop new analysis methods to study the properties of nuclear matters in HICs, especially the evolution of dynamics system.
Entanglement interpretation of black hole entropy in string theory
International Nuclear Information System (INIS)
Brustein, Ram; Einhorn, Martin B.; Yarom, Amos
2006-01-01
We show that the entropy resulting from the counting of microstates of non extremal black holes using field theory duals of string theories can be interpreted as arising from entanglement. The conditions for making such an interpretation consistent are discussed. First, we interpret the entropy (and thermodynamics) of spacetimes with non degenerate, bifurcating Killing horizons as arising from entanglement. We use a path integral method to define the Hartle-Hawking vacuum state in such spacetimes and discuss explicitly its entangled nature and its relation to the geometry. If string theory on such spacetimes has a field theory dual, then, in the low-energy, weak coupling limit, the field theory state that is dual to the Hartle-Hawking state is a thermofield double state. This allows the comparison of the entanglement entropy with the entropy of the field theory dual, and thus, with the Bekenstein-Hawking entropy of the black hole. As an example, we discuss in detail the case of the five dimensional anti-de Sitter, black hole spacetime
Entropy-based financial asset pricing.
Directory of Open Access Journals (Sweden)
Mihály Ormos
Full Text Available We investigate entropy as a financial risk measure. Entropy explains the equity premium of securities and portfolios in a simpler way and, at the same time, with higher explanatory power than the beta parameter of the capital asset pricing model. For asset pricing we define the continuous entropy as an alternative measure of risk. Our results show that entropy decreases in the function of the number of securities involved in a portfolio in a similar way to the standard deviation, and that efficient portfolios are situated on a hyperbola in the expected return-entropy system. For empirical investigation we use daily returns of 150 randomly selected securities for a period of 27 years. Our regression results show that entropy has a higher explanatory power for the expected return than the capital asset pricing model beta. Furthermore we show the time varying behavior of the beta along with entropy.
Entropy Generation Across Earth's Bow Shock
Parks, George K.; McCarthy, Michael; Fu, Suiyan; Lee E. s; Cao, Jinbin; Goldstein, Melvyn L.; Canu, Patrick; Dandouras, Iannis S.; Reme, Henri; Fazakerley, Andrew;
2011-01-01
Earth's bow shock is a transition layer that causes an irreversible change in the state of plasma that is stationary in time. Theories predict entropy increases across the bow shock but entropy has never been directly measured. Cluster and Double Star plasma experiments measure 3D plasma distributions upstream and downstream of the bow shock that allow calculation of Boltzmann's entropy function H and his famous H-theorem, dH/dt O. We present the first direct measurements of entropy density changes across Earth's bow shock. We will show that this entropy generation may be part of the processes that produce the non-thermal plasma distributions is consistent with a kinetic entropy flux model derived from the collisionless Boltzmann equation, giving strong support that solar wind's total entropy across the bow shock remains unchanged. As far as we know, our results are not explained by any existing shock models and should be of interests to theorists.
Entropy-based financial asset pricing.
Ormos, Mihály; Zibriczky, Dávid
2014-01-01
We investigate entropy as a financial risk measure. Entropy explains the equity premium of securities and portfolios in a simpler way and, at the same time, with higher explanatory power than the beta parameter of the capital asset pricing model. For asset pricing we define the continuous entropy as an alternative measure of risk. Our results show that entropy decreases in the function of the number of securities involved in a portfolio in a similar way to the standard deviation, and that efficient portfolios are situated on a hyperbola in the expected return-entropy system. For empirical investigation we use daily returns of 150 randomly selected securities for a period of 27 years. Our regression results show that entropy has a higher explanatory power for the expected return than the capital asset pricing model beta. Furthermore we show the time varying behavior of the beta along with entropy.
Quantifying ‘Causality’ in Complex Systems: Understanding Transfer Entropy
Abdul Razak, Fatimah; Jensen, Henrik Jeldtoft
2014-01-01
‘Causal’ direction is of great importance when dealing with complex systems. Often big volumes of data in the form of time series are available and it is important to develop methods that can inform about possible causal connections between the different observables. Here we investigate the ability of the Transfer Entropy measure to identify causal relations embedded in emergent coherent correlations. We do this by firstly applying Transfer Entropy to an amended Ising model. In addition we use a simple Random Transition model to test the reliability of Transfer Entropy as a measure of ‘causal’ direction in the presence of stochastic fluctuations. In particular we systematically study the effect of the finite size of data sets. PMID:24955766
Definition of Turbulent Boundary-Layer with Entropy Concept
Directory of Open Access Journals (Sweden)
Zhao Rui
2016-01-01
Full Text Available The relationship between the entropy increment and the viscosity dissipation in turbulent boundary-layer is systematically investigated. Through theoretical analysis and direct numerical simulation (DNS, an entropy function fs is proposed to distinguish the turbulent boundary-layer from the external flow. This approach is proved to be reliable after comparing its performance in the following complex flows, namely, low-speed airfoil flows with different wall temperature, supersonic cavity-ramp flow dominated by the combination of free-shear layer, larger recirculation and shocks, and the hypersonic flow past an aeroplane configuration. Moreover, fs is deduced from the point of energy, independent of any particular turbulent quantities. That is, this entropy concept could be utilized by other engineering applications related with turbulent boundary-layer, such as turbulence modelling transition prediction and engineering thermal protection.
Area law for localization-entropy in local quantum physics
Energy Technology Data Exchange (ETDEWEB)
Schroer, Bert [Centro Brasileiro de Pesquisas Fisicas (CBPF), Rio de Janeiro, RJ (Brazil)]. E-mail: schroer@cbpf.br
2002-02-01
The previously developed algebraic lightfront holography is used in conjunction with the tensor splitting of the chiral theory on the causal horizon. In this way a universal area law for the entanglement entropy of the vacuum relative to the split (tensor factorized) vacuum is obtained. The universality of the area law is a result of the kinematical structure of the properly defined lightfront degrees of freedom. We consider this entropy associated with causal horizon of the wedge algebra in Minkowski spacetime as an analog of the quantum Bekenstein black hole entropy similar to the way in which the Unruh temperature for the wedge algebra may be viewed as an analog in Minkowski spacetime of the Hawking thermal behavior. My more recent preprint hep-th/20202085 presents other aspects of the same problem. (author)
Residual Entropy, the Third Law and Latent Heat
Directory of Open Access Journals (Sweden)
Frank L. Lambert
2008-09-01
Full Text Available A novel thermodynamic treatment of residual entropy in crystals, involving the configurational partition function, is suggested, which is consistent with both classical and statistical thermodynamics. It relates residual entropy to the inherent latent heat which would be released upon cooling if the reversible path were available. The nature of this heat is that if the crystal possessing residual entropy freezes above its BoltzmannÃ¢Â€Â™s characteristic temperature of molecular alignment, the difference in energy between different molecular arrangements is overcome by the kT heat bath to form a nearly-ideal solution. However, upon cooling below this characteristic temperature, they would separate with a concomitant release of the corresponding energy, provided the reversible path were available.
Rumor Identification with Maximum Entropy in MicroNet
Directory of Open Access Journals (Sweden)
Suisheng Yu
2017-01-01
Full Text Available The widely used applications of Microblog, WeChat, and other social networking platforms (that we call MicroNet shorten the period of information dissemination and expand the range of information dissemination, which allows rumors to cause greater harm and have more influence. A hot topic in the information dissemination field is how to identify and block rumors. Based on the maximum entropy model, this paper constructs the recognition mechanism of rumor information in the micronetwork environment. First, based on the information entropy theory, we obtained the characteristics of rumor information using the maximum entropy model. Next, we optimized the original classifier training set and the feature function to divide the information into rumors and nonrumors. Finally, the experimental simulation results show that the rumor identification results using this method are better than the original classifier and other related classification methods.
Hierarchical Polygamy Inequality for Entanglement of Tsallis q-Entropy
Luo, Yu; Li, Yong-Ming
2018-05-01
In this paper, we study the polygamy inequality of quantum entanglement in terms of Tsallis q-entropy. We first give a lower bound of Tsallis q-entropy entanglement of assistance (TOA) in the 2 ⊗ d systems. The relation-ships between Tsallis q-entropy entanglement (TEE) and TOA are also given. Furthermore, we prove TOA follows a hierarchical polygamy inequality in a 2 ⊗ 2 ⊗ 2 N‑2 systems. Supported by the National Natural Science Foundation of China under Grant No. 11671244, the Higher School Doctoral Subject Foun- dation of Ministry of Education of China under Grant No. 20130202110001, and Fundamental Research Funds for the Central Universities under Grants Nos. 2016TS060 and 2016CBY003
Granger Causality and Transfer Entropy Are Equivalent for Gaussian Variables
Barnett, Lionel; Barrett, Adam B.; Seth, Anil K.
2009-12-01
Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.
The smooth entropy formalism for von Neumann algebras
International Nuclear Information System (INIS)
Berta, Mario; Furrer, Fabian; Scholz, Volkher B.
2016-01-01
We discuss information-theoretic concepts on infinite-dimensional quantum systems. In particular, we lift the smooth entropy formalism as introduced by Renner and collaborators for finite-dimensional systems to von Neumann algebras. For the smooth conditional min- and max-entropy, we recover similar characterizing properties and information-theoretic operational interpretations as in the finite-dimensional case. We generalize the entropic uncertainty relation with quantum side information of Tomamichel and Renner and discuss applications to quantum cryptography. In particular, we prove the possibility to perform privacy amplification and classical data compression with quantum side information modeled by a von Neumann algebra
Minimum entropy density method for the time series analysis
Lee, Jeong Won; Park, Joongwoo Brian; Jo, Hang-Hyun; Yang, Jae-Suk; Moon, Hie-Tae
2009-01-01
The entropy density is an intuitive and powerful concept to study the complicated nonlinear processes derived from physical systems. We develop the minimum entropy density method (MEDM) to detect the structure scale of a given time series, which is defined as the scale in which the uncertainty is minimized, hence the pattern is revealed most. The MEDM is applied to the financial time series of Standard and Poor’s 500 index from February 1983 to April 2006. Then the temporal behavior of structure scale is obtained and analyzed in relation to the information delivery time and efficient market hypothesis.
Generalized entropy decay rates of one-dimensional maps
International Nuclear Information System (INIS)
Csordas, A.; Szepfalusy, P.
1988-01-01
A series of entropies, approaching the order-q Renyi's entropies when the length of orbits tends to infinity, is considered. Their scaling form is determined for chaotic one-dimensional maps. For the characteristic relaxation time a general expression is derived, and it is shown to be closely related to the eigenvalues of a generalized Frobenius-Perron operator. The case of intermittent maps is also considered, and the spectrum of relaxation time is found to reflect the phase transition at q = 1. Results of numerical experiments are also presented
The smooth entropy formalism for von Neumann algebras
Energy Technology Data Exchange (ETDEWEB)
Berta, Mario, E-mail: berta@caltech.edu [Institute for Quantum Information and Matter, California Institute of Technology, Pasadena, California 91125 (United States); Furrer, Fabian, E-mail: furrer@eve.phys.s.u-tokyo.ac.jp [Department of Physics, Graduate School of Science, University of Tokyo, Tokyo, Japan and Institute for Theoretical Physics, Leibniz University Hanover, Hanover (Germany); Scholz, Volkher B., E-mail: scholz@phys.ethz.ch [Institute for Theoretical Physics, ETH Zurich, Zurich (Switzerland)
2016-01-15
We discuss information-theoretic concepts on infinite-dimensional quantum systems. In particular, we lift the smooth entropy formalism as introduced by Renner and collaborators for finite-dimensional systems to von Neumann algebras. For the smooth conditional min- and max-entropy, we recover similar characterizing properties and information-theoretic operational interpretations as in the finite-dimensional case. We generalize the entropic uncertainty relation with quantum side information of Tomamichel and Renner and discuss applications to quantum cryptography. In particular, we prove the possibility to perform privacy amplification and classical data compression with quantum side information modeled by a von Neumann algebra.
Shannon entropy: A study of confined hydrogenic-like atoms
Nascimento, Wallas S.; Prudente, Frederico V.
2018-01-01
The Shannon entropy in the atomic, molecular and chemical physics context is presented by using as test cases the hydrogenic-like atoms Hc, Hec+ and Lic2 + confined by an impenetrable spherical box. Novel expressions for entropic uncertainty relation and Shannon entropies Sr and Sp are proposed to ensure their physical dimensionless characteristic. The electronic ground state energy and the quantities Sr,Sp and St are calculated for the hydrogenic-like atoms to different confinement radii by using a variational method. The global behavior of these quantities and different conjectures are analyzed. The results are compared, when available, with those previously published.
Entropy and Entropy Production: Old Misconceptions and New Breakthroughs
Directory of Open Access Journals (Sweden)
Leonid M. Martyushev
2013-03-01
Full Text Available Persistent misconceptions existing for dozens of years and influencing progress in various fields of science are sometimes encountered in the scientific and especially, the popular-science literature. The present brief review deals with two such interrelated misconceptions (misunderstandings. The first misunderstanding: entropy is a measure of disorder. This is an old and very common opinion. The second misconception is that the entropy production minimizes in the evolution of nonequilibrium systems. However, as it has recently become clear, evolution (progress in Nature demonstrates the opposite, i.e., maximization of the entropy production. The principal questions connected with this maximization are considered herein. The two misconceptions mentioned above can lead to the apparent contradiction between the conclusions of modern thermodynamics and the basic conceptions of evolution existing in biology. In this regard, the analysis of these issues seems extremely important and timely as it contributes to the deeper understanding of the laws of development of the surrounding World and the place of humans in it.
Free Energy, Enthalpy and Entropy from Implicit Solvent End-Point Simulations.
Fogolari, Federico; Corazza, Alessandra; Esposito, Gennaro
2018-01-01
Free energy is the key quantity to describe the thermodynamics of biological systems. In this perspective we consider the calculation of free energy, enthalpy and entropy from end-point molecular dynamics simulations. Since the enthalpy may be calculated as the ensemble average over equilibrated simulation snapshots the difficulties related to free energy calculation are ultimately related to the calculation of the entropy of the system and in particular of the solvent entropy. In the last two decades implicit solvent models have been used to circumvent the problem and to take into account solvent entropy implicitly in the solvation terms. More recently outstanding advancement in both implicit solvent models and in entropy calculations are making the goal of free energy estimation from end-point simulations more feasible than ever before. We review briefly the basic theory and discuss the advancements in light of practical applications.
Free Energy, Enthalpy and Entropy from Implicit Solvent End-Point Simulations
Directory of Open Access Journals (Sweden)
Federico Fogolari
2018-02-01
Full Text Available Free energy is the key quantity to describe the thermodynamics of biological systems. In this perspective we consider the calculation of free energy, enthalpy and entropy from end-point molecular dynamics simulations. Since the enthalpy may be calculated as the ensemble average over equilibrated simulation snapshots the difficulties related to free energy calculation are ultimately related to the calculation of the entropy of the system and in particular of the solvent entropy. In the last two decades implicit solvent models have been used to circumvent the problem and to take into account solvent entropy implicitly in the solvation terms. More recently outstanding advancement in both implicit solvent models and in entropy calculations are making the goal of free energy estimation from end-point simulations more feasible than ever before. We review briefly the basic theory and discuss the advancements in light of practical applications.
An alternative expression to the Sackur-Tetrode entropy formula for an ideal gas
Nagata, Shoichi
2018-03-01
An expression for the entropy of a monoatomic classical ideal gas is known as the Sackur-Tetrode equation. This pioneering investigation about 100 years ago incorporates quantum considerations. The purpose of this paper is to provide an alternative expression for the entropy in terms of the Heisenberg uncertainty relation. The analysis is made on the basis of fluctuation theory, for a canonical system in thermal equilibrium at temperature T. This new formula indicates manifestly that the entropy of macroscopic world is recognized as a measure of uncertainty in microscopic quantum world. The entropy in the Sackur-Tetrode equation can be re-interpreted from a different perspective viewpoint. The emphasis is on the connection between the entropy and the uncertainty relation in quantum consideration.
The transfer of Cfunc contextual control through equivalence relations.
Perez, William F; Fidalgo, Adriana P; Kovac, Roberta; Nico, Yara C
2015-05-01
Derived relational responding is affected by contextual stimuli (Cfunc) that select specific stimulus functions. The present study investigated the transfer of Cfunc contextual control through equivalence relations by evaluating both (a) the maintenance of Cfunc contextual control after the expansion of a relational network, and (b) the establishment of novel contextual stimuli by the transfer of Cfunc contextual control through equivalence relations. Initially, equivalence relations were established and contingencies were arranged so that colors functioned as Cfunc stimuli controlling participants' key-pressing responses in the presence of any stimulus from a three-member equivalence network. To investigate the first research question, the three-member equivalence relations were expanded to five members and the novel members were presented with the Cfunc stimuli in the key-pressing task. To address the second goal of this study, the colors (Cfunc) were established as equivalent to certain line patterns. The transfer of contextual cue function (Cfunc) was tested replacing the colored backgrounds with line patterns in the key-pressing task. Results suggest that the Cfunc contextual control was transferred to novel stimuli that were added to the relational network. In addition, the line patterns indirectly acquired the contextual cue function (Cfunc) initially established for the colored backgrounds. The conceptual and applied implications of Cfunc contextual control are discussed. © Society for the Experimental Analysis of Behavior.
Cross-entropy optimization for neuromodulation.
Brar, Harleen K; Yunpeng Pan; Mahmoudi, Babak; Theodorou, Evangelos A
2016-08-01
This study presents a reinforcement learning approach for the optimization of the proportional-integral gains of the feedback controller represented in a computational model of epilepsy. The chaotic oscillator model provides a feedback control systems view of the dynamics of an epileptic brain with an internal feedback controller representative of the natural seizure suppression mechanism within the brain circuitry. Normal and pathological brain activity is simulated in this model by adjusting the feedback gain values of the internal controller. With insufficient gains, the internal controller cannot provide enough feedback to the brain dynamics causing an increase in correlation between different brain sites. This increase in synchronization results in the destabilization of the brain dynamics, which is representative of an epileptic seizure. To provide compensation for an insufficient internal controller an external controller is designed using proportional-integral feedback control strategy. A cross-entropy optimization algorithm is applied to the chaotic oscillator network model to learn the optimal feedback gains for the external controller instead of hand-tuning the gains to provide sufficient control to the pathological brain and prevent seizure generation. The correlation between the dynamics of neural activity within different brain sites is calculated for experimental data to show similar dynamics of epileptic neural activity as simulated by the network of chaotic oscillators.
Quantum statistical entropy corresponding to cosmic horizon in five-dimensional spacetime
Institute of Scientific and Technical Information of China (English)
2008-01-01
The generalized uncertainty relation is introduced to calculate the quantum statis-tical entropy corresponding to cosmic horizon. By using the new equation of state density motivated by the generalized uncertainty relation, we discuss entropies of Bose field and Fermi field on the background of five-dimensional spacetime. In our calculation, we need not introduce cutoff. There is no divergent logarithmic term in the original brick-wall method. And it is obtained that the quantum statistical en-tropy corresponding to cosmic horizon is proportional to the area of the horizon. Further it is shown that the entropy corresponding to cosmic horizon is the entropy of quantum state on the surface of horizon. The black hole’s entropy is the intrinsic property of the black hole. The entropy is a quantum effect. In our calculation, by using the quantum statistical method, we obtain the partition function of Bose field and Fermi field on the background of five-dimensional spacetime. We provide a way to study the quantum statistical entropy corresponding to cosmic horizon in the higher-dimensional spacetime.
Manufacturing of High Entropy Alloys
Jablonski, Paul D.; Licavoli, Joseph J.; Gao, Michael C.; Hawk, Jeffrey A.
2015-07-01
High entropy alloys (HEAs) have generated interest in recent years due to their unique positioning within the alloy world. By incorporating a number of elements in high proportion they have high configurational entropy, and thus they hold the promise of interesting and useful properties such as enhanced strength and phase stability. The present study investigates the microstructure of two single-phase face-centered cubic (FCC) HEAs, CoCrFeNi and CoCrFeNiMn, with special attention given to melting, homogenization and thermo-mechanical processing. Large-scale ingots were made by vacuum induction melting to avoid the extrinsic factors inherent in small-scale laboratory button samples. A computationally based homogenization heat treatment was applied to both alloys in order to eliminate segregation due to normal ingot solidification. The alloys fabricated well, with typical thermo-mechanical processing parameters being employed.
On Maximum Entropy and Inference
Directory of Open Access Journals (Sweden)
Luigi Gresele
2017-11-01
Full Text Available Maximum entropy is a powerful concept that entails a sharp separation between relevant and irrelevant variables. It is typically invoked in inference, once an assumption is made on what the relevant variables are, in order to estimate a model from data, that affords predictions on all other (dependent variables. Conversely, maximum entropy can be invoked to retrieve the relevant variables (sufficient statistics directly from the data, once a model is identified by Bayesian model selection. We explore this approach in the case of spin models with interactions of arbitrary order, and we discuss how relevant interactions can be inferred. In this perspective, the dimensionality of the inference problem is not set by the number of parameters in the model, but by the frequency distribution of the data. We illustrate the method showing its ability to recover the correct model in a few prototype cases and discuss its application on a real dataset.
Entropy favours open colloidal lattices
Mao, Xiaoming; Chen, Qian; Granick, Steve
2013-03-01
Burgeoning experimental and simulation activity seeks to understand the existence of self-assembled colloidal structures that are not close-packed. Here we describe an analytical theory based on lattice dynamics and supported by experiments that reveals the fundamental role entropy can play in stabilizing open lattices. The entropy we consider is associated with the rotational and vibrational modes unique to colloids interacting through extended attractive patches. The theory makes predictions of the implied temperature, pressure and patch-size dependence of the phase diagram of open and close-packed structures. More generally, it provides guidance for the conditions at which targeted patchy colloidal assemblies in two and three dimensions are stable, thus overcoming the difficulty in exploring by experiment or simulation the full range of conceivable parameters.
Maximizing Entropy over Markov Processes
DEFF Research Database (Denmark)
Biondi, Fabrizio; Legay, Axel; Nielsen, Bo Friis
2013-01-01
The channel capacity of a deterministic system with confidential data is an upper bound on the amount of bits of data an attacker can learn from the system. We encode all possible attacks to a system using a probabilistic specification, an Interval Markov Chain. Then the channel capacity...... as a reward function, a polynomial algorithm to verify the existence of an system maximizing entropy among those respecting a specification, a procedure for the maximization of reward functions over Interval Markov Chains and its application to synthesize an implementation maximizing entropy. We show how...... to use Interval Markov Chains to model abstractions of deterministic systems with confidential data, and use the above results to compute their channel capacity. These results are a foundation for ongoing work on computing channel capacity for abstractions of programs derived from code....
Maximizing entropy over Markov processes
DEFF Research Database (Denmark)
Biondi, Fabrizio; Legay, Axel; Nielsen, Bo Friis
2014-01-01
The channel capacity of a deterministic system with confidential data is an upper bound on the amount of bits of data an attacker can learn from the system. We encode all possible attacks to a system using a probabilistic specification, an Interval Markov Chain. Then the channel capacity...... as a reward function, a polynomial algorithm to verify the existence of a system maximizing entropy among those respecting a specification, a procedure for the maximization of reward functions over Interval Markov Chains and its application to synthesize an implementation maximizing entropy. We show how...... to use Interval Markov Chains to model abstractions of deterministic systems with confidential data, and use the above results to compute their channel capacity. These results are a foundation for ongoing work on computing channel capacity for abstractions of programs derived from code. © 2014 Elsevier...
Preserved entropy and fragile magnetism.
Canfield, Paul C; Bud'ko, Sergey L
2016-08-01
A large swath of quantum critical and strongly correlated electron systems can be associated with the phenomena of preserved entropy and fragile magnetism. In this overview we present our thoughts and plans for the discovery and development of lanthanide and transition metal based, strongly correlated systems that are revealed by suppressed, fragile magnetism, quantum criticality, or grow out of preserved entropy. We will present and discuss current examples such as YbBiPt, YbAgGe, YbFe2Zn20, PrAg2In, BaFe2As2, CaFe2As2, LaCrSb3 and LaCrGe3 as part of our motivation and to provide illustrative examples.
Image coding based on maximum entropy partitioning for identifying ...
Indian Academy of Sciences (India)
A new coding scheme based on maximum entropy partitioning is proposed in our work, particularly to identify the improbable intensities related to different emotions. The improbable intensities when used as a mask decode the facial expression correctly, providing an effectiveplatform for future emotion categorization ...
The constraint rule of the maximum entropy principle
Uffink, J.
1995-01-01
The principle of maximum entropy is a method for assigning values to probability distributions on the basis of partial information. In usual formulations of this and related methods of inference one assumes that this partial information takes the form of a constraint on allowed probability
Fisher-Renyi entropy product and information plane
International Nuclear Information System (INIS)
Romera, E.; Nagy, A.
2008-01-01
Connection between Fisher information and Renyi entropy has been established. This link allows us to define the Fisher-Renyi information plane and an entropic product in terms of these quantities. New Renyi uncertainty relations are obtained for single particle densities of many particle systems in position-momentum conjugate spaces
Quantum information entropies of ultracold atomic gases in a ...
Indian Academy of Sciences (India)
bosonic systems and a ≃ 1.982 and b = 1 for ideal fermionic systems. These results obey the entropic uncertainty relation given by Beckner, Bialynicki-Birula and Myceilski. Keywords. Ultracold atomic gases; information entropy; foundations of quantum mechanics. PACS Nos 67.85.−d; 89.70.Cf; 03.65.Ta. 1. Introduction.
Two aspects of black hole entropy in Lanczos-Lovelock models of gravity
Kolekar, Sanved; Kothawala, Dawood; Padmanabhan, T.
2012-03-01
We consider two specific approaches to evaluate the black hole entropy which are known to produce correct results in the case of Einstein’s theory and generalize them to Lanczos-Lovelock models. In the first approach (which could be called extrinsic), we use a procedure motivated by earlier work by Pretorius, Vollick, and Israel, and by Oppenheim, and evaluate the entropy of a configuration of densely packed gravitating shells on the verge of forming a black hole in Lanczos-Lovelock theories of gravity. We find that this matter entropy is not equal to (it is less than) Wald entropy, except in the case of Einstein theory, where they are equal. The matter entropy is proportional to the Wald entropy if we consider a specific mth-order Lanczos-Lovelock model, with the proportionality constant depending on the spacetime dimensions D and the order m of the Lanczos-Lovelock theory as (D-2m)/(D-2). Since the proportionality constant depends on m, the proportionality between matter entropy and Wald entropy breaks down when we consider a sum of Lanczos-Lovelock actions involving different m. In the second approach (which could be called intrinsic), we generalize a procedure, previously introduced by Padmanabhan in the context of general relativity, to study off-shell entropy of a class of metrics with horizon using a path integral method. We consider the Euclidean action of Lanczos-Lovelock models for a class of metrics off shell and interpret it as a partition function. We show that in the case of spherically symmetric metrics, one can interpret the Euclidean action as the free energy and read off both the entropy and energy of a black hole spacetime. Surprisingly enough, this leads to exactly the Wald entropy and the energy of the spacetime in Lanczos-Lovelock models obtained by other methods. We comment on possible implications of the result.
ASSESSMENT OF MOTIVATION BY ENTROPY
Tadeusz G³owacki
2014-01-01
Motivation is inseparable from human work. It is also one of the five most important elements of the management process. The ability to determine the level of motivation would therefore be very useful in the work of every manager. This paper is an attempt to quantify motivation and evaluate its size, using the concept of entropy. The main reason to try defining a method of measuring the amount of motivation is to improve the management techniques of companies.