Spatial-dependence recurrence sample entropy

Science.gov (United States)

Pham, Tuan D.; Yan, Hong

2018-03-01

Measuring complexity in terms of the predictability of time series is a major area of research in science and engineering, and its applications are spreading throughout many scientific disciplines, where the analysis of physiological signals is perhaps the most widely reported in literature. Sample entropy is a popular measure for quantifying signal irregularity. However, the sample entropy does not take sequential information, which is inherently useful, into its calculation of sample similarity. Here, we develop a method that is based on the mathematical principle of the sample entropy and enables the capture of sequential information of a time series in the context of spatial dependence provided by the binary-level co-occurrence matrix of a recurrence plot. Experimental results on time-series data of the Lorenz system, physiological signals of gait maturation in healthy children, and gait dynamics in Huntington's disease show the potential of the proposed method.

Sample Entropy and Traditional Measures of Heart Rate Dynamics Reveal Different Modes of Cardiovascular Control During Low Intensity Exercise

Directory of Open Access Journals (Sweden)

Matthias Weippert

2014-10-01

Full Text Available Nonlinear parameters of heart rate variability (HRV have proven their prognostic value in clinical settings, but their physiological background is not very well established. We assessed the effects of low intensity isometric (ISO and dynamic (DYN exercise of the lower limbs on heart rate matched intensity on traditional and entropy measures of HRV. Due to changes of afferent feedback under DYN and ISO a distinct autonomic response, mirrored by HRV measures, was hypothesized. Five-minute inter-beat interval measurements of 43 healthy males (26.0 ± 3.1 years were performed during rest, DYN and ISO in a randomized order. Blood pressures and rate pressure product were higher during ISO vs. DYN (p < 0.001. HRV indicators SDNN as well as low and high frequency power were significantly higher during ISO (p < 0.001 for all measures. Compared to DYN, sample entropy (SampEn was lower during ISO (p < 0.001. Concluding, contraction mode itself is a significant modulator of the autonomic cardiovascular response to exercise. Compared to DYN, ISO evokes a stronger blood pressure response and an enhanced interplay between both autonomic branches. Non-linear HRV measures indicate a more regular behavior under ISO. Results support the view of the reciprocal antagonism being only one of many modes of autonomic heart rate control. Under different conditions; the identical “end product” heart rate might be achieved by other modes such as sympathovagal co-activation as well.

Applying Improved Multiscale Fuzzy Entropy for Feature Extraction of MI-EEG

Directory of Open Access Journals (Sweden)

Ming-ai Li

2017-01-01

Full Text Available Electroencephalography (EEG is considered the output of a brain and it is a bioelectrical signal with multiscale and nonlinear properties. Motor Imagery EEG (MI-EEG not only has a close correlation with the human imagination and movement intention but also contains a large amount of physiological or disease information. As a result, it has been fully studied in the field of rehabilitation. To correctly interpret and accurately extract the features of MI-EEG signals, many nonlinear dynamic methods based on entropy, such as Approximate Entropy (ApEn, Sample Entropy (SampEn, Fuzzy Entropy (FE, and Permutation Entropy (PE, have been proposed and exploited continuously in recent years. However, these entropy-based methods can only measure the complexity of MI-EEG based on a single scale and therefore fail to account for the multiscale property inherent in MI-EEG. To solve this problem, Multiscale Sample Entropy (MSE, Multiscale Permutation Entropy (MPE, and Multiscale Fuzzy Entropy (MFE are developed by introducing scale factor. However, MFE has not been widely used in analysis of MI-EEG, and the same parameter values are employed when the MFE method is used to calculate the fuzzy entropy values on multiple scales. Actually, each coarse-grained MI-EEG carries the characteristic information of the original signal on different scale factors. It is necessary to optimize MFE parameters to discover more feature information. In this paper, the parameters of MFE are optimized independently for each scale factor, and the improved MFE (IMFE is applied to the feature extraction of MI-EEG. Based on the event-related desynchronization (ERD/event-related synchronization (ERS phenomenon, IMFE features from multi channels are fused organically to construct the feature vector. Experiments are conducted on a public dataset by using Support Vector Machine (SVM as a classifier. The experiment results of 10-fold cross-validation show that the proposed method yields

Multiscale sample entropy and cross-sample entropy based on symbolic representation and similarity of stock markets

Science.gov (United States)

Wu, Yue; Shang, Pengjian; Li, Yilong

2018-03-01

A modified multiscale sample entropy measure based on symbolic representation and similarity (MSEBSS) is proposed in this paper to research the complexity of stock markets. The modified algorithm reduces the probability of inducing undefined entropies and is confirmed to be robust to strong noise. Considering the validity and accuracy, MSEBSS is more reliable than Multiscale entropy (MSE) for time series mingled with much noise like financial time series. We apply MSEBSS to financial markets and results show American stock markets have the lowest complexity compared with European and Asian markets. There are exceptions to the regularity that stock markets show a decreasing complexity over the time scale, indicating a periodicity at certain scales. Based on MSEBSS, we introduce the modified multiscale cross-sample entropy measure based on symbolic representation and similarity (MCSEBSS) to consider the degree of the asynchrony between distinct time series. Stock markets from the same area have higher synchrony than those from different areas. And for stock markets having relative high synchrony, the entropy values will decrease with the increasing scale factor. While for stock markets having high asynchrony, the entropy values will not decrease with the increasing scale factor sometimes they tend to increase. So both MSEBSS and MCSEBSS are able to distinguish stock markets of different areas, and they are more helpful if used together for studying other features of financial time series.

Entropy Information of Cardiorespiratory Dynamics in Neonates during Sleep

Directory of Open Access Journals (Sweden)

Maristella Lucchini

2017-05-01

Full Text Available Sleep is a central activity in human adults and characterizes most of the newborn infant life. During sleep, autonomic control acts to modulate heart rate variability (HRV and respiration. Mechanisms underlying cardiorespiratory interactions in different sleep states have been studied but are not yet fully understood. Signal processing approaches have focused on cardiorespiratory analysis to elucidate this co-regulation. This manuscript proposes to analyze heart rate (HR, respiratory variability and their interrelationship in newborn infants to characterize cardiorespiratory interactions in different sleep states (active vs. quiet. We are searching for indices that could detect regulation alteration or malfunction, potentially leading to infant distress. We have analyzed inter-beat (RR interval series and respiration in a population of 151 newborns, and followed up with 33 at 1 month of age. RR interval series were obtained by recognizing peaks of the QRS complex in the electrocardiogram (ECG, corresponding to the ventricles depolarization. Univariate time domain, frequency domain and entropy measures were applied. In addition, Transfer Entropy was considered as a bivariate approach able to quantify the bidirectional information flow from one signal (respiration to another (RR series. Results confirm the validity of the proposed approach. Overall, HRV is higher in active sleep, while high frequency (HF power characterizes more quiet sleep. Entropy analysis provides higher indices for SampEn and Quadratic Sample entropy (QSE in quiet sleep. Transfer Entropy values were higher in quiet sleep and point to a major influence of respiration on the RR series. At 1 month of age, time domain parameters show an increase in HR and a decrease in variability. No entropy differences were found across ages. The parameters employed in this study help to quantify the potential for infants to adapt their cardiorespiratory responses as they mature. Thus, they

Entropy Information of Cardiorespiratory Dynamics in Neonates during Sleep.

Science.gov (United States)

Lucchini, Maristella; Pini, Nicolò; Fifer, William P; Burtchen, Nina; Signorini, Maria G

2017-05-01

Sleep is a central activity in human adults and characterizes most of the newborn infant life. During sleep, autonomic control acts to modulate heart rate variability (HRV) and respiration. Mechanisms underlying cardiorespiratory interactions in different sleep states have been studied but are not yet fully understood. Signal processing approaches have focused on cardiorespiratory analysis to elucidate this co-regulation. This manuscript proposes to analyze heart rate (HR), respiratory variability and their interrelationship in newborn infants to characterize cardiorespiratory interactions in different sleep states (active vs. quiet). We are searching for indices that could detect regulation alteration or malfunction, potentially leading to infant distress. We have analyzed inter-beat (RR) interval series and respiration in a population of 151 newborns, and followed up with 33 at 1 month of age. RR interval series were obtained by recognizing peaks of the QRS complex in the electrocardiogram (ECG), corresponding to the ventricles depolarization. Univariate time domain, frequency domain and entropy measures were applied. In addition, Transfer Entropy was considered as a bivariate approach able to quantify the bidirectional information flow from one signal (respiration) to another (RR series). Results confirm the validity of the proposed approach. Overall, HRV is higher in active sleep, while high frequency (HF) power characterizes more quiet sleep. Entropy analysis provides higher indices for SampEn and Quadratic Sample entropy (QSE) in quiet sleep. Transfer Entropy values were higher in quiet sleep and point to a major influence of respiration on the RR series. At 1 month of age, time domain parameters show an increase in HR and a decrease in variability. No entropy differences were found across ages. The parameters employed in this study help to quantify the potential for infants to adapt their cardiorespiratory responses as they mature. Thus, they could be useful

Weighted fractional permutation entropy and fractional sample entropy for nonlinear Potts financial dynamics

Energy Technology Data Exchange (ETDEWEB)

Xu, Kaixuan, E-mail: kaixuanxubjtu@yeah.net; Wang, Jun

2017-02-26

In this paper, recently introduced permutation entropy and sample entropy are further developed to the fractional cases, weighted fractional permutation entropy (WFPE) and fractional sample entropy (FSE). The fractional order generalization of information entropy is utilized in the above two complexity approaches, to detect the statistical characteristics of fractional order information in complex systems. The effectiveness analysis of proposed methods on the synthetic data and the real-world data reveals that tuning the fractional order allows a high sensitivity and more accurate characterization to the signal evolution, which is useful in describing the dynamics of complex systems. Moreover, the numerical research on nonlinear complexity behaviors is compared between the returns series of Potts financial model and the actual stock markets. And the empirical results confirm the feasibility of the proposed model. - Highlights: • Two new entropy approaches for estimation of nonlinear complexity are proposed for the financial market. • Effectiveness analysis of proposed methods is presented and their respective features are studied. • Empirical research of proposed analysis on seven world financial market indices. • Numerical simulation of Potts financial dynamics is preformed for nonlinear complexity behaviors.

Weighted fractional permutation entropy and fractional sample entropy for nonlinear Potts financial dynamics

International Nuclear Information System (INIS)

Xu, Kaixuan; Wang, Jun

2017-01-01

In this paper, recently introduced permutation entropy and sample entropy are further developed to the fractional cases, weighted fractional permutation entropy (WFPE) and fractional sample entropy (FSE). The fractional order generalization of information entropy is utilized in the above two complexity approaches, to detect the statistical characteristics of fractional order information in complex systems. The effectiveness analysis of proposed methods on the synthetic data and the real-world data reveals that tuning the fractional order allows a high sensitivity and more accurate characterization to the signal evolution, which is useful in describing the dynamics of complex systems. Moreover, the numerical research on nonlinear complexity behaviors is compared between the returns series of Potts financial model and the actual stock markets. And the empirical results confirm the feasibility of the proposed model. - Highlights: • Two new entropy approaches for estimation of nonlinear complexity are proposed for the financial market. • Effectiveness analysis of proposed methods is presented and their respective features are studied. • Empirical research of proposed analysis on seven world financial market indices. • Numerical simulation of Potts financial dynamics is preformed for nonlinear complexity behaviors.

Correlation between movement complexity during static standing and balance function in institutionalized older adults

OpenAIRE

Yamagata, Momoko; Ikezoe, Tome; Kamiya, Midori; Masaki, Mitsuhiro; Ichihashi, Noriaki

2017-01-01

Momoko Yamagata,1 Tome Ikezoe,1 Midori Kamiya,1 Mitsuhiro Masaki,2,3 Noriaki Ichihashi1 1Human Health Sciences, Graduate School of Medicine, Kyoto University, Kyoto, 2Department of Physical Therapy, 3Institute for Human Movement and Medical Sciences, Niigata University of Health and Welfare, Niigata, Japan Purpose: Sample entropy (SampEn) is an analysis to evaluate movement complexity of the center of pressure (COP). A lower value of SampEn indicates lower complexity of COP variability, tha...

Correlation between movement complexity during static standing and balance function in institutionalized older adults

Directory of Open Access Journals (Sweden)

Yamagata M

2017-03-01

Full Text Available Momoko Yamagata,1 Tome Ikezoe,1 Midori Kamiya,1 Mitsuhiro Masaki,2,3 Noriaki Ichihashi1 1Human Health Sciences, Graduate School of Medicine, Kyoto University, Kyoto, 2Department of Physical Therapy, 3Institute for Human Movement and Medical Sciences, Niigata University of Health and Welfare, Niigata, Japan Purpose: Sample entropy (SampEn is an analysis to evaluate movement complexity of the center of pressure (COP. A lower value of SampEn indicates lower complexity of COP variability, that is, rigidity, and lower degrees of freedom. Previous studies reported the association of increased SampEn with improved standing balance ability in young subjects. However, no studies have examined these relationships among older adults. Thus, we aimed to investigate the relationship between SampEn and standing balance ability in older adults.Subjects and methods: The subjects were 33 institutionalized older adults (aged 82.2±6.5 years. COP during static standing was measured. The standard deviation (SD values of COP and SampEn in the sagittal and frontal planes were calculated using time series data. One-leg standing test (OLST, functional reach (FR test, and lateral reach (LR test were also measured to evaluate standing balance ability.Results: OLST, FR, and LR were 6.5±8.3 s, 19.8±5.9 cm, and 18.2±6.4 cm, respectively. Pearson correlation analysis revealed that SampEn in the sagittal plane significantly correlated with OLST (r=-0.35 and FR (r=-0.36. However, SampEn in the frontal plane and SD of COP in both sagittal and frontal planes had no relationship with any of the clinical balance tests.Conclusion: Lower SampEn implies rigidity for postural control. In the present study, it was found that lower SampEn in the sagittal plane was related to a higher balance function, which suggests that older adults utilized body rigidity to maintain postural stability as a compensative strategy. Keywords: older adults, posture, balance, standing, complexity

Generalized sample entropy analysis for traffic signals based on similarity measure

Science.gov (United States)

Shang, Du; Xu, Mengjia; Shang, Pengjian

2017-05-01

Sample entropy is a prevailing method used to quantify the complexity of a time series. In this paper a modified method of generalized sample entropy and surrogate data analysis is proposed as a new measure to assess the complexity of a complex dynamical system such as traffic signals. The method based on similarity distance presents a different way of signals patterns match showing distinct behaviors of complexity. Simulations are conducted over synthetic data and traffic signals for providing the comparative study, which is provided to show the power of the new method. Compared with previous sample entropy and surrogate data analysis, the new method has two main advantages. The first one is that it overcomes the limitation about the relationship between the dimension parameter and the length of series. The second one is that the modified sample entropy functions can be used to quantitatively distinguish time series from different complex systems by the similar measure.

Sample Entropy-Based Approach to Evaluate the Stability of Double-Wire Pulsed MIG Welding

Directory of Open Access Journals (Sweden)

Ping Yao

2014-01-01

Full Text Available According to the sample entropy, this paper deals with a quantitative method to evaluate the current stability in double-wire pulsed MIG welding. Firstly, the sample entropy of current signals with different stability but the same parameters is calculated. The results show that the more stable the current, the smaller the value and the standard deviation of sample entropy. Secondly, four parameters, which are pulse width, peak current, base current, and frequency, are selected for four-level three-factor orthogonal experiment. The calculation and analysis of desired signals indicate that sample entropy values are affected by welding current parameters. Then, a quantitative method based on sample entropy is proposed. The experiment results show that the method can preferably quantify the welding current stability.

Non-linear Heart Rate Variability as a Discriminator of Internalizing Psychopathology and Negative Affect in Children With Internalizing Problems and Healthy Controls

Directory of Open Access Journals (Sweden)

Charlotte Fiskum

2018-05-01

Full Text Available Background: Internalizing psychopathology and dysregulated negative affect are characterized by dysregulation in the autonomic nervous system and reduced heart rate variability (HRV due to increases in sympathetic activity alongside reduced vagal tone. The neurovisceral system is however, a complex nonlinear system, and nonlinear indices related to psychopathology are so far less studied in children. Essential nonlinear properties of a system can be found in two main domains: the informational domain and the invariant domain. sample entropy (SampEn is a much-used method from the informational domain, while detrended fluctuation analysis (DFA represents a widely-used method from the invariant domain. To see if nonlinear HRV can provide information beyond linear indices of autonomic activation, this study investigated SampEn and DFA as discriminators of internalizing psychopathology and negative affect alongside measures of vagally-mediated HRV and sympathetic activation.Material and Methods: Thirty-Two children with internalizing difficulties and 25 healthy controls (aged 9–13 were assessed with the Child Behavior Checklist and the Early Adolescent Temperament Questionnaire, Revised, giving an estimate of internalizing psychopathology, negative affect and effortful control, a protective factor against psychopathology. Five minute electrocardiogram and impedance cardiography recordings were collected during a resting baseline, giving estimates of SampEn, DFA short-term scaling exponent α1, root mean square of successive differences (RMSSD, and pre-ejection period (PEP. Between-group differences and correlations were assessed with parametric and non-parametric tests, and the relationships between cardiac variables, psychopathology and negative affect were assessed using generalized linear modeling.Results: SampEn and DFA were not significantly different between the groups. SampEn was weakly negatively related to heart rate (HR in the controls

An application of sample entropy to precipitation in Paraíba State, Brazil

Science.gov (United States)

Xavier, Sílvio Fernando Alves; da Silva Jale, Jader; Stosic, Tatijana; dos Santos, Carlos Antonio Costa; Singh, Vijay P.

2018-05-01

A climate system is characterized to be a complex non-linear system. In order to describe the complex characteristics of precipitation series in Paraíba State, Brazil, we aim the use of sample entropy, a kind of entropy-based algorithm, to evaluate the complexity of precipitation series. Sixty-nine meteorological stations are distributed over four macroregions: Zona da Mata, Agreste, Borborema, and Sertão. The results of the analysis show that intricacies of monthly average precipitation have differences in the macroregions. Sample entropy is able to reflect the dynamic change of precipitation series providing a new way to investigate complexity of hydrological series. The complexity exhibits areal variation of local water resource systems which can influence the basis for utilizing and developing resources in dry areas.

Multidimensional scaling analysis of financial time series based on modified cross-sample entropy methods

Science.gov (United States)

He, Jiayi; Shang, Pengjian; Xiong, Hui

2018-06-01

Stocks, as the concrete manifestation of financial time series with plenty of potential information, are often used in the study of financial time series. In this paper, we utilize the stock data to recognize their patterns through out the dissimilarity matrix based on modified cross-sample entropy, then three-dimensional perceptual maps of the results are provided through multidimensional scaling method. Two modified multidimensional scaling methods are proposed in this paper, that is, multidimensional scaling based on Kronecker-delta cross-sample entropy (MDS-KCSE) and multidimensional scaling based on permutation cross-sample entropy (MDS-PCSE). These two methods use Kronecker-delta based cross-sample entropy and permutation based cross-sample entropy to replace the distance or dissimilarity measurement in classical multidimensional scaling (MDS). Multidimensional scaling based on Chebyshev distance (MDSC) is employed to provide a reference for comparisons. Our analysis reveals a clear clustering both in synthetic data and 18 indices from diverse stock markets. It implies that time series generated by the same model are easier to have similar irregularity than others, and the difference in the stock index, which is caused by the country or region and the different financial policies, can reflect the irregularity in the data. In the synthetic data experiments, not only the time series generated by different models can be distinguished, the one generated under different parameters of the same model can also be detected. In the financial data experiment, the stock indices are clearly divided into five groups. Through analysis, we find that they correspond to five regions, respectively, that is, Europe, North America, South America, Asian-Pacific (with the exception of mainland China), mainland China and Russia. The results also demonstrate that MDS-KCSE and MDS-PCSE provide more effective divisions in experiments than MDSC.

Optimizing human activity patterns using global sensitivity analysis.

Science.gov (United States)

Fairchild, Geoffrey; Hickmann, Kyle S; Mniszewski, Susan M; Del Valle, Sara Y; Hyman, James M

2014-12-01

Implementing realistic activity patterns for a population is crucial for modeling, for example, disease spread, supply and demand, and disaster response. Using the dynamic activity simulation engine, DASim, we generate schedules for a population that capture regular (e.g., working, eating, and sleeping) and irregular activities (e.g., shopping or going to the doctor). We use the sample entropy (SampEn) statistic to quantify a schedule's regularity for a population. We show how to tune an activity's regularity by adjusting SampEn, thereby making it possible to realistically design activities when creating a schedule. The tuning process sets up a computationally intractable high-dimensional optimization problem. To reduce the computational demand, we use Bayesian Gaussian process regression to compute global sensitivity indices and identify the parameters that have the greatest effect on the variance of SampEn. We use the harmony search (HS) global optimization algorithm to locate global optima. Our results show that HS combined with global sensitivity analysis can efficiently tune the SampEn statistic with few search iterations. We demonstrate how global sensitivity analysis can guide statistical emulation and global optimization algorithms to efficiently tune activities and generate realistic activity patterns. Though our tuning methods are applied to dynamic activity schedule generation, they are general and represent a significant step in the direction of automated tuning and optimization of high-dimensional computer simulations.

Local entropy as a measure for sampling solutions in constraint satisfaction problems

International Nuclear Information System (INIS)

Baldassi, Carlo; Ingrosso, Alessandro; Lucibello, Carlo; Saglietti, Luca; Zecchina, Riccardo

2016-01-01

We introduce a novel entropy-driven Monte Carlo (EdMC) strategy to efficiently sample solutions of random constraint satisfaction problems (CSPs). First, we extend a recent result that, using a large-deviation analysis, shows that the geometry of the space of solutions of the binary perceptron learning problem (a prototypical CSP), contains regions of very high-density of solutions. Despite being sub-dominant, these regions can be found by optimizing a local entropy measure. Building on these results, we construct a fast solver that relies exclusively on a local entropy estimate, and can be applied to general CSPs. We describe its performance not only for the perceptron learning problem but also for the random K-satisfiabilty problem (another prototypical CSP with a radically different structure), and show numerically that a simple zero-temperature Metropolis search in the smooth local entropy landscape can reach sub-dominant clusters of optimal solutions in a small number of steps, while standard Simulated Annealing either requires extremely long cooling procedures or just fails. We also discuss how the EdMC can heuristically be made even more efficient for the cases we studied. (paper: disordered systems, classical and quantum)

Parametric Bayesian Estimation of Differential Entropy and Relative Entropy

OpenAIRE

Gupta; Srivastava

2010-01-01

Given iid samples drawn from a distribution with known parametric form, we propose the minimization of expected Bregman divergence to form Bayesian estimates of differential entropy and relative entropy, and derive such estimators for the uniform, Gaussian, Wishart, and inverse Wishart distributions. Additionally, formulas are given for a log gamma Bregman divergence and the differential entropy and relative entropy for the Wishart and inverse Wishart. The results, as always with Bayesian est...

Bayesian Reliability Estimation for Deteriorating Systems with Limited Samples Using the Maximum Entropy Approach

OpenAIRE

Xiao, Ning-Cong; Li, Yan-Feng; Wang, Zhonglai; Peng, Weiwen; Huang, Hong-Zhong

2013-01-01

In this paper the combinations of maximum entropy method and Bayesian inference for reliability assessment of deteriorating system is proposed. Due to various uncertainties, less data and incomplete information, system parameters usually cannot be determined precisely. These uncertainty parameters can be modeled by fuzzy sets theory and the Bayesian inference which have been proved to be useful for deteriorating systems under small sample sizes. The maximum entropy approach can be used to cal...

Complexity of heartbeat interval series in young healthy trained and untrained men

International Nuclear Information System (INIS)

Platisa, Mirjana M; Nestorovic, Zorica; Gal, Vera; Mazic, Sanja

2008-01-01

The origin of heart rate variability (HRV) is largely in parasympathetic activity. The direct influence of sympathetic activity and other control mechanisms, especially at an increased HR, is not well understood. The objectives of the study were to investigate the influence of increasing HR on the properties of heartbeat interval (RR) series in young healthy subjects. ECG was recorded in 9 trained and 11 untrained young men during supine rest, standing, incremental running exercise and relaxation. During exercise, a breath-to-breath gas exchange was monitored. The RR time series analysis included the spectral analysis, detrended fluctuations analysis method and sample entropy (SampEn) calculation. During exercise, spectral powers were reduced dramatically in both groups. The dependence of short-term scaling exponent (α 1 ) on the RR included a characteristic maximum, while SampEn for the same value of the RR had a minimum. The value of HR corresponding to the maximum of α 1 and minimum of SampEn (IHR) corresponded to the intrinsic HR obtained by an autonomic blockade. In trained subjects, the curves α 1 versus RR and SampEn versus RR were moved toward larger RR, compared with control. For HR values higher than IHR, α 1 decreased and SampEn increased. These results reveal that the complexity of the heart rhythm above intrinsic HR decreases with an increase in HR. We suggest that at the highest HR intrinsic heart control is reflected in the heart rhythm. We point out the possibility of developing a new non-invasive method for the determination of intrinsic HR from the curve α 1 versus RR

Fatigue reduces the complexity of knee extensor torque fluctuations during maximal and submaximal intermittent isometric contractions in man

Science.gov (United States)

Pethick, Jamie; Winter, Samantha L; Burnley, Mark

2015-01-01

Neuromuscular fatigue increases the amplitude of fluctuations in torque output during isometric contractions, but the effect of fatigue on the temporal structure, or complexity, of these fluctuations is not known. We hypothesised that fatigue would result in a loss of temporal complexity and a change in fractal scaling of the torque signal during isometric knee extensor exercise. Eleven healthy participants performed a maximal test (5 min of intermittent maximal voluntary contractions, MVCs), and a submaximal test (contractions at a target of 40% MVC performed until task failure), each with a 60% duty factor (6 s contraction, 4 s rest). Torque and surface EMG signals were sampled continuously. Complexity and fractal scaling of torque were quantified by calculating approximate entropy (ApEn), sample entropy (SampEn) and the detrended fluctuation analysis (DFA) scaling exponent α. Fresh submaximal contractions were more complex than maximal contractions (mean ± SEM, submaximal vs. maximal: ApEn 0.65 ± 0.09 vs. 0.15 ± 0.02; SampEn 0.62 ± 0.09 vs. 0.14 ± 0.02; DFA α 1.35 ± 0.04 vs. 1.55 ± 0.03; all P torque, fatigue reduces the neuromuscular system's adaptability to external perturbations. PMID:25664928

Bayesian Reliability Estimation for Deteriorating Systems with Limited Samples Using the Maximum Entropy Approach

Directory of Open Access Journals (Sweden)

Ning-Cong Xiao

2013-12-01

Full Text Available In this paper the combinations of maximum entropy method and Bayesian inference for reliability assessment of deteriorating system is proposed. Due to various uncertainties, less data and incomplete information, system parameters usually cannot be determined precisely. These uncertainty parameters can be modeled by fuzzy sets theory and the Bayesian inference which have been proved to be useful for deteriorating systems under small sample sizes. The maximum entropy approach can be used to calculate the maximum entropy density function of uncertainty parameters more accurately for it does not need any additional information and assumptions. Finally, two optimization models are presented which can be used to determine the lower and upper bounds of systems probability of failure under vague environment conditions. Two numerical examples are investigated to demonstrate the proposed method.

Three faces of entropy for complex systems: Information, thermodynamics, and the maximum entropy principle

Science.gov (United States)

Thurner, Stefan; Corominas-Murtra, Bernat; Hanel, Rudolf

2017-09-01

There are at least three distinct ways to conceptualize entropy: entropy as an extensive thermodynamic quantity of physical systems (Clausius, Boltzmann, Gibbs), entropy as a measure for information production of ergodic sources (Shannon), and entropy as a means for statistical inference on multinomial processes (Jaynes maximum entropy principle). Even though these notions represent fundamentally different concepts, the functional form of the entropy for thermodynamic systems in equilibrium, for ergodic sources in information theory, and for independent sampling processes in statistical systems, is degenerate, H (p ) =-∑ipilogpi . For many complex systems, which are typically history-dependent, nonergodic, and nonmultinomial, this is no longer the case. Here we show that for such processes, the three entropy concepts lead to different functional forms of entropy, which we will refer to as SEXT for extensive entropy, SIT for the source information rate in information theory, and SMEP for the entropy functional that appears in the so-called maximum entropy principle, which characterizes the most likely observable distribution functions of a system. We explicitly compute these three entropy functionals for three concrete examples: for Pólya urn processes, which are simple self-reinforcing processes, for sample-space-reducing (SSR) processes, which are simple history dependent processes that are associated with power-law statistics, and finally for multinomial mixture processes.

Effects of breathing patterns and light exercise on linear and nonlinear heart rate variability.

Science.gov (United States)

Weippert, Matthias; Behrens, Kristin; Rieger, Annika; Kumar, Mohit; Behrens, Martin

2015-08-01

Despite their use in cardiac risk stratification, the physiological meaning of nonlinear heart rate variability (HRV) measures is not well understood. The aim of this study was to elucidate effects of breathing frequency, tidal volume, and light exercise on nonlinear HRV and to determine associations with traditional HRV indices. R-R intervals, blood pressure, minute ventilation, breathing frequency, and respiratory gas concentrations were measured in 24 healthy male volunteers during 7 conditions: voluntary breathing at rest, and metronome guided breathing (0.1, 0.2 and 0.4 Hz) during rest, and cycling, respectively. The effect of physical load was significant for heart rate (HR; p < 0.001) and traditional HRV indices SDNN, RMSSD, lnLFP, and lnHFP (p < 0.01 for all). It approached significance for sample entropy (SampEn) and correlation dimension (D2) (p < 0.1 for both), while HRV detrended fluctuation analysis (DFA) measures DFAα1 and DFAα2 were not affected by load condition. Breathing did not affect HR but affected all traditional HRV measures. D2 was not affected by breathing; DFAα1 was moderately affected by breathing; and DFAα2, approximate entropy (ApEn), and SampEn were strongly affected by breathing. DFAα1 was strongly increased, whereas DFAα2, ApEn, and SampEn were decreased by slow breathing. No interaction effect of load and breathing pattern was evident. Correlations to traditional HRV indices were modest (r from -0.14 to -0.67, p < 0.05 to <0.01). In conclusion, while light exercise does not significantly affect short-time HRV nonlinear indices, respiratory activity has to be considered as a potential contributor at rest and during light dynamic exercise.

Nonlinear analysis of fetal heart rate dynamics in fetuses compromised by asymptomatic partial placental abruption.

Science.gov (United States)

Choi, Won-Young; Hoh, Jeong-Kyu

2015-12-01

We analyzed fetal heart rate (FHR) parameters, dynamics, and outcomes in pregnancies with asymptomatic partial placental abruption (PPA) compared with those in normal pregnancies. We examined nonstress test (NST) data acquired from 2003 to 2012 at our institution. Normal pregnancies (N = 170) and PPA cases (N = 17) were matched for gestational age, fetal sex, and mean FHR. NSTs were performed at 33-42 weeks of gestation. FHR parameters obtained from the NST and perinatal outcomes were analyzed using linear methods. Nonlinear indices, including approximate entropy (ApEn), sample entropy (SampEn), short-term and long-term scaling exponents (α1 and α2), and correlation dimension (CD), were used to interpret FHR dynamics and system complexity. The area under a receiver operating characteristic curve (AUC) was used to evaluate the nonlinear indices. There were no significant differences in general characteristics and FHR parameters between the PPA and control groups. However, gestational age at delivery, birth weight, 5-min Apgar scores, ApEn, SampEn, and CD were significantly lower in the PPA group than in the control group (P Nonlinear dynamic indices of FHR in asymptomatic PPA were qualitatively different from those in normal pregnancies, whereas the conventional FHR parameters were not significantly different. Copyright © 2015 Elsevier Ltd. All rights reserved.

Parametric Bayesian Estimation of Differential Entropy and Relative Entropy

Directory of Open Access Journals (Sweden)

Maya Gupta

2010-04-01

Full Text Available Given iid samples drawn from a distribution with known parametric form, we propose the minimization of expected Bregman divergence to form Bayesian estimates of differential entropy and relative entropy, and derive such estimators for the uniform, Gaussian, Wishart, and inverse Wishart distributions. Additionally, formulas are given for a log gamma Bregman divergence and the differential entropy and relative entropy for the Wishart and inverse Wishart. The results, as always with Bayesian estimates, depend on the accuracy of the prior parameters, but example simulations show that the performance can be substantially improved compared to maximum likelihood or state-of-the-art nonparametric estimators.

Adaptive Neuro-Fuzzy Inference System for Classification of Background EEG Signals from ESES Patients and Controls

Directory of Open Access Journals (Sweden)

Zhixian Yang

2014-01-01

Full Text Available Background electroencephalography (EEG, recorded with scalp electrodes, in children with electrical status epilepticus during slow-wave sleep (ESES syndrome and control subjects has been analyzed. We considered 10 ESES patients, all right-handed and aged 3–9 years. The 10 control individuals had the same characteristics of the ESES ones but presented a normal EEG. Recordings were undertaken in the awake and relaxed states with their eyes open. The complexity of background EEG was evaluated using the permutation entropy (PE and sample entropy (SampEn in combination with the ANOVA test. It can be seen that the entropy measures of EEG are significantly different between the ESES patients and normal control subjects. Then, a classification framework based on entropy measures and adaptive neuro-fuzzy inference system (ANFIS classifier is proposed to distinguish ESES and normal EEG signals. The results are promising and a classification accuracy of about 89% is achieved.

Multivariate refined composite multiscale entropy analysis

International Nuclear Information System (INIS)

Humeau-Heurtier, Anne

2016-01-01

Multiscale entropy (MSE) has become a prevailing method to quantify signals complexity. MSE relies on sample entropy. However, MSE may yield imprecise complexity estimation at large scales, because sample entropy does not give precise estimation of entropy when short signals are processed. A refined composite multiscale entropy (RCMSE) has therefore recently been proposed. Nevertheless, RCMSE is for univariate signals only. The simultaneous analysis of multi-channel (multivariate) data often over-performs studies based on univariate signals. We therefore introduce an extension of RCMSE to multivariate data. Applications of multivariate RCMSE to simulated processes reveal its better performances over the standard multivariate MSE. - Highlights: • Multiscale entropy quantifies data complexity but may be inaccurate at large scale. • A refined composite multiscale entropy (RCMSE) has therefore recently been proposed. • Nevertheless, RCMSE is adapted to univariate time series only. • We herein introduce an extension of RCMSE to multivariate data. • It shows better performances than the standard multivariate multiscale entropy.

Application of Multivariate Empirical Mode Decomposition and Sample Entropy in EEG Signals via Artificial Neural Networks for Interpreting Depth of Anesthesia

Directory of Open Access Journals (Sweden)

Jiann-Shing Shieh

2013-08-01

Full Text Available EEG (Electroencephalography signals can express the human awareness activities and consequently it can indicate the depth of anesthesia. On the other hand, Bispectral-index (BIS is often used as an indicator to assess the depth of anesthesia. This study is aimed at using an advanced signal processing method to analyze EEG signals and compare them with existing BIS indexes from a commercial product (i.e., IntelliVue MP60 BIS module. Multivariate empirical mode decomposition (MEMD algorithm is utilized to filter the EEG signals. A combination of two MEMD components (IMF2 + IMF3 is used to express the raw EEG. Then, sample entropy algorithm is used to calculate the complexity of the patients’ EEG signal. Furthermore, linear regression and artificial neural network (ANN methods were used to model the sample entropy using BIS index as the gold standard. ANN can produce better target value than linear regression. The correlation coefficient is 0.790 ± 0.069 and MAE is 8.448 ± 1.887. In conclusion, the area under the receiver operating characteristic (ROC curve (AUC of sample entropy value using ANN and MEMD is 0.969 ± 0.028 while the AUC of sample entropy value without filter is 0.733 ± 0.123. It means the MEMD method can filter out noise of the brain waves, so that the sample entropy of EEG can be closely related to the depth of anesthesia. Therefore, the resulting index can be adopted as the reference for the physician, in order to reduce the risk of surgery.

Analysis and Classification of Stride Patterns Associated with Children Development Using Gait Signal Dynamics Parameters and Ensemble Learning Algorithms

Directory of Open Access Journals (Sweden)

Meihong Wu

2016-01-01

Full Text Available Measuring stride variability and dynamics in children is useful for the quantitative study of gait maturation and neuromotor development in childhood and adolescence. In this paper, we computed the sample entropy (SampEn and average stride interval (ASI parameters to quantify the stride series of 50 gender-matched children participants in three age groups. We also normalized the SampEn and ASI values by leg length and body mass for each participant, respectively. Results show that the original and normalized SampEn values consistently decrease over the significance level of the Mann-Whitney U test (p<0.01 in children of 3–14 years old, which indicates the stride irregularity has been significantly ameliorated with the body growth. The original and normalized ASI values are also significantly changing when comparing between any two groups of young (aged 3–5 years, middle (aged 6–8 years, and elder (aged 10–14 years children. Such results suggest that healthy children may better modulate their gait cadence rhythm with the development of their musculoskeletal and neurological systems. In addition, the AdaBoost.M2 and Bagging algorithms were used to effectively distinguish the children’s gait patterns. These ensemble learning algorithms both provided excellent gait classification results in terms of overall accuracy (≥90%, recall (≥0.8, and precision (≥0.8077.

Information Entropy Production of Maximum Entropy Markov Chains from Spike Trains

Science.gov (United States)

Cofré, Rodrigo; Maldonado, Cesar

2018-01-01

We consider the maximum entropy Markov chain inference approach to characterize the collective statistics of neuronal spike trains, focusing on the statistical properties of the inferred model. We review large deviations techniques useful in this context to describe properties of accuracy and convergence in terms of sampling size. We use these results to study the statistical fluctuation of correlations, distinguishability and irreversibility of maximum entropy Markov chains. We illustrate these applications using simple examples where the large deviation rate function is explicitly obtained for maximum entropy models of relevance in this field.

Study of multiparameter respiratory pattern complexity in surgical critically ill patients during weaning trials

Directory of Open Access Journals (Sweden)

Maglaveras Nikos K

2011-01-01

Full Text Available Abstract Background Separation from mechanical ventilation is a difficult task, whereas conventional predictive indices have not been proven accurate enough, so far. A few studies have explored changes of breathing pattern variability for weaning outcome prediction, with conflicting results. In this study, we tried to assess respiratory complexity during weaning trials, using different non-linear methods derived from theory of complex systems, in a cohort of surgical critically ill patients. Results Thirty two patients were enrolled in the study. There were 22 who passed and 10 who failed a weaning trial. Tidal volume and mean inspiratory flow were analyzed for 10 minutes during two phases: 1. pressure support (PS ventilation (15-20 cm H2O and 2. weaning trials with PS: 5 cm H2O. Sample entropy (SampEn, detrended fluctuation analysis (DFA exponent, fractal dimension (FD and largest lyapunov exponents (LLE of the two respiratory parameters were computed in all patients and during the two phases of PS. Weaning failure patients exhibited significantly decreased respiratory pattern complexity, reflected in reduced sample entropy and lyapunov exponents and increased DFA exponents of respiratory flow time series, compared to weaning success subjects (p 0.1, SampEn and LLE predicted better weaning outcome compared with RSBI, P0.1 and RSBI* P0.1 (conventional model, R2 = 0.874 vs 0.643, p Conclusions We suggest that complexity analysis of respiratory signals can assess inherent breathing pattern dynamics and has increased prognostic impact upon weaning outcome in surgical patients.

Measuring Coupling of Rhythmical Time Series Using Cross Sample Entropy and Cross Recurrence Quantification Analysis

Directory of Open Access Journals (Sweden)

John McCamley

2017-01-01

Full Text Available The aim of this investigation was to compare and contrast the use of cross sample entropy (xSE and cross recurrence quantification analysis (cRQA measures for the assessment of coupling of rhythmical patterns. Measures were assessed using simulated signals with regular, chaotic, and random fluctuations in frequency, amplitude, and a combination of both. Biological data were studied as models of normal and abnormal locomotor-respiratory coupling. Nine signal types were generated for seven frequency ratios. Fifteen patients with COPD (abnormal coupling and twenty-one healthy controls (normal coupling walked on a treadmill at three speeds while breathing and walking were recorded. xSE and the cRQA measures of percent determinism, maximum line, mean line, and entropy were quantified for both the simulated and experimental data. In the simulated data, xSE, percent determinism, and entropy were influenced by the frequency manipulation. The 1 : 1 frequency ratio was different than other frequency ratios for almost all measures and/or manipulations. The patients with COPD used a 2 : 3 ratio more often and xSE, percent determinism, maximum line, mean line, and cRQA entropy were able to discriminate between the groups. Analysis of the effects of walking speed indicated that all measures were able to discriminate between speeds.

SpatEntropy: Spatial Entropy Measures in R

OpenAIRE

Altieri, Linda; Cocchi, Daniela; Roli, Giulia

2018-01-01

This article illustrates how to measure the heterogeneity of spatial data presenting a finite number of categories via computation of spatial entropy. The R package SpatEntropy contains functions for the computation of entropy and spatial entropy measures. The extension to spatial entropy measures is a unique feature of SpatEntropy. In addition to the traditional version of Shannon's entropy, the package includes Batty's spatial entropy, O'Neill's entropy, Li and Reynolds' contagion index, Ka...

The vibrational and configurational entropy of α-brass

International Nuclear Information System (INIS)

Benisek, Artur; Dachs, Edgar; Salihović, Miralem; Paunovic, Aleksandar; Maier, Maria E.

2014-01-01

Highlights: • The heat capacity of two α-brass samples was measured from T = 5 K to 300 K. • Above T = 300 K, the ordering/disordering processes were investigated calorimetrically. • The vibrational and configurational entropies of α-brass were calculated. • A volume vs. bulk modulus approach describing the excess entropy was tested. -- Abstract: The heat capacities of two samples of a fcc Cu–Zn alloy with the composition CuZn15 and CuZn34 were measured from T = 5 K to 573 K using relaxation and differential scanning calorimetry. Below ∼90 K, they are characterised by negative excess heat capacities deviating from ideal mixing by up to −0.20 and −0.44 J · mol −1 · K −1 for CuZn15 and CuZn34, respectively. The excess heat capacities produce excess vibrational entropies, which are less negative compared to the excess entropy available from the literature. Since the literature entropy data contain both, the configurational and the vibrational part of the entropy, the difference is attributed to the excess configurational entropy. The thermodynamics of different short-range ordered samples was also investigated. The extent of the short-range order had no influence on the heat capacity below T = 300 K. Above T = 300 K, where the ordering changed during the measurement, the heat capacity depended strongly on the thermal history of the samples. From these data, the heat and entropy of ordering was calculated. The results on the vibrational entropy of this study were also used to test a relationship for estimating the excess vibrational entropy of mixing

Hippotherapy acute impact on heart rate variability non-linear dynamics in neurological disorders.

Science.gov (United States)

Cabiddu, Ramona; Borghi-Silva, Audrey; Trimer, Renata; Trimer, Vitor; Ricci, Paula Angélica; Italiano Monteiro, Clara; Camargo Magalhães Maniglia, Marcela; Silva Pereira, Ana Maria; Rodrigues das Chagas, Gustavo; Carvalho, Eliane Maria

2016-05-15

Neurological disorders are associated with autonomic dysfunction. Hippotherapy (HT) is a therapy treatment strategy that utilizes a horse in an interdisciplinary approach for the physical and mental rehabilitation of people with physical, mental and/or psychological disabilities. However, no studies have been carried out which evaluated the effects of HT on the autonomic control in these patients. Therefore, the objective of the present study was to investigate the effects of a single HT session on cardiovascular autonomic control by time domain and non-linear analysis of heart rate variability (HRV). The HRV signal was recorded continuously in twelve children affected by neurological disorders during a HT session, consisting in a 10-minute sitting position rest (P1), a 15-minute preparatory phase sitting on the horse (P2), a 15-minute HT session (P3) and a final 10-minute sitting position recovery (P4). Time domain and non-linear HRV indices, including Sample Entropy (SampEn), Lempel-Ziv Complexity (LZC) and Detrended Fluctuation Analysis (DFA), were calculated for each treatment phase. We observed that SampEn increased during P3 (SampEn=0.56±0.10) with respect to P1 (SampEn=0.40±0.14, p<0.05), while DFA decreased during P3 (DFA=1.10±0.10) with respect to P1 (DFA=1.26±0.14, p<0.05). A significant SDRR increase (p<0.05) was observed during the recovery period P4 (SDRR=50±30ms) with respect to the HT session period P3 (SDRR=30±10ms). Our results suggest that HT might benefit children with disabilities attributable to neurological disorders by eliciting an acute autonomic response during the therapy and during the recovery period. Copyright © 2016 Elsevier Inc. All rights reserved.

Adjoint entropy vs topological entropy

OpenAIRE

Giordano Bruno, Anna

2012-01-01

Recently the adjoint algebraic entropy of endomorphisms of abelian groups was introduced and studied. We generalize the notion of adjoint entropy to continuous endomorphisms of topological abelian groups. Indeed, the adjoint algebraic entropy is defined using the family of all finite-index subgroups, while we take only the subfamily of all open finite-index subgroups to define the topological adjoint entropy. This allows us to compare the (topological) adjoint entropy with the known topologic...

The Dynameomics Entropy Dictionary: A Large-Scale Assessment of Conformational Entropy across Protein Fold Space.

Science.gov (United States)

Towse, Clare-Louise; Akke, Mikael; Daggett, Valerie

2017-04-27

Molecular dynamics (MD) simulations contain considerable information with regard to the motions and fluctuations of a protein, the magnitude of which can be used to estimate conformational entropy. Here we survey conformational entropy across protein fold space using the Dynameomics database, which represents the largest existing data set of protein MD simulations for representatives of essentially all known protein folds. We provide an overview of MD-derived entropies accounting for all possible degrees of dihedral freedom on an unprecedented scale. Although different side chains might be expected to impose varying restrictions on the conformational space that the backbone can sample, we found that the backbone entropy and side chain size are not strictly coupled. An outcome of these analyses is the Dynameomics Entropy Dictionary, the contents of which have been compared with entropies derived by other theoretical approaches and experiment. As might be expected, the conformational entropies scale linearly with the number of residues, demonstrating that conformational entropy is an extensive property of proteins. The calculated conformational entropies of folding agree well with previous estimates. Detailed analysis of specific cases identifies deviations in conformational entropy from the average values that highlight how conformational entropy varies with sequence, secondary structure, and tertiary fold. Notably, α-helices have lower entropy on average than do β-sheets, and both are lower than coil regions.

Upper entropy axioms and lower entropy axioms

International Nuclear Information System (INIS)

Guo, Jin-Li; Suo, Qi

2015-01-01

The paper suggests the concepts of an upper entropy and a lower entropy. We propose a new axiomatic definition, namely, upper entropy axioms, inspired by axioms of metric spaces, and also formulate lower entropy axioms. We also develop weak upper entropy axioms and weak lower entropy axioms. Their conditions are weaker than those of Shannon–Khinchin axioms and Tsallis axioms, while these conditions are stronger than those of the axiomatics based on the first three Shannon–Khinchin axioms. The subadditivity and strong subadditivity of entropy are obtained in the new axiomatics. Tsallis statistics is a special case of satisfying our axioms. Moreover, different forms of information measures, such as Shannon entropy, Daroczy entropy, Tsallis entropy and other entropies, can be unified under the same axiomatics

Nonsymmetric entropy and maximum nonsymmetric entropy principle

International Nuclear Information System (INIS)

Liu Chengshi

2009-01-01

Under the frame of a statistical model, the concept of nonsymmetric entropy which generalizes the concepts of Boltzmann's entropy and Shannon's entropy, is defined. Maximum nonsymmetric entropy principle is proved. Some important distribution laws such as power law, can be derived from this principle naturally. Especially, nonsymmetric entropy is more convenient than other entropy such as Tsallis's entropy in deriving power laws.

Entropy, neutro-entropy and anti-entropy for neutrosophic information

OpenAIRE

Vasile Patrascu

2017-01-01

This approach presents a multi-valued representation of the neutrosophic information. It highlights the link between the bifuzzy information and neutrosophic one. The constructed deca-valued structure shows the neutrosophic information complexity. This deca-valued structure led to construction of two new concepts for the neutrosophic information: neutro-entropy and anti-entropy. These two concepts are added to the two existing: entropy and non-entropy. Thus, we obtained the following triad: e...

Using maximum entropy modeling for optimal selection of sampling sites for monitoring networks

Science.gov (United States)

Stohlgren, Thomas J.; Kumar, Sunil; Barnett, David T.; Evangelista, Paul H.

2011-01-01

Environmental monitoring programs must efficiently describe state shifts. We propose using maximum entropy modeling to select dissimilar sampling sites to capture environmental variability at low cost, and demonstrate a specific application: sample site selection for the Central Plains domain (453,490 km2) of the National Ecological Observatory Network (NEON). We relied on four environmental factors: mean annual temperature and precipitation, elevation, and vegetation type. A “sample site” was defined as a 20 km × 20 km area (equal to NEON’s airborne observation platform [AOP] footprint), within which each 1 km2 cell was evaluated for each environmental factor. After each model run, the most environmentally dissimilar site was selected from all potential sample sites. The iterative selection of eight sites captured approximately 80% of the environmental envelope of the domain, an improvement over stratified random sampling and simple random designs for sample site selection. This approach can be widely used for cost-efficient selection of survey and monitoring sites.

Physical entropy, information entropy and their evolution equations

Institute of Scientific and Technical Information of China (English)

无

2001-01-01

Inspired by the evolution equation of nonequilibrium statistical physics entropy and the concise statistical formula of the entropy production rate, we develop a theory of the dynamic information entropy and build a nonlinear evolution equation of the information entropy density changing in time and state variable space. Its mathematical form and physical meaning are similar to the evolution equation of the physical entropy: The time rate of change of information entropy density originates together from drift, diffusion and production. The concise statistical formula of information entropy production rate is similar to that of physical entropy also. Furthermore, we study the similarity and difference between physical entropy and information entropy and the possible unification of the two statistical entropies, and discuss the relationship among the principle of entropy increase, the principle of equilibrium maximum entropy and the principle of maximum information entropy as well as the connection between them and the entropy evolution equation.

Explaining the entropy concept and entropy components

Directory of Open Access Journals (Sweden)

Marko Popovic

2018-04-01

Full Text Available Total entropy of a thermodynamic system consists of two components: thermal entropy due to energy, and residual entropy due to molecular orientation. In this article, a three-step method for explaining entropy is suggested. Step one is to use a classical method to introduce thermal entropy STM as a function of temperature T and heat capacity at constant pressure Cp: STM = ∫(Cp/T dT. Thermal entropy is the entropy due to uncertainty in motion of molecules and vanishes at absolute zero (zero-point energy state. It is also the measure of useless thermal energy that cannot be converted into useful work. The next step is to introduce residual entropy S0 as a function of the number of molecules N and the number of distinct orientations available to them in a crystal m: S0 = N kB ln m, where kB is the Boltzmann constant. Residual entropy quantifies the uncertainty in molecular orientation. Residual entropy, unlike thermal entropy, is independent of temperature and remains present at absolute zero. The third step is to show that thermal entropy and residual entropy add up to the total entropy of a thermodynamic system S: S = S0 + STM. This method of explanation should result in a better comprehension of residual entropy and thermal entropy, as well as of their similarities and differences. The new method was tested in teaching at Faculty of Chemistry University of Belgrade, Serbia. The results of the test show that the new method has a potential to improve the quality of teaching.

Dynamic Cross-Entropy.

Science.gov (United States)

Aur, Dorian; Vila-Rodriguez, Fidel

2017-01-01

Complexity measures for time series have been used in many applications to quantify the regularity of one dimensional time series, however many dynamical systems are spatially distributed multidimensional systems. We introduced Dynamic Cross-Entropy (DCE) a novel multidimensional complexity measure that quantifies the degree of regularity of EEG signals in selected frequency bands. Time series generated by discrete logistic equations with varying control parameter r are used to test DCE measures. Sliding window DCE analyses are able to reveal specific period doubling bifurcations that lead to chaos. A similar behavior can be observed in seizures triggered by electroconvulsive therapy (ECT). Sample entropy data show the level of signal complexity in different phases of the ictal ECT. The transition to irregular activity is preceded by the occurrence of cyclic regular behavior. A significant increase of DCE values in successive order from high frequencies in gamma to low frequencies in delta band reveals several phase transitions into less ordered states, possible chaos in the human brain. To our knowledge there are no reliable techniques able to reveal the transition to chaos in case of multidimensional times series. In addition, DCE based on sample entropy appears to be robust to EEG artifacts compared to DCE based on Shannon entropy. The applied technique may offer new approaches to better understand nonlinear brain activity. Copyright © 2016 Elsevier B.V. All rights reserved.

Entropy, neutro-entropy and anti-entropy for neutrosophic information

OpenAIRE

Vasile Patrascu

2017-01-01

This article shows a deca-valued representation of neutrosophic information in which are defined the following features: truth, falsity, weak truth, weak falsity, ignorance, contradiction, saturation, neutrality, ambiguity and hesitation. Using these features, there are constructed computing formulas for entropy, neutro-entropy and anti-entropy.

Application of multi-scale (cross-) sample entropy for structural health monitoring

Science.gov (United States)

Lin, Tzu-Kang; Liang, Jui-Chang

2015-08-01

This study proposes an information-theoretic structural health monitoring (SHM) system based on multi-scale entropy (MSE) and multi-scale cross-sample entropy (MSCE). By measuring the ambient vibration signal from a structure, the damage condition can be rapidly evaluated via MSE analysis. The damage location can then be detected by analyzing the signals of different floors under the same damage condition via MSCE analysis. Moreover, a damage index is proposed to efficiently quantify the SHM process. Unlike some existing SHM methods, no experimental database or numerical model is required. Instead, a reference measurement of the current stage can initiate and launch the SHM system. A numerical simulation of a four-story steel structure is used to verify that the damage location and condition can be detected by the proposed SHM algorithm, and the location can be efficiently quantified by the damage index. A seven-story scaled-down benchmark structure is then employed for experimental verification. Based on the results, the damage condition can be correctly assessed, and average accuracy rates of 63.4 and 86.6% for the damage location can be achieved using the MSCE and damage index methods, respectively. As only the ambient vibration signal is required with a set of initial reference measurements, the proposed SHM system can be implemented practically with low cost.

Linear entropy in quantum phase space

International Nuclear Information System (INIS)

Rosales-Zarate, Laura E. C.; Drummond, P. D.

2011-01-01

We calculate the quantum Renyi entropy in a phase-space representation for either fermions or bosons. This can also be used to calculate purity and fidelity, or the entanglement between two systems. We show that it is possible to calculate the entropy from sampled phase-space distributions in normally ordered representations, although this is not possible for all quantum states. We give an example of the use of this method in an exactly soluble thermal case. The quantum entropy cannot be calculated at all using sampling methods in classical symmetric (Wigner) or antinormally ordered (Husimi) phase spaces, due to inner-product divergences. The preferred method is to use generalized Gaussian phase-space methods, which utilize a distribution over stochastic Green's functions. We illustrate this approach by calculating the reduced entropy and entanglement of bosonic or fermionic modes coupled to a time-evolving, non-Markovian reservoir.

Linear entropy in quantum phase space

Energy Technology Data Exchange (ETDEWEB)

Rosales-Zarate, Laura E. C.; Drummond, P. D. [Centre for Atom Optics and Ultrafast Spectroscopy, Swinburne University of Technology, Melbourne 3122 (Australia)

2011-10-15

We calculate the quantum Renyi entropy in a phase-space representation for either fermions or bosons. This can also be used to calculate purity and fidelity, or the entanglement between two systems. We show that it is possible to calculate the entropy from sampled phase-space distributions in normally ordered representations, although this is not possible for all quantum states. We give an example of the use of this method in an exactly soluble thermal case. The quantum entropy cannot be calculated at all using sampling methods in classical symmetric (Wigner) or antinormally ordered (Husimi) phase spaces, due to inner-product divergences. The preferred method is to use generalized Gaussian phase-space methods, which utilize a distribution over stochastic Green's functions. We illustrate this approach by calculating the reduced entropy and entanglement of bosonic or fermionic modes coupled to a time-evolving, non-Markovian reservoir.

Using entropy measures to characterize human locomotion.

Science.gov (United States)

Leverick, Graham; Szturm, Tony; Wu, Christine Q

2014-12-01

Entropy measures have been widely used to quantify the complexity of theoretical and experimental dynamical systems. In this paper, the value of using entropy measures to characterize human locomotion is demonstrated based on their construct validity, predictive validity in a simple model of human walking and convergent validity in an experimental study. Results show that four of the five considered entropy measures increase meaningfully with the increased probability of falling in a simple passive bipedal walker model. The same four entropy measures also experienced statistically significant increases in response to increasing age and gait impairment caused by cognitive interference in an experimental study. Of the considered entropy measures, the proposed quantized dynamical entropy (QDE) and quantization-based approximation of sample entropy (QASE) offered the best combination of sensitivity to changes in gait dynamics and computational efficiency. Based on these results, entropy appears to be a viable candidate for assessing the stability of human locomotion.

Prediction of Protein Configurational Entropy (Popcoen).

Science.gov (United States)

Goethe, Martin; Gleixner, Jan; Fita, Ignacio; Rubi, J Miguel

2018-03-13

A knowledge-based method for configurational entropy prediction of proteins is presented; this methodology is extremely fast, compared to previous approaches, because it does not involve any type of configurational sampling. Instead, the configurational entropy of a query fold is estimated by evaluating an artificial neural network, which was trained on molecular-dynamics simulations of ∼1000 proteins. The predicted entropy can be incorporated into a large class of protein software based on cost-function minimization/evaluation, in which configurational entropy is currently neglected for performance reasons. Software of this type is used for all major protein tasks such as structure predictions, proteins design, NMR and X-ray refinement, docking, and mutation effect predictions. Integrating the predicted entropy can yield a significant accuracy increase as we show exemplarily for native-state identification with the prominent protein software FoldX. The method has been termed Popcoen for Prediction of Protein Configurational Entropy. An implementation is freely available at http://fmc.ub.edu/popcoen/ .

Maximum entropy PDF projection: A review

Science.gov (United States)

Baggenstoss, Paul M.

2017-06-01

We review maximum entropy (MaxEnt) PDF projection, a method with wide potential applications in statistical inference. The method constructs a sampling distribution for a high-dimensional vector x based on knowing the sampling distribution p(z) of a lower-dimensional feature z = T (x). Under mild conditions, the distribution p(x) having highest possible entropy among all distributions consistent with p(z) may be readily found. Furthermore, the MaxEnt p(x) may be sampled, making the approach useful in Monte Carlo methods. We review the theorem and present a case study in model order selection and classification for handwritten character recognition.

Entropy generation as an environmental impact indicator and a sample application to freshwater ecosystems eutrophication

International Nuclear Information System (INIS)

Diaz-Mendez, S.E.; Sierra-Grajeda, J.M.T.; Hernandez-Guerrero, A.; Rodriguez-Lelis, J.M.

2013-01-01

Generally speaking, an ecosystem is seen as a complex set, it is composed by different biotic and abiotic parts. Naturally, each part has specifics functions related with mass and energy, those functions have influence between the parts directly and indirectly, and these functions are subjected to the basic laws of thermodynamics. If each part of the ecosystem is taken as thermodynamics system its entropy generation could be evaluated, then the total entropy generation of the ecosystem must be sum of the entropy generation in each part, to be in accordance with the Gouy-Stodola theorem. With this in mind, in this work an environmental indicator, for any kind of ecosystems, can be determined as a function of the ratio of total entropy generation for reference state, for instance a healthy forest; and the entropy generation of new different state of the same ecosystem can take, for instance a deforestation. Thus, thermodynamics concepts are applied to study the eutrophication of freshwater ecosystems; the strategy is based on techniques that integrate assumptions of the methodology of entropy generation inside ecosystems. The results show that if the amount of entropy generation is small respect a reference state; the sustainability of the ecosystem will be greater. - Highlights: • We estimate an environmental impact indicator using the concept of entropy generation. • It can be a useful tool for assessing the environmental impacts of the society over the environment. • It can be a useful tool to compare new technologies and improve their efficiencies even more. • It can help for a better understanding of the concept of entropy and its role among various classes of processes. • It can help to reduce environmental concerns and increase the sustainability of the planet

Entropy Coherent and Entropy Convex Measures of Risk

NARCIS (Netherlands)

Laeven, R.J.A.; Stadje, M.A.

2011-01-01

We introduce two subclasses of convex measures of risk, referred to as entropy coherent and entropy convex measures of risk. We prove that convex, entropy convex and entropy coherent measures of risk emerge as certainty equivalents under variational, homothetic and multiple priors preferences,

MAXIMUM-LIKELIHOOD-ESTIMATION OF THE ENTROPY OF AN ATTRACTOR

NARCIS (Netherlands)

SCHOUTEN, JC; TAKENS, F; VANDENBLEEK, CM

In this paper, a maximum-likelihood estimate of the (Kolmogorov) entropy of an attractor is proposed that can be obtained directly from a time series. Also, the relative standard deviation of the entropy estimate is derived; it is dependent on the entropy and on the number of samples used in the

Entropy coherent and entropy convex measures of risk

NARCIS (Netherlands)

Laeven, Roger; Stadje, M.A.

2010-01-01

We introduce entropy coherent and entropy convex measures of risk and prove a collection of axiomatic characterization and duality results. We show in particular that entropy coherent and entropy convex measures of risk emerge as negative certainty equivalents in (the regular and a generalized

Entropy coherent and entropy convex measures of risk

NARCIS (Netherlands)

Laeven, R.J.A.; Stadje, M.

2013-01-01

We introduce two subclasses of convex measures of risk, referred to as entropy coherent and entropy convex measures of risk. Entropy coherent and entropy convex measures of risk are special cases of φ-coherent and φ-convex measures of risk. Contrary to the classical use of coherent and convex

Cellular network entropy as the energy potential in Waddington's differentiation landscape

Science.gov (United States)

Banerji, Christopher R. S.; Miranda-Saavedra, Diego; Severini, Simone; Widschwendter, Martin; Enver, Tariq; Zhou, Joseph X.; Teschendorff, Andrew E.

2013-01-01

Differentiation is a key cellular process in normal tissue development that is significantly altered in cancer. Although molecular signatures characterising pluripotency and multipotency exist, there is, as yet, no single quantitative mark of a cellular sample's position in the global differentiation hierarchy. Here we adopt a systems view and consider the sample's network entropy, a measure of signaling pathway promiscuity, computable from a sample's genome-wide expression profile. We demonstrate that network entropy provides a quantitative, in-silico, readout of the average undifferentiated state of the profiled cells, recapitulating the known hierarchy of pluripotent, multipotent and differentiated cell types. Network entropy further exhibits dynamic changes in time course differentiation data, and in line with a sample's differentiation stage. In disease, network entropy predicts a higher level of cellular plasticity in cancer stem cell populations compared to ordinary cancer cells. Importantly, network entropy also allows identification of key differentiation pathways. Our results are consistent with the view that pluripotency is a statistical property defined at the cellular population level, correlating with intra-sample heterogeneity, and driven by the degree of signaling promiscuity in cells. In summary, network entropy provides a quantitative measure of a cell's undifferentiated state, defining its elevation in Waddington's landscape. PMID:24154593

Entropy for the Complexity of Physiological Signal Dynamics.

Science.gov (United States)

Zhang, Xiaohua Douglas

2017-01-01

Recently, the rapid development of large data storage technologies, mobile network technology, and portable medical devices makes it possible to measure, record, store, and track analysis of biological dynamics. Portable noninvasive medical devices are crucial to capture individual characteristics of biological dynamics. The wearable noninvasive medical devices and the analysis/management of related digital medical data will revolutionize the management and treatment of diseases, subsequently resulting in the establishment of a new healthcare system. One of the key features that can be extracted from the data obtained by wearable noninvasive medical device is the complexity of physiological signals, which can be represented by entropy of biological dynamics contained in the physiological signals measured by these continuous monitoring medical devices. Thus, in this chapter I present the major concepts of entropy that are commonly used to measure the complexity of biological dynamics. The concepts include Shannon entropy, Kolmogorov entropy, Renyi entropy, approximate entropy, sample entropy, and multiscale entropy. I also demonstrate an example of using entropy for the complexity of glucose dynamics.

Logarithmic black hole entropy corrections and holographic Renyi entropy

Energy Technology Data Exchange (ETDEWEB)

Mahapatra, Subhash [The Institute of Mathematical Sciences, Chennai (India); KU Leuven - KULAK, Department of Physics, Kortrijk (Belgium)

2018-01-15

The entanglement and Renyi entropies for spherical entangling surfaces in CFTs with gravity duals can be explicitly calculated by mapping these entropies first to the thermal entropy on hyperbolic space and then, using the AdS/CFT correspondence, to the Wald entropy of topological black holes. Here we extend this idea by taking into account corrections to the Wald entropy. Using the method based on horizon symmetries and the asymptotic Cardy formula, we calculate corrections to the Wald entropy and find that these corrections are proportional to the logarithm of the area of the horizon. With the corrected expression for the entropy of the black hole, we then find corrections to the Renyi entropies. We calculate these corrections for both Einstein and Gauss-Bonnet gravity duals. Corrections with logarithmic dependence on the area of the entangling surface naturally occur at the order G{sub D}{sup 0}. The entropic c-function and the inequalities of the Renyi entropy are also satisfied even with the correction terms. (orig.)

Logarithmic black hole entropy corrections and holographic Renyi entropy

International Nuclear Information System (INIS)

Mahapatra, Subhash

2018-01-01

The entanglement and Renyi entropies for spherical entangling surfaces in CFTs with gravity duals can be explicitly calculated by mapping these entropies first to the thermal entropy on hyperbolic space and then, using the AdS/CFT correspondence, to the Wald entropy of topological black holes. Here we extend this idea by taking into account corrections to the Wald entropy. Using the method based on horizon symmetries and the asymptotic Cardy formula, we calculate corrections to the Wald entropy and find that these corrections are proportional to the logarithm of the area of the horizon. With the corrected expression for the entropy of the black hole, we then find corrections to the Renyi entropies. We calculate these corrections for both Einstein and Gauss-Bonnet gravity duals. Corrections with logarithmic dependence on the area of the entangling surface naturally occur at the order G D 0 . The entropic c-function and the inequalities of the Renyi entropy are also satisfied even with the correction terms. (orig.)

EMG-Torque Relation in Chronic Stroke: A Novel EMG Complexity Representation With a Linear Electrode Array.

Science.gov (United States)

Zhang, Xu; Wang, Dongqing; Yu, Zaiyang; Chen, Xiang; Li, Sheng; Zhou, Ping

2017-11-01

This study examines the electromyogram (EMG)-torque relation for chronic stroke survivors using a novel EMG complexity representation. Ten stroke subjects performed a series of submaximal isometric elbow flexion tasks using their affected and contralateral arms, respectively, while a 20-channel linear electrode array was used to record surface EMG from the biceps brachii muscles. The sample entropy (SampEn) of surface EMG signals was calculated with both global and local tolerance schemes. A regression analysis was performed between SampEn of each channel's surface EMG and elbow flexion torque. It was found that a linear regression can be used to well describe the relation between surface EMG SampEn and the torque. Each channel's root mean square (RMS) amplitude of surface EMG signal in the different torque level was computed to determine the channel with the highest EMG amplitude. The slope of the regression (observed from the channel with the highest EMG amplitude) was smaller on the impaired side than on the nonimpaired side in 8 of the 10 subjects, regardless of the tolerance scheme (global or local) and the range of torques (full or matched range) used for comparison. The surface EMG signals from the channels above the estimated muscle innervation zones demonstrated significantly lower levels of complexity compared with other channels between innervation zones and muscle tendons. The study provides a novel point of view of the EMG-torque relation in the complexity domain, and reveals its alterations post stroke, which are associated with complex neural and muscular changes post stroke. The slope difference between channels with regard to innervation zones also confirms the relevance of electrode position in surface EMG analysis.

Wearing a safety harness during treadmill walking influences lower extremity kinematics mainly through changes in ankle regularity and local stability

Directory of Open Access Journals (Sweden)

Decker Leslie M

2012-02-01

Full Text Available Abstract Background Wearing a harness during treadmill walking ensures the subject's safety and is common practice in biomedical engineering research. However, the extent to which such practice influences gait is unknown. This study investigated harness-related changes in gait patterns, as evaluated from lower extremity kinematics during treadmill walking. Findings Healthy subjects (n = 10 walked on a treadmill at their preferred speed for 3 minutes with and without wearing a harness (LiteGait®, Mobility Research, Inc.. In the former condition, no weight support was provided to the subjects. Lower extremity kinematics was assessed in the sagittal plane from the mean (meanRoM, standard deviation (SDRoM and coefficient of variation (CoVRoM of the hip, knee, and ankle ranges of motion (RoM, as well as from the sample entropy (SampEn and the largest Lyapunov exponent (LyE of the joints' angles. Wearing the harness increased the meanRoM of the hip, the SDRoM and the CoVRoM of the knee, and the SampEn and the LyE of the ankle. In particular, the harness effect sizes for both the SampEn and the LyE of the ankle were large, likely reflecting a meaningful decline in the neuromuscular stabilizing control of this joint. Conclusions Wearing a harness during treadmill walking marginally influences lower extremity kinematics, resulting in more or less subtle changes in certain kinematic variables. However, in cases where differences in gait patterns would be expressed through modifications in these variables, having subjects walk with a harness may mask or reinforce such differences.

ENTROPY FUNCTIONAL FOR CONTINUOUS SYSTEMS OF FINITE ENTROPY

Institute of Scientific and Technical Information of China (English)

M. Rahimi A. Riazi

2012-01-01

In this article,we introduce the concept of entropy functional for continuous systems on compact metric spaces,and prove some of its properties.We also extract the Kolmogorov entropy from the entropy functional.

Entropy of the Mixture of Sources and Entropy Dimension

OpenAIRE

Smieja, Marek; Tabor, Jacek

2011-01-01

We investigate the problem of the entropy of the mixture of sources. There is given an estimation of the entropy and entropy dimension of convex combination of measures. The proof is based on our alternative definition of the entropy based on measures instead of partitions.

Characterization of complexity in the electroencephalograph activity of Alzheimer's disease based on fuzzy entropy.

Science.gov (United States)

Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing

2015-08-01

In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.

Entanglement entropy and differential entropy for massive flavors

International Nuclear Information System (INIS)

Jones, Peter A.R.; Taylor, Marika

2015-01-01

In this paper we compute the holographic entanglement entropy for massive flavors in the D3-D7 system, for arbitrary mass and various entangling region geometries. We show that the universal terms in the entanglement entropy exactly match those computed in the dual theory using conformal perturbation theory. We derive holographically the universal terms in the entanglement entropy for a CFT perturbed by a relevant operator, up to second order in the coupling; our results are valid for any entangling region geometry. We present a new method for computing the entanglement entropy of any top-down brane probe system using Kaluza-Klein holography and illustrate our results with massive flavors at finite density. Finally we discuss the differential entropy for brane probe systems, emphasising that the differential entropy captures only the effective lower-dimensional Einstein metric rather than the ten-dimensional geometry.

Bubble Entropy: An Entropy Almost Free of Parameters.

Science.gov (United States)

Manis, George; Aktaruzzaman, Md; Sassi, Roberto

2017-11-01

Objective : A critical point in any definition of entropy is the selection of the parameters employed to obtain an estimate in practice. We propose a new definition of entropy aiming to reduce the significance of this selection. Methods: We call the new definition Bubble Entropy . Bubble Entropy is based on permutation entropy, where the vectors in the embedding space are ranked. We use the bubble sort algorithm for the ordering procedure and count instead the number of swaps performed for each vector. Doing so, we create a more coarse-grained distribution and then compute the entropy of this distribution. Results: Experimental results with both real and synthetic HRV signals showed that bubble entropy presents remarkable stability and exhibits increased descriptive and discriminating power compared to all other definitions, including the most popular ones. Conclusion: The definition proposed is almost free of parameters. The most common ones are the scale factor r and the embedding dimension m . In our definition, the scale factor is totally eliminated and the importance of m is significantly reduced. The proposed method presents increased stability and discriminating power. Significance: After the extensive use of some entropy measures in physiological signals, typical values for their parameters have been suggested, or at least, widely used. However, the parameters are still there, application and dataset dependent, influencing the computed value and affecting the descriptive power. Reducing their significance or eliminating them alleviates the problem, decoupling the method from the data and the application, and eliminating subjective factors. Objective : A critical point in any definition of entropy is the selection of the parameters employed to obtain an estimate in practice. We propose a new definition of entropy aiming to reduce the significance of this selection. Methods: We call the new definition Bubble Entropy . Bubble Entropy is based on permutation

Logarithmic black hole entropy corrections and holographic Rényi entropy

Science.gov (United States)

Mahapatra, Subhash

2018-01-01

The entanglement and Rényi entropies for spherical entangling surfaces in CFTs with gravity duals can be explicitly calculated by mapping these entropies first to the thermal entropy on hyperbolic space and then, using the AdS/CFT correspondence, to the Wald entropy of topological black holes. Here we extend this idea by taking into account corrections to the Wald entropy. Using the method based on horizon symmetries and the asymptotic Cardy formula, we calculate corrections to the Wald entropy and find that these corrections are proportional to the logarithm of the area of the horizon. With the corrected expression for the entropy of the black hole, we then find corrections to the Rényi entropies. We calculate these corrections for both Einstein and Gauss-Bonnet gravity duals. Corrections with logarithmic dependence on the area of the entangling surface naturally occur at the order GD^0. The entropic c-function and the inequalities of the Rényi entropy are also satisfied even with the correction terms.

Symplectic entropy

International Nuclear Information System (INIS)

De Nicola, Sergio; Fedele, Renato; Man'ko, Margarita A; Man'ko, Vladimir I

2007-01-01

The tomographic-probability description of quantum states is reviewed. The symplectic tomography of quantum states with continuous variables is studied. The symplectic entropy of the states with continuous variables is discussed and its relation to Shannon entropy and information is elucidated. The known entropic uncertainty relations of the probability distribution in position and momentum of a particle are extended and new uncertainty relations for symplectic entropy are obtained. The partial case of symplectic entropy, which is optical entropy of quantum states, is considered. The entropy associated to optical tomogram is shown to satisfy the new entropic uncertainty relation. The example of Gaussian states of harmonic oscillator is studied and the entropic uncertainty relations for optical tomograms of the Gaussian state are shown to minimize the uncertainty relation

Distance-Based Configurational Entropy of Proteins from Molecular Dynamics Simulations.

Science.gov (United States)

Fogolari, Federico; Corazza, Alessandra; Fortuna, Sara; Soler, Miguel Angel; VanSchouwen, Bryan; Brancolini, Giorgia; Corni, Stefano; Melacini, Giuseppe; Esposito, Gennaro

2015-01-01

Estimation of configurational entropy from molecular dynamics trajectories is a difficult task which is often performed using quasi-harmonic or histogram analysis. An entirely different approach, proposed recently, estimates local density distribution around each conformational sample by measuring the distance from its nearest neighbors. In this work we show this theoretically well grounded the method can be easily applied to estimate the entropy from conformational sampling. We consider a set of systems that are representative of important biomolecular processes. In particular: reference entropies for amino acids in unfolded proteins are obtained from a database of residues not participating in secondary structure elements;the conformational entropy of folding of β2-microglobulin is computed from molecular dynamics simulations using reference entropies for the unfolded state;backbone conformational entropy is computed from molecular dynamics simulations of four different states of the EPAC protein and compared with order parameters (often used as a measure of entropy);the conformational and rototranslational entropy of binding is computed from simulations of 20 tripeptides bound to the peptide binding protein OppA and of β2-microglobulin bound to a citrate coated gold surface. This work shows the potential of the method in the most representative biological processes involving proteins, and provides a valuable alternative, principally in the shown cases, where other approaches are problematic.

Entropy equilibrium equation and dynamic entropy production in environment liquid

Institute of Scientific and Technical Information of China (English)

无

2002-01-01

The entropy equilibrium equation is the basis of the nonequilibrium state thermodynamics. But the internal energy implies the kinetic energy of the fluid micelle relative to mass center in the classical entropy equilibrium equation at present. This internal energy is not the mean kinetic energy of molecular movement in thermodynamics. Here a modified entropy equilibrium equation is deduced, based on the concept that the internal energy is just the mean kinetic energy of the molecular movement. A dynamic entropy production is introduced into the entropy equilibrium equation to describe the dynamic process distinctly. This modified entropy equilibrium equation can describe not only the entropy variation of the irreversible processes but also the reversible processes in a thermodynamic system. It is more reasonable and suitable for wider applications.

The improvement of Clausius entropy and its application in entropy analysis

Institute of Scientific and Technical Information of China (English)

WU Jing; GUO ZengYuan

2008-01-01

The defects of Cleusius entropy which Include s premise of reversible process and a process quantlty of heat in Its definition are discussed in this paper. Moreover, the heat temperature quotient under reversible conditions, i.e. (δQ/T)rev, is essentially a process quantity although it is numerically equal to the entropy change. The sum of internal energy temperature quotient and work temperature quotient is defined as the improved form of Clausius entropy and it can be further proved to be a state funcllon. Unlike Clausius entropy, the improved deflnltion consists of system properties wlthout premise just like other state functions, for example, pressure p and enthalpy h, etc. it is unnecessary to invent reversible paths when calculating entropy change for irreversible processes based on the improved form of entropy since it is independent of process. Furthermore, entropy balance equations for internally and externally irreversible processes are deduced respectively based on the concepts of thermal reservoir entropy transfer and system entropy transfer. Finally, some examples are presented to show that the improved deflnitlon of Clausius entropy provides a clear concept as well as a convenient method for en-tropy change calculation.

Entropy Analysis of RR and QT Interval Variability during Orthostatic and Mental Stress in Healthy Subjects

Directory of Open Access Journals (Sweden)

Mathias Baumert

2014-12-01

Full Text Available Autonomic activity affects beat-to-beat variability of heart rate and QT interval. The aim of this study was to explore whether entropy measures are suitable to detect changes in neural outflow to the heart elicited by two different stress paradigms. We recorded short-term ECG in 11 normal subjects during an experimental protocol that involved head-up tilt and mental arithmetic stress and computed sample entropy, cross-sample entropy and causal interactions based on conditional entropy from RR and QT interval time series. Head-up tilt resulted in a significant reduction in sample entropy of RR intervals and cross-sample entropy, while mental arithmetic stress resulted in a significant reduction in coupling directed from RR to QT. In conclusion, measures of entropy are suitable to detect changes in neural outflow to the heart and decoupling of repolarisation variability from heart rate variability elicited by orthostatic or mental arithmetic stress.

Entropy and information

CERN Document Server

Volkenstein, Mikhail V

2009-01-01

The book "Entropy and Information" deals with the thermodynamical concept of entropy and its relationship to information theory. It is successful in explaining the universality of the term "Entropy" not only as a physical phenomenon, but reveals its existence also in other domains. E.g., Volkenstein discusses the "meaning" of entropy in a biological context and shows how entropy is related to artistic activities. Written by the renowned Russian bio-physicist Mikhail V. Volkenstein, this book on "Entropy and Information" surely serves as a timely introduction to understand entropy from a thermodynamic perspective and is definitely an inspiring and thought-provoking book that should be read by every physicist, information-theorist, biologist, and even artist.

Properties of Risk Measures of Generalized Entropy in Portfolio Selection

Directory of Open Access Journals (Sweden)

Rongxi Zhou

2017-12-01

Full Text Available This paper systematically investigates the properties of six kinds of entropy-based risk measures: Information Entropy and Cumulative Residual Entropy in the probability space, Fuzzy Entropy, Credibility Entropy and Sine Entropy in the fuzzy space, and Hybrid Entropy in the hybridized uncertainty of both fuzziness and randomness. We discover that none of the risk measures satisfy all six of the following properties, which various scholars have associated with effective risk measures: Monotonicity, Translation Invariance, Sub-additivity, Positive Homogeneity, Consistency and Convexity. Measures based on Fuzzy Entropy, Credibility Entropy, and Sine Entropy all exhibit the same properties: Sub-additivity, Positive Homogeneity, Consistency, and Convexity. These measures based on Information Entropy and Hybrid Entropy, meanwhile, only exhibit Sub-additivity and Consistency. Cumulative Residual Entropy satisfies just Sub-additivity, Positive Homogeneity, and Convexity. After identifying these properties, we develop seven portfolio models based on different risk measures and made empirical comparisons using samples from both the Shenzhen Stock Exchange of China and the New York Stock Exchange of America. The comparisons show that the Mean Fuzzy Entropy Model performs the best among the seven models with respect to both daily returns and relative cumulative returns. Overall, these results could provide an important reference for both constructing effective risk measures and rationally selecting the appropriate risk measure under different portfolio selection conditions.

Direct measurements of the magnetic entropy change

DEFF Research Database (Denmark)

Nielsen, Kaspar Kirstein; Neves Bez, Henrique; von Moos, Lars

2015-01-01

An experimental device that can accurately measure the magnetic entropy change, Δs, as a function of temperature, T, and magnetic field, H, is presented. The magnetic field source is in this case a set of counter-rotating concentric Halbach-type magnets, which produce a highly homogeneous applied...... to the ambient are negligible in terms of the calorimetric determination of the magnetic entropy change, while the losses cannot be ignored when correcting for the actual sample temperature. We apply the device to two different types of samples; one is commercial grade Gd, i.e., a pure second-order phase...

The improvement of Clausius entropy and its application in entropy analysis

Institute of Scientific and Technical Information of China (English)

2008-01-01

The defects of Clausius entropy which include a premise of reversible process and a process quantity of heat in its definition are discussed in this paper. Moreover, the heat temperature quotient under reversible conditions, i.e. (δQ/T)rev, is essentially a process quantity although it is numerically equal to the entropy change. The sum of internal energy temperature quotient and work temperature quotient is defined as the improved form of Clausius entropy and it can be further proved to be a state function. Unlike Clausius entropy, the improved definition consists of system properties without premise just like other state functions, for example, pressure p and enthalpy h, etc. It is unnecessary to invent reversible paths when calculating entropy change for irreversible processes based on the improved form of entropy since it is independent of process. Furthermore, entropy balance equations for internally and externally irreversible processes are deduced respectively based on the concepts of thermal reservoir entropy transfer and system entropy transfer. Finally, some examples are presented to show that the improved definition of Clausius entropy provides a clear concept as well as a convenient method for en- tropy change calculation.

Quantum dynamical entropy revisited

International Nuclear Information System (INIS)

Hudetz, T.

1996-10-01

We define a new quantum dynamical entropy, which is a 'hybrid' of the closely related, physically oriented entropy introduced by Alicki and Fannes in 1994, and of the mathematically well-developed, single-argument entropy introduced by Connes, Narnhofer and Thirring in 1987. We show that this new quantum dynamical entropy has many properties similar to the ones of the Alicki-Fannes entropy, and also inherits some additional properties from the CNT entropy. In particular, the 'hybrid' entropy interpolates between the two different ways in which both the AF and the CNT entropy of the shift automorphism on the quantum spin chain agree with the usual quantum entropy density, resulting in even better agreement. Also, the new quantum dynamical entropy generalizes the classical dynamical entropy of Kolmogorov and Sinai in the same way as does the AF entropy. Finally, we estimate the 'hybrid' entropy both for the Powers-Price shift systems and for the noncommutative Arnold map on the irrational rotation C * -algebra, leaving some interesting open problems. (author)

Automatic maximum entropy spectral reconstruction in NMR

International Nuclear Information System (INIS)

Mobli, Mehdi; Maciejewski, Mark W.; Gryk, Michael R.; Hoch, Jeffrey C.

2007-01-01

Developments in superconducting magnets, cryogenic probes, isotope labeling strategies, and sophisticated pulse sequences together have enabled the application, in principle, of high-resolution NMR spectroscopy to biomolecular systems approaching 1 megadalton. In practice, however, conventional approaches to NMR that utilize the fast Fourier transform, which require data collected at uniform time intervals, result in prohibitively lengthy data collection times in order to achieve the full resolution afforded by high field magnets. A variety of approaches that involve nonuniform sampling have been proposed, each utilizing a non-Fourier method of spectrum analysis. A very general non-Fourier method that is capable of utilizing data collected using any of the proposed nonuniform sampling strategies is maximum entropy reconstruction. A limiting factor in the adoption of maximum entropy reconstruction in NMR has been the need to specify non-intuitive parameters. Here we describe a fully automated system for maximum entropy reconstruction that requires no user-specified parameters. A web-accessible script generator provides the user interface to the system

Information Entropy Measures for Stand Structural Diversity:Joint Entropy

Institute of Scientific and Technical Information of China (English)

Lei Xiangdong; Lu Yuanchang

2004-01-01

Structural diversity is the key attribute of a stand. A set of biodiversity measures in ecology was introduced in forest management for describing stand structure, of which Shannon information entropy (Shannon index) has been the most widely used measure of species diversity. It is generally thought that tree size diversity could serve as a good proxy for height diversity. However, tree size diversity and height diversity for stand structure is not completely consistent. Stand diameter cannot reflect height information completely. Either tree size diversity or height diversity is one-dimensional information entropy measure. This paper discussed the method of multiple-dimensional information entropy measure with the concept of joint entropy. It is suggested that joint entropy is a good measure for describing overall stand structural diversity.

Quantum chaos: entropy signatures

International Nuclear Information System (INIS)

Miller, P.A.; Sarkar, S.; Zarum, R.

1998-01-01

A definition of quantum chaos is given in terms of entropy production rates for a quantum system coupled weakly to a reservoir. This allows the treatment of classical and quantum chaos on the same footing. In the quantum theory the entropy considered is the von Neumann entropy and in classical systems it is the Gibbs entropy. The rate of change of the coarse-grained Gibbs entropy of the classical system with time is given by the Kolmogorov-Sinai (KS) entropy. The relation between KS entropy and the rate of change of von Neumann entropy is investigated for the kicked rotator. For a system which is classically chaotic there is a linear relationship between these two entropies. Moreover it is possible to construct contour plots for the local KS entropy and compare it with the corresponding plots for the rate of change of von Neumann entropy. The quantitative and qualitative similarities of these plots are discussed for the standard map (kicked rotor) and the generalised cat maps. (author)

Sequence space coverage, entropy of genomes and the potential to detect non-human DNA in human samples

Directory of Open Access Journals (Sweden)

Maley Carlo C

2008-10-01

Full Text Available Abstract Background Genomes store information for building and maintaining organisms. Complete sequencing of many genomes provides the opportunity to study and compare global information properties of those genomes. Results We have analyzed aspects of the information content of Homo sapiens, Mus musculus, Drosophila melanogaster, Caenorhabditis elegans, Arabidopsis thaliana, Saccharomyces cerevisiae, and Escherichia coli (K-12 genomes. Virtually all possible (> 98% 12 bp oligomers appear in vertebrate genomes while 98% to D. melanogaster (12–17 bp, C. elegans (11–17 bp, A. thaliana (11–17 bp, S. cerevisiae (10–16 bp and E. coli (9–15 bp. Frequencies of unique oligomers in the genomes follow similar patterns. We identified a set of 2.6 M 15-mers that are more than 1 nucleotide different from all 15-mers in the human genome and so could be used as probes to detect microbes in human samples. In a human sample, these probes would detect 100% of the 433 currently fully sequenced prokaryotes and 75% of the 3065 fully sequenced viruses. The human genome is significantly more compact in sequence space than a random genome. We identified the most frequent 5- to 20-mers in the human genome, which may prove useful as PCR primers. We also identified a bacterium, Anaeromyxobacter dehalogenans, which has an exceptionally low diversity of oligomers given the size of its genome and its GC content. The entropy of coding regions in the human genome is significantly higher than non-coding regions and chromosomes. However chromosomes 1, 2, 9, 12 and 14 have a relatively high proportion of coding DNA without high entropy, and chromosome 20 is the opposite with a low frequency of coding regions but relatively high entropy. Conclusion Measures of the frequency of oligomers are useful for designing PCR assays and for identifying chromosomes and organisms with hidden structure that had not been previously recognized. This information may be used to detect

Sequence space coverage, entropy of genomes and the potential to detect non-human DNA in human samples

Science.gov (United States)

Liu, Zhandong; Venkatesh, Santosh S; Maley, Carlo C

2008-01-01

Background Genomes store information for building and maintaining organisms. Complete sequencing of many genomes provides the opportunity to study and compare global information properties of those genomes. Results We have analyzed aspects of the information content of Homo sapiens, Mus musculus, Drosophila melanogaster, Caenorhabditis elegans, Arabidopsis thaliana, Saccharomyces cerevisiae, and Escherichia coli (K-12) genomes. Virtually all possible (> 98%) 12 bp oligomers appear in vertebrate genomes while 98% to < 2% of possible oligomers in D. melanogaster (12–17 bp), C. elegans (11–17 bp), A. thaliana (11–17 bp), S. cerevisiae (10–16 bp) and E. coli (9–15 bp). Frequencies of unique oligomers in the genomes follow similar patterns. We identified a set of 2.6 M 15-mers that are more than 1 nucleotide different from all 15-mers in the human genome and so could be used as probes to detect microbes in human samples. In a human sample, these probes would detect 100% of the 433 currently fully sequenced prokaryotes and 75% of the 3065 fully sequenced viruses. The human genome is significantly more compact in sequence space than a random genome. We identified the most frequent 5- to 20-mers in the human genome, which may prove useful as PCR primers. We also identified a bacterium, Anaeromyxobacter dehalogenans, which has an exceptionally low diversity of oligomers given the size of its genome and its GC content. The entropy of coding regions in the human genome is significantly higher than non-coding regions and chromosomes. However chromosomes 1, 2, 9, 12 and 14 have a relatively high proportion of coding DNA without high entropy, and chromosome 20 is the opposite with a low frequency of coding regions but relatively high entropy. Conclusion Measures of the frequency of oligomers are useful for designing PCR assays and for identifying chromosomes and organisms with hidden structure that had not been previously recognized. This information may be used to

Refined generalized multiscale entropy analysis for physiological signals

Science.gov (United States)

Liu, Yunxiao; Lin, Youfang; Wang, Jing; Shang, Pengjian

2018-01-01

Multiscale entropy analysis has become a prevalent complexity measurement and been successfully applied in various fields. However, it only takes into account the information of mean values (first moment) in coarse-graining procedure. Then generalized multiscale entropy (MSEn) considering higher moments to coarse-grain a time series was proposed and MSEσ2 has been implemented. However, the MSEσ2 sometimes may yield an imprecise estimation of entropy or undefined entropy, and reduce statistical reliability of sample entropy estimation as scale factor increases. For this purpose, we developed the refined model, RMSEσ2, to improve MSEσ2. Simulations on both white noise and 1 / f noise show that RMSEσ2 provides higher entropy reliability and reduces the occurrence of undefined entropy, especially suitable for short time series. Besides, we discuss the effect on RMSEσ2 analysis from outliers, data loss and other concepts in signal processing. We apply the proposed model to evaluate the complexity of heartbeat interval time series derived from healthy young and elderly subjects, patients with congestive heart failure and patients with atrial fibrillation respectively, compared to several popular complexity metrics. The results demonstrate that RMSEσ2 measured complexity (a) decreases with aging and diseases, and (b) gives significant discrimination between different physiological/pathological states, which may facilitate clinical application.

Quantum key distribution with finite resources: Smooth Min entropy vs. Smooth Renyi entropy

Energy Technology Data Exchange (ETDEWEB)

Mertz, Markus; Abruzzo, Silvestre; Bratzik, Sylvia; Kampermann, Hermann; Bruss, Dagmar [Institut fuer Theoretische Physik III, Duesseldorf (Germany)

2010-07-01

We consider different entropy measures that play an important role in the analysis of the security of QKD with finite resources. The smooth min entropy leads to an optimal bound for the length of a secure key. Another bound on the secure key length was derived by using Renyi entropies. Unfortunately, it is very hard or even impossible to calculate these entropies for realistic QKD scenarios. To estimate the security rate it becomes important to find computable bounds on these entropies. Here, we compare a lower bound for the smooth min entropy with a bound using Renyi entropies. We compare these entropies for the six-state protocol with symmetric attacks.

Nearest Neighbor Estimates of Entropy for Multivariate Circular Distributions

Directory of Open Access Journals (Sweden)

Neeraj Misra

2010-05-01

Full Text Available In molecular sciences, the estimation of entropies of molecules is important for the understanding of many chemical and biological processes. Motivated by these applications, we consider the problem of estimating the entropies of circular random vectors and introduce non-parametric estimators based on circular distances between n sample points and their k th nearest neighbors (NN, where k (≤ n – 1 is a fixed positive integer. The proposed NN estimators are based on two different circular distances, and are proven to be asymptotically unbiased and consistent. The performance of one of the circular-distance estimators is investigated and compared with that of the already established Euclidean-distance NN estimator using Monte Carlo samples from an analytic distribution of six circular variables of an exactly known entropy and a large sample of seven internal-rotation angles in the molecule of tartaric acid, obtained by a realistic molecular-dynamics simulation.

Comparison of algorithms to quantify muscle fatigue in upper limb muscles based on sEMG signals.

Science.gov (United States)

Kahl, Lorenz; Hofmann, Ulrich G

2016-11-01

This work compared the performance of six different fatigue detection algorithms quantifying muscle fatigue based on electromyographic signals. Surface electromyography (sEMG) was obtained by an experiment from upper arm contractions at three different load levels from twelve volunteers. Fatigue detection algorithms mean frequency (MNF), spectral moments ratio (SMR), the wavelet method WIRM1551, sample entropy (SampEn), fuzzy approximate entropy (fApEn) and recurrence quantification analysis (RQA%DET) were calculated. The resulting fatigue signals were compared considering the disturbances incorporated in fatiguing situations as well as according to the possibility to differentiate the load levels based on the fatigue signals. Furthermore we investigated the influence of the electrode locations on the fatigue detection quality and whether an optimized channel set is reasonable. The results of the MNF, SMR, WIRM1551 and fApEn algorithms fell close together. Due to the small amount of subjects in this study significant differences could not be found. In terms of disturbances the SMR algorithm showed a slight tendency to out-perform the others. Copyright © 2016 IPEM. Published by Elsevier Ltd. All rights reserved.

Entropy? Honest!

Directory of Open Access Journals (Sweden)

Tommaso Toffoli

2016-06-01

Full Text Available Here we deconstruct, and then in a reasoned way reconstruct, the concept of “entropy of a system”, paying particular attention to where the randomness may be coming from. We start with the core concept of entropy as a count associated with a description; this count (traditionally expressed in logarithmic form for a number of good reasons is in essence the number of possibilities—specific instances or “scenarios”—that match that description. Very natural (and virtually inescapable generalizations of the idea of description are the probability distribution and its quantum mechanical counterpart, the density operator. We track the process of dynamically updating entropy as a system evolves. Three factors may cause entropy to change: (1 the system’s internal dynamics; (2 unsolicited external influences on it; and (3 the approximations one has to make when one tries to predict the system’s future state. The latter task is usually hampered by hard-to-quantify aspects of the original description, limited data storage and processing resource, and possibly algorithmic inadequacy. Factors 2 and 3 introduce randomness—often huge amounts of it—into one’s predictions and accordingly degrade them. When forecasting, as long as the entropy bookkeping is conducted in an honest fashion, this degradation will always lead to an entropy increase. To clarify the above point we introduce the notion of honest entropy, which coalesces much of what is of course already done, often tacitly, in responsible entropy-bookkeping practice. This notion—we believe—will help to fill an expressivity gap in scientific discourse. With its help, we shall prove that any dynamical system—not just our physical universe—strictly obeys Clausius’s original formulation of the second law of thermodynamics if and only if it is invertible. Thus this law is a tautological property of invertible systems!

Infinite Shannon entropy

International Nuclear Information System (INIS)

Baccetti, Valentina; Visser, Matt

2013-01-01

Even if a probability distribution is properly normalizable, its associated Shannon (or von Neumann) entropy can easily be infinite. We carefully analyze conditions under which this phenomenon can occur. Roughly speaking, this happens when arbitrarily small amounts of probability are dispersed into an infinite number of states; we shall quantify this observation and make it precise. We develop several particularly simple, elementary, and useful bounds, and also provide some asymptotic estimates, leading to necessary and sufficient conditions for the occurrence of infinite Shannon entropy. We go to some effort to keep technical computations as simple and conceptually clear as possible. In particular, we shall see that large entropies cannot be localized in state space; large entropies can only be supported on an exponentially large number of states. We are for the time being interested in single-channel Shannon entropy in the information theoretic sense, not entropy in a stochastic field theory or quantum field theory defined over some configuration space, on the grounds that this simple problem is a necessary precursor to understanding infinite entropy in a field theoretic context. (paper)

Relation Entropy and Transferable Entropy Think of Aggregation on Group Decision Making

Institute of Scientific and Technical Information of China (English)

CHENG Qi-yue; QIU Wan-hua; LIU Xiao-feng

2002-01-01

In this paper, aggregation question based on group decision making and a single decision making is studied. The theory of entropy is applied to the sets pair analysis. The system of relation entropy and the transferable entropy notion are put. The character is studied. An potential by the relation entropy and transferable entropy are defined. It is the consistency measure on the group between a single decision making. We gained a new aggregation effective definition on the group misjudge.

Entropies from Markov Models as Complexity Measures of Embedded Attractors

Directory of Open Access Journals (Sweden)

Julián D. Arias-Londoño

2015-06-01

Full Text Available This paper addresses the problem of measuring complexity from embedded attractors as a way to characterize changes in the dynamical behavior of different types of systems with a quasi-periodic behavior by observing their outputs. With the aim of measuring the stability of the trajectories of the attractor along time, this paper proposes three new estimations of entropy that are derived from a Markov model of the embedded attractor. The proposed estimators are compared with traditional nonparametric entropy measures, such as approximate entropy, sample entropy and fuzzy entropy, which only take into account the spatial dimension of the trajectory. The method proposes the use of an unsupervised algorithm to find the principal curve, which is considered as the “profile trajectory”, that will serve to adjust the Markov model. The new entropy measures are evaluated using three synthetic experiments and three datasets of physiological signals. In terms of consistency and discrimination capabilities, the results show that the proposed measures perform better than the other entropy measures used for comparison purposes.

RNA Thermodynamic Structural Entropy.

Directory of Open Access Journals (Sweden)

Juan Antonio Garcia-Martin

Full Text Available Conformational entropy for atomic-level, three dimensional biomolecules is known experimentally to play an important role in protein-ligand discrimination, yet reliable computation of entropy remains a difficult problem. Here we describe the first two accurate and efficient algorithms to compute the conformational entropy for RNA secondary structures, with respect to the Turner energy model, where free energy parameters are determined from UV absorption experiments. An algorithm to compute the derivational entropy for RNA secondary structures had previously been introduced, using stochastic context free grammars (SCFGs. However, the numerical value of derivational entropy depends heavily on the chosen context free grammar and on the training set used to estimate rule probabilities. Using data from the Rfam database, we determine that both of our thermodynamic methods, which agree in numerical value, are substantially faster than the SCFG method. Thermodynamic structural entropy is much smaller than derivational entropy, and the correlation between length-normalized thermodynamic entropy and derivational entropy is moderately weak to poor. In applications, we plot the structural entropy as a function of temperature for known thermoswitches, such as the repression of heat shock gene expression (ROSE element, we determine that the correlation between hammerhead ribozyme cleavage activity and total free energy is improved by including an additional free energy term arising from conformational entropy, and we plot the structural entropy of windows of the HIV-1 genome. Our software RNAentropy can compute structural entropy for any user-specified temperature, and supports both the Turner'99 and Turner'04 energy parameters. It follows that RNAentropy is state-of-the-art software to compute RNA secondary structure conformational entropy. Source code is available at https://github.com/clotelab/RNAentropy/; a full web server is available at http

RNA Thermodynamic Structural Entropy.

Science.gov (United States)

Garcia-Martin, Juan Antonio; Clote, Peter

2015-01-01

Conformational entropy for atomic-level, three dimensional biomolecules is known experimentally to play an important role in protein-ligand discrimination, yet reliable computation of entropy remains a difficult problem. Here we describe the first two accurate and efficient algorithms to compute the conformational entropy for RNA secondary structures, with respect to the Turner energy model, where free energy parameters are determined from UV absorption experiments. An algorithm to compute the derivational entropy for RNA secondary structures had previously been introduced, using stochastic context free grammars (SCFGs). However, the numerical value of derivational entropy depends heavily on the chosen context free grammar and on the training set used to estimate rule probabilities. Using data from the Rfam database, we determine that both of our thermodynamic methods, which agree in numerical value, are substantially faster than the SCFG method. Thermodynamic structural entropy is much smaller than derivational entropy, and the correlation between length-normalized thermodynamic entropy and derivational entropy is moderately weak to poor. In applications, we plot the structural entropy as a function of temperature for known thermoswitches, such as the repression of heat shock gene expression (ROSE) element, we determine that the correlation between hammerhead ribozyme cleavage activity and total free energy is improved by including an additional free energy term arising from conformational entropy, and we plot the structural entropy of windows of the HIV-1 genome. Our software RNAentropy can compute structural entropy for any user-specified temperature, and supports both the Turner'99 and Turner'04 energy parameters. It follows that RNAentropy is state-of-the-art software to compute RNA secondary structure conformational entropy. Source code is available at https://github.com/clotelab/RNAentropy/; a full web server is available at http

Scaling of the magnetic entropy change of Fe3−xMnxSi

International Nuclear Information System (INIS)

Said, M.R.; Hamam, Y.A.; Abu-Aljarayesh, I.

2014-01-01

The magnetic entropy change of Fe 3−x Mn x Si (for x=1.15, 1.3 and 1.5) has been extracted from isothermal magnetization measurements near the Curie temperature. We used the scaling hypotheses of the thermodynamic potentials to scale the magnetic entropy change to a single universal curve for each sample. The effect of the exchange field and the Curie temperature on the maximum entropy change is discussed. - Highlights: • The maximum of the magnetic entropy change occurs at temperatures T>T C . • The exchange field enhances the magnetic entropy change. • The magnetic entropy change at T C is inversely proportional to T C . • Scaling hypothesis is used to scale the magnetic entropy change

The concept of entropy. Relation between action and entropy

Directory of Open Access Journals (Sweden)

J.-P.Badiali

2005-01-01

Full Text Available The Boltzmann expression for entropy represents the traditional link between thermodynamics and statistical mechanics. New theoretical developments like the Unruh effect or the black hole theory suggest a new definition of entropy. In this paper we consider the thermodynamics of black holes as seriously founded and we try to see what we can learn from it in the case of ordinary systems for which a pre-relativistic description is sufficient. We introduce a space-time model and a new definition of entropy considering the thermal equilibrium from a dynamic point of view. Then we show that for black hole and ordinary systems we have the same relation relating a change of entropy to a change of action.

Epoch-based Entropy for Early Screening of Alzheimer's Disease.

Science.gov (United States)

Houmani, N; Dreyfus, G; Vialatte, F B

2015-12-01

In this paper, we introduce a novel entropy measure, termed epoch-based entropy. This measure quantifies disorder of EEG signals both at the time level and spatial level, using local density estimation by a Hidden Markov Model on inter-channel stationary epochs. The investigation is led on a multi-centric EEG database recorded from patients at an early stage of Alzheimer's disease (AD) and age-matched healthy subjects. We investigate the classification performances of this method, its robustness to noise, and its sensitivity to sampling frequency and to variations of hyperparameters. The measure is compared to two alternative complexity measures, Shannon's entropy and correlation dimension. The classification accuracies for the discrimination of AD patients from healthy subjects were estimated using a linear classifier designed on a development dataset, and subsequently tested on an independent test set. Epoch-based entropy reached a classification accuracy of 83% on the test dataset (specificity = 83.3%, sensitivity = 82.3%), outperforming the two other complexity measures. Furthermore, it was shown to be more stable to hyperparameter variations, and less sensitive to noise and sampling frequency disturbances than the other two complexity measures.

Nonequilibrium entropies

International Nuclear Information System (INIS)

Maes, Christian

2012-01-01

In contrast to the quite unique entropy concept useful for systems in (local) thermodynamic equilibrium, there is a variety of quite distinct nonequilibrium entropies, reflecting different physical points. We disentangle these entropies as they relate to heat, fluctuations, response, time asymmetry, variational principles, monotonicity, volume contraction or statistical forces. However, not all of those extensions yield state quantities as understood thermodynamically. At the end we sketch how aspects of dynamical activity can take over for obtaining an extended Clausius relation.

The holographic entropy cone

Energy Technology Data Exchange (ETDEWEB)

Bao, Ning [Institute for Quantum Information and Matter, California Institute of Technology,Pasadena, CA 91125 (United States); Walter Burke Institute for Theoretical Physics, California Institute of Technology,452-48, Pasadena, CA 91125 (United States); Nezami, Sepehr [Stanford Institute for Theoretical Physics, Stanford University,Stanford, CA 94305 (United States); Ooguri, Hirosi [Walter Burke Institute for Theoretical Physics, California Institute of Technology,452-48, Pasadena, CA 91125 (United States); Kavli Institute for the Physics and Mathematics of the Universe, University of Tokyo,Kashiwa 277-8583 (Japan); Stoica, Bogdan [Walter Burke Institute for Theoretical Physics, California Institute of Technology,452-48, Pasadena, CA 91125 (United States); Sully, James [Theory Group, SLAC National Accelerator Laboratory, Stanford University,Menlo Park, CA 94025 (United States); Walter, Michael [Stanford Institute for Theoretical Physics, Stanford University,Stanford, CA 94305 (United States)

2015-09-21

We initiate a systematic enumeration and classification of entropy inequalities satisfied by the Ryu-Takayanagi formula for conformal field theory states with smooth holographic dual geometries. For 2, 3, and 4 regions, we prove that the strong subadditivity and the monogamy of mutual information give the complete set of inequalities. This is in contrast to the situation for generic quantum systems, where a complete set of entropy inequalities is not known for 4 or more regions. We also find an infinite new family of inequalities applicable to 5 or more regions. The set of all holographic entropy inequalities bounds the phase space of Ryu-Takayanagi entropies, defining the holographic entropy cone. We characterize this entropy cone by reducing geometries to minimal graph models that encode the possible cutting and gluing relations of minimal surfaces. We find that, for a fixed number of regions, there are only finitely many independent entropy inequalities. To establish new holographic entropy inequalities, we introduce a combinatorial proof technique that may also be of independent interest in Riemannian geometry and graph theory.

The holographic entropy cone

International Nuclear Information System (INIS)

Bao, Ning; Nezami, Sepehr; Ooguri, Hirosi; Stoica, Bogdan; Sully, James; Walter, Michael

2015-01-01

We initiate a systematic enumeration and classification of entropy inequalities satisfied by the Ryu-Takayanagi formula for conformal field theory states with smooth holographic dual geometries. For 2, 3, and 4 regions, we prove that the strong subadditivity and the monogamy of mutual information give the complete set of inequalities. This is in contrast to the situation for generic quantum systems, where a complete set of entropy inequalities is not known for 4 or more regions. We also find an infinite new family of inequalities applicable to 5 or more regions. The set of all holographic entropy inequalities bounds the phase space of Ryu-Takayanagi entropies, defining the holographic entropy cone. We characterize this entropy cone by reducing geometries to minimal graph models that encode the possible cutting and gluing relations of minimal surfaces. We find that, for a fixed number of regions, there are only finitely many independent entropy inequalities. To establish new holographic entropy inequalities, we introduce a combinatorial proof technique that may also be of independent interest in Riemannian geometry and graph theory.

On the determination of the magnetic entropy change in materials with first-order transitions

International Nuclear Information System (INIS)

Caron, L.; Ou, Z.Q.; Nguyen, T.T.; Cam Thanh, D.T.; Tegus, O.; Brueck, E.

2009-01-01

An accurate method to determine the magnetic entropy change in materials with hysteretic first-order transitions is presented, which is needed to estimate their potential for applications. We have investigated the effect of the maximal entropy change derived from magnetization measurements performed in different measurement processes. The results show that the isothermal entropy change can be derived from the Maxwell relations even for samples with large thermal hysteresis. In the temperature region with hysteresis, overestimating the entropy change can be avoided by measuring the isothermal magnetization of the sample after it is cooled from the paramagnetic state to the measurement temperature. In this way the so-called peak effect is not observed as shown here for a few compounds.

A Theoretical Basis for Entropy-Scaling Effects in Human Mobility Patterns.

Science.gov (United States)

Osgood, Nathaniel D; Paul, Tuhin; Stanley, Kevin G; Qian, Weicheng

2016-01-01

Characterizing how people move through space has been an important component of many disciplines. With the advent of automated data collection through GPS and other location sensing systems, researchers have the opportunity to examine human mobility at spatio-temporal resolution heretofore impossible. However, the copious and complex data collected through these logging systems can be difficult for humans to fully exploit, leading many researchers to propose novel metrics for encapsulating movement patterns in succinct and useful ways. A particularly salient proposed metric is the mobility entropy rate of the string representing the sequence of locations visited by an individual. However, mobility entropy rate is not scale invariant: entropy rate calculations based on measurements of the same trajectory at varying spatial or temporal granularity do not yield the same value, limiting the utility of mobility entropy rate as a metric by confounding inter-experimental comparisons. In this paper, we derive a scaling relationship for mobility entropy rate of non-repeating straight line paths from the definition of Lempel-Ziv compression. We show that the resulting formulation predicts the scaling behavior of simulated mobility traces, and provides an upper bound on mobility entropy rate under certain assumptions. We further show that this formulation has a maximum value for a particular sampling rate, implying that optimal sampling rates for particular movement patterns exist.

Modeling multisite streamflow dependence with maximum entropy copula

Science.gov (United States)

Hao, Z.; Singh, V. P.

2013-10-01

Synthetic streamflows at different sites in a river basin are needed for planning, operation, and management of water resources projects. Modeling the temporal and spatial dependence structure of monthly streamflow at different sites is generally required. In this study, the maximum entropy copula method is proposed for multisite monthly streamflow simulation, in which the temporal and spatial dependence structure is imposed as constraints to derive the maximum entropy copula. The monthly streamflows at different sites are then generated by sampling from the conditional distribution. A case study for the generation of monthly streamflow at three sites in the Colorado River basin illustrates the application of the proposed method. Simulated streamflow from the maximum entropy copula is in satisfactory agreement with observed streamflow.

On the Conditional Rényi Entropy

NARCIS (Netherlands)

S. Fehr (Serge); S. Berens (Stefan)

2014-01-01

htmlabstractThe Rényi entropy of general order unifies the well-known Shannon entropy with several other entropy notions, like the min-entropy or the collision entropy. In contrast to the Shannon entropy, there seems to be no commonly accepted definition for the conditional Rényi entropy: several

Tsallis-like entropies in quantum scattering

International Nuclear Information System (INIS)

Ion, D.B.; Ion, M.L.

1998-01-01

In this work, the following entropies in quantum scattering are defined: the informational angular entropy, S θ ; Tsallis-like angular entropies, S q (θ); the angular momentum entropy, S L ; the Tsallis-like angular momentum entropies, S q (L); the angle-angular momentum entropy, S θL . These entropies are defined as natural measures of the uncertainties corresponding to the distribution probabilities. If we are interested in obtaining a measure of uncertainty of the simultaneous realization of the probability distributions, than, we have to calculate the entropy corresponding to these distributions. The expression of angle-angular momentum entropy is given. The relation between the Tsallis entropies and the angle-angular momentum entropy is derived

Entropy for Mechanically Vibrating Systems

Science.gov (United States)

Tufano, Dante

The research contained within this thesis deals with the subject of entropy as defined for and applied to mechanically vibrating systems. This work begins with an overview of entropy as it is understood in the fields of classical thermodynamics, information theory, statistical mechanics, and statistical vibroacoustics. Khinchin's definition of entropy, which is the primary definition used for the work contained in this thesis, is introduced in the context of vibroacoustic systems. The main goal of this research is to to establish a mathematical framework for the application of Khinchin's entropy in the field of statistical vibroacoustics by examining the entropy context of mechanically vibrating systems. The introduction of this thesis provides an overview of statistical energy analysis (SEA), a modeling approach to vibroacoustics that motivates this work on entropy. The objective of this thesis is given, and followed by a discussion of the intellectual merit of this work as well as a literature review of relevant material. Following the introduction, an entropy analysis of systems of coupled oscillators is performed utilizing Khinchin's definition of entropy. This analysis develops upon the mathematical theory relating to mixing entropy, which is generated by the coupling of vibroacoustic systems. The mixing entropy is shown to provide insight into the qualitative behavior of such systems. Additionally, it is shown that the entropy inequality property of Khinchin's entropy can be reduced to an equality using the mixing entropy concept. This equality can be interpreted as a facet of the second law of thermodynamics for vibroacoustic systems. Following this analysis, an investigation of continuous systems is performed using Khinchin's entropy. It is shown that entropy analyses using Khinchin's entropy are valid for continuous systems that can be decomposed into a finite number of modes. The results are shown to be analogous to those obtained for simple oscillators

Entropy of the electroencephalogram as applied in the M-Entropy S ...

African Journals Online (AJOL)

Background: It has been suggested that spectral entropy of the electroencephalogram as applied in the M-Entropy S/5TM Module (GE Healthcare) does not detect the effects of nitrous oxide (N2O). The aim of this study was to investigate the effect on entropy by graded increases in N2O concentrations in the presence of a ...

Entropy of Baker's Transformation

Institute of Scientific and Technical Information of China (English)

栾长福

2003-01-01

Four theorems about four different kinds of entropies for Baker's transformation are presented. The Kolmogorov entropy of Baker's transformation is sensitive to the initial flips by the time. The topological entropy of Baker's transformation is found to be log k. The conditions for the state of Baker's transformation to be forbidden are also derived. The relations among the Shanonn, Kolmogorov, topological and Boltzmann entropies are discussed in details.

The maximum entropy production and maximum Shannon information entropy in enzyme kinetics

Science.gov (United States)

Dobovišek, Andrej; Markovič, Rene; Brumen, Milan; Fajmut, Aleš

2018-04-01

We demonstrate that the maximum entropy production principle (MEPP) serves as a physical selection principle for the description of the most probable non-equilibrium steady states in simple enzymatic reactions. A theoretical approach is developed, which enables maximization of the density of entropy production with respect to the enzyme rate constants for the enzyme reaction in a steady state. Mass and Gibbs free energy conservations are considered as optimization constraints. In such a way computed optimal enzyme rate constants in a steady state yield also the most uniform probability distribution of the enzyme states. This accounts for the maximal Shannon information entropy. By means of the stability analysis it is also demonstrated that maximal density of entropy production in that enzyme reaction requires flexible enzyme structure, which enables rapid transitions between different enzyme states. These results are supported by an example, in which density of entropy production and Shannon information entropy are numerically maximized for the enzyme Glucose Isomerase.

Entropy production in a cell and reversal of entropy flow as an anticancer therapy

Institute of Scientific and Technical Information of China (English)

Liao-fu LUO

2009-01-01

The entropy production rate of cancer cells is always higher than healthy cells in the case where no external field is applied. Different entropy production between two kinds of cells determines the direction of entropy flow among cells. The entropy flow is the carrier of information flow. The entropy flow from cancerous cells to healthy cells takes along the harmful information of cancerous cells, propagating its toxic action to healthy tissues. We demonstrate that a low-frequency and low- intensity electromagnetic field or ultrasound irradiation may increase the entropy production rate of a cell in normal tissue than that in cancer and consequently re- verse the direction of entropy current between two kinds of cells. The modification of the PH value of cells may also cause the reversal of the direction of entropy flow between healthy and cancerous cells. Therefore, the bio- logical tissue under the irradiation of an electromagnetic field or ultrasound or under the appropriate change of cell acidity can avoid the propagation of harmful infor- marion from cancer cells. We suggest that this entropy mechanism possibly provides a basis for a novel approach to anticancer therapy.

The different paths to entropy

International Nuclear Information System (INIS)

Benguigui, L

2013-01-01

In order to understand how the complex concept of entropy emerged, we propose a trip into the past, reviewing the works of Clausius, Boltzmann, Gibbs and Planck. In particular, since Gibbs's work is not very well known we present a detailed analysis, recalling the three definitions of entropy that Gibbs gives. The introduction of entropy in quantum mechanics gives in a compact form all the classical definitions of entropy. Perhaps one of the most important aspects of entropy is to see it as a thermodynamic potential like the others proposed by Callen. The calculation of fluctuations in thermodynamic quantities is thus naturally related to entropy. We close with some remarks on entropy and irreversibility. (paper)

ENTROPY - OUR BEST FRIEND

Directory of Open Access Journals (Sweden)

Urban Kordes

2005-10-01

Full Text Available The paper tries to tackle the question of connection between entropy and the living. Definitions of life as the phenomenon that defies entropy are overviewed and the conclusion is reached that life is in a way dependant on entropy - it couldn't exist without it. Entropy is a sort of medium, a fertile soil, that gives life possibility to blossom. Paper ends with presenting some consequences for the field of artificial intelligence.

Entropy Measures for Stochastic Processes with Applications in Functional Anomaly Detection

Directory of Open Access Journals (Sweden)

Gabriel Martos

2018-01-01

Full Text Available We propose a definition of entropy for stochastic processes. We provide a reproducing kernel Hilbert space model to estimate entropy from a random sample of realizations of a stochastic process, namely functional data, and introduce two approaches to estimate minimum entropy sets. These sets are relevant to detect anomalous or outlier functional data. A numerical experiment illustrates the performance of the proposed method; in addition, we conduct an analysis of mortality rate curves as an interesting application in a real-data context to explore functional anomaly detection.

Path length entropy analysis of diastolic heart sounds.

Science.gov (United States)

Griffel, Benjamin; Zia, Mohammad K; Fridman, Vladamir; Saponieri, Cesare; Semmlow, John L

2013-09-01

Early detection of coronary artery disease (CAD) using the acoustic approach, a noninvasive and cost-effective method, would greatly improve the outcome of CAD patients. To detect CAD, we analyze diastolic sounds for possible CAD murmurs. We observed diastolic sounds to exhibit 1/f structure and developed a new method, path length entropy (PLE) and a scaled version (SPLE), to characterize this structure to improve CAD detection. We compare SPLE results to Hurst exponent, Sample entropy and Multiscale entropy for distinguishing between normal and CAD patients. SPLE achieved a sensitivity-specificity of 80%-81%, the best of the tested methods. However, PLE and SPLE are not sufficient to prove nonlinearity, and evaluation using surrogate data suggests that our cardiovascular sound recordings do not contain significant nonlinear properties. Copyright © 2013 Elsevier Ltd. All rights reserved.

Editorial: Entropy in Landscape Ecology

Directory of Open Access Journals (Sweden)

Samuel A. Cushman

2018-04-01

Full Text Available Entropy and the second law of thermodynamics are the central organizing principles of nature, but the ideas and implications of the second law are poorly developed in landscape ecology. The purpose of this Special Issue “Entropy in Landscape Ecology” in Entropy is to bring together current research on applications of thermodynamics in landscape ecology, to consolidate current knowledge and identify key areas for future research. The special issue contains six articles, which cover a broad range of topics including relationships between entropy and evolution, connections between fractal geometry and entropy, new approaches to calculate configurational entropy of landscapes, example analyses of computing entropy of landscapes, and using entropy in the context of optimal landscape planning. Collectively these papers provide a broad range of contributions to the nascent field of ecological thermodynamics. Formalizing the connections between entropy and ecology are in a very early stage, and that this special issue contains papers that address several centrally important ideas, and provides seminal work that will be a foundation for the future development of ecological and evolutionary thermodynamics.

On quantum Rényi entropies

DEFF Research Database (Denmark)

Müller-Lennert, Martin; Dupont-Dupuis, Fréderic; Szehr, Oleg

2013-01-01

The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in in...

Entanglement entropy of ABJM theory and entropy of topological black hole

Science.gov (United States)

Nian, Jun; Zhang, Xinyu

2017-07-01

In this paper we discuss the supersymmetric localization of the 4D N = 2 offshell gauged supergravity on the background of the AdS4 neutral topological black hole, which is the gravity dual of the ABJM theory defined on the boundary {S}^1× H^2 . We compute the large- N expansion of the supergravity partition function. The result gives the black hole entropy with the logarithmic correction, which matches the previous result of the entanglement entropy of the ABJM theory up to some stringy effects. Our result is consistent with the previous on-shell one-loop computation of the logarithmic correction to black hole entropy. It provides an explicit example of the identification of the entanglement entropy of the boundary conformal field theory with the bulk black hole entropy beyond the leading order given by the classical Bekenstein-Hawking formula, which consequently tests the AdS/CFT correspondence at the subleading order.

Entropy-Stabilized Oxides

Science.gov (United States)

2015-09-29

antiferroelectrics. Phys. Rev. Lett. 110, 017603 (2013). 22. Cantor , B., Chang, I., Knight, P. & Vincent, A. Microstructural development in equiatomic...Science 345, 1153–1158 (2014). 24. Gali, A. & George , E. Tensile properties of high- and medium-entropy alloys. Intermetallics 39, 74–78 (2013). 25...148–153 (2014). 26. Otto, F., Yang, Y., Bei, H. & George , E. Relative effects of enthalpy and entropy on the phase stability of equiatomic high-entropy

Transplanckian entanglement entropy

International Nuclear Information System (INIS)

Chang, Darwin; Chu, C.-S.; Lin Fengli

2004-01-01

The entanglement entropy of the event horizon is known to be plagued by the UV divergence due to the infinitely blue-shifted near horizon modes. In this Letter we calculate the entanglement entropy using the transplanckian dispersion relation, which has been proposed to model the quantum gravity effects. We show that, very generally, the entropy is rendered UV finite due to the suppression of high energy modes effected by the transplanckian dispersion relation

Entropy-Based Privacy against Profiling of User Mobility

Directory of Open Access Journals (Sweden)

Alicia Rodriguez-Carrion

2015-06-01

Full Text Available Location-based services (LBSs flood mobile phones nowadays, but their use poses an evident privacy risk. The locations accompanying the LBS queries can be exploited by the LBS provider to build the user profile of visited locations, which might disclose sensitive data, such as work or home locations. The classic concept of entropy is widely used to evaluate privacy in these scenarios, where the information is represented as a sequence of independent samples of categorized data. However, since the LBS queries might be sent very frequently, location profiles can be improved by adding temporal dependencies, thus becoming mobility profiles, where location samples are not independent anymore and might disclose the user’s mobility patterns. Since the time dimension is factored in, the classic entropy concept falls short of evaluating the real privacy level, which depends also on the time component. Therefore, we propose to extend the entropy-based privacy metric to the use of the entropy rate to evaluate mobility profiles. Then, two perturbative mechanisms are considered to preserve locations and mobility profiles under gradual utility constraints. We further use the proposed privacy metric and compare it to classic ones to evaluate both synthetic and real mobility profiles when the perturbative methods proposed are applied. The results prove the usefulness of the proposed metric for mobility profiles and the need for tailoring the perturbative methods to the features of mobility profiles in order to improve privacy without completely loosing utility.

Thermostatistical aspects of generalized entropies

International Nuclear Information System (INIS)

Fa, K.S.; Lenzi, E.K.

2004-01-01

We investigate the properties concerning a class of generalized entropies given by S q,r =k{1-[Σ i p i q ] r }/[r(q-1)] which include Tsallis' entropy (r=1), the usual Boltzmann-Gibbs entropy (q=1), Renyi's entropy (r=0) and normalized Tsallis' entropy (r=-1). In order to obtain the generalized thermodynamic relations we use the laws of thermodynamics and considering the hypothesis that the joint probability of two independent systems is given by p ij A c upB =p i A p j B . We show that the transmutation which occurs from Tsallis' entropy to Renyi's entropy also occur with S q,r . In this scenario, we also analyze the generalized variance, covariance and correlation coefficient of a non-interacting system by using extended optimal Lagrange multiplier approach. We show that the correlation coefficient tends to zero in the thermodynamic limit. However, Renyi's entropy related to this non-interacting system presents a certain degree of non-extensivity

Absolute entropy of ions in methanol

International Nuclear Information System (INIS)

Abakshin, V.A.; Kobenin, V.A.; Krestov, G.A.

1978-01-01

By measuring the initial thermoelectromotive forces of chains with bromo-silver electrodes in tetraalkylammonium bromide solutions the absolute entropy of bromide-ion in methanol is determined in the 298.15-318.15 K range. The anti Ssub(Brsup(-))sup(0) = 9.8 entropy units value is used for calculation of the absolute partial molar entropy of alkali metal ions and halogenide ions. It has been found that, absolute entropy of Cs + =12.0 entropy units, I - =14.0 entropy units. The obtained ion absolute entropies in methanol at 298.15 K within 1-2 entropy units is in an agreement with published data

Some remarks on conditional entropy

NARCIS (Netherlands)

Nijst, A.G.P.M.

1969-01-01

Using a definition of conditional entropy given by Hanen and Neveu [5, 10, 11] we discuss in this paper some properties of conditional entropy and mean entropy, in particular an integral representation of conditional entropy (§ 2), and the decomposition theorem of the KolmogorovSina¯i invariant (§

Entropy, matter, and cosmology.

Science.gov (United States)

Prigogine, I; Géhéniau, J

1986-09-01

The role of irreversible processes corresponding to creation of matter in general relativity is investigated. The use of Landau-Lifshitz pseudotensors together with conformal (Minkowski) coordinates suggests that this creation took place in the early universe at the stage of the variation of the conformal factor. The entropy production in this creation process is calculated. It is shown that these dissipative processes lead to the possibility of cosmological models that start from empty conditions and gradually build up matter and entropy. Gravitational entropy takes a simple meaning as associated to the entropy that is necessary to produce matter. This leads to an extension of the third law of thermodynamics, as now the zero point of entropy becomes the space-time structure out of which matter is generated. The theory can be put into a convenient form using a supplementary "C" field in Einstein's field equations. The role of the C field is to express the coupling between gravitation and matter leading to irreversible entropy production.

Relations Among Some Fuzzy Entropy Formulae

Institute of Scientific and Technical Information of China (English)

卿铭

2004-01-01

Fuzzy entropy has been widely used to analyze and design fuzzy systems, and many fuzzy entropy formulae have been proposed. For further in-deepth analysis of fuzzy entropy, the axioms and some important formulae of fuzzy entropy are introduced. Some equivalence results among these fuzzy entropy formulae are proved, and it is shown that fuzzy entropy is a special distance measurement.

Intra-tumour signalling entropy determines clinical outcome in breast and lung cancer.

Directory of Open Access Journals (Sweden)

Christopher R S Banerji

2015-03-01

Full Text Available The cancer stem cell hypothesis, that a small population of tumour cells are responsible for tumorigenesis and cancer progression, is becoming widely accepted and recent evidence has suggested a prognostic and predictive role for such cells. Intra-tumour heterogeneity, the diversity of the cancer cell population within the tumour of an individual patient, is related to cancer stem cells and is also considered a potential prognostic indicator in oncology. The measurement of cancer stem cell abundance and intra-tumour heterogeneity in a clinically relevant manner however, currently presents a challenge. Here we propose signalling entropy, a measure of signalling pathway promiscuity derived from a sample's genome-wide gene expression profile, as an estimate of the stemness of a tumour sample. By considering over 500 mixtures of diverse cellular expression profiles, we reveal that signalling entropy also associates with intra-tumour heterogeneity. By analysing 3668 breast cancer and 1692 lung adenocarcinoma samples, we further demonstrate that signalling entropy correlates negatively with survival, outperforming leading clinical gene expression based prognostic tools. Signalling entropy is found to be a general prognostic measure, valid in different breast cancer clinical subgroups, as well as within stage I lung adenocarcinoma. We find that its prognostic power is driven by genes involved in cancer stem cells and treatment resistance. In summary, by approximating both stemness and intra-tumour heterogeneity, signalling entropy provides a powerful prognostic measure across different epithelial cancers.

Entropy and Digital Installation

Directory of Open Access Journals (Sweden)

Susan Ballard

2005-01-01

Full Text Available This paper examines entropy as a process which introduces ideas of distributed materiality to digital installation. Beginning from an analysis of entropy as both force and probability measure within information theory and it’s extension in Ruldof Arnheim’s text ‘Entropy and Art” it develops an argument for the positive rather thannegative forces of entropy. The paper centres on a discussion of two recent works by New Zealand artists Ronnie van Hout (“On the Run”, Wellington City Gallery, NZ, 2004 and Alex Monteith (“Invisible Cities”, Physics Room Contemporary Art Space, Christchurch, NZ, 2004. Ballard suggests that entropy, rather than being a hindrance to understanding or a random chaotic force, discloses a necessary and material politics of noise present in digital installation.

Brain entropy and human intelligence: A resting-state fMRI study

Science.gov (United States)

Calderone, Daniel; Morales, Leah J.

2018-01-01

Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns. PMID:29432427

Brain entropy and human intelligence: A resting-state fMRI study.

Science.gov (United States)

Saxe, Glenn N; Calderone, Daniel; Morales, Leah J

2018-01-01

Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns.

Misuse of thermodynamic entropy in economics

International Nuclear Information System (INIS)

Kovalev, Andrey V.

2016-01-01

The direct relationship between thermodynamic entropy and economic scarcity is only valid for a thermodynamically isolated economy. References to the second law of thermodynamics in economics within the context of scarcity ignore the fact that the earth is not an isolated system. The earth interacts with external sources and sinks of entropy and the resulting total entropy fluctuates around a constant. Even if the mankind finally proves unable to recycle industrial waste and close the technological cycle, the economic disruption caused by the depletion of natural resources may happen while the total thermodynamic entropy of the ecosystem remains essentially at the present level, because the transfer of chemically refined products may not increase significantly the total entropy, but it may decrease their recyclability. The inutility of industrial waste is not connected with its entropy, which may be exemplified with the case of alumina production. The case also demonstrates that industrially generated entropy is discharged into surroundings without being accumulated in ‘thermodynamically unavailable matter’. Material entropy, as a measure of complexity and economic dispersal of resources, can be a recyclability metric, but it is not a thermodynamic parameter, and its growth is not equivalent to the growth of thermodynamic entropy. - Highlights: • Entropy cannot be used as a measure of economic scarcity. • There is no anthropogenic entropy separate from the entropy produced naturally. • Inutility of industrial waste is not connected with its thermodynamic entropy. • Industrially generated entropy may or may not be accumulated in industrial waste. • Recyclability is more important than thermodynamic entropy of a product.

How multiplicity determines entropy and the derivation of the maximum entropy principle for complex systems.

Science.gov (United States)

Hanel, Rudolf; Thurner, Stefan; Gell-Mann, Murray

2014-05-13

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and Markovian systems in statistical mechanics, information theory, and statistics. For several decades there has been an ongoing controversy over whether the notion of the maximum entropy principle can be extended in a meaningful way to nonextensive, nonergodic, and complex statistical systems and processes. In this paper we start by reviewing how Boltzmann-Gibbs-Shannon entropy is related to multiplicities of independent random processes. We then show how the relaxation of independence naturally leads to the most general entropies that are compatible with the first three Shannon-Khinchin axioms, the (c,d)-entropies. We demonstrate that the MEP is a perfectly consistent concept for nonergodic and complex statistical systems if their relative entropy can be factored into a generalized multiplicity and a constraint term. The problem of finding such a factorization reduces to finding an appropriate representation of relative entropy in a linear basis. In a particular example we show that path-dependent random processes with memory naturally require specific generalized entropies. The example is to our knowledge the first exact derivation of a generalized entropy from the microscopic properties of a path-dependent random process.

Calculation of Configurational Entropy in Complex Landscapes

Directory of Open Access Journals (Sweden)

Samuel A Cushman

2018-04-01

Full Text Available Entropy and the second law of thermodynamics are fundamental concepts that underlie all natural processes and patterns. Recent research has shown how the entropy of a landscape mosaic can be calculated using the Boltzmann equation, with the entropy of a lattice mosaic equal to the logarithm of the number of ways a lattice with a given dimensionality and number of classes can be arranged to produce the same total amount of edge between cells of different classes. However, that work seemed to also suggest that the feasibility of applying this method to real landscapes was limited due to intractably large numbers of possible arrangements of raster cells in large landscapes. Here I extend that work by showing that: (1 the proportion of arrangements rather than the number with a given amount of edge length provides a means to calculate unbiased relative configurational entropy, obviating the need to compute all possible configurations of a landscape lattice; (2 the edge lengths of randomized landscape mosaics are normally distributed, following the central limit theorem; and (3 given this normal distribution it is possible to fit parametric probability density functions to estimate the expected proportion of randomized configurations that have any given edge length, enabling the calculation of configurational entropy on any landscape regardless of size or number of classes. I evaluate the boundary limits (4 for this normal approximation for small landscapes with a small proportion of a minority class and show it holds under all realistic landscape conditions. I further (5 demonstrate that this relationship holds for a sample of real landscapes that vary in size, patch richness, and evenness of area in each cover type, and (6 I show that the mean and standard deviation of the normally distributed edge lengths can be predicted nearly perfectly as a function of the size, patch richness and diversity of a landscape. Finally, (7 I show that the

Autonomous entropy-based intelligent experimental design

Science.gov (United States)

Malakar, Nabin Kumar

2011-07-01

The aim of this thesis is to explore the application of probability and information theory in experimental design, and to do so in a way that combines what we know about inference and inquiry in a comprehensive and consistent manner. Present day scientific frontiers involve data collection at an ever-increasing rate. This requires that we find a way to collect the most relevant data in an automated fashion. By following the logic of the scientific method, we couple an inference engine with an inquiry engine to automate the iterative process of scientific learning. The inference engine involves Bayesian machine learning techniques to estimate model parameters based upon both prior information and previously collected data, while the inquiry engine implements data-driven exploration. By choosing an experiment whose distribution of expected results has the maximum entropy, the inquiry engine selects the experiment that maximizes the expected information gain. The coupled inference and inquiry engines constitute an autonomous learning method for scientific exploration. We apply it to a robotic arm to demonstrate the efficacy of the method. Optimizing inquiry involves searching for an experiment that promises, on average, to be maximally informative. If the set of potential experiments is described by many parameters, the search involves a high-dimensional entropy space. In such cases, a brute force search method will be slow and computationally expensive. We develop an entropy-based search algorithm, called nested entropy sampling, to select the most informative experiment. This helps to reduce the number of computations necessary to find the optimal experiment. We also extended the method of maximizing entropy, and developed a method of maximizing joint entropy so that it could be used as a principle of collaboration between two robots. This is a major achievement of this thesis, as it allows the information-based collaboration between two robotic units towards a same

Entropy: Order or Information

Science.gov (United States)

Ben-Naim, Arieh

2011-01-01

Changes in entropy can "sometimes" be interpreted in terms of changes in disorder. On the other hand, changes in entropy can "always" be interpreted in terms of changes in Shannon's measure of information. Mixing and demixing processes are used to highlight the pitfalls in the association of entropy with disorder. (Contains 3 figures.)

Manufacturing of High Entropy Alloys

Science.gov (United States)

Jablonski, Paul D.; Licavoli, Joseph J.; Gao, Michael C.; Hawk, Jeffrey A.

2015-07-01

High entropy alloys (HEAs) have generated interest in recent years due to their unique positioning within the alloy world. By incorporating a number of elements in high proportion they have high configurational entropy, and thus they hold the promise of interesting and useful properties such as enhanced strength and phase stability. The present study investigates the microstructure of two single-phase face-centered cubic (FCC) HEAs, CoCrFeNi and CoCrFeNiMn, with special attention given to melting, homogenization and thermo-mechanical processing. Large-scale ingots were made by vacuum induction melting to avoid the extrinsic factors inherent in small-scale laboratory button samples. A computationally based homogenization heat treatment was applied to both alloys in order to eliminate segregation due to normal ingot solidification. The alloys fabricated well, with typical thermo-mechanical processing parameters being employed.

Entropie analysis of floating car data systems

Directory of Open Access Journals (Sweden)

F. Gössel

2004-01-01

Full Text Available The knowledge of the actual traffic state is a basic prerequisite of modern traffic telematic systems. Floating Car Data (FCD systems are becoming more and more important for the provision of actual and reliable traffic data. In these systems the vehicle velocity is the original variable for the evaluation of the current traffic condition. As real FCDsystems are operating under conditions of limited transmission and processing capacity the analysis of the original variable vehicle speed is of special interest. Entropy considerations are especially useful for the deduction of fundamental restrictions and limitations. The paper analyses velocity-time profiles by means of information entropy. It emphasises in quantification of the information content of velocity-time profiles and the discussion of entropy dynamic in velocity-time profiles. Investigations are based on empirical data derived during field trials. The analysis of entropy dynamic is carried out in two different ways. On one hand velocity differences within a certain interval of time are used, on the other hand the transinformation between velocities in certain time distances was evaluated. One important result is an optimal sample-rate for the detection of velocity data in FCD-systems. The influence of spatial segmentation and of different states of traffic was discussed.

Entropy-based financial asset pricing.

Directory of Open Access Journals (Sweden)

Mihály Ormos

Full Text Available We investigate entropy as a financial risk measure. Entropy explains the equity premium of securities and portfolios in a simpler way and, at the same time, with higher explanatory power than the beta parameter of the capital asset pricing model. For asset pricing we define the continuous entropy as an alternative measure of risk. Our results show that entropy decreases in the function of the number of securities involved in a portfolio in a similar way to the standard deviation, and that efficient portfolios are situated on a hyperbola in the expected return-entropy system. For empirical investigation we use daily returns of 150 randomly selected securities for a period of 27 years. Our regression results show that entropy has a higher explanatory power for the expected return than the capital asset pricing model beta. Furthermore we show the time varying behavior of the beta along with entropy.

Entropy-based financial asset pricing.

Science.gov (United States)

Ormos, Mihály; Zibriczky, Dávid

2014-01-01

We investigate entropy as a financial risk measure. Entropy explains the equity premium of securities and portfolios in a simpler way and, at the same time, with higher explanatory power than the beta parameter of the capital asset pricing model. For asset pricing we define the continuous entropy as an alternative measure of risk. Our results show that entropy decreases in the function of the number of securities involved in a portfolio in a similar way to the standard deviation, and that efficient portfolios are situated on a hyperbola in the expected return-entropy system. For empirical investigation we use daily returns of 150 randomly selected securities for a period of 27 years. Our regression results show that entropy has a higher explanatory power for the expected return than the capital asset pricing model beta. Furthermore we show the time varying behavior of the beta along with entropy.

Entropy of Iterated Function Systems and Their Relations with Black Holes and Bohr-Like Black Holes Entropies

Directory of Open Access Journals (Sweden)

Christian Corda

2018-01-01

Full Text Available In this paper we consider the metric entropies of the maps of an iterated function system deduced from a black hole which are known the Bekenstein–Hawking entropies and its subleading corrections. More precisely, we consider the recent model of a Bohr-like black hole that has been recently analysed in some papers in the literature, obtaining the intriguing result that the metric entropies of a black hole are created by the metric entropies of the functions, created by the black hole principal quantum numbers, i.e., by the black hole quantum levels. We present a new type of topological entropy for general iterated function systems based on a new kind of the inverse of covers. Then the notion of metric entropy for an Iterated Function System ( I F S is considered, and we prove that these definitions for topological entropy of IFS’s are equivalent. It is shown that this kind of topological entropy keeps some properties which are hold by the classic definition of topological entropy for a continuous map. We also consider average entropy as another type of topological entropy for an I F S which is based on the topological entropies of its elements and it is also an invariant object under topological conjugacy. The relation between Axiom A and the average entropy is investigated.

Quantum thermodynamics: Microscopic foundations of entropy and of entropy generation by irreversibility

Directory of Open Access Journals (Sweden)

Beretta, Gian Paolo

2008-02-01

Full Text Available What is the physical significance of entropy? What is the physical origin of irreversibility? Do entropy and irreversibility exist only for complex and macroscopic systems? Most physicists still accept and teach that the rationalization of these fundamental questions is given by Statistical Mechanics. Indeed, for everyday laboratory physics, the mathematical formalism of Statistical Mechanics (canonical and grand-canonical, Boltzmann, Bose-Einstein and Fermi-Dirac distributions allows a successful description of the thermodynamic equilibrium properties of matter, including entropy values. However, as already recognized by Schrodinger in 1936, Statistical Mechanics is impaired by conceptual ambiguities and logical inconsistencies, both in its explanation of the meaning of entropy and in its implications on the concept of state of a system. An alternative theory has been developed by Gyftopoulos, Hatsopoulos and the present author to eliminate these stumbling conceptual blocks while maintaining the mathematical formalism so successful in applications. To resolve both the problem of the meaning of entropy and that of the origin of irreversibility we have built entropy and irreversibility into the laws of microscopic physics. The result is a theory, that we call Quantum Thermodynamics, that has all the necessary features to combine Mechanics and Thermodynamics uniting all the successful results of both theories, eliminating the logical inconsistencies of Statistical Mechanics and the paradoxes on irreversibility, and providing an entirely new perspective on the microscopic origin of irreversibility, nonlinearity (therefore including chaotic behavior and maximal-entropy-generation nonequilibrium dynamics. In this paper we discuss the background and formalism of Quantum Thermodynamics including its nonlinear equation of motion and the main general results. Our objective is to show in a not-too-technical manner that this theory provides indeed a

Holographic charged Rényi entropies

Science.gov (United States)

Belin, Alexandre; Hung, Ling-Yan; Maloney, Alexander; Matsuura, Shunji; Myers, Robert C.; Sierens, Todd

2013-12-01

We construct a new class of entanglement measures by extending the usual definition of Rényi entropy to include a chemical potential. These charged Rényi entropies measure the degree of entanglement in different charge sectors of the theory and are given by Euclidean path integrals with the insertion of a Wilson line encircling the entangling surface. We compute these entropies for a spherical entangling surface in CFT's with holographic duals, where they are related to entropies of charged black holes with hyperbolic horizons. We also compute charged Rényi entropies in free field theories.

Entropy of quasiblack holes

International Nuclear Information System (INIS)

Lemos, Jose P. S.; Zaslavskii, Oleg B.

2010-01-01

We trace the origin of the black hole entropy S, replacing a black hole by a quasiblack hole. Let the boundary of a static body approach its own gravitational radius, in such a way that a quasihorizon forms. We show that if the body is thermal with the temperature taking the Hawking value at the quasihorizon limit, it follows, in the nonextremal case, from the first law of thermodynamics that the entropy approaches the Bekenstein-Hawking value S=A/4. In this setup, the key role is played by the surface stresses on the quasihorizon and one finds that the entropy comes from the quasihorizon surface. Any distribution of matter inside the surface leads to the same universal value for the entropy in the quasihorizon limit. This can be of some help in the understanding of black hole entropy. Other similarities between black holes and quasiblack holes such as the mass formulas for both objects had been found previously. We also discuss the entropy for extremal quasiblack holes, a more subtle issue.

Correlation as a Determinant of Configurational Entropy in Supramolecular and Protein Systems

Science.gov (United States)

2015-01-01

For biomolecules in solution, changes in configurational entropy are thought to contribute substantially to the free energies of processes like binding and conformational change. In principle, the configurational entropy can be strongly affected by pairwise and higher-order correlations among conformational degrees of freedom. However, the literature offers mixed perspectives regarding the contributions that changes in correlations make to changes in configurational entropy for such processes. Here we take advantage of powerful techniques for simulation and entropy analysis to carry out rigorous in silico studies of correlation in binding and conformational changes. In particular, we apply information-theoretic expansions of the configurational entropy to well-sampled molecular dynamics simulations of a model host–guest system and the protein bovine pancreatic trypsin inhibitor. The results bear on the interpretation of NMR data, as they indicate that changes in correlation are important determinants of entropy changes for biologically relevant processes and that changes in correlation may either balance or reinforce changes in first-order entropy. The results also highlight the importance of main-chain torsions as contributors to changes in protein configurational entropy. As simulation techniques grow in power, the mathematical techniques used here will offer new opportunities to answer challenging questions about complex molecular systems. PMID:24702693

Possible extended forms of thermodynamic entropy

International Nuclear Information System (INIS)

Sasa, Shin-ichi

2014-01-01

Thermodynamic entropy is determined by a heat measurement through the Clausius equality. The entropy then formalizes a fundamental limitation of operations by the second law of thermodynamics. The entropy is also expressed as the Shannon entropy of the microscopic degrees of freedom. Whenever an extension of thermodynamic entropy is attempted, we must pay special attention to how its three different aspects just mentioned are altered. In this paper, we discuss possible extensions of the thermodynamic entropy. (paper)

Monotonicity of the von Neumann entropy expressed as a function of R\\'enyi entropies

OpenAIRE

Fannes, Mark

2013-01-01

The von Neumann entropy of a density matrix of dimension d, expressed in terms of the first d-1 integer order R\\'enyi entropies, is monotonically increasing in R\\'enyi entropies of even order and decreasing in those of odd order.

Driver Fatigue Detection System Using Electroencephalography Signals Based on Combined Entropy Features

Directory of Open Access Journals (Sweden)

Zhendong Mu

2017-02-01

Full Text Available Driver fatigue has become one of the major causes of traffic accidents, and is a complicated physiological process. However, there is no effective method to detect driving fatigue. Electroencephalography (EEG signals are complex, unstable, and non-linear; non-linear analysis methods, such as entropy, maybe more appropriate. This study evaluates a combined entropy-based processing method of EEG data to detect driver fatigue. In this paper, 12 subjects were selected to take part in an experiment, obeying driving training in a virtual environment under the instruction of the operator. Four types of enthrones (spectrum entropy, approximate entropy, sample entropy and fuzzy entropy were used to extract features for the purpose of driver fatigue detection. Electrode selection process and a support vector machine (SVM classification algorithm were also proposed. The average recognition accuracy was 98.75%. Retrospective analysis of the EEG showed that the extracted features from electrodes T5, TP7, TP8 and FP1 may yield better performance. SVM classification algorithm using radial basis function as kernel function obtained better results. A combined entropy-based method demonstrates good classification performance for studying driver fatigue detection.

More dimensions: Less entropy

International Nuclear Information System (INIS)

Kolb, E.W.; Lindley, D.; Seckel, D.

1984-01-01

For a cosmological model with d noncompact and D compact spatial dimensions and symmetry R 1 x S/sup d/ x S/sup D/, we calculate the entropy produced in d dimensions due to the compactification of D dimensions and show it too small to be of cosmological interest. Although insufficient entropy is produced in the model we study, the contraction of extra dimensions does lead to entropy production. We discuss modifications of our assumptions, including changing our condition for decoupling of the extra dimensions, which may lead to a large entropy production and change our conclusions

Enzyme catalysis by entropy without Circe effect.

Science.gov (United States)

Kazemi, Masoud; Himo, Fahmi; Åqvist, Johan

2016-03-01

Entropic effects have often been invoked to explain the extraordinary catalytic power of enzymes. In particular, the hypothesis that enzymes can use part of the substrate-binding free energy to reduce the entropic penalty associated with the subsequent chemical transformation has been very influential. The enzymatic reaction of cytidine deaminase appears to be a distinct example. Here, substrate binding is associated with a significant entropy loss that closely matches the activation entropy penalty for the uncatalyzed reaction in water, whereas the activation entropy for the rate-limiting catalytic step in the enzyme is close to zero. Herein, we report extensive computer simulations of the cytidine deaminase reaction and its temperature dependence. The energetics of the catalytic reaction is first evaluated by density functional theory calculations. These results are then used to parametrize an empirical valence bond description of the reaction, which allows efficient sampling by molecular dynamics simulations and computation of Arrhenius plots. The thermodynamic activation parameters calculated by this approach are in excellent agreement with experimental data and indeed show an activation entropy close to zero for the rate-limiting transition state. However, the origin of this effect is a change of reaction mechanism compared the uncatalyzed reaction. The enzyme operates by hydroxide ion attack, which is intrinsically associated with a favorable activation entropy. Hence, this has little to do with utilization of binding free energy to pay the entropic penalty but rather reflects how a preorganized active site can stabilize a reaction path that is not operational in solution.

Black hole thermodynamical entropy

International Nuclear Information System (INIS)

Tsallis, Constantino; Cirto, Leonardo J.L.

2013-01-01

As early as 1902, Gibbs pointed out that systems whose partition function diverges, e.g. gravitation, lie outside the validity of the Boltzmann-Gibbs (BG) theory. Consistently, since the pioneering Bekenstein-Hawking results, physically meaningful evidence (e.g., the holographic principle) has accumulated that the BG entropy S BG of a (3+1) black hole is proportional to its area L 2 (L being a characteristic linear length), and not to its volume L 3 . Similarly it exists the area law, so named because, for a wide class of strongly quantum-entangled d-dimensional systems, S BG is proportional to lnL if d=1, and to L d-1 if d>1, instead of being proportional to L d (d ≥ 1). These results violate the extensivity of the thermodynamical entropy of a d-dimensional system. This thermodynamical inconsistency disappears if we realize that the thermodynamical entropy of such nonstandard systems is not to be identified with the BG additive entropy but with appropriately generalized nonadditive entropies. Indeed, the celebrated usefulness of the BG entropy is founded on hypothesis such as relatively weak probabilistic correlations (and their connections to ergodicity, which by no means can be assumed as a general rule of nature). Here we introduce a generalized entropy which, for the Schwarzschild black hole and the area law, can solve the thermodynamic puzzle. (orig.)

Entropy-Corrected Holographic Dark Energy

International Nuclear Information System (INIS)

Wei Hao

2009-01-01

The holographic dark energy (HDE) is now an interesting candidate of dark energy, which has been studied extensively in the literature. In the derivation of HDE, the black hole entropy plays an important role. In fact, the entropy-area relation can be modified due to loop quantum gravity or other reasons. With the modified entropy-area relation, we propose the so-called 'entropy-corrected holographic dark energy' (ECHDE) in the present work. We consider many aspects of ECHDE and find some interesting results. In addition, we briefly consider the so-called 'entropy-corrected agegraphic dark energy' (ECADE). (geophysics, astronomy, and astrophysics)

Variations mechanism in entropy of wave height field and its relation with thermodynamic entropy

Institute of Scientific and Technical Information of China (English)

无

2006-01-01

This paper gives a brief description of annual period and seasonal variation in the wave height field entropy in the northeastern Pacific. A calculation of the quantity of the, received by lithosphere systems in the northern hemisphere is introduced. The wave heat field entropy is compared with the difference in the quantity of the sun's radiation heat. Analysis on the transfer method, period and lag of this seasonal variation led to the conclusion that the annual period and seasonal variation in the entropy of the wave height field in the Northwestern Pacific is due to the seasonal variation of the sun's radiation heat. Furthermore, the inconsistency between thermodynamic entropy and information entropy was studied.

Multivariate Generalized Multiscale Entropy Analysis

Directory of Open Access Journals (Sweden)

Anne Humeau-Heurtier

2016-11-01

Full Text Available Multiscale entropy (MSE was introduced in the 2000s to quantify systems’ complexity. MSE relies on (i a coarse-graining procedure to derive a set of time series representing the system dynamics on different time scales; (ii the computation of the sample entropy for each coarse-grained time series. A refined composite MSE (rcMSE—based on the same steps as MSE—also exists. Compared to MSE, rcMSE increases the accuracy of entropy estimation and reduces the probability of inducing undefined entropy for short time series. The multivariate versions of MSE (MMSE and rcMSE (MrcMSE have also been introduced. In the coarse-graining step used in MSE, rcMSE, MMSE, and MrcMSE, the mean value is used to derive representations of the original data at different resolutions. A generalization of MSE was recently published, using the computation of different moments in the coarse-graining procedure. However, so far, this generalization only exists for univariate signals. We therefore herein propose an extension of this generalized MSE to multivariate data. The multivariate generalized algorithms of MMSE and MrcMSE presented herein (MGMSE and MGrcMSE, respectively are first analyzed through the processing of synthetic signals. We reveal that MGrcMSE shows better performance than MGMSE for short multivariate data. We then study the performance of MGrcMSE on two sets of short multivariate electroencephalograms (EEG available in the public domain. We report that MGrcMSE may show better performance than MrcMSE in distinguishing different types of multivariate EEG data. MGrcMSE could therefore supplement MMSE or MrcMSE in the processing of multivariate datasets.

Unification of field theory and maximum entropy methods for learning probability densities

Science.gov (United States)

Kinney, Justin B.

2015-09-01

The need to estimate smooth probability distributions (a.k.a. probability densities) from finite sampled data is ubiquitous in science. Many approaches to this problem have been described, but none is yet regarded as providing a definitive solution. Maximum entropy estimation and Bayesian field theory are two such approaches. Both have origins in statistical physics, but the relationship between them has remained unclear. Here I unify these two methods by showing that every maximum entropy density estimate can be recovered in the infinite smoothness limit of an appropriate Bayesian field theory. I also show that Bayesian field theory estimation can be performed without imposing any boundary conditions on candidate densities, and that the infinite smoothness limit of these theories recovers the most common types of maximum entropy estimates. Bayesian field theory thus provides a natural test of the maximum entropy null hypothesis and, furthermore, returns an alternative (lower entropy) density estimate when the maximum entropy hypothesis is falsified. The computations necessary for this approach can be performed rapidly for one-dimensional data, and software for doing this is provided.

Unification of field theory and maximum entropy methods for learning probability densities.

Science.gov (United States)

Kinney, Justin B

2015-09-01

The need to estimate smooth probability distributions (a.k.a. probability densities) from finite sampled data is ubiquitous in science. Many approaches to this problem have been described, but none is yet regarded as providing a definitive solution. Maximum entropy estimation and Bayesian field theory are two such approaches. Both have origins in statistical physics, but the relationship between them has remained unclear. Here I unify these two methods by showing that every maximum entropy density estimate can be recovered in the infinite smoothness limit of an appropriate Bayesian field theory. I also show that Bayesian field theory estimation can be performed without imposing any boundary conditions on candidate densities, and that the infinite smoothness limit of these theories recovers the most common types of maximum entropy estimates. Bayesian field theory thus provides a natural test of the maximum entropy null hypothesis and, furthermore, returns an alternative (lower entropy) density estimate when the maximum entropy hypothesis is falsified. The computations necessary for this approach can be performed rapidly for one-dimensional data, and software for doing this is provided.

On unified-entropy characterization of quantum channels

International Nuclear Information System (INIS)

Rastegin, A E

2012-01-01

We consider properties of quantum channels with the use of unified entropies. Extremal unravelings of quantum channel with respect to these entropies are examined. The concept of map entropy is extended in terms of the unified entropies. The map (q, s)-entropy is naturally defined as the unified (q, s)-entropy of a rescaled dynamical matrix of given quantum channel. Inequalities of Fannes type are obtained for introduced entropies in terms of both the trace and Frobenius norms of difference between corresponding dynamical matrices. Additivity properties of introduced map entropies are discussed. The known inequality of Lindblad with the entropy exchange is generalized to many of the unified entropies. For the tensor product of a pair of quantum channels, we derive a two-sided estimate on the output entropy of a maximally entangled input state. (paper)

Maximum Entropy Fundamentals

Directory of Open Access Journals (Sweden)

F. Topsøe

2001-09-01

Full Text Available Abstract: In its modern formulation, the Maximum Entropy Principle was promoted by E.T. Jaynes, starting in the mid-fifties. The principle dictates that one should look for a distribution, consistent with available information, which maximizes the entropy. However, this principle focuses only on distributions and it appears advantageous to bring information theoretical thinking more prominently into play by also focusing on the "observer" and on coding. This view was brought forward by the second named author in the late seventies and is the view we will follow-up on here. It leads to the consideration of a certain game, the Code Length Game and, via standard game theoretical thinking, to a principle of Game Theoretical Equilibrium. This principle is more basic than the Maximum Entropy Principle in the sense that the search for one type of optimal strategies in the Code Length Game translates directly into the search for distributions with maximum entropy. In the present paper we offer a self-contained and comprehensive treatment of fundamentals of both principles mentioned, based on a study of the Code Length Game. Though new concepts and results are presented, the reading should be instructional and accessible to a rather wide audience, at least if certain mathematical details are left aside at a rst reading. The most frequently studied instance of entropy maximization pertains to the Mean Energy Model which involves a moment constraint related to a given function, here taken to represent "energy". This type of application is very well known from the literature with hundreds of applications pertaining to several different elds and will also here serve as important illustration of the theory. But our approach reaches further, especially regarding the study of continuity properties of the entropy function, and this leads to new results which allow a discussion of models with so-called entropy loss. These results have tempted us to speculate over

Compressibility and rarefaction effects on entropy and entropy generation in micro/nano Couette flow using DSMC

International Nuclear Information System (INIS)

Ejtehadi, Omid; Esfahani, Javad Abolfazli; Roohi, Ehsan

2012-01-01

In the present work, compressible flow of argon gas in the famous problem of Couette flow in micro/nano-scale is considered and numerically analyzed using the direct simulation Monte Carlo (DSMC) method. The effects of compressibility and rarefaction on entropy and entropy generation in terms of viscous dissipation and thermal diffusion are studied in a wide range of Mach and Knudsen numbers and the observed physics are discussed. In this regard, we computed entropy by using its kinetic theory formulation in a microscopic way while the entropy generation distribution is achieved by applying a semi-microscopic approach and thoroughly free from equilibrium assumptions. The results of our simulations demonstrated that the entropy profiles are in accordance with the temperature profiles. It is also illustrated that the increase of Mach number will result in non-uniform entropy profiles with increase in the vicinity of the central regions of the channel. Moreover, generation of entropy in all regions of the domain stages clear growth. By contrast, increasing the Knudsen number has inverse effects such as: uniform entropy profiles and a falling off in entropy generation amount throughout the channel.

Entropy in Biology

Indian Academy of Sciences (India)

During the process of ageing, the balance shifts in the direction of anarchy. Death is ... tion of life and the laws of statistieal physics and entropy, both of which ... capable of doing work. ... defined by Ludwig Boltzmann in 1877, the entropy of the.

Entropy Generation and Human Aging: Lifespan Entropy and Effect of Physical Activity Level

Science.gov (United States)

Silva, Carlos; Annamalai, Kalyan

2008-06-01

The first and second laws of thermodynamics were applied to biochemical reactions typical of human metabolism. An open-system model was used for a human body. Energy conservation, availability and entropy balances were performed to obtain the entropy generated for the main food components. Quantitative results for entropy generation were obtained as a function of age using the databases from the U.S. Food and Nutrition Board (FNB) and Centers for Disease Control and Prevention (CDC), which provide energy requirements and food intake composition as a function of age, weight and stature. Numerical integration was performed through human lifespan for different levels of physical activity. Results were presented and analyzed. Entropy generated over the lifespan of average individuals (natural death) was found to be 11,404 kJ/ºK per kg of body mass with a rate of generation three times higher on infants than on the elderly. The entropy generated predicts a life span of 73.78 and 81.61 years for the average U.S. male and female individuals respectively, which are values that closely match the average lifespan from statistics (74.63 and 80.36 years). From the analysis of the effect of different activity levels, it is shown that entropy generated increases with physical activity, suggesting that exercise should be kept to a “healthy minimum” if entropy generation is to be minimized.

Preimage entropy dimension of topological dynamical systems

OpenAIRE

Liu, Lei; Zhou, Xiaomin; Zhou, Xiaoyao

2014-01-01

We propose a new definition of preimage entropy dimension for continuous maps on compact metric spaces, investigate fundamental properties of the preimage entropy dimension, and compare the preimage entropy dimension with the topological entropy dimension. The defined preimage entropy dimension holds various basic properties of topological entropy dimension, for example, the preimage entropy dimension of a subsystem is bounded by that of the original system and topologically conjugated system...

On S-mixing entropy of quantum channels

Science.gov (United States)

Mukhamedov, Farrukh; Watanabe, Noboru

2018-06-01

In this paper, an S-mixing entropy of quantum channels is introduced as a generalization of Ohya's S-mixing entropy. We investigate several properties of the introduced entropy. Moreover, certain relations between the S-mixing entropy and the existing map and output entropies of quantum channels are investigated as well. These relations allowed us to find certain connections between separable states and the introduced entropy. Hence, there is a sufficient condition to detect entangled states. Moreover, several properties of the introduced entropy are investigated. Besides, entropies of qubit and phase-damping channels are calculated.

Arterial Stiffness and Autonomic Modulation After Free-Weight Resistance Exercises in Resistance Trained Individuals.

Science.gov (United States)

Kingsley, J Derek; Mayo, Xián; Tai, Yu Lun; Fennell, Curtis

2016-12-01

Kingsley, JD, Mayo, X, Tai, YL, and Fennell, C. Arterial stiffness and autonomic modulation after free-weight resistance exercises in resistance trained individuals. J Strength Cond Res 30(12): 3373-3380, 2016-We investigated the effects of an acute bout of free-weight, whole-body resistance exercise consisting of the squat, bench press, and deadlift on arterial stiffness and cardiac autonomic modulation in 16 (aged 23 ± 3 years; mean ± SD) resistance-trained individuals. Arterial stiffness, autonomic modulation, and baroreflex sensitivity (BRS) were assessed at rest and after 3 sets of 10 repetitions at 75% 1-repetition maximum on each exercise with 2 minutes of rest between sets and exercises. Arterial stiffness was analyzed using carotid-femoral pulse wave velocity (cf-PWV). Linear heart rate variability (log transformed [ln] absolute and normalized units [nu] of low-frequency [LF] and high-frequency [HF] power) and nonlinear heart rate complexity (Sample Entropy [SampEn], Lempel-Ziv Entropy [LZEn]) were measured to determine autonomic modulation. BRS was measured by the sequence method. A 2 × 2 repeated measures analysis of variance (ANOVA) was used to analyze time (rest, recovery) across condition (acute resistance exercise, control). There were significant increases in cf-PWV (p = 0.05), heart rate (p = 0.0001), normalized LF (LFnu; p = 0.001), and the LF/HF ratio (p = 0.0001). Interactions were also noted for ln HF (p = 0.006), HFnu (p = 0.0001), SampEn (p = 0.001), LZEn (p = 0.005), and BRS (p = 0.0001) such that they significantly decreased during recovery from the resistance exercise compared with rest and the control. There was no effect on ln total power, or ln LF. These data suggest that a bout of resistance exercise using free-weights increases arterial stiffness and reduces vagal activity and BRS in comparison with a control session. Vagal tone may not be fully recovered up to 30 minutes after a resistance exercise bout.

Maximum Quantum Entropy Method

OpenAIRE

Sim, Jae-Hoon; Han, Myung Joon

2018-01-01

Maximum entropy method for analytic continuation is extended by introducing quantum relative entropy. This new method is formulated in terms of matrix-valued functions and therefore invariant under arbitrary unitary transformation of input matrix. As a result, the continuation of off-diagonal elements becomes straightforward. Without introducing any further ambiguity, the Bayesian probabilistic interpretation is maintained just as in the conventional maximum entropy method. The applications o...

Entropy: From Thermodynamics to Hydrology

Directory of Open Access Journals (Sweden)

Demetris Koutsoyiannis

2014-02-01

Full Text Available Some known results from statistical thermophysics as well as from hydrology are revisited from a different perspective trying: (a to unify the notion of entropy in thermodynamic and statistical/stochastic approaches of complex hydrological systems and (b to show the power of entropy and the principle of maximum entropy in inference, both deductive and inductive. The capability for deductive reasoning is illustrated by deriving the law of phase change transition of water (Clausius-Clapeyron from scratch by maximizing entropy in a formal probabilistic frame. However, such deductive reasoning cannot work in more complex hydrological systems with diverse elements, yet the entropy maximization framework can help in inductive inference, necessarily based on data. Several examples of this type are provided in an attempt to link statistical thermophysics with hydrology with a unifying view of entropy.

All Inequalities for the Relative Entropy

Science.gov (United States)

Ibinson, Ben; Linden, Noah; Winter, Andreas

2007-01-01

The relative entropy of two n-party quantum states is an important quantity exhibiting, for example, the extent to which the two states are different. The relative entropy of the states formed by reducing two n-party states to a smaller number m of parties is always less than or equal to the relative entropy of the two original n-party states. This is the monotonicity of relative entropy. Using techniques from convex geometry, we prove that monotonicity under restrictions is the only general inequality satisfied by quantum relative entropies. In doing so we make a connection to secret sharing schemes with general access structures: indeed, it turns out that the extremal rays of the cone defined by monotonicity are populated by classical secret sharing schemes. A surprising outcome is that the structure of allowed relative entropy values of subsets of multiparty states is much simpler than the structure of allowed entropy values. And the structure of allowed relative entropy values (unlike that of entropies) is the same for classical probability distributions and quantum states.

Algebraic entropy for algebraic maps

International Nuclear Information System (INIS)

Hone, A N W; Ragnisco, Orlando; Zullo, Federico

2016-01-01

We propose an extension of the concept of algebraic entropy, as introduced by Bellon and Viallet for rational maps, to algebraic maps (or correspondences) of a certain kind. The corresponding entropy is an index of the complexity of the map. The definition inherits the basic properties from the definition of entropy for rational maps. We give an example with positive entropy, as well as two examples taken from the theory of Bäcklund transformations. (letter)

Nonsymmetric entropy I: basic concepts and results

OpenAIRE

Liu, Chengshi

2006-01-01

A new concept named nonsymmetric entropy which generalizes the concepts of Boltzman's entropy and shannon's entropy, was introduced. Maximal nonsymmetric entropy principle was proven. Some important distribution laws were derived naturally from maximal nonsymmetric entropy principle.

Statistical mechanical theory of liquid entropy

International Nuclear Information System (INIS)

Wallace, D.C.

1993-01-01

The multiparticle correlation expansion for the entropy of a classical monatomic liquid is presented. This entropy expresses the physical picture in which there is no free particle motion, but rather, each atom moves within a cage formed by its neighbors. The liquid expansion, including only pair correlations, gives an excellent account of the experimental entropy of most liquid metals, of liquid argon, and the hard sphere liquid. The pair correlation entropy is well approximated by a universal function of temperature. Higher order correlation entropy, due to n-particle irreducible correlations for n≥3, is significant in only a few liquid metals, and its occurrence suggests the presence of n-body forces. When the liquid theory is applied to the study of melting, the author discovers the important classification of normal and anomalous melting, according to whether there is not or is a significant change in the electronic structure upon melting, and he discovers the universal disordering entropy for melting of a monatomic crystal. Interesting directions for future research are: extension to include orientational correlations of molecules, theoretical calculation of the entropy of water, application to the entropy of the amorphous state, and correlational entropy of compressed argon. The author clarifies the relation among different entropy expansions in the recent literature

Entropy and equilibrium via games of complexity

Science.gov (United States)

Topsøe, Flemming

2004-09-01

It is suggested that thermodynamical equilibrium equals game theoretical equilibrium. Aspects of this thesis are discussed. The philosophy is consistent with maximum entropy thinking of Jaynes, but goes one step deeper by deriving the maximum entropy principle from an underlying game theoretical principle. The games introduced are based on measures of complexity. Entropy is viewed as minimal complexity. It is demonstrated that Tsallis entropy ( q-entropy) and Kaniadakis entropy ( κ-entropy) can be obtained in this way, based on suitable complexity measures. A certain unifying effect is obtained by embedding these measures in a two-parameter family of entropy functions.

Enthalpy–entropy compensation

Indian Academy of Sciences (India)

Enthalpy–entropy compensation is the name given to the correlation sometimes observed between the estimates of the enthalpy and entropy of a reaction obtained from temperature-dependence data. Although the mainly artefactual nature of this correlation has been known for many years, the subject enjoys periodical ...

Selection of entropy-measure parameters for knowledge discovery in heart rate variability data.

Science.gov (United States)

Mayer, Christopher C; Bachler, Martin; Hörtenhuber, Matthias; Stocker, Christof; Holzinger, Andreas; Wassertheurer, Siegfried

2014-01-01

Heart rate variability is the variation of the time interval between consecutive heartbeats. Entropy is a commonly used tool to describe the regularity of data sets. Entropy functions are defined using multiple parameters, the selection of which is controversial and depends on the intended purpose. This study describes the results of tests conducted to support parameter selection, towards the goal of enabling further biomarker discovery. This study deals with approximate, sample, fuzzy, and fuzzy measure entropies. All data were obtained from PhysioNet, a free-access, on-line archive of physiological signals, and represent various medical conditions. Five tests were defined and conducted to examine the influence of: varying the threshold value r (as multiples of the sample standard deviation σ, or the entropy-maximizing rChon), the data length N, the weighting factors n for fuzzy and fuzzy measure entropies, and the thresholds rF and rL for fuzzy measure entropy. The results were tested for normality using Lilliefors' composite goodness-of-fit test. Consequently, the p-value was calculated with either a two sample t-test or a Wilcoxon rank sum test. The first test shows a cross-over of entropy values with regard to a change of r. Thus, a clear statement that a higher entropy corresponds to a high irregularity is not possible, but is rather an indicator of differences in regularity. N should be at least 200 data points for r = 0.2 σ and should even exceed a length of 1000 for r = rChon. The results for the weighting parameters n for the fuzzy membership function show different behavior when coupled with different r values, therefore the weighting parameters have been chosen independently for the different threshold values. The tests concerning rF and rL showed that there is no optimal choice, but r = rF = rL is reasonable with r = rChon or r = 0.2σ. Some of the tests showed a dependency of the test significance on the data at hand. Nevertheless, as the medical

On holographic defect entropy

International Nuclear Information System (INIS)

Estes, John; Jensen, Kristan; O’Bannon, Andy; Tsatis, Efstratios; Wrase, Timm

2014-01-01

We study a number of (3+1)- and (2+1)-dimensional defect and boundary conformal field theories holographically dual to supergravity theories. In all cases the defects or boundaries are planar, and the defects are codimension-one. Using holography, we compute the entanglement entropy of a (hemi-)spherical region centered on the defect (boundary). We define defect and boundary entropies from the entanglement entropy by an appropriate background subtraction. For some (3+1)-dimensional theories we find evidence that the defect/boundary entropy changes monotonically under certain renormalization group flows triggered by operators localized at the defect or boundary. This provides evidence that the g-theorem of (1+1)-dimensional field theories generalizes to higher dimensions

Entropy Generation and Human Aging: Lifespan Entropy and Effect of Physical Activity Level

Directory of Open Access Journals (Sweden)

Kalyan Annamalai

2008-06-01

Full Text Available The first and second laws of thermodynamics were applied to biochemical reactions typical of human metabolism. An open-system model was used for a human body. Energy conservation, availability and entropy balances were performed to obtain the entropy generated for the main food components. Quantitative results for entropy generation were obtained as a function of age using the databases from the U.S. Food and Nutrition Board (FNB and Centers for Disease Control and Prevention (CDC, which provide energy requirements and food intake composition as a function of age, weight and stature. Numerical integration was performed through human lifespan for different levels of physical activity. Results were presented and analyzed. Entropy generated over the lifespan of average individuals (natural death was found to be 11,404 kJ/ºK per kg of body mass with a rate of generation three times higher on infants than on the elderly. The entropy generated predicts a life span of 73.78 and 81.61 years for the average U.S. male and female individuals respectively, which are values that closely match the average lifespan from statistics (74.63 and 80.36 years. From the analysis of the effect of different activity levels, it is shown that entropy generated increases with physical activity, suggesting that exercise should be kept to a “healthy minimum” if entropy generation is to be minimized.

Entropy and cosmology.

Science.gov (United States)

Zucker, M. H.

This paper is a critical analysis and reassessment of entropic functioning as it applies to the question of whether the ultimate fate of the universe will be determined in the future to be "open" (expanding forever to expire in a big chill), "closed" (collapsing to a big crunch), or "flat" (balanced forever between the two). The second law of thermodynamics declares that entropy can only increase and that this principle extends, inevitably, to the universe as a whole. This paper takes the position that this extension is an unwarranted projection based neither on experience nonfact - an extrapolation that ignores the powerful effect of a gravitational force acting within a closed system. Since it was originally presented by Clausius, the thermodynamic concept of entropy has been redefined in terms of "order" and "disorder" - order being equated with a low degree of entropy and disorder with a high degree. This revised terminology more subjective than precise, has generated considerable confusion in cosmology in several critical instances. For example - the chaotic fireball of the big bang, interpreted by Stephen Hawking as a state of disorder (high entropy), is infinitely hot and, thermally, represents zero entropy (order). Hawking, apparently focusing on the disorderly "chaotic" aspect, equated it with a high degree of entropy - overlooking the fact that the universe is a thermodynamic system and that the key factor in evaluating the big-bang phenomenon is the infinitely high temperature at the early universe, which can only be equated with zero entropy. This analysis resolves this confusion and reestablishes entropy as a cosmological function integrally linked to temperature. The paper goes on to show that, while all subsystems contained within the universe require external sources of energization to have their temperatures raised, this requirement does not apply to the universe as a whole. The universe is the only system that, by itself can raise its own

Entropy maximization

Indian Academy of Sciences (India)

Abstract. It is shown that (i) every probability density is the unique maximizer of relative entropy in an appropriate class and (ii) in the class of all pdf f that satisfy. ∫ fhi dμ = λi for i = 1, 2,...,...k the maximizer of entropy is an f0 that is pro- portional to exp(. ∑ ci hi ) for some choice of ci . An extension of this to a continuum of.

Excess Entropy and Diffusivity

Indian Academy of Sciences (India)

First page Back Continue Last page Graphics. Excess Entropy and Diffusivity. Excess entropy scaling of diffusivity (Rosenfeld,1977). Analogous relationships also exist for viscosity and thermal conductivity.

Entropy of self-gravitating radiation

International Nuclear Information System (INIS)

Sorkin, R.D.; Wald, R.M.; Jiu, Z.Z.

1981-01-01

The entropy of self-gravitating radiation confined to a spherical box of radius R is examined in the context of general relativity. It is expected that configurations (i.e., initial data) which extremize total entropy will be spherically symmetric, time symmetric distributions of radiation in local thermodynamic equilibrium. Assuming this is the case, it is proved that extrema of S coincide precisely with static equilibrium configurations of the radiation fluid. Furthermore, dynamically stable equilibrium configurations are shown to coincide with local maxima of S. The equilibrium configurations and their entropies are calculated and their properties are discussed. However, it is shown that entropies higher than these local extrema can be achieved and, indeed, arbitrarily high entropies can be attained by configurations inside of or outside but arbitrarily near their own Schwarzschild radius. However, consideration is limited to configurations which are outside their own Schwarzschild radius by at least one radiation wavelength, then the entropy is bounded and it is found Ssub(max) < is approximately equal to MR, where M is the total mass. This supports the validity for self-gravitating systems of the Bekenstein upper limit on the entropy to energy ratio of material bodies. (author)

Entropy in molecular recognition by proteins.

Science.gov (United States)

Caro, José A; Harpole, Kyle W; Kasinath, Vignesh; Lim, Jackwee; Granja, Jeffrey; Valentine, Kathleen G; Sharp, Kim A; Wand, A Joshua

2017-06-20

Molecular recognition by proteins is fundamental to molecular biology. Dissection of the thermodynamic energy terms governing protein-ligand interactions has proven difficult, with determination of entropic contributions being particularly elusive. NMR relaxation measurements have suggested that changes in protein conformational entropy can be quantitatively obtained through a dynamical proxy, but the generality of this relationship has not been shown. Twenty-eight protein-ligand complexes are used to show a quantitative relationship between measures of fast side-chain motion and the underlying conformational entropy. We find that the contribution of conformational entropy can range from favorable to unfavorable, which demonstrates the potential of this thermodynamic variable to modulate protein-ligand interactions. For about one-quarter of these complexes, the absence of conformational entropy would render the resulting affinity biologically meaningless. The dynamical proxy for conformational entropy or "entropy meter" also allows for refinement of the contributions of solvent entropy and the loss in rotational-translational entropy accompanying formation of high-affinity complexes. Furthermore, structure-based application of the approach can also provide insight into long-lived specific water-protein interactions that escape the generic treatments of solvent entropy based simply on changes in accessible surface area. These results provide a comprehensive and unified view of the general role of entropy in high-affinity molecular recognition by proteins.

q-entropy for symbolic dynamical systems

International Nuclear Information System (INIS)

Zhao, Yun; Pesin, Yakov

2015-01-01

For symbolic dynamical systems we use the Carathéodory construction as described in (Pesin 1997 Dimension Theory in Dynamical Systems, ConTemporary Views and Applications (Chicago: University of Chicago Press)) to introduce the notions of q-topological and q-metric entropies. We describe some basic properties of these entropies and in particular, discuss relations between q-metric entropy and local metric entropy. Both q-topological and q-metric entropies are new invariants respectively under homeomorphisms and metric isomorphisms of dynamical systems. (paper)

A Maximum Entropy Approach to Loss Distribution Analysis

Directory of Open Access Journals (Sweden)

Marco Bee

2013-03-01

Full Text Available In this paper we propose an approach to the estimation and simulation of loss distributions based on Maximum Entropy (ME, a non-parametric technique that maximizes the Shannon entropy of the data under moment constraints. Special cases of the ME density correspond to standard distributions; therefore, this methodology is very general as it nests most classical parametric approaches. Sampling the ME distribution is essential in many contexts, such as loss models constructed via compound distributions. Given the difficulties in carrying out exact simulation,we propose an innovative algorithm, obtained by means of an extension of Adaptive Importance Sampling (AIS, for the approximate simulation of the ME distribution. Several numerical experiments confirm that the AIS-based simulation technique works well, and an application to insurance data gives further insights in the usefulness of the method for modelling, estimating and simulating loss distributions.

Entropy Maximization

Indian Academy of Sciences (India)

It is shown that (i) every probability density is the unique maximizer of relative entropy in an appropriate class and (ii) in the class of all pdf that satisfy ∫ f h i d = i for i = 1 , 2 , … , … k the maximizer of entropy is an f 0 that is proportional to exp ⁡ ( ∑ c i h i ) for some choice of c i . An extension of this to a continuum of ...

Entropy evaporated by a black hole

International Nuclear Information System (INIS)

Zurek, W.H.

1982-01-01

It is shown that the entropy of the radiation evaporated by an uncharged, nonrotating black hole into vacuum in the course of its lifetime is approximately (4/3) times the initial entropy of this black hole. Also considered is a thermodynamically reversible process in which an increase of black-hole entropy is equal to the decrease of the entropy of its surroundings. Implications of these results for the generalized second law of thermodynamics and for the interpretation of black-hole entropy are pointed out

Entropy and transverse section reconstruction

International Nuclear Information System (INIS)

Gullberg, G.T.

1976-01-01

A new approach to the reconstruction of a transverse section using projection data from multiple views incorporates the concept of maximum entropy. The principle of maximizing information entropy embodies the assurance of minimizing bias or prejudice in the reconstruction. Using maximum entropy is a necessary condition for the reconstructed image. This entropy criterion is most appropriate for 3-D reconstruction of objects from projections where the system is underdetermined or the data are limited statistically. This is the case in nuclear medicine time limitations in patient studies do not yield sufficient projections

Multivariate multiscale entropy of financial markets

Science.gov (United States)

Lu, Yunfan; Wang, Jun

2017-11-01

In current process of quantifying the dynamical properties of the complex phenomena in financial market system, the multivariate financial time series are widely concerned. In this work, considering the shortcomings and limitations of univariate multiscale entropy in analyzing the multivariate time series, the multivariate multiscale sample entropy (MMSE), which can evaluate the complexity in multiple data channels over different timescales, is applied to quantify the complexity of financial markets. Its effectiveness and advantages have been detected with numerical simulations with two well-known synthetic noise signals. For the first time, the complexity of four generated trivariate return series for each stock trading hour in China stock markets is quantified thanks to the interdisciplinary application of this method. We find that the complexity of trivariate return series in each hour show a significant decreasing trend with the stock trading time progressing. Further, the shuffled multivariate return series and the absolute multivariate return series are also analyzed. As another new attempt, quantifying the complexity of global stock markets (Asia, Europe and America) is carried out by analyzing the multivariate returns from them. Finally we utilize the multivariate multiscale entropy to assess the relative complexity of normalized multivariate return volatility series with different degrees.

Effects of Force Load, Muscle Fatigue, and Magnetic Stimulation on Surface Electromyography during Side Arm Lateral Raise Task: A Preliminary Study with Healthy Subjects.

Science.gov (United States)

Cao, Liu; Wang, Ying; Hao, Dongmei; Rong, Yao; Yang, Lin; Zhang, Song; Zheng, Dingchang

2017-01-01

The aim of this study was to quantitatively investigate the effects of force load, muscle fatigue, and extremely low-frequency (ELF) magnetic stimulation on surface electromyography (SEMG) signal features during side arm lateral raise task. SEMG signals were recorded from 18 healthy subjects on the anterior deltoid using a BIOSEMI ActiveTwo system during side lateral raise task (with the right arm 90 degrees away from the body) with three different loads on the forearm (0 kg, 1 kg, and 3 kg; their order was randomized between subjects). The arm maintained the loads until the subject felt exhausted. The first 10 s recording for each load was regarded as nonfatigue status and the last 10 s before the subject was exhausted was regarded as fatigue status. The subject was then given a five-minute resting between different loads. Two days later, the same experiment was repeated on every subject, and this time the ELF magnetic stimulation was applied to the subject's deltoid muscle during the five-minute rest period. Three commonly used SEMG features, root mean square (RMS), median frequency (MDF), and sample entropy (SampEn), were analyzed and compared between different loads, nonfatigue/fatigue status, and ELF stimulation and no stimulation. Variance analysis results showed that the effect of force load on RMS was significant ( p 0.05). In comparison with nonfatigue status, for all the different force loads with and without ELF stimulation, RMS was significantly larger at fatigue (all p < 0.001) and MDF and SampEn were significantly smaller (all p < 0.001).

Intra-Tumour Signalling Entropy Determines Clinical Outcome in Breast and Lung Cancer

Science.gov (United States)

Banerji, Christopher R. S.; Severini, Simone; Caldas, Carlos; Teschendorff, Andrew E.

2015-01-01

The cancer stem cell hypothesis, that a small population of tumour cells are responsible for tumorigenesis and cancer progression, is becoming widely accepted and recent evidence has suggested a prognostic and predictive role for such cells. Intra-tumour heterogeneity, the diversity of the cancer cell population within the tumour of an individual patient, is related to cancer stem cells and is also considered a potential prognostic indicator in oncology. The measurement of cancer stem cell abundance and intra-tumour heterogeneity in a clinically relevant manner however, currently presents a challenge. Here we propose signalling entropy, a measure of signalling pathway promiscuity derived from a sample’s genome-wide gene expression profile, as an estimate of the stemness of a tumour sample. By considering over 500 mixtures of diverse cellular expression profiles, we reveal that signalling entropy also associates with intra-tumour heterogeneity. By analysing 3668 breast cancer and 1692 lung adenocarcinoma samples, we further demonstrate that signalling entropy correlates negatively with survival, outperforming leading clinical gene expression based prognostic tools. Signalling entropy is found to be a general prognostic measure, valid in different breast cancer clinical subgroups, as well as within stage I lung adenocarcinoma. We find that its prognostic power is driven by genes involved in cancer stem cells and treatment resistance. In summary, by approximating both stemness and intra-tumour heterogeneity, signalling entropy provides a powerful prognostic measure across different epithelial cancers. PMID:25793737

Dynamical entropy for infinite quantum systems

International Nuclear Information System (INIS)

Hudetz, T.

1990-01-01

We review the recent physical application of the so-called Connes-Narnhofer-Thirring entropy, which is the successful quantum mechanical generalization of the classical Kolmogorov-Sinai entropy and, by its very conception, is a dynamical entropy for infinite quantum systems. We thus comparingly review also the physical applications of the classical dynamical entropy for infinite classical systems. 41 refs. (Author)

Structural transformations of heat treated Co-less high entropy alloys

Science.gov (United States)

Mitrica, D.; Tudor, A.; Rinaldi, A.; Soare, V.; Predescu, C.; Berbecaru, A.; Stoiciu, F.; Badilita, V.

2018-03-01

Co is considered to be one of the main ingredients in superalloys. Co is considered a critical element and its substitution is difficult due to its unique ability to form high temperature stable structures with high mechanical and corrosion/oxidation resistance. High entropy alloys (HEA) represent a relatively new concept in material design. HEA are characterised by a high number of alloying elements, in unusually high proportion. Due to their specific particularities, high entropy alloys tend to form predominant solid solution structures that develop potentially high chemical, physical and mechanical properties. Present paper is studying Co-less high entropy alloys with high potential in severe environment applications. The high entropy alloys based on Al-Cr-Fe-Mn-Ni system were prepared by induction melting and casting under protective atmosphere. The as-cast specimens were heat treated at various temperatures to determine the structure and property behaviour. Samples taken before and after heat treatment were investigated for chemical, physical, structural and mechanical characteristics. Sigma phase composition and heat treatment parameters had major influence over the resulted alloy structure and properties.

On the maximum entropy distributions of inherently positive nuclear data

Energy Technology Data Exchange (ETDEWEB)

Taavitsainen, A., E-mail: aapo.taavitsainen@gmail.com; Vanhanen, R.

2017-05-11

The multivariate log-normal distribution is used by many authors and statistical uncertainty propagation programs for inherently positive quantities. Sometimes it is claimed that the log-normal distribution results from the maximum entropy principle, if only means, covariances and inherent positiveness of quantities are known or assumed to be known. In this article we show that this is not true. Assuming a constant prior distribution, the maximum entropy distribution is in fact a truncated multivariate normal distribution – whenever it exists. However, its practical application to multidimensional cases is hindered by lack of a method to compute its location and scale parameters from means and covariances. Therefore, regardless of its theoretical disadvantage, use of other distributions seems to be a practical necessity. - Highlights: • Statistical uncertainty propagation requires a sampling distribution. • The objective distribution of inherently positive quantities is determined. • The objectivity is based on the maximum entropy principle. • The maximum entropy distribution is the truncated normal distribution. • Applicability of log-normal or normal distribution approximation is limited.

Time-evolution of the entropy of fluctuations in some biological systems as investigated by NMR

International Nuclear Information System (INIS)

Lenk, R.

1979-01-01

A simple expression for the entropy of fluctuations has been developed, using the tunnelling-effect model. This gives the possibility to estimate the changes and evolution of entropy in non-crystalline and biological samples by NMR investigations. On the other hand, the oscillatory character of the time-evolution of some properties, experimentally found in the investigated samples of plants, is interpreted in terms of the generalized master equation with an exponential memory function. (Auth.)

The Entropy of Words—Learnability and Expressivity across More than 1000 Languages

Directory of Open Access Journals (Sweden)

Christian Bentz

2017-06-01

Full Text Available The choice associated with words is a fundamental property of natural languages. It lies at the heart of quantitative linguistics, computational linguistics and language sciences more generally. Information theory gives us tools at hand to measure precisely the average amount of choice associated with words: the word entropy. Here, we use three parallel corpora, encompassing ca. 450 million words in 1916 texts and 1259 languages, to tackle some of the major conceptual and practical problems of word entropy estimation: dependence on text size, register, style and estimation method, as well as non-independence of words in co-text. We present two main findings: Firstly, word entropies display relatively narrow, unimodal distributions. There is no language in our sample with a unigram entropy of less than six bits/word. We argue that this is in line with information-theoretic models of communication. Languages are held in a narrow range by two fundamental pressures: word learnability and word expressivity, with a potential bias towards expressivity. Secondly, there is a strong linear relationship between unigram entropies and entropy rates. The entropy difference between words with and without co-textual information is narrowly distributed around ca. three bits/word. In other words, knowing the preceding text reduces the uncertainty of words by roughly the same amount across languages of the world.

Entropy Generation Across Earth's Bow Shock

Science.gov (United States)

Parks, George K.; McCarthy, Michael; Fu, Suiyan; Lee E. s; Cao, Jinbin; Goldstein, Melvyn L.; Canu, Patrick; Dandouras, Iannis S.; Reme, Henri; Fazakerley, Andrew;

Topological entropy of continuous functions on topological spaces

International Nuclear Information System (INIS)

Liu Lei; Wang Yangeng; Wei Guo

2009-01-01

Adler, Konheim and McAndrew introduced the concept of topological entropy of a continuous mapping for compact dynamical systems. Bowen generalized the concept to non-compact metric spaces, but Walters indicated that Bowen's entropy is metric-dependent. We propose a new definition of topological entropy for continuous mappings on arbitrary topological spaces (compactness, metrizability, even axioms of separation not necessarily required), investigate fundamental properties of the new entropy, and compare the new entropy with the existing ones. The defined entropy generates that of Adler, Konheim and McAndrew and is metric-independent for metrizable spaces. Yet, it holds various basic properties of Adler, Konheim and McAndrew's entropy, e.g., the entropy of a subsystem is bounded by that of the original system, topologically conjugated systems have a same entropy, the entropy of the induced hyperspace system is larger than or equal to that of the original system, and in particular this new entropy coincides with Adler, Konheim and McAndrew's entropy for compact systems

Problems in black-hole entropy interpretation

International Nuclear Information System (INIS)

Liberati, S.

1997-01-01

In this work some proposals for black-hole entropy interpretation are exposed and investigated. In particular, the author will firstly consider the so-called 'entanglement entropy' interpretation, in the framework of the brick wall model and the divergence problem arising in the one-loop calculations of various thermodynamical quantities, like entropy, internal energy and heat capacity. It is shown that the assumption of equality of entanglement entropy and Bekenstein-Hawking one appears to give inconsistent results. These will be a starting point for a different interpretation of black.hole entropy based on peculiar topological structures of manifolds with 'intrinsic' thermodynamical features. It is possible to show an exact relation between black-hole gravitational entropy and topology of these Euclidean space-times. the expression for the Euler characteristic, through the Gauss-Bonnet integral, and the one for entropy for gravitational instantons are proposed in a form which makes the relation between these self-evident. Using this relation he propose a generalization of the Bekenstein-Hawking entropy in which the former and Euler characteristic are related in the equation S = χA / 8. Finally, he try to expose some conclusions and hypotheses about possible further development of this research

Single-cell entropy for accurate estimation of differentiation potency from a cell's transcriptome

Science.gov (United States)

Teschendorff, Andrew E.; Enver, Tariq

2017-01-01

The ability to quantify differentiation potential of single cells is a task of critical importance. Here we demonstrate, using over 7,000 single-cell RNA-Seq profiles, that differentiation potency of a single cell can be approximated by computing the signalling promiscuity, or entropy, of a cell's transcriptome in the context of an interaction network, without the need for feature selection. We show that signalling entropy provides a more accurate and robust potency estimate than other entropy-based measures, driven in part by a subtle positive correlation between the transcriptome and connectome. Signalling entropy identifies known cell subpopulations of varying potency and drug resistant cancer stem-cell phenotypes, including those derived from circulating tumour cells. It further reveals that expression heterogeneity within single-cell populations is regulated. In summary, signalling entropy allows in silico estimation of the differentiation potency and plasticity of single cells and bulk samples, providing a means to identify normal and cancer stem-cell phenotypes. PMID:28569836

Gravitational entropies in LTB dust models

International Nuclear Information System (INIS)

Sussman, Roberto A; Larena, Julien

2014-01-01

We consider generic Lemaître–Tolman–Bondi (LTB) dust models to probe the gravitational entropy proposals of Clifton, Ellis and Tavakol (CET) and of Hosoya and Buchert (HB). We also consider a variant of the HB proposal based on a suitable quasi-local scalar weighted average. We show that the conditions for entropy growth for all proposals are directly related to a negative correlation of similar fluctuations of the energy density and Hubble scalar. While this correlation is evaluated locally for the CET proposal, it must be evaluated in a non-local domain dependent manner for the two HB proposals. By looking at the fulfilment of these conditions at the relevant asymptotic limits we are able to provide a well grounded qualitative description of the full time evolution and radial asymptotic scaling of the three entropies in generic models. The following rigorous analytic results are obtained for the three proposals: (i) entropy grows when the density growing mode is dominant, (ii) all ever-expanding hyperbolic models reach a stable terminal equilibrium characterized by an inhomogeneous entropy maximum in their late time evolution; (iii) regions with decaying modes and collapsing elliptic models exhibit unstable equilibria associated with an entropy minimum (iv) near singularities the CET entropy diverges while the HB entropies converge; (v) the CET entropy converges for all models in the radial asymptotic range, whereas the HB entropies only converge for models asymptotic to a Friedmann–Lemaître–Robertson–Walker background. The fact that different independent proposals yield fairly similar conditions for entropy production, time evolution and radial scaling in generic LTB models seems to suggest that their common notion of a ‘gravitational entropy’ may be a theoretically robust concept applicable to more general spacetimes. (paper)

Information Entropy Production of Maximum Entropy Markov Chains from Spike Trains

Directory of Open Access Journals (Sweden)

Rodrigo Cofré

2018-01-01

Full Text Available The spiking activity of neuronal networks follows laws that are not time-reversal symmetric; the notion of pre-synaptic and post-synaptic neurons, stimulus correlations and noise correlations have a clear time order. Therefore, a biologically realistic statistical model for the spiking activity should be able to capture some degree of time irreversibility. We use the thermodynamic formalism to build a framework in the context maximum entropy models to quantify the degree of time irreversibility, providing an explicit formula for the information entropy production of the inferred maximum entropy Markov chain. We provide examples to illustrate our results and discuss the importance of time irreversibility for modeling the spike train statistics.

Enthalpy-entropy compensation in protein unfolding

Institute of Scientific and Technical Information of China (English)

无

2000-01-01

Enthalpy-entropy compensation was found to be a universal law in protein unfolding based on over 3 000 experimental data. Water molecular reorganization accompanying the protein unfolding was suggested as the origin of the enthalpy-entropy compensation in protein unfolding. It is indicated that the enthalpy-entropy compensation constitutes the physical foundation that satisfies the biological need of the small free energy changes in protein unfolding, without the sacrifice of the bio-diversity of proteins. The enthalpy-entropy compensation theory proposed herein also provides valuable insights into the Privalov's puzzle of enthalpy and entropy convergence in protein unfolding.

Entropy inequalities from reflection positivity

International Nuclear Information System (INIS)

Casini, H

2010-01-01

We investigate the question of whether the entropy and the Renyi entropies of the vacuum state reduced to a region of space can be represented in terms of correlators in quantum field theory. In this case, the positivity relations for the correlators are mapped into inequalities for the entropies. We write them using a real-time version of reflection positivity, which can be generalized to general quantum systems. Using this generalization we can prove an infinite sequence of inequalities which are obeyed by the Renyi entropies of integer index. There is one independent inequality involving any number of different subsystems. In quantum field theory the inequalities acquire a simple geometrical form and are consistent with the integer index Renyi entropies being given by vacuum expectation values of twisting operators in the Euclidean formulation. Several possible generalizations and specific examples are analyzed

The Entropy of Co-Compact Open Covers

Directory of Open Access Journals (Sweden)

Steven Bourquin

2013-06-01

Full Text Available Co-compact entropy is introduced as an invariant of topological conjugation for perfect mappings defined on any Hausdorff space (compactness and metrizability are not necessarily required. This is achieved through the consideration of co-compact covers of the space. The advantages of co-compact entropy include: (1 it does not require the space to be compact and, thus, generalizes Adler, Konheim and McAndrew’s topological entropy of continuous mappings on compact dynamical systems; and (2 it is an invariant of topological conjugation, compared to Bowen’s entropy, which is metric-dependent. Other properties of co-compact entropy are investigated, e.g., the co-compact entropy of a subsystem does not exceed that of the whole system. For the linear system, (R; f, defined by f(x = 2x, the co-compact entropy is zero, while Bowen’s entropy for this system is at least log 2. More generally, it is found that co-compact entropy is a lower bound of Bowen’s entropies, and the proof of this result also generates the Lebesgue Covering Theorem to co-compact open covers of non-compact metric spaces.

Maximum-Entropy Inference with a Programmable Annealer

Science.gov (United States)

Chancellor, Nicholas; Szoke, Szilard; Vinci, Walter; Aeppli, Gabriel; Warburton, Paul A.

2016-03-01

Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the other hand takes the form of a Boltzmann distribution over the ground and excited states of the cost function to correct for noise. Here we use a programmable annealer for the information decoding problem which we simulate as a random Ising model in a field. We show experimentally that finite temperature maximum entropy decoding can give slightly better bit-error-rates than the maximum likelihood approach, confirming that useful information can be extracted from the excited states of the annealer. Furthermore we introduce a bit-by-bit analytical method which is agnostic to the specific application and use it to show that the annealer samples from a highly Boltzmann-like distribution. Machines of this kind are therefore candidates for use in a variety of machine learning applications which exploit maximum entropy inference, including language processing and image recognition.

On Thermodynamic Interpretation of Transfer Entropy

Directory of Open Access Journals (Sweden)

Don C. Price

2013-02-01

Full Text Available We propose a thermodynamic interpretation of transfer entropy near equilibrium, using a specialised Boltzmann’s principle. The approach relates conditional probabilities to the probabilities of the corresponding state transitions. This in turn characterises transfer entropy as a difference of two entropy rates: the rate for a resultant transition and another rate for a possibly irreversible transition within the system affected by an additional source. We then show that this difference, the local transfer entropy, is proportional to the external entropy production, possibly due to irreversibility. Near equilibrium, transfer entropy is also interpreted as the difference in equilibrium stabilities with respect to two scenarios: a default case and the case with an additional source. Finally, we demonstrated that such a thermodynamic treatment is not applicable to information flow, a measure of causal effect.

Entropy type complexity of quantum processes

International Nuclear Information System (INIS)

Watanabe, Noboru

2014-01-01

von Neumann entropy represents the amount of information in the quantum state, and this was extended by Ohya for general quantum systems [10]. Umegaki first defined the quantum relative entropy for σ-finite von Neumann algebras, which was extended by Araki, and Uhlmann, for general von Neumann algebras and *-algebras, respectively. In 1983 Ohya introduced the quantum mutual entropy by using compound states; this describes the amount of information correctly transmitted through the quantum channel, which was also extended by Ohya for general quantum systems. In this paper, we briefly explain Ohya's S-mixing entropy and the quantum mutual entropy for general quantum systems. By using structure equivalent class, we will introduce entropy type functionals based on quantum information theory to improve treatment for the Gaussian communication process. (paper)

Notes on entanglement entropy in string theory

International Nuclear Information System (INIS)

He, Song; Numasawa, Tokiro; Takayanagi, Tadashi; Watanabe, Kento

2015-01-01

In this paper, we study the conical entropy in string theory in the simplest setup of dividing the nine dimensional space into two halves. This corresponds to the leading quantum correction to the horizon entropy in string theory on the Rindler space. This entropy is also called the conical entropy and includes surface term contributions. We first derive a new simple formula of the conical entropy for any free higher spin fields. Then we apply this formula to computations of conical entropy in open and closed superstring. In our analysis of closed string, we study the twisted conical entropy defined by making use of string theory on Melvin backgrounds. This quantity is easier to calculate owing to the folding trick. Our analysis shows that the conical entropy in closed superstring is UV finite owing to the string scale cutoff.

Entropy and Entropy Production: Old Misconceptions and New Breakthroughs

Directory of Open Access Journals (Sweden)

Leonid M. Martyushev

2013-03-01

Full Text Available Persistent misconceptions existing for dozens of years and influencing progress in various fields of science are sometimes encountered in the scientific and especially, the popular-science literature. The present brief review deals with two such interrelated misconceptions (misunderstandings. The first misunderstanding: entropy is a measure of disorder. This is an old and very common opinion. The second misconception is that the entropy production minimizes in the evolution of nonequilibrium systems. However, as it has recently become clear, evolution (progress in Nature demonstrates the opposite, i.e., maximization of the entropy production. The principal questions connected with this maximization are considered herein. The two misconceptions mentioned above can lead to the apparent contradiction between the conclusions of modern thermodynamics and the basic conceptions of evolution existing in biology. In this regard, the analysis of these issues seems extremely important and timely as it contributes to the deeper understanding of the laws of development of the surrounding World and the place of humans in it.

A Note on Quantum Entropy

International Nuclear Information System (INIS)

Hansen, Frank

2016-01-01

Incremental information, as measured by the quantum entropy, is increasing when two ensembles are united. This result was proved by Lieb and Ruskai, and it is the foundation for the proof of strong subadditivity of quantum entropy. We present a truly elementary proof of this fact in the context of the broader family of matrix entropies introduced by Chen and Tropp.

A Note on Quantum Entropy

Energy Technology Data Exchange (ETDEWEB)

Hansen, Frank, E-mail: frank.hansen@m.tohoku.ac.jp [Tohoku University, Institute for Excellence in Higher Education (Japan)

2016-06-15

Incremental information, as measured by the quantum entropy, is increasing when two ensembles are united. This result was proved by Lieb and Ruskai, and it is the foundation for the proof of strong subadditivity of quantum entropy. We present a truly elementary proof of this fact in the context of the broader family of matrix entropies introduced by Chen and Tropp.

Entropy function and universality of entropy-area relation for small black holes

International Nuclear Information System (INIS)

Cai Ronggen; Chen, C.-M.; Maeda, Kei-ichi; Ohta, Nobuyoshi; Pang Dawei

2008-01-01

We discuss the entropy-area relation for the small black holes with higher curvature corrections by using the entropy function formalism and field redefinition method. We show that the entropy S BH of the small black hole is proportional to its horizon area A. In particular, we find a universal result that S BH =A/2G, the ratio is 2 times of Bekenstein-Hawking entropy-area formula in many cases of physical interest. In four dimensions, the universal relation is always true irrespective of the coefficients of the higher-order terms if the dilaton couplings are the same, which is the case for string effective theory, while in five dimensions, the relation again holds irrespective of the overall coefficient if the higher-order corrections are in the GB combination. We also discuss how this result generalizes to known physically interesting cases with Lovelock correction terms in various dimensions, and possible implications of the universal relation.

Entropy Production of Stars

Directory of Open Access Journals (Sweden)

Leonid M. Martyushev

2015-06-01

Full Text Available The entropy production (inside the volume bounded by a photosphere of main-sequence stars, subgiants, giants, and supergiants is calculated based on B–V photometry data. A non-linear inverse relationship of thermodynamic fluxes and forces as well as an almost constant specific (per volume entropy production of main-sequence stars (for 95% of stars, this quantity lies within 0.5 to 2.2 of the corresponding solar magnitude is found. The obtained results are discussed from the perspective of known extreme principles related to entropy production.

Weak entropy inequalities and entropic convergence

Institute of Scientific and Technical Information of China (English)

2008-01-01

A criterion for algebraic convergence of the entropy is presented and an algebraic convergence result for the entropy of an exclusion process is improved. A weak entropy inequality is considered and its relationship to entropic convergence is discussed.

Relative entropy and the RG flow

Energy Technology Data Exchange (ETDEWEB)

Casini, Horacio; Testé, Eduardo; Torroba, Gonzalo [Centro Atómico Bariloche and CONICET,S.C. de Bariloche, Río Negro, R8402AGP (Argentina)

2017-03-16

We consider the relative entropy between vacuum states of two different theories: a conformal field theory (CFT), and the CFT perturbed by a relevant operator. By restricting both states to the null Cauchy surface in the causal domain of a sphere, we make the relative entropy equal to the difference of entanglement entropies. As a result, this difference has the positivity and monotonicity properties of relative entropy. From this it follows a simple alternative proof of the c-theorem in d=2 space-time dimensions and, for d>2, the proof that the coefficient of the area term in the entanglement entropy decreases along the renormalization group (RG) flow between fixed points. We comment on the regimes of convergence of relative entropy, depending on the space-time dimensions and the conformal dimension Δ of the perturbation that triggers the RG flow.

Large Field Inflation and Gravitational Entropy

DEFF Research Database (Denmark)

Kaloper, Nemanja; Kleban, Matthew; Lawrence, Albion

2016-01-01

species will lead to a violation of the covariant entropy bound at large $N$. If so, requiring the validity of the covariant entropy bound could limit the number of light species and their couplings, which in turn could severely constrain axion-driven inflation. Here we show that there is no such problem...... entropy of de Sitter or near-de Sitter backgrounds at leading order. Working in detail with $N$ scalar fields in de Sitter space, renormalized to one loop order, we show that the gravitational entropy automatically obeys the covariant entropy bound. Furthermore, while the axion decay constant is a strong...... in this light, and show that they are perfectly consistent with the covariant entropy bound. Thus, while quantum gravity might yet spoil large field inflation, holographic considerations in the semiclassical theory do not obstruct it....

Entropy Budget for Hawking Evaporation

Directory of Open Access Journals (Sweden)

Ana Alonso-Serrano

2017-07-01

Full Text Available Blackbody radiation, emitted from a furnace and described by a Planck spectrum, contains (on average an entropy of 3 . 9 ± 2 . 5 bits per photon. Since normal physical burning is a unitary process, this amount of entropy is compensated by the same amount of “hidden information” in correlations between the photons. The importance of this result lies in the posterior extension of this argument to the Hawking radiation from black holes, demonstrating that the assumption of unitarity leads to a perfectly reasonable entropy/information budget for the evaporation process. In order to carry out this calculation, we adopt a variant of the “average subsystem” approach, but consider a tripartite pure system that includes the influence of the rest of the universe, and which allows “young” black holes to still have a non-zero entropy; which we identify with the standard Bekenstein entropy.

The dynamical entropy of quantum systems

International Nuclear Information System (INIS)

Connes, A.; Narnhofer, H.; Thirring, W.

1987-01-01

The definition of the dynamical entropy for automorphisms of C * - algebras is represented. Several properties are discussed; especially it is argued that the entropy of the shift can be shown in special cases to be equal with the entropy density. (Author)

Spontaneous entropy decrease and its statistical formula

OpenAIRE

Xing, Xiu-San

2007-01-01

Why can the world resist the law of entropy increase and produce self-organizing structure? Does the entropy of an isolated system always only increase and never decrease? Can be thermodymamic degradation and self-organizing evolution united? How to unite? In this paper starting out from nonequilibrium entropy evolution equation we proved that a new entropy decrease could spontaneously emerge in nonequilibrium system with internal attractive interaction. This new entropy decrease coexists wit...

Magnetic entropy-change in La0.67-xBixCa0.33MnO3 compound

International Nuclear Information System (INIS)

Atalay, S.; Kolat, V.S.; Gencer, H.; Adiguzel, H.I.

2006-01-01

Bi doped lanthanum manganites with the chemical composition of La 0.67-x Bi x Ca 0.33 MnO 3 (x=0, 0.05, 0.1, 0.2) were prepared by the standard solid-state process. The Curie temperatures were measured to be 267K for x=0, 248K for x=0.05, 244K for x=0.1 and 229K for x=0.2 samples. It was found that the maximum value of the magnetic entropy change |ΔS m | has reached the highest value of 6.08J/kgK at 3T for the composition with x=0.05. Nearly the same maximum entropy change was observed for the x=0 sample. A large decrease in the magnitude of the entropy change was observed for the x=0.2 sample

Entropy Maximization as a Basis for Information Recovery in Dynamic Economic Behavioral Systems

Directory of Open Access Journals (Sweden)

George Judge

2015-02-01

Full Text Available As a basis for information recovery in open dynamic microeconomic systems, we emphasize the connection between adaptive intelligent behavior, causal entropy maximization and self-organized equilibrium seeking behavior. This entropy-based causal adaptive behavior framework permits the use of information-theoretic methods as a solution basis for the resulting pure and stochastic inverse economic-econometric problems. We cast the information recovery problem in the form of a binary network and suggest information-theoretic methods to recover estimates of the unknown binary behavioral parameters without explicitly sampling the configuration-arrangement of the sample space.

Black hole versus cosmological horizon entropy

International Nuclear Information System (INIS)

Davis, Tamara M; Davies, P C W; Lineweaver, Charles H

2003-01-01

The generalized second law of thermodynamics states that entropy always increases when all event horizons are attributed with an entropy proportional to their area. We test the generalized second law by investigating the change in entropy when dust, radiation and black holes cross a cosmological event horizon. We generalize for flat, open and closed Friedmann-Robertson-Walker universes by using numerical calculations to determine the cosmological horizon evolution. In most cases, the loss of entropy from within the cosmological horizon is more than balanced by an increase in cosmological event horizon entropy, maintaining the validity of the generalized second law of thermodynamics. However, an intriguing set of open universe models shows an apparent entropy decrease when black holes disappear over the cosmological event horizon. We anticipate that this apparent violation of the generalized second law will disappear when solutions are available for black holes embedded in arbitrary backgrounds

Entropy of uremia and dialysis technology.

Science.gov (United States)

Ronco, Claudio

2013-01-01

The second law of thermodynamics applies with local exceptions to patient history and therapy interventions. Living things preserve their low level of entropy throughout time because they receive energy from their surroundings in the form of food. They gain their order at the expense of disordering the nutrients they consume. Death is the thermodynamically favored state: it represents a large increase in entropy as molecular structure yields to chaos. The kidney is an organ dissipating large amounts of energy to maintain the level of entropy of the organism as low as possible. Diseases, and in particular uremia, represent conditions of rapid increase in entropy. Therapeutic strategies are oriented towards a reduction in entropy or at least a decrease in the speed of entropy increase. Uremia is a process accelerating the trend towards randomness and disorder (increase in entropy). Dialysis is a factor external to the patient that tends to reduce the level of entropy caused by kidney disease. Since entropy can only increase in closed systems, energy and work must be spent to limit the entropy of uremia. This energy should be adapted to the system (patient) and be specifically oriented and personalized. This includes a multidimensional effort to achieve an adequate dialysis that goes beyond small molecular weight solute clearance. It includes a biological plan for recovery of homeostasis and a strategy towards long-term rehabilitation of the patient. Such objectives can be achieved with a combination of technology and innovation to answer specific questions that are still present after 60 years of dialysis history. This change in the individual bioentropy may represent a local exception to natural trends as the patient could be considered an isolated universe responding to the classic laws of thermodynamics. Copyright © 2013 S. Karger AG, Basel.

Time Dependence of Entropy Flux and Entropy Production of a Dissipative Dynamical System Driven by Non-Gaussian Noise

International Nuclear Information System (INIS)

Guo Yongfeng; Xu Wei; Li Dongxi; Xie Wenxian

2008-01-01

A stochastic dissipative dynamical system driven by non-Gaussian noise is investigated. A general approximate Fokker-Planck equation of the system is derived through a path-integral approach. Based on the definition of Shannon's information entropy, the exact time dependence of entropy flux and entropy production of the system is calculated both in the absence and in the presence of non-equilibrium constraint. The present calculation can be used to interpret the interplay of the dissipative constant and non-Gaussian noise on the entropy flux and entropy production

Information-theoretical aspects of quantum-mechanical entropy

International Nuclear Information System (INIS)

Wehrl, A.

1990-01-01

Properties of the quantum ( = von Neumann) entropy S(ρ) -k Trρ lnρ, ρ being a compact operator, are proved first, and differences against the classical case, e.g. the Shannon entropy, are worked out. The main result is on the strong subadditivity of this quantum entropy. Then another entropy, a function not of the state but of the dynamics of the system, is considered as a quantum analogue of the classical Kolmogorov-Sinai-entropy. An attempt in defining such a quantity had only recently sucess in a paper of Connes, Narnhofer and Thirring. A definition of this entropy is given. 34 refs

Algorithmic randomness and physical entropy

International Nuclear Information System (INIS)

Zurek, W.H.

1989-01-01

Algorithmic randomness provides a rigorous, entropylike measure of disorder of an individual, microscopic, definite state of a physical system. It is defined by the size (in binary digits) of the shortest message specifying the microstate uniquely up to the assumed resolution. Equivalently, algorithmic randomness can be expressed as the number of bits in the smallest program for a universal computer that can reproduce the state in question (for instance, by plotting it with the assumed accuracy). In contrast to the traditional definitions of entropy, algorithmic randomness can be used to measure disorder without any recourse to probabilities. Algorithmic randomness is typically very difficult to calculate exactly but relatively easy to estimate. In large systems, probabilistic ensemble definitions of entropy (e.g., coarse-grained entropy of Gibbs and Boltzmann's entropy H=lnW, as well as Shannon's information-theoretic entropy) provide accurate estimates of the algorithmic entropy of an individual system or its average value for an ensemble. One is thus able to rederive much of thermodynamics and statistical mechanics in a setting very different from the usual. Physical entropy, I suggest, is a sum of (i) the missing information measured by Shannon's formula and (ii) of the algorithmic information content---algorithmic randomness---present in the available data about the system. This definition of entropy is essential in describing the operation of thermodynamic engines from the viewpoint of information gathering and using systems. These Maxwell demon-type entities are capable of acquiring and processing information and therefore can ''decide'' on the basis of the results of their measurements and computations the best strategy for extracting energy from their surroundings. From their internal point of view the outcome of each measurement is definite

Entropy of network ensembles

Science.gov (United States)

Bianconi, Ginestra

2009-03-01

In this paper we generalize the concept of random networks to describe network ensembles with nontrivial features by a statistical mechanics approach. This framework is able to describe undirected and directed network ensembles as well as weighted network ensembles. These networks might have nontrivial community structure or, in the case of networks embedded in a given space, they might have a link probability with a nontrivial dependence on the distance between the nodes. These ensembles are characterized by their entropy, which evaluates the cardinality of networks in the ensemble. In particular, in this paper we define and evaluate the structural entropy, i.e., the entropy of the ensembles of undirected uncorrelated simple networks with given degree sequence. We stress the apparent paradox that scale-free degree distributions are characterized by having small structural entropy while they are so widely encountered in natural, social, and technological complex systems. We propose a solution to the paradox by proving that scale-free degree distributions are the most likely degree distribution with the corresponding value of the structural entropy. Finally, the general framework we present in this paper is able to describe microcanonical ensembles of networks as well as canonical or hidden-variable network ensembles with significant implications for the formulation of network-constructing algorithms.

Entropy Production in Stochastics

Directory of Open Access Journals (Sweden)

Demetris Koutsoyiannis

2017-10-01

Full Text Available While the modern definition of entropy is genuinely probabilistic, in entropy production the classical thermodynamic definition, as in heat transfer, is typically used. Here we explore the concept of entropy production within stochastics and, particularly, two forms of entropy production in logarithmic time, unconditionally (EPLT or conditionally on the past and present having been observed (CEPLT. We study the theoretical properties of both forms, in general and in application to a broad set of stochastic processes. A main question investigated, related to model identification and fitting from data, is how to estimate the entropy production from a time series. It turns out that there is a link of the EPLT with the climacogram, and of the CEPLT with two additional tools introduced here, namely the differenced climacogram and the climacospectrum. In particular, EPLT and CEPLT are related to slopes of log-log plots of these tools, with the asymptotic slopes at the tails being most important as they justify the emergence of scaling laws of second-order characteristics of stochastic processes. As a real-world application, we use an extraordinary long time series of turbulent velocity and show how a parsimonious stochastic model can be identified and fitted using the tools developed.

Does black-hole entropy make sense

International Nuclear Information System (INIS)

Wilkins, D.

1979-01-01

Bekenstein and Hawking saved the second law of thermodynamics near a black hole by assigning to the hole an entropy Ssub(h) proportional to the area of its event horizon. It is tempting to assume that Ssub(h) possesses all the features commonly associated with the physical entropy. Kundt has shown, however, that Ssub(h) violates several reasonable physical expectations. This criticism is reviewed, augmenting it as follows: (a) Ssub(h) is a badly behaved state function requiring knowledge of the hole's future history; and (b) close analogs of event horizons in other space-times do not possess an 'entropy'. These questions are also discussed: (c) Is Ssub(h) suitable for all regions of a black-hole space-time. And (b) should Ssub(h) be attributed to the exterior of a white hole. One can retain Ssub(h) for the interior (respectively, exterior) of a black (respectively, white) hole, but is rejected as contrary to the information-theoretic derivation of horizon entropy given by Berkenstein. The total entropy defined by Kundt (all ordinary entropy on space-section cutting through the hole, no horizon term) and that of Bekenstein-Hawking (ordinary entropy outside horizon plus horizon term) appear to be complementary concepts with separate domains of validity. In the most natural choice, an observer inside a black hole will use Kundt's entropy, and one remaining outside that of Bekenstein-Hawking. (author)

Altered cardiorespiratory coupling in young male adults with excessive online gaming.

Science.gov (United States)

Chang, Jae Seung; Kim, Eun Young; Jung, Dooyoung; Jeong, Seong Hoon; Kim, Yeni; Roh, Myoung-Sun; Ahn, Yong Min; Hahm, Bong-Jin

2015-09-01

This study aimed to investigate changes in heart rate variability and cardiorespiratory coupling in male college students with problematic Internet use (PIU) excessive gaming type during action video game play to assess the relationship between PIU tendency and central autonomic regulation. Electrocardiograms and respiration were simultaneously recorded from 22 male participants with excessive online gaming and 22 controls during action video game play. Sample entropy (SampEn) was computed to assess autonomic regularity, and cross-SampEn was calculated to quantify autonomic coordination. During video game play, reduced cardiorespiratory coupling (CRC) was observed in individuals with PIU excessive gaming type compared with controls, implicating central autonomic dysregulation. The PIU tendency was associated with the severity of autonomic dysregulation. These findings indicate impaired CRC in PIU excessive gaming type, which may reflect alterations of central inhibitory control over autonomic responses to pleasurable online stimuli. Copyright © 2015 Elsevier B.V. All rights reserved.

Applications of Entropy in Finance: A Review

Directory of Open Access Journals (Sweden)

Guanqun Tong

2013-11-01

Full Text Available Although the concept of entropy is originated from thermodynamics, its concepts and relevant principles, especially the principles of maximum entropy and minimum cross-entropy, have been extensively applied in finance. In this paper, we review the concepts and principles of entropy, as well as their applications in the field of finance, especially in portfolio selection and asset pricing. Furthermore, we review the effects of the applications of entropy and compare them with other traditional and new methods.

Unification of field theory and maximum entropy methods for learning probability densities

OpenAIRE

Kinney, Justin B.

2014-01-01

The need to estimate smooth probability distributions (a.k.a. probability densities) from finite sampled data is ubiquitous in science. Many approaches to this problem have been described, but none is yet regarded as providing a definitive solution. Maximum entropy estimation and Bayesian field theory are two such approaches. Both have origins in statistical physics, but the relationship between them has remained unclear. Here I unify these two methods by showing that every maximum entropy de...

Wavelet entropy characterization of elevated intracranial pressure.

Science.gov (United States)

Xu, Peng; Scalzo, Fabien; Bergsneider, Marvin; Vespa, Paul; Chad, Miller; Hu, Xiao

2008-01-01

Intracranial Hypertension (ICH) often occurs for those patients with traumatic brain injury (TBI), stroke, tumor, etc. Pathology of ICH is still controversial. In this work, we used wavelet entropy and relative wavelet entropy to study the difference existed between normal and hypertension states of ICP for the first time. The wavelet entropy revealed the similar findings as the approximation entropy that entropy during ICH state is smaller than that in normal state. Moreover, with wavelet entropy, we can see that ICH state has the more focused energy in the low wavelet frequency band (0-3.1 Hz) than the normal state. The relative wavelet entropy shows that the energy distribution in the wavelet bands between these two states is actually different. Based on these results, we suggest that ICH may be formed by the re-allocation of oscillation energy within brain.

Entropy of international trades

Science.gov (United States)

Oh, Chang-Young; Lee, D.-S.

2017-05-01

The organization of international trades is highly complex under the collective efforts towards economic profits of participating countries given inhomogeneous resources for production. Considering the trade flux as the probability of exporting a product from a country to another, we evaluate the entropy of the world trades in the period 1950-2000. The trade entropy has increased with time, and we show that it is mainly due to the extension of trade partnership. For a given number of trade partners, the mean trade entropy is about 60% of the maximum possible entropy, independent of time, which can be regarded as a characteristic of the trade fluxes' heterogeneity and is shown to be derived from the scaling and functional behaviors of the universal trade-flux distribution. The correlation and time evolution of the individual countries' gross-domestic products and the number of trade partners show that most countries achieved their economic growth partly by extending their trade relationship.

Curvature Entropy for Curved Profile Generation

Directory of Open Access Journals (Sweden)

Koichiro Sato

2012-03-01

Full Text Available In a curved surface design, the overall shape features that emerge from combinations of shape elements are important. However, controlling the features of the overall shape in curved profiles is difficult using conventional microscopic shape information such as dimension. Herein two types of macroscopic shape information, curvature entropy and quadrature curvature entropy, quantitatively represent the features of the overall shape. The curvature entropy is calculated by the curvature distribution, and represents the complexity of a shape (one of the overall shape features. The quadrature curvature entropy is an improvement of the curvature entropy by introducing a Markov process to evaluate the continuity of a curvature and to approximate human cognition of the shape. Additionally, a shape generation method using a genetic algorithm as a calculator and the entropy as a shape generation index is presented. Finally, the applicability of the proposed method is demonstrated using the side view of an automobile as a design example.

Gradient Dynamics and Entropy Production Maximization

Science.gov (United States)

Janečka, Adam; Pavelka, Michal

2018-01-01

We compare two methods for modeling dissipative processes, namely gradient dynamics and entropy production maximization. Both methods require similar physical inputs-how energy (or entropy) is stored and how it is dissipated. Gradient dynamics describes irreversible evolution by means of dissipation potential and entropy, it automatically satisfies Onsager reciprocal relations as well as their nonlinear generalization (Maxwell-Onsager relations), and it has statistical interpretation. Entropy production maximization is based on knowledge of free energy (or another thermodynamic potential) and entropy production. It also leads to the linear Onsager reciprocal relations and it has proven successful in thermodynamics of complex materials. Both methods are thermodynamically sound as they ensure approach to equilibrium, and we compare them and discuss their advantages and shortcomings. In particular, conditions under which the two approaches coincide and are capable of providing the same constitutive relations are identified. Besides, a commonly used but not often mentioned step in the entropy production maximization is pinpointed and the condition of incompressibility is incorporated into gradient dynamics.

Entropy is in Flux V3.4

Science.gov (United States)

Kadanoff, Leo P.

2017-05-01

The science of thermodynamics was put together in the Nineteenth Century to describe large systems in equilibrium. One part of thermodynamics defines entropy for equilibrium systems and demands an ever-increasing entropy for non-equilibrium ones. Since thermodynamics does not define entropy out of equilibrium, pure thermodynamics cannot follow the details of how this increase occurs. However, starting with the work of Ludwig Boltzmann in 1872, and continuing to the present day, various models of non-equilibrium behavior have been put together with the specific aim of generalizing the concept of entropy to non-equilibrium situations. This kind of entropy has been termed kinetic entropy to distinguish it from the thermodynamic variety. Knowledge of kinetic entropy started from Boltzmann's insight about his equation for the time dependence of gaseous systems. In this paper, his result is stated as a definition of kinetic entropy in terms of a local equation for the entropy density. This definition is then applied to Landau's theory of the Fermi liquid thereby giving the kinetic entropy within that theory. The dynamics of many condensed matter systems including Fermi liquids, low temperature superfluids, and ordinary metals lend themselves to the definition of kinetic entropy. In fact, entropy has been defined and used for a wide variety of situations in which a condensed matter system has been allowed to relax for a sufficient period so that the very most rapid fluctuations have been ironed out. One of the broadest applications of non-equilibrium analysis considers quantum degenerate systems using Martin-Schwinger Green's functions (Phys Rev 115:1342-1373, 1959) as generalized Wigner functions, g^({p},ω ,{R},T). This paper describes once again how the quantum kinetic equations for these functions give locally defined conservation laws for mass momentum and energy. In local thermodynamic equilibrium, this kinetic theory enables a reasonable definition of the density

Algebraic entropy for differential-delay equations

OpenAIRE

Viallet, Claude M.

2014-01-01

We extend the definition of algebraic entropy to a class of differential-delay equations. The vanishing of the entropy, as a structural property of an equation, signals its integrability. We suggest a simple way to produce differential-delay equations with vanishing entropy from known integrable differential-difference equations.

The Wehrl entropy has Gaussian optimizers

DEFF Research Database (Denmark)

De Palma, Giacomo

2018-01-01

We determine the minimum Wehrl entropy among the quantum states with a given von Neumann entropy and prove that it is achieved by thermal Gaussian states. This result determines the relation between the von Neumann and the Wehrl entropies. The key idea is proving that the quantum-classical channel...

Single Particle Entropy in Heated Nuclei

International Nuclear Information System (INIS)

Guttormsen, M.; Chankova, R.; Hjorth-Jensen, M.; Rekstad, J.; Siem, S.; Sunde, A. C.; Syed, N. U. H.; Agvaanluvsan, U.; Schiller, A.; Voinov, A.

2006-01-01

The thermal motion of single particles represents the largest contribution to level density (or entropy) in atomic nuclei. The concept of single particle entropy is presented and shown to be an approximate extensive (additive) quantity for mid-shell nuclei. A few applications of single particle entropy are demonstrated

BiEntropy for Python v. 1.0

Energy Technology Data Exchange (ETDEWEB)

2018-03-15

This Python package provides high-performance implementations of the functions and examples presented in "BiEntropy - The Approximate Entropy of a Finite Binary String" by Grenville J. Croll, presented at ANPA 34 in 2013. https://arxiv.org/abs/1305.0954 According to the paper, BiEntropy is "a simple algorithm which computes the approximate entropy of a finite binary string of arbitrary length" using "a weighted average of the Shannon Entropies of the string and all but the last binary derivative of the string."

Nonextensive entropies derived from Gauss' principle

International Nuclear Information System (INIS)

Wada, Tatsuaki

2011-01-01

Gauss' principle in statistical mechanics is generalized for a q-exponential distribution in nonextensive statistical mechanics. It determines the associated stochastic and statistical nonextensive entropies which satisfy Greene-Callen principle concerning on the equivalence between microcanonical and canonical ensembles. - Highlights: → Nonextensive entropies are derived from Gauss' principle and ensemble equivalence. → Gauss' principle is generalized for a q-exponential distribution. → I have found the condition for satisfying Greene-Callen principle. → The associated statistical q-entropy is found to be normalized Tsallis entropy.

Entanglement entropy in top-down models

Energy Technology Data Exchange (ETDEWEB)

Jones, Peter A.R.; Taylor, Marika [Mathematical Sciences and STAG Research Centre, University of Southampton,Highfield, Southampton, SO17 1BJ (United Kingdom)

2016-08-26

We explore holographic entanglement entropy in ten-dimensional supergravity solutions. It has been proposed that entanglement entropy can be computed in such top-down models using minimal surfaces which asymptotically wrap the compact part of the geometry. We show explicitly in a wide range of examples that the holographic entanglement entropy thus computed agrees with the entanglement entropy computed using the Ryu-Takayanagi formula from the lower-dimensional Einstein metric obtained from reduction over the compact space. Our examples include not only consistent truncations but also cases in which no consistent truncation exists and Kaluza-Klein holography is used to identify the lower-dimensional Einstein metric. We then give a general proof, based on the Lewkowycz-Maldacena approach, of the top-down entanglement entropy formula.

Entanglement entropy in top-down models

International Nuclear Information System (INIS)

Jones, Peter A.R.; Taylor, Marika

2016-01-01

We explore holographic entanglement entropy in ten-dimensional supergravity solutions. It has been proposed that entanglement entropy can be computed in such top-down models using minimal surfaces which asymptotically wrap the compact part of the geometry. We show explicitly in a wide range of examples that the holographic entanglement entropy thus computed agrees with the entanglement entropy computed using the Ryu-Takayanagi formula from the lower-dimensional Einstein metric obtained from reduction over the compact space. Our examples include not only consistent truncations but also cases in which no consistent truncation exists and Kaluza-Klein holography is used to identify the lower-dimensional Einstein metric. We then give a general proof, based on the Lewkowycz-Maldacena approach, of the top-down entanglement entropy formula.

Repetitive head impacts do not affect postural control following a competitive athletic season.

Science.gov (United States)

Murray, Nicholas G; Grimes, Katelyn E; Shiflett, Eric D; Munkasy, Barry A; D'Amico, Nathan R; Mormile, Megan E; Powell, Douglas W; Buckley, Thomas A

2017-10-03

Evidence suggests that Repetitive Head Impacts (RHI) directly influence the brain over the course of a single contact collision season yet do not significantly impact a player's performance on the standard clinical concussion assessment battery. The purpose of this study was to investigate changes in static postural control after a season of RHI in Division I football athletes using more sensitive measures of postural control as compared to a non-head contact sports. Fourteen Division I football players (CON) (age=20.4±1.12years) and fourteen non-contact athletes (NON) (2 male, 11 female; age=19.85±1.21years) completed a single trial of two minutes of eyes open quiet upright stance on a force platform (1000Hz) prior to athletic participation (PRE) and at the end of the athletic season (POST). All CON athletes wore helmets outfitted with Head Impact Telemetry (HIT) sensors and total number of RHI and linear accelerations forces of each RHI were recorded. Center of pressure root mean square (RMS), peak excursion velocity (PEV), and sample entropy (SampEn) in the anteroposterior (AP) and mediolateral (ML) directions were calculated. CON group experienced 649.5±496.8 mean number of impacts, 27.1±3.0 mean linear accelerations, with ≈1% of total player impacts exceeded 98g over the course of the season. There were no significant interactions for group x time RMS in the AP (p=0.434) and ML (p=0.114) directions, PEV in the AP (p=0.262) and ML (p=0.977) directions, and SampEn in the AP (p=0.499) and ML (p=0.984) directions. In addition, no significant interactions for group were observed for RMS in the AP (p=0.105) and ML (p=0.272) directions, PEV in the AP (p=0.081) and ML (p=0.143) directions, and SampEn in the AP (p=0.583) and ML (p=0.129) directions. These results suggest that over the course of a single competitive season, RHI do not negatively impact postural control even when measured with sensitive non-linear metrics. Copyright © 2017 Elsevier B.V. All rights

Credal Networks under Maximum Entropy

OpenAIRE

Lukasiewicz, Thomas

2013-01-01

We apply the principle of maximum entropy to select a unique joint probability distribution from the set of all joint probability distributions specified by a credal network. In detail, we start by showing that the unique joint distribution of a Bayesian tree coincides with the maximum entropy model of its conditional distributions. This result, however, does not hold anymore for general Bayesian networks. We thus present a new kind of maximum entropy models, which are computed sequentially. ...

Holographic entanglement entropy and cyclic cosmology

Science.gov (United States)

Frampton, Paul H.

2018-06-01

We discuss a cyclic cosmology in which the visible universe, or introverse, is all that is accessible to an observer while the extroverse represents the total spacetime originating from the time when the dark energy began to dominate. It is argued that entanglement entropy of the introverse is the more appropriate quantity to render infinitely cyclic, rather than the entropy of the total universe. Since vanishing entanglement entropy implies disconnected spacetimes, at the turnaround when the introverse entropy is zero the disconnected extroverse can be jettisoned with impunity.

Entropy as a measure of diffusion

International Nuclear Information System (INIS)

Aghamohammadi, Amir; Fatollahi, Amir H.; Khorrami, Mohammad; Shariati, Ahmad

2013-01-01

The time variation of entropy, as an alternative to the variance, is proposed as a measure of the diffusion rate. It is shown that for linear and time-translationally invariant systems having a large-time limit for the density, at large times the entropy tends exponentially to a constant. For systems with no stationary density, at large times the entropy is logarithmic with a coefficient specifying the speed of the diffusion. As an example, the large-time behaviors of the entropy and the variance are compared for various types of fractional-derivative diffusions.

Entropy as a measure of diffusion

Energy Technology Data Exchange (ETDEWEB)

Aghamohammadi, Amir, E-mail: mohamadi@alzahra.ac.ir; Fatollahi, Amir H., E-mail: fath@alzahra.ac.ir; Khorrami, Mohammad, E-mail: mamwad@mailaps.org; Shariati, Ahmad, E-mail: shariati@mailaps.org

2013-10-15

The time variation of entropy, as an alternative to the variance, is proposed as a measure of the diffusion rate. It is shown that for linear and time-translationally invariant systems having a large-time limit for the density, at large times the entropy tends exponentially to a constant. For systems with no stationary density, at large times the entropy is logarithmic with a coefficient specifying the speed of the diffusion. As an example, the large-time behaviors of the entropy and the variance are compared for various types of fractional-derivative diffusions.

A Modified Entropy Generation Number for Heat Exchangers

Institute of Scientific and Technical Information of China (English)

无

1996-01-01

This paper demonstrates the difference between the entropy generation number method proposed by Bejian and the method of entropy generation per unit amount of heat transferred in analyzing the ther-modynamic performance of heat exchangers,points out the reason for leading to the above difference.A modified entropy generation number for evaluating the irreversibility of heat exchangers is proposed which is in consistent with the entropy generation per unit amount of heat transferred in entropy generation analysis.The entropy generated by friction is also investigated.Results show that when the entropy generated by friction in heat exchangers in taken into account,there is a minimum total entropy generation number while the NTU and the ratio of heat capacity rates vary.The existence of this minimum is the prerequisite of heat exchanger optimization.

Entropy of charged dilaton-axion black hole

International Nuclear Information System (INIS)

Ghosh, Tanwi; SenGupta, Soumitra

2008-01-01

Using the brick wall method, the entropy of the charged dilaton-axion black hole is determined for both asymptotically flat and nonflat cases. The entropy turns out to be proportional to the horizon area of the black hole confirming the Bekenstein-Hawking area-entropy formula for black holes. The leading order logarithmic corrections to the entropy are also derived for such black holes.

Towards operational interpretations of generalized entropies

Science.gov (United States)

Topsøe, Flemming

2010-12-01

The driving force behind our study has been to overcome the difficulties you encounter when you try to extend the clear and convincing operational interpretations of classical Boltzmann-Gibbs-Shannon entropy to other notions, especially to generalized entropies as proposed by Tsallis. Our approach is philosophical, based on speculations regarding the interplay between truth, belief and knowledge. The main result demonstrates that, accepting philosophically motivated assumptions, the only possible measures of entropy are those suggested by Tsallis - which, as we know, include classical entropy. This result constitutes, so it seems, a more transparent interpretation of entropy than previously available. However, further research to clarify the assumptions is still needed. Our study points to the thesis that one should never consider the notion of entropy in isolation - in order to enable a rich and technically smooth study, further concepts, such as divergence, score functions and descriptors or controls should be included in the discussion. This will clarify the distinction between Nature and Observer and facilitate a game theoretical discussion. The usefulness of this distinction and the subsequent exploitation of game theoretical results - such as those connected with the notion of Nash equilibrium - is demonstrated by a discussion of the Maximum Entropy Principle.

Towards operational interpretations of generalized entropies

International Nuclear Information System (INIS)

Topsoee, Flemming

2010-01-01

The driving force behind our study has been to overcome the difficulties you encounter when you try to extend the clear and convincing operational interpretations of classical Boltzmann-Gibbs-Shannon entropy to other notions, especially to generalized entropies as proposed by Tsallis. Our approach is philosophical, based on speculations regarding the interplay between truth, belief and knowledge. The main result demonstrates that, accepting philosophically motivated assumptions, the only possible measures of entropy are those suggested by Tsallis - which, as we know, include classical entropy. This result constitutes, so it seems, a more transparent interpretation of entropy than previously available. However, further research to clarify the assumptions is still needed. Our study points to the thesis that one should never consider the notion of entropy in isolation - in order to enable a rich and technically smooth study, further concepts, such as divergence, score functions and descriptors or controls should be included in the discussion. This will clarify the distinction between Nature and Observer and facilitate a game theoretical discussion. The usefulness of this distinction and the subsequent exploitation of game theoretical results - such as those connected with the notion of Nash equilibrium - is demonstrated by a discussion of the Maximum Entropy Principle.

Maximum Entropy in Drug Discovery

Directory of Open Access Journals (Sweden)

Chih-Yuan Tseng

2014-07-01

Full Text Available Drug discovery applies multidisciplinary approaches either experimentally, computationally or both ways to identify lead compounds to treat various diseases. While conventional approaches have yielded many US Food and Drug Administration (FDA-approved drugs, researchers continue investigating and designing better approaches to increase the success rate in the discovery process. In this article, we provide an overview of the current strategies and point out where and how the method of maximum entropy has been introduced in this area. The maximum entropy principle has its root in thermodynamics, yet since Jaynes’ pioneering work in the 1950s, the maximum entropy principle has not only been used as a physics law, but also as a reasoning tool that allows us to process information in hand with the least bias. Its applicability in various disciplines has been abundantly demonstrated. We give several examples of applications of maximum entropy in different stages of drug discovery. Finally, we discuss a promising new direction in drug discovery that is likely to hinge on the ways of utilizing maximum entropy.

Temporal Correlations and Neural Spike Train Entropy

International Nuclear Information System (INIS)

Schultz, Simon R.; Panzeri, Stefano

2001-01-01

Sampling considerations limit the experimental conditions under which information theoretic analyses of neurophysiological data yield reliable results. We develop a procedure for computing the full temporal entropy and information of ensembles of neural spike trains, which performs reliably for limited samples of data. This approach also yields insight to the role of correlations between spikes in temporal coding mechanisms. The method, when applied to recordings from complex cells of the monkey primary visual cortex, results in lower rms error information estimates in comparison to a 'brute force' approach

Entropy: A new measure of stock market volatility?

Science.gov (United States)

Bentes, Sonia R.; Menezes, Rui

2012-11-01

When uncertainty dominates understanding stock market volatility is vital. There are a number of reasons for that. On one hand, substantial changes in volatility of financial market returns are capable of having significant negative effects on risk averse investors. In addition, such changes can also impact on consumption patterns, corporate capital investment decisions and macroeconomic variables. Arguably, volatility is one of the most important concepts in the whole finance theory. In the traditional approach this phenomenon has been addressed based on the concept of standard-deviation (or variance) from which all the famous ARCH type models - Autoregressive Conditional Heteroskedasticity Models- depart. In this context, volatility is often used to describe dispersion from an expected value, price or model. The variability of traded prices from their sample mean is only an example. Although as a measure of uncertainty and risk standard-deviation is very popular since it is simple and easy to calculate it has long been recognized that it is not fully satisfactory. The main reason for that lies in the fact that it is severely affected by extreme values. This may suggest that this is not a closed issue. Bearing on the above we might conclude that many other questions might arise while addressing this subject. One of outstanding importance, from which more sophisticated analysis can be carried out, is how to evaluate volatility, after all? If the standard-deviation has some drawbacks shall we still rely on it? Shall we look for an alternative measure? In searching for this shall we consider the insight of other domains of knowledge? In this paper we specifically address if the concept of entropy, originally developed in physics by Clausius in the XIX century, which can constitute an effective alternative. Basically, what we try to understand is, which are the potentialities of entropy compared to the standard deviation. But why entropy? The answer lies on the fact

Arithmetic of quantum entropy function

International Nuclear Information System (INIS)

Sen, Ashoke

2009-01-01

Quantum entropy function is a proposal for computing the entropy associated with the horizon of a black hole in the extremal limit, and is related via AdS/CFT correspondence to the dimension of the Hilbert space in a dual quantum mechanics. We show that in N = 4 supersymmetric string theories, quantum entropy function formalism naturally explains the origin of the subtle differences between the microscopic degeneracies of quarter BPS dyons carrying different torsion, i.e. different arithmetical properties. These arise from additional saddle points in the path integral - whose existence depends on the arithmetical properties of the black hole charges - constructed as freely acting orbifolds of the original AdS 2 x S 2 near horizon geometry. During this analysis we demonstrate that the quantum entropy function is insensitive to the details of the infrared cutoff used in the computation, and the details of the boundary terms added to the action. We also discuss the role of the asymptotic symmetries of AdS 2 in carrying out the path integral in the definition of quantum entropy function. Finally we show that even though quantum entropy function is expected to compute the absolute degeneracy in a given charge and angular momentum sector, it can also be used to compute the index. This can then be compared with the microscopic computation of the index.

Time dependence of entropy flux and entropy production for a dynamical system driven by noises with coloured cross-correlation

Institute of Scientific and Technical Information of China (English)

Xie Wen-Xian; Xu Wei; Cai Li

2007-01-01

This paper shows the Fokker-Planck equation of a dynamical system driven by coloured cross-correlated white noises in the absence and presence of a small external force. Based on the Fokker-Planck equation and the definition of Shannon's information entropy, the time dependence of entropy flux and entropy production can be calculated. The present results can be used to explain the extremal behaviour of time dependence of entropy flux and entropy production in view of the dissipative parameter γ of the system, coloured cross-correlation time τ and coloured cross-correlation strength λ.

Transfer Entropy Estimation and Directional Coupling Change Detection in Biomedical Time Series

Directory of Open Access Journals (Sweden)

Lee Joon

2012-04-01

Full Text Available Abstract Background The detection of change in magnitude of directional coupling between two non-linear time series is a common subject of interest in the biomedical domain, including studies involving the respiratory chemoreflex system. Although transfer entropy is a useful tool in this avenue, no study to date has investigated how different transfer entropy estimation methods perform in typical biomedical applications featuring small sample size and presence of outliers. Methods With respect to detection of increased coupling strength, we compared three transfer entropy estimation techniques using both simulated time series and respiratory recordings from lambs. The following estimation methods were analyzed: fixed-binning with ranking, kernel density estimation (KDE, and the Darbellay-Vajda (D-V adaptive partitioning algorithm extended to three dimensions. In the simulated experiment, sample size was varied from 50 to 200, while coupling strength was increased. In order to introduce outliers, the heavy-tailed Laplace distribution was utilized. In the lamb experiment, the objective was to detect increased respiratory-related chemosensitivity to O2 and CO2 induced by a drug, domperidone. Specifically, the separate influence of end-tidal PO2 and PCO2 on minute ventilation (V˙E before and after administration of domperidone was analyzed. Results In the simulation, KDE detected increased coupling strength at the lowest SNR among the three methods. In the lamb experiment, D-V partitioning resulted in the statistically strongest increase in transfer entropy post-domperidone for PO2→V˙E. In addition, D-V partitioning was the only method that could detect an increase in transfer entropy for PCO2→V˙E, in agreement with experimental findings. Conclusions Transfer entropy is capable of detecting directional coupling changes in non-linear biomedical time series analysis featuring a small number of observations and presence of outliers. The results

Topological nearly entropy

Science.gov (United States)

Gulamsarwar, Syazwani; Salleh, Zabidin

2017-08-01

The purpose of this paper is to generalize the notions of Adler's topological entropy along with their several fundamental properties. A function f : X → Y is said to be R-map if f-1 (V) is regular open in X for every regular open set V in Y. Thus, we initiated a notion of topological nearly entropy for topological R-dynamical systems which is based on nearly compact relative to the space by using R-map.

Quantum Statistical Entropy of Five-Dimensional Black Hole

Institute of Scientific and Technical Information of China (English)

ZHAO Ren; WU Yue-Qin; ZHANG Sheng-Li

2006-01-01

The generalized uncertainty relation is introduced to calculate quantum statistic entropy of a black hole.By using the new equation of state density motivated by the generalized uncertainty relation, we discuss entropies of Bose field and Fermi field on the background of the five-dimensional spacetime. In our calculation, we need not introduce cutoff. There is not the divergent logarithmic term as in the original brick-wall method. And it is obtained that the quantum statistic entropy corresponding to black hole horizon is proportional to the area of the horizon. Further it is shown that the entropy of black hole is the entropy of quantum state on the surface of horizon. The black hole's entropy is the intrinsic property of the black hole. The entropy is a quantum effect. It makes people further understand the quantum statistic entropy.

Quantum Statistical Entropy of Five-Dimensional Black Hole

International Nuclear Information System (INIS)

Zhao Ren; Zhang Shengli; Wu Yueqin

2006-01-01

The generalized uncertainty relation is introduced to calculate quantum statistic entropy of a black hole. By using the new equation of state density motivated by the generalized uncertainty relation, we discuss entropies of Bose field and Fermi field on the background of the five-dimensional spacetime. In our calculation, we need not introduce cutoff. There is not the divergent logarithmic term as in the original brick-wall method. And it is obtained that the quantum statistic entropy corresponding to black hole horizon is proportional to the area of the horizon. Further it is shown that the entropy of black hole is the entropy of quantum state on the surface of horizon. The black hole's entropy is the intrinsic property of the black hole. The entropy is a quantum effect. It makes people further understand the quantum statistic entropy.

Equipartition of entropy production as an approximation to the state of minimum entropy production in diabatic distillation

International Nuclear Information System (INIS)

Johannessen, Eivind; Rosjorde, Audun

2007-01-01

We show that the theorem of equipartition of entropy production is important for the understanding of the state of minimum entropy production in diabatic distillation. The theorem is not valid in a strictly mathematical sense. We explain why, when and in what sense this theorem is a good approximation to the optimal state in diabatic distillation. In order to make these predictions, we use a hypothesis for the state of minimum entropy production of an optimally controlled system, which was formulated on the basis of results of entropy production minimisation in chemical reactors. The hypothesis says that the state of minimum entropy production is characterised by approximately constant local entropy production and thermodynamic forces, given that there is sufficient freedom in the system. We present numerical results which are in agreement with the predictions. The results show that a column with constant tray entropy production in the stripping section and in the rectifying section is a good approximation to the optimal column, except when the total heat transfer area is low. The agreement between the two columns becomes better and better as the total heat transfer area and the number of trays increase. The fact that the predictions and the numerical results agree very well gives support to the validity of the hypothesis

Escort entropies and divergences and related canonical distribution

International Nuclear Information System (INIS)

Bercher, J.-F.

2011-01-01

We discuss two families of two-parameter entropies and divergences, derived from the standard Renyi and Tsallis entropies and divergences. These divergences and entropies are found as divergences or entropies of escort distributions. Exploiting the nonnegativity of the divergences, we derive the expression of the canonical distribution associated to the new entropies and a observable given as an escort-mean value. We show that this canonical distribution extends, and smoothly connects, the results obtained in nonextensive thermodynamics for the standard and generalized mean value constraints. -- Highlights: → Two-parameter entropies are derived from q-entropies and escort distributions. → The related canonical distribution is derived. → This connects and extends known results in nonextensive statistics.

Clausius entropy for arbitrary bifurcate null surfaces

International Nuclear Information System (INIS)

Baccetti, Valentina; Visser, Matt

2014-01-01

Jacobson’s thermodynamic derivation of the Einstein equations was originally applied only to local Rindler horizons. But at least some parts of that construction can usefully be extended to give meaningful results for arbitrary bifurcate null surfaces. As presaged in Jacobson’s original article, this more general construction sharply brings into focus the questions: is entropy objectively ‘real’? Or is entropy in some sense subjective and observer-dependent? These innocent questions open a Pandora’s box of often inconclusive debate. A consensus opinion, though certainly not universally held, seems to be that Clausius entropy (thermodynamic entropy, defined via a Clausius relation dS=đQ/T) should be objectively real, but that the ontological status of statistical entropy (Shannon or von Neumann entropy) is much more ambiguous, and much more likely to be observer-dependent. This question is particularly pressing when it comes to understanding Bekenstein entropy (black hole entropy). To perhaps further add to the confusion, we shall argue that even the Clausius entropy can often be observer-dependent. In the current article we shall conclusively demonstrate that one can meaningfully assign a notion of Clausius entropy to arbitrary bifurcate null surfaces—effectively defining a ‘virtual Clausius entropy’ for arbitrary ‘virtual (local) causal horizons’. As an application, we see that we can implement a version of the generalized second law (GSL) for this virtual Clausius entropy. This version of GSL can be related to certain (nonstandard) integral variants of the null energy condition. Because the concepts involved are rather subtle, we take some effort in being careful and explicit in developing our framework. In future work we will apply this construction to generalize Jacobson’s derivation of the Einstein equations. (paper)

Holographic entropy inequalities and gapped phases of matter

Energy Technology Data Exchange (ETDEWEB)

Bao, Ning [Institute for Quantum Information and Matter, California Institute of Technology,Pasadena, CA 91125 (United States); Walter Burke Institute for Theoretical Physics, California Institute of Technology,Pasadena, CA 91125 (United States); Cao, ChunJun [Walter Burke Institute for Theoretical Physics, California Institute of Technology,Pasadena, CA 91125 (United States); Walter, Michael [Stanford Institute for Theoretical Physics,Stanford University, Stanford, CA 94305 (United States); Wang, Zitao [Institute for Quantum Information and Matter, California Institute of Technology,Pasadena, CA 91125 (United States); Walter Burke Institute for Theoretical Physics, California Institute of Technology,Pasadena, CA 91125 (United States)

2015-09-29

We extend our studies of holographic entropy inequalities to gapped phases of matter. For any number of regions, we determine the linear entropy inequalities satisfied by systems in which the entanglement entropy satisfies an exact area law. In particular, we find that all holographic entropy inequalities are valid in such systems. In gapped systems with topological order, the “cyclic inequalities” derived recently for the holographic entanglement entropy generalize the Kitaev-Preskill formula for the topological entanglement entropy. Finally, we propose a candidate linear inequality for general 4-party quantum states.

Holographic entropy inequalities and gapped phases of matter

International Nuclear Information System (INIS)

Bao, Ning; Cao, ChunJun; Walter, Michael; Wang, Zitao

2015-01-01

We extend our studies of holographic entropy inequalities to gapped phases of matter. For any number of regions, we determine the linear entropy inequalities satisfied by systems in which the entanglement entropy satisfies an exact area law. In particular, we find that all holographic entropy inequalities are valid in such systems. In gapped systems with topological order, the “cyclic inequalities” derived recently for the holographic entanglement entropy generalize the Kitaev-Preskill formula for the topological entanglement entropy. Finally, we propose a candidate linear inequality for general 4-party quantum states.

Examples of Entropy-driven Ordering

Indian Academy of Sciences (India)

driven Ordering. Orientational ordering of long objects. Entropy of sliding increases. Freezing in hard-sphere systems. Vibrational entropy increases. Phase separation in hard-sphere binary mixtures with disparate sizes. More room for smaller ...

Receiver function estimated by maximum entropy deconvolution

Institute of Scientific and Technical Information of China (English)

吴庆举; 田小波; 张乃铃; 李卫平; 曾融生

2003-01-01

Maximum entropy deconvolution is presented to estimate receiver function, with the maximum entropy as the rule to determine auto-correlation and cross-correlation functions. The Toeplitz equation and Levinson algorithm are used to calculate the iterative formula of error-predicting filter, and receiver function is then estimated. During extrapolation, reflective coefficient is always less than 1, which keeps maximum entropy deconvolution stable. The maximum entropy of the data outside window increases the resolution of receiver function. Both synthetic and real seismograms show that maximum entropy deconvolution is an effective method to measure receiver function in time-domain.

Controlling the Shannon Entropy of Quantum Systems

Science.gov (United States)

Xing, Yifan; Wu, Jun

2013-01-01

This paper proposes a new quantum control method which controls the Shannon entropy of quantum systems. For both discrete and continuous entropies, controller design methods are proposed based on probability density function control, which can drive the quantum state to any target state. To drive the entropy to any target at any prespecified time, another discretization method is proposed for the discrete entropy case, and the conditions under which the entropy can be increased or decreased are discussed. Simulations are done on both two- and three-dimensional quantum systems, where division and prediction are used to achieve more accurate tracking. PMID:23818819

Controlling the Shannon Entropy of Quantum Systems

Directory of Open Access Journals (Sweden)

Yifan Xing

2013-01-01

Full Text Available This paper proposes a new quantum control method which controls the Shannon entropy of quantum systems. For both discrete and continuous entropies, controller design methods are proposed based on probability density function control, which can drive the quantum state to any target state. To drive the entropy to any target at any prespecified time, another discretization method is proposed for the discrete entropy case, and the conditions under which the entropy can be increased or decreased are discussed. Simulations are done on both two- and three-dimensional quantum systems, where division and prediction are used to achieve more accurate tracking.

Universal canonical entropy for gravitating systems

Indian Academy of Sciences (India)

Similar to this is the case of ref. [12] which also uses the saddle point approximation to express the microcanonical entropy in terms of the canonical entropy [12a]. Recalling that there is at least 'circumstantial' evidence that the microcanonical entropy has a 'universal' form [13–15], identical to that obtained in ref. [6] quoted.

Angular momentum independence of the entropy sum and entropy product for AdS rotating black holes in all dimensions

Directory of Open Access Journals (Sweden)

Hang Liu

2016-08-01

Full Text Available In this paper, we investigate the angular momentum independence of the entropy sum and product for AdS rotating black holes based on the first law of thermodynamics and a mathematical lemma related to Vandermonde determinant. The advantage of this method is that the explicit forms of the spacetime metric, black hole mass and charge are not needed but the Hawking temperature and entropy formula on the horizons are necessary for static black holes, while our calculations require the expressions of metric and angular velocity formula. We find that the entropy sum is always independent of angular momentum for all dimensions and the angular momentum-independence of entropy product only holds for the dimensions d>4 with at least one rotation parameter ai=0, while the mass-free of entropy sum and entropy product for rotating black holes only stand for higher dimensions (d>4 and for all dimensions, respectively. On the other hand, we find that the introduction of a negative cosmological constant does not affect the angular momentum-free of entropy sum and product but the criterion for angular momentum-independence of entropy product will be affected.

Maximum-entropy networks pattern detection, network reconstruction and graph combinatorics

CERN Document Server

Squartini, Tiziano

2017-01-01

This book is an introduction to maximum-entropy models of random graphs with given topological properties and their applications. Its original contribution is the reformulation of many seemingly different problems in the study of both real networks and graph theory within the unified framework of maximum entropy. Particular emphasis is put on the detection of structural patterns in real networks, on the reconstruction of the properties of networks from partial information, and on the enumeration and sampling of graphs with given properties.  After a first introductory chapter explaining the motivation, focus, aim and message of the book, chapter 2 introduces the formal construction of maximum-entropy ensembles of graphs with local topological constraints. Chapter 3 focuses on the problem of pattern detection in real networks and provides a powerful way to disentangle nontrivial higher-order structural features from those that can be traced back to simpler local constraints. Chapter 4 focuses on the problem o...

Characterizing brain structures and remodeling after TBI based on information content, diffusion entropy.

Science.gov (United States)

Fozouni, Niloufar; Chopp, Michael; Nejad-Davarani, Siamak P; Zhang, Zheng Gang; Lehman, Norman L; Gu, Steven; Ueno, Yuji; Lu, Mei; Ding, Guangliang; Li, Lian; Hu, Jiani; Bagher-Ebadian, Hassan; Hearshen, David; Jiang, Quan

2013-01-01

To overcome the limitations of conventional diffusion tensor magnetic resonance imaging resulting from the assumption of a Gaussian diffusion model for characterizing voxels containing multiple axonal orientations, Shannon's entropy was employed to evaluate white matter structure in human brain and in brain remodeling after traumatic brain injury (TBI) in a rat. Thirteen healthy subjects were investigated using a Q-ball based DTI data sampling scheme. FA and entropy values were measured in white matter bundles, white matter fiber crossing areas, different gray matter (GM) regions and cerebrospinal fluid (CSF). Axonal densities' from the same regions of interest (ROIs) were evaluated in Bielschowsky and Luxol fast blue stained autopsy (n = 30) brain sections by light microscopy. As a case demonstration, a Wistar rat subjected to TBI and treated with bone marrow stromal cells (MSC) 1 week after TBI was employed to illustrate the superior ability of entropy over FA in detecting reorganized crossing axonal bundles as confirmed by histological analysis with Bielschowsky and Luxol fast blue staining. Unlike FA, entropy was less affected by axonal orientation and more affected by axonal density. A significant agreement (r = 0.91) was detected between entropy values from in vivo human brain and histologically measured axonal density from post mortum from the same brain structures. The MSC treated TBI rat demonstrated that the entropy approach is superior to FA in detecting axonal remodeling after injury. Compared with FA, entropy detected new axonal remodeling regions with crossing axons, confirmed with immunohistological staining. Entropy measurement is more effective in distinguishing axonal remodeling after injury, when compared with FA. Entropy is also more sensitive to axonal density than axonal orientation, and thus may provide a more accurate reflection of axonal changes that occur in neurological injury and disease.

Characterizing Brain Structures and Remodeling after TBI Based on Information Content, Diffusion Entropy

Science.gov (United States)

Fozouni, Niloufar; Chopp, Michael; Nejad-Davarani, Siamak P.; Zhang, Zheng Gang; Lehman, Norman L.; Gu, Steven; Ueno, Yuji; Lu, Mei; Ding, Guangliang; Li, Lian; Hu, Jiani; Bagher-Ebadian, Hassan; Hearshen, David; Jiang, Quan

2013-01-01

Background To overcome the limitations of conventional diffusion tensor magnetic resonance imaging resulting from the assumption of a Gaussian diffusion model for characterizing voxels containing multiple axonal orientations, Shannon's entropy was employed to evaluate white matter structure in human brain and in brain remodeling after traumatic brain injury (TBI) in a rat. Methods Thirteen healthy subjects were investigated using a Q-ball based DTI data sampling scheme. FA and entropy values were measured in white matter bundles, white matter fiber crossing areas, different gray matter (GM) regions and cerebrospinal fluid (CSF). Axonal densities' from the same regions of interest (ROIs) were evaluated in Bielschowsky and Luxol fast blue stained autopsy (n = 30) brain sections by light microscopy. As a case demonstration, a Wistar rat subjected to TBI and treated with bone marrow stromal cells (MSC) 1 week after TBI was employed to illustrate the superior ability of entropy over FA in detecting reorganized crossing axonal bundles as confirmed by histological analysis with Bielschowsky and Luxol fast blue staining. Results Unlike FA, entropy was less affected by axonal orientation and more affected by axonal density. A significant agreement (r = 0.91) was detected between entropy values from in vivo human brain and histologically measured axonal density from post mortum from the same brain structures. The MSC treated TBI rat demonstrated that the entropy approach is superior to FA in detecting axonal remodeling after injury. Compared with FA, entropy detected new axonal remodeling regions with crossing axons, confirmed with immunohistological staining. Conclusions Entropy measurement is more effective in distinguishing axonal remodeling after injury, when compared with FA. Entropy is also more sensitive to axonal density than axonal orientation, and thus may provide a more accurate reflection of axonal changes that occur in neurological injury and disease

Constant conditional entropy and related hypotheses

International Nuclear Information System (INIS)

Ferrer-i-Cancho, Ramon; Dębowski, Łukasz; Moscoso del Prado Martín, Fermín

2013-01-01

Constant entropy rate (conditional entropies must remain constant as the sequence length increases) and uniform information density (conditional probabilities must remain constant as the sequence length increases) are two information theoretic principles that are argued to underlie a wide range of linguistic phenomena. Here we revise the predictions of these principles in the light of Hilberg’s law on the scaling of conditional entropy in language and related laws. We show that constant entropy rate (CER) and two interpretations for uniform information density (UID), full UID and strong UID, are inconsistent with these laws. Strong UID implies CER but the reverse is not true. Full UID, a particular case of UID, leads to costly uncorrelated sequences that are totally unrealistic. We conclude that CER and its particular cases are incomplete hypotheses about the scaling of conditional entropies. (letter)

On the fundamental equation of nonequilibrium statistical physics—Nonequilibrium entropy evolution equation and the formula for entropy production rate

Institute of Scientific and Technical Information of China (English)

无

2010-01-01

In this paper the author presents an overview on his own research works. More than ten years ago, we proposed a new fundamental equation of nonequilibrium statistical physics in place of the present Liouville equation. That is the stochastic velocity type’s Langevin equation in 6N dimensional phase space or its equivalent Liouville diffusion equation. This equation is time-reversed asymmetrical. It shows that the form of motion of particles in statistical thermodynamic systems has the drift-diffusion duality, and the law of motion of statistical thermodynamics is expressed by a superposition of both the law of dynamics and the stochastic velocity and possesses both determinism and probability. Hence it is different from the law of motion of particles in dynamical systems. The stochastic diffusion motion of the particles is the microscopic origin of macroscopic irreversibility. Starting from this fundamental equation the BBGKY diffusion equation hierarchy, the Boltzmann collision diffusion equation, the hydrodynamic equations such as the mass drift-diffusion equation, the Navier-Stokes equation and the thermal conductivity equation have been derived and presented here. What is more important, we first constructed a nonlinear evolution equation of nonequilibrium entropy density in 6N, 6 and 3 dimensional phase space, predicted the existence of entropy diffusion. This entropy evolution equation plays a leading role in nonequilibrium entropy theory, it reveals that the time rate of change of nonequilibrium entropy density originates together from its drift, diffusion and production in space. From this evolution equation, we presented a formula for entropy production rate (i.e. the law of entropy increase) in 6N and 6 dimensional phase space, proved that internal attractive force in nonequilibrium system can result in entropy decrease while internal repulsive force leads to another entropy increase, and derived a common expression for this entropy decrease rate or

On Equivalence of Nonequilibrium Thermodynamic and Statistical Entropies

Directory of Open Access Journals (Sweden)

Purushottam D. Gujrati

2015-02-01

Full Text Available We review the concept of nonequilibrium thermodynamic entropy and observables and internal variables as state variables, introduced recently by us, and provide a simple first principle derivation of additive statistical entropy, applicable to all nonequilibrium states by treating thermodynamics as an experimental science. We establish their numerical equivalence in several cases, which includes the most important case when the thermodynamic entropy is a state function. We discuss various interesting aspects of the two entropies and show that the number of microstates in the Boltzmann entropy includes all possible microstates of non-zero probabilities even if the system is trapped in a disjoint component of the microstate space. We show that negative thermodynamic entropy can appear from nonnegative statistical entropy.

Black hole entropy in the O(N) model

International Nuclear Information System (INIS)

Kabat, D.; Shenker, S.H.; Strassler, M.J.

1995-01-01

We consider corrections to the entropy of a black hole from an O(N)-invariant linear σ model. We obtain the entropy from a 1/N expansion of the partition function on a cone. The entropy arises from diagrams which are analogous to those introduced by Susskind and Uglum to explain black hole entropy in string theory. The interpretation of the σ-model entropy depends on scale. At short distances, it has a state counting interpretation, as the entropy of entanglement of the N fields φ a . In the infrared, the effective theory has a single composite field σ∼φ a φ a , and the state counting interpretation of the entropy is lost. copyright 1995 The American Physical Society

Entropy concentration and the empirical coding game

NARCIS (Netherlands)

Grünwald, P.D.

2008-01-01

We give a characterization of maximum entropy/minimum relative entropy inference by providing two 'strong entropy concentration' theorems. These theorems unify and generalize Jaynes''concentration phenomenon' and Van Campenhout and Cover's 'conditional limit theorem'. The theorems characterize

Logical entropy of quantum dynamical systems

Directory of Open Access Journals (Sweden)

Ebrahimzadeh Abolfazl

2016-01-01

Full Text Available This paper introduces the concepts of logical entropy and conditional logical entropy of hnite partitions on a quantum logic. Some of their ergodic properties are presented. Also logical entropy of a quantum dynamical system is dehned and ergodic properties of dynamical systems on a quantum logic are investigated. Finally, the version of Kolmogorov-Sinai theorem is proved.

Study on corrosion resistance of high - entropy alloy in medium acid liquid and chemical properties

International Nuclear Information System (INIS)

Florea, I; Buluc, G; Florea, R M; Carcea, I; Soare, V

2015-01-01

High-entropy alloy is a new alloy which is different from traditional alloys. The high entropy alloys were started in Tsing Hua University of Taiwan since 1995 by Yeh et al. Consisting of a variety of elements, each element occupying a similar compared with other alloy elements to form a high entropy. We could define high entropy alloys as having approximately equal concentrations, made up of a group of 5 to 11 major elements. In general, the content of each element is not more than 35% by weight of the alloy. During the investigation it turned out that this alloy has a high hardness and is also corrosion proof and also strength and good thermal stability. In the experimental area, scientists used different tools, including traditional casting, mechanical alloying, sputtering, splat-quenching to obtain the high entropy alloys with different alloying elements and then to investigate the corresponding microstructures and mechanical, chemical, thermal, and electronic performances. The present study is aimed to investigate the corrosion resistance in a different medium acid and try to put in evidence the mechanical properties. Forasmuch of the wide composition range and the enormous number of alloy systems in high entropy alloys, the mechanical properties of high entropy alloys can vary significantly. In terms of hardness, the most critical factors are: hardness/strength of each composing phase in the alloy, distribution of the composing phases. The corrosion resistance of an high entropy alloy was made in acid liquid such as 10%HNO 3 -3%HF, 10%H 2 SO 4 , 5%HCl and then was investigated, respectively with weight loss experiment. Weight loss test was carried out by put the samples into the acid solution for corrosion. The solution was maintained at a constant room temperature. The liquid formulations used for tests were 3% hydrofluoric acid with 10% nitric acid, 10% sulphuric acid, 5% hydrochloric acid. Weight loss of the samples was measured by electronic scale. (paper)

Black hole entropy functions and attractor equations

International Nuclear Information System (INIS)

Lopes Cardoso, Gabriel; Wit, Bernard de; Mahapatra, Swapna

2007-01-01

The entropy and the attractor equations for static extremal black hole solutions follow from a variational principle based on an entropy function. In the general case such an entropy function can be derived from the reduced action evaluated in a near-horizon geometry. BPS black holes constitute special solutions of this variational principle, but they can also be derived directly from a different entropy function based on supersymmetry enhancement at the horizon. Both functions are consistent with electric/magnetic duality and for BPS black holes their corresponding OSV-type integrals give identical results at the semi-classical level. We clarify the relation between the two entropy functions and the corresponding attractor equations for N = 2 supergravity theories with higher-derivative couplings in four space-time dimensions. We discuss how non-holomorphic corrections will modify these entropy functions

Left-right entanglement entropy of Dp-branes

Energy Technology Data Exchange (ETDEWEB)

Zayas, Leopoldo A. Pando [The Abdus Salam International Centre for Theoretical Physics,Strada Costiera 11, 34014 Trieste (Italy); Michigan Center for Theoretical Physics, Randall Laboratory of Physics,The University of Michigan,450 Church Street, Ann Arbor, MI 48109-1120 (United States); Quiroz, Norma [Departamento de Ciencias Exactas, Tecnología y Metodología,Centro Universitario del Sur, Universidad de Guadalajara,Enrique Arreola Silva 883, C.P. 49000, Cd. Guzmán, Jalisco (Mexico)

2016-11-04

We compute the left-right entanglement entropy for Dp-branes in string theory. We employ the CFT approach to string theory Dp-branes, in particular, its presentation as coherent states of the closed string sector. The entanglement entropy is computed as the von Neumann entropy for a density matrix resulting from integration over the left-moving degrees of freedom. We discuss various crucial ambiguities related to sums over spin structures and argue that different choices capture different physics; however, we advance a themodynamic argument that seems to favor a particular choice of replica. We also consider Dp branes on compact dimensions and verify that the effects of T-duality act covariantly on the Dp brane entanglement entropy. We find that generically the left-right entanglement entropy provides a suitable generalization of boundary entropy and of the D-brane tension.

Shannon versus Kullback-Leibler entropies in nonequilibrium random motion

International Nuclear Information System (INIS)

Garbaczewski, Piotr

2005-01-01

We analyze dynamical properties of the Shannon information entropy of a continuous probability distribution, which is driven by a standard diffusion process. This entropy choice is confronted with another option, employing the conditional Kullback-Leibler entropy. Both entropies discriminate among various probability distributions, either statically or in the time domain. An asymptotic approach towards equilibrium is typically monotonic in terms of the Kullback entropy. The Shannon entropy time rate needs not to be positive and is a sensitive indicator of the power transfer processes (removal/supply) due to an active environment. In the case of Smoluchowski diffusions, the Kullback entropy time rate coincides with the Shannon entropy 'production' rate

On the way towards a generalized entropy maximization procedure

International Nuclear Information System (INIS)

Bagci, G. Baris; Tirnakli, Ugur

2009-01-01

We propose a generalized entropy maximization procedure, which takes into account the generalized averaging procedures and information gain definitions underlying the generalized entropies. This novel generalized procedure is then applied to Renyi and Tsallis entropies. The generalized entropy maximization procedure for Renyi entropies results in the exponential stationary distribution asymptotically for q element of (0,1] in contrast to the stationary distribution of the inverse power law obtained through the ordinary entropy maximization procedure. Another result of the generalized entropy maximization procedure is that one can naturally obtain all the possible stationary distributions associated with the Tsallis entropies by employing either ordinary or q-generalized Fourier transforms in the averaging procedure.

Detection of cracks in shafts with the Approximated Entropy algorithm

Science.gov (United States)

Sampaio, Diego Luchesi; Nicoletti, Rodrigo

2016-05-01

The Approximate Entropy is a statistical calculus used primarily in the fields of Medicine, Biology, and Telecommunication for classifying and identifying complex signal data. In this work, an Approximate Entropy algorithm is used to detect cracks in a rotating shaft. The signals of the cracked shaft are obtained from numerical simulations of a de Laval rotor with breathing cracks modelled by the Fracture Mechanics. In this case, one analysed the vertical displacements of the rotor during run-up transients. The results show the feasibility of detecting cracks from 5% depth, irrespective of the unbalance of the rotating system and crack orientation in the shaft. The results also show that the algorithm can differentiate the occurrence of crack only, misalignment only, and crack + misalignment in the system. However, the algorithm is sensitive to intrinsic parameters p (number of data points in a sample vector) and f (fraction of the standard deviation that defines the minimum distance between two sample vectors), and good results are only obtained by appropriately choosing their values according to the sampling rate of the signal.

Entropy and black-hole thermodynamics

International Nuclear Information System (INIS)

Wald, R.M.

1979-01-01

The concept of entropy is examined with an eye toward gaining insight into the nature of black-hole thermodynamics. Definitions of entropy are given for ordinary classical and quantum-mechanical systems which lead to plausibility arguments for the ordinary laws of thermodynamics. The treatment of entropy for a classical system is in the spirit of the information-theory viewpoint, but by explicitly incorporating the coarse-grained observable into the definition of entropy, we eliminate any nonobjective features. The definition of entropy for a quantum-mechanical system is new, but directly parallels the classical treatment. We then apply these ideas to a self-gravitating quantum system which contains a black hole. Under some assumptions: which, although nontrivial, are by no means exotic: about the nature of such a system, it is seen that the same plausibility arguments which lead to the ordinary laws of thermodynamics for ordinary systems now lead to the laws of black-hole mechanics, including the generalized second law of thermodynamics. Thus, it appears perfectly plausible that black-hole thermodynamics is nothing more than ordinary thermodynamics applied to a self-gravitating quantum system

Resting state fMRI entropy probes complexity of brain activity in adults with ADHD.

Science.gov (United States)

Sokunbi, Moses O; Fung, Wilson; Sawlani, Vijay; Choppin, Sabine; Linden, David E J; Thome, Johannes

2013-12-30

In patients with attention deficit hyperactivity disorder (ADHD), quantitative neuroimaging techniques have revealed abnormalities in various brain regions, including the frontal cortex, striatum, cerebellum, and occipital cortex. Nonlinear signal processing techniques such as sample entropy have been used to probe the regularity of brain magnetoencephalography signals in patients with ADHD. In the present study, we extend this technique to analyse the complex output patterns of the 4 dimensional resting state functional magnetic resonance imaging signals in adult patients with ADHD. After adjusting for the effect of age, we found whole brain entropy differences (P=0.002) between groups and negative correlation (r=-0.45) between symptom scores and mean whole brain entropy values, indicating lower complexity in patients. In the regional analysis, patients showed reduced entropy in frontal and occipital regions bilaterally and a significant negative correlation between the symptom scores and the entropy maps at a family-wise error corrected cluster level of Pentropy is a useful tool in revealing abnormalities in the brain dynamics of patients with psychiatric disorders. © 2013 Elsevier Ireland Ltd. All rights reserved.

ENTROPY FLOW CHARACTERISTICS ANALYSIS OF TYPHOON MATSA (0509)

Institute of Scientific and Technical Information of China (English)

XU Hui; LIU Chong-jian

2008-01-01

The evolution of Typhoon Matsa (0509) is examined in terms of entropy flow through an entropy balance equation derived from the Gibbs relation, according to the second law of thermodynamics. The entropy flows in the various significant stages of (genesis, development and decaying) during its evolution are diagnosed based on the outputs of the PSU/NCAR mesoscale model (known as MM5). The results show that: (1) the vertical spatial distribution of entropy flow for Matsa is characterized by a predominantly negative entropy flow in a large portion of the troposphere and a positive flow in the upper levels; (2) the fields of entropy flows at the middle troposphere (500 hPa) show that the growth of the typhoon is greatly dependent on the negative entropy flows from its surroundings; and (3) the simulated centres of heavy rainfall associated with the typhoon match well with the zones of large negative entropy flows, suggesting that they may be a significant indicator for severe weather events.

Zero modes and entanglement entropy

Energy Technology Data Exchange (ETDEWEB)

Yazdi, Yasaman K. [Perimeter Institute for Theoretical Physics,31 Caroline St. N., Waterloo, ON, N2L 2Y5 (Canada); Department of Physics and Astronomy, University of Waterloo,200 University Avenue West, Waterloo, ON, N2L 3G1 (Canada)

2017-04-26

Ultraviolet divergences are widely discussed in studies of entanglement entropy. Also present, but much less understood, are infrared divergences due to zero modes in the field theory. In this note, we discuss the importance of carefully handling zero modes in entanglement entropy. We give an explicit example for a chain of harmonic oscillators in 1D, where a mass regulator is necessary to avoid an infrared divergence due to a zero mode. We also comment on a surprising contribution of the zero mode to the UV-scaling of the entanglement entropy.

Entropy Learning in Neural Network

Directory of Open Access Journals (Sweden)

Geok See Ng

2017-12-01

Full Text Available In this paper, entropy term is used in the learning phase of a neural network.  As learning progresses, more hidden nodes get into saturation.  The early creation of such hidden nodes may impair generalisation.  Hence entropy approach is proposed to dampen the early creation of such nodes.  The entropy learning also helps to increase the importance of relevant nodes while dampening the less important nodes.  At the end of learning, the less important nodes can then be eliminated to reduce the memory requirements of the neural network.

Shannon's information is not entropy

International Nuclear Information System (INIS)

Schiffer, M.

1990-01-01

In this letter we clear up the long-standing misidentification of Shannon's Information with Entropy. We show that Information, in contrast to Entropy, is not invariant under unitary transformations and that these quantities are only equivalent for representations consisting of Hamiltonian eigenstates. We illustrate this fact through a toy system consisting of a harmonic oscillator in a coherent state. It is further proved that the representations which maximize the information are those which are energy-eigenstates. This fact sets the entropy as an upper bound for Shannon's Information. (author)

Entanglement entropy and nonabelian gauge symmetry

International Nuclear Information System (INIS)

Donnelly, William

2014-01-01

Entanglement entropy has proven to be an extremely useful concept in quantum field theory. Gauge theories are of particular interest, but for these systems the entanglement entropy is not clearly defined because the physical Hilbert space does not factor as a tensor product according to regions of space. Here we review a definition of entanglement entropy that applies to abelian and nonabelian lattice gauge theories. This entanglement entropy is obtained by embedding the physical Hilbert space into a product of Hilbert spaces associated to regions with boundary. The latter Hilbert spaces include degrees of freedom on the entangling surface that transform like surface charges under the gauge symmetry. These degrees of freedom are shown to contribute to the entanglement entropy, and the form of this contribution is determined by the gauge symmetry. We test our definition using the example of two-dimensional Yang–Mills theory, and find that it agrees with the thermal entropy in de Sitter space, and with the results of the Euclidean replica trick. We discuss the possible implications of this result for more complicated gauge theories, including quantum gravity. (paper)

Effects of Force Load, Muscle Fatigue, and Magnetic Stimulation on Surface Electromyography during Side Arm Lateral Raise Task: A Preliminary Study with Healthy Subjects

Directory of Open Access Journals (Sweden)

Liu Cao

2017-01-01

Full Text Available The aim of this study was to quantitatively investigate the effects of force load, muscle fatigue, and extremely low-frequency (ELF magnetic stimulation on surface electromyography (SEMG signal features during side arm lateral raise task. SEMG signals were recorded from 18 healthy subjects on the anterior deltoid using a BIOSEMI ActiveTwo system during side lateral raise task (with the right arm 90 degrees away from the body with three different loads on the forearm (0 kg, 1 kg, and 3 kg; their order was randomized between subjects. The arm maintained the loads until the subject felt exhausted. The first 10 s recording for each load was regarded as nonfatigue status and the last 10 s before the subject was exhausted was regarded as fatigue status. The subject was then given a five-minute resting between different loads. Two days later, the same experiment was repeated on every subject, and this time the ELF magnetic stimulation was applied to the subject’s deltoid muscle during the five-minute rest period. Three commonly used SEMG features, root mean square (RMS, median frequency (MDF, and sample entropy (SampEn, were analyzed and compared between different loads, nonfatigue/fatigue status, and ELF stimulation and no stimulation. Variance analysis results showed that the effect of force load on RMS was significant (p0.05. In comparison with nonfatigue status, for all the different force loads with and without ELF stimulation, RMS was significantly larger at fatigue (all p<0.001 and MDF and SampEn were significantly smaller (all p<0.001.

Topological entropy for induced hyperspace maps

International Nuclear Information System (INIS)

Canovas Pena, Jose S.; Lopez, Gabriel Soler

2006-01-01

Let (X,d) be a compact metric space and let f:X->X be continuous. Let K(X) be the family of compact subsets of X endowed with the Hausdorff metric and define the extension f-bar :K(X)->K(X) by f-bar (K)=f(K) for any K-bar K(X). We prove that the topological entropy of f-bar is greater or equal than the topological entropy of f, and this inequality can be strict. On the other hand, we prove that the topological entropy of f is positive if and only if the topological entropy of f-bar is also positive

Topological entropy for induced hyperspace maps

Energy Technology Data Exchange (ETDEWEB)

Canovas Pena, Jose S. [Departamento de Matematica Aplicada y Estadistica, Universidad Politecnica de Cartagena, 30203 Cartagena, Murcia (Spain)]. E-mail: Jose.canovas@upct.es; Lopez, Gabriel Soler [Departamento de Matematica Aplicada y Estadistica, Universidad Politecnica de Cartagena, 30203 Cartagena, Murcia (Spain)]. E-mail: Gabriel.soler@upct.es

2006-05-15

Let (X,d) be a compact metric space and let f:X->X be continuous. Let K(X) be the family of compact subsets of X endowed with the Hausdorff metric and define the extension f-bar :K(X)->K(X) by f-bar (K)=f(K) for any K-bar K(X). We prove that the topological entropy of f-bar is greater or equal than the topological entropy of f, and this inequality can be strict. On the other hand, we prove that the topological entropy of f is positive if and only if the topological entropy of f-bar is also positive.

Entropy statistics and information theory

NARCIS (Netherlands)

Frenken, K.; Hanusch, H.; Pyka, A.

2007-01-01

Entropy measures provide important tools to indicate variety in distributions at particular moments in time (e.g., market shares) and to analyse evolutionary processes over time (e.g., technical change). Importantly, entropy statistics are suitable to decomposition analysis, which renders the

Microscopic entropy and nonlocality

International Nuclear Information System (INIS)

Karpov, E.; Ordonets, G.; Petroskij, T.; Prigozhin, I.

2003-01-01

We have obtained a microscopic expression for entropy in terms of H function based on nonunitary Λ transformation which leads from the time evolution as a unitary group to a Markovian dynamics and unifies the reversible and irreversible aspects of quantum mechanics. This requires a new representation outside the Hilbert space. In terms of H, we show the entropy production and the entropy flow during the emission and absorption of radiation by an atom. Analyzing the time inversion experiment, we emphasize the importance of pre- and postcollisional correlations, which break the symmetry between incoming and outgoing waves. We consider the angle dependence of the H function in a three-dimensional situation. A model including virtual transitions is discussed in a subsequent paper

Maximum entropy methods

International Nuclear Information System (INIS)

Ponman, T.J.

1984-01-01

For some years now two different expressions have been in use for maximum entropy image restoration and there has been some controversy over which one is appropriate for a given problem. Here two further entropies are presented and it is argued that there is no single correct algorithm. The properties of the four different methods are compared using simple 1D simulations with a view to showing how they can be used together to gain as much information as possible about the original object. (orig.)

Entropies of the automata networks with additive rule

Institute of Scientific and Technical Information of China (English)

Guo－qingGU; GeCHEN; 等

1996-01-01

The matrix presentation for automata networks with additive rule are described.A set of entropy theorems of additive automata network are proved and an analytic formula of its entropy is built.For example,we proved that the topological entropy is identically equal to metric entropy for an additive antomata network.

Entropy Generation Analysis of Desalination Technologies

Directory of Open Access Journals (Sweden)

John H. Lienhard V

2011-09-01

Full Text Available Increasing global demand for fresh water is driving the development and implementation of a wide variety of seawater desalination technologies. Entropy generation analysis, and specifically, Second Law efficiency, is an important tool for illustrating the influence of irreversibilities within a system on the required energy input. When defining Second Law efficiency, the useful exergy output of the system must be properly defined. For desalination systems, this is the minimum least work of separation required to extract a unit of water from a feed stream of a given salinity. In order to evaluate the Second Law efficiency, entropy generation mechanisms present in a wide range of desalination processes are analyzed. In particular, entropy generated in the run down to equilibrium of discharge streams must be considered. Physical models are applied to estimate the magnitude of entropy generation by component and individual processes. These formulations are applied to calculate the total entropy generation in several desalination systems including multiple effect distillation, multistage flash, membrane distillation, mechanical vapor compression, reverse osmosis, and humidification-dehumidification. Within each technology, the relative importance of each source of entropy generation is discussed in order to determine which should be the target of entropy generation minimization. As given here, the correct application of Second Law efficiency shows which systems operate closest to the reversible limit and helps to indicate which systems have the greatest potential for improvement.

Logarithmic terms in entanglement entropies of 2D quantum critical points and Shannon entropies of spin chains.

Science.gov (United States)

Zaletel, Michael P; Bardarson, Jens H; Moore, Joel E

2011-07-08

Universal logarithmic terms in the entanglement entropy appear at quantum critical points (QCPs) in one dimension (1D) and have been predicted in 2D at QCPs described by 2D conformal field theories. The entanglement entropy in a strip geometry at such QCPs can be obtained via the "Shannon entropy" of a 1D spin chain with open boundary conditions. The Shannon entropy of the XXZ chain is found to have a logarithmic term that implies, for the QCP of the square-lattice quantum dimer model, a logarithm with universal coefficient ±0.25. However, the logarithm in the Shannon entropy of the transverse-field Ising model, which corresponds to entanglement in the 2D Ising conformal QCP, is found to have a singular dependence on the replica or Rényi index resulting from flows to different boundary conditions at the entanglement cut.

Entanglement Entropy of AdS Black Holes

Directory of Open Access Journals (Sweden)

Maurizio Melis

2010-11-01

Full Text Available We review recent progress in understanding the entanglement entropy of gravitational configurations for anti-de Sitter gravity in two and three spacetime dimensions using the AdS/CFT correspondence. We derive simple expressions for the entanglement entropy of two- and three-dimensional black holes. In both cases, the leading term of the entanglement entropy in the large black hole mass expansion reproduces exactly the Bekenstein-Hawking entropy, whereas the subleading term behaves logarithmically. In particular, for the BTZ black hole the leading term of the entanglement entropy can be obtained from the large temperature expansion of the partition function of a broad class of 2D CFTs on the torus.

The Wigner-Yanase entropy is not subadditive

DEFF Research Database (Denmark)

Hansen, Frank

2007-01-01

Wigner and Yanase introduced in 1963 the Wigner-Yanase entropy defined as minus the skew information of a state with respect to a conserved observable. They proved that the Wigner-Yanase entropy is a concave function in the state and conjectured that it is subadditive with respect...... to the aggregation of possibly interacting subsystems. While this turned out to be true for the quantum-mechanical entropy, we negate the conjecture for the Wigner-Yanase entropy by providing a counter example....

Curvature Entropy for Curved Profile Generation

OpenAIRE

Ujiie, Yoshiki; Kato, Takeo; Sato, Koichiro; Matsuoka, Yoshiyuki

2012-01-01

In a curved surface design, the overall shape features that emerge from combinations of shape elements are important. However, controlling the features of the overall shape in curved profiles is difficult using conventional microscopic shape information such as dimension. Herein two types of macroscopic shape information, curvature entropy and quadrature curvature entropy, quantitatively represent the features of the overall shape. The curvature entropy is calculated by the curvature distribu...

Entanglement entropy in causal set theory

Science.gov (United States)

Sorkin, Rafael D.; Yazdi, Yasaman K.

2018-04-01

Entanglement entropy is now widely accepted as having deep connections with quantum gravity. It is therefore desirable to understand it in the context of causal sets, especially since they provide in a natural manner the UV cutoff needed to render entanglement entropy finite. Formulating a notion of entanglement entropy in a causal set is not straightforward because the type of canonical hypersurface-data on which its definition typically relies is not available. Instead, we appeal to the more global expression given in Sorkin (2012 (arXiv:1205.2953)) which, for a Gaussian scalar field, expresses the entropy of a spacetime region in terms of the field’s correlation function within that region (its ‘Wightman function’ W(x, x') ). Carrying this formula over to the causal set, one obtains an entropy which is both finite and of a Lorentz invariant nature. We evaluate this global entropy-expression numerically for certain regions (primarily order-intervals or ‘causal diamonds’) within causal sets of 1  +  1 dimensions. For the causal-set counterpart of the entanglement entropy, we obtain, in the first instance, a result that follows a (spacetime) volume law instead of the expected (spatial) area law. We find, however, that one obtains an area law if one truncates the commutator function (‘Pauli–Jordan operator’) and the Wightman function by projecting out the eigenmodes of the Pauli–Jordan operator whose eigenvalues are too close to zero according to a geometrical criterion which we describe more fully below. In connection with these results and the questions they raise, we also study the ‘entropy of coarse-graining’ generated by thinning out the causal set, and we compare it with what one obtains by similarly thinning out a chain of harmonic oscillators, finding the same, ‘universal’ behaviour in both cases.

Quantum statistical entropy for Kerr-de Sitter black hole

Institute of Scientific and Technical Information of China (English)

Zhang Li-Chun; Wu Yue-Qin; Zhao Ren

2004-01-01

Improving the membrane model by which the entropy of the black hole is studied, we study the entropy of the black hole in the non-thermal equilibrium state. To give the problem stated here widespread meaning, we discuss the (n+2)-dimensional de Sitter spacetime. Through discussion, we obtain that the black hole's entropy which contains two horizons (a black hole's horizon and a cosmological horizon) in the non-thermal equilibrium state comprises the entropy corresponding to the black hole's horizon and the entropy corresponding to the cosmological horizon. Furthermore, the entropy of the black hole is a natural property of the black hole. The entropy is irrelevant to the radiation field out of the horizon. This deepens the understanding of the relationship between black hole's entropy and horizon's area. A way to study the bosonic and fermionic entropy of the black hole in high non-thermal equilibrium spacetime is given.

Definition of Nonequilibrium Entropy of General Systems

OpenAIRE

Mei, Xiaochun

1999-01-01

The definition of nonequilibrium entropy is provided for the general nonequilibrium processes by connecting thermodynamics with statistical physics, and the principle of entropy increment in the nonequilibrium processes is also proved in the paper. The result shows that the definition of nonequilibrium entropy is not unique.

Algebraic topological entropy

International Nuclear Information System (INIS)

Hudetz, T.

1989-01-01

As a 'by-product' of the Connes-Narnhofer-Thirring theory of dynamical entropy for (originally non-Abelian) nuclear C * -algebras, the well-known variational principle for topological entropy is eqivalently reformulated in purly algebraically defined terms for (separable) Abelian C * -algebras. This 'algebraic variational principle' should not only nicely illustrate the 'feed-back' of methods developed for quantum dynamical systems to the classical theory, but it could also be proved directly by 'algebraic' methods and could thus further simplify the original proof of the variational principle (at least 'in principle'). 23 refs. (Author)

Combinatorial Image Entropy

DEFF Research Database (Denmark)

Yuri, Shtarkov; Justesen, Jørn

1997-01-01

The concept of entropy for an image on a discrete two dimensional grid is introduced. This concept is used as an information theoretic bound on the coding rate for the image. It is proved that this quantity exists as a limit for arbitrary sets satisfying certain conditions.......The concept of entropy for an image on a discrete two dimensional grid is introduced. This concept is used as an information theoretic bound on the coding rate for the image. It is proved that this quantity exists as a limit for arbitrary sets satisfying certain conditions....

Entropy of Vaidya-deSitter Spacetime

Institute of Scientific and Technical Information of China (English)

LI Xiang; ZHAO Zheng

2001-01-01

As a statistical model of black hole entropy, the brick-wall method based on the thermal equilibrium in a large scale cannot be applied to the cases out of equilibrium, such as the non-static hole or the case with two horizons.However, the leading term of hole entropy called the Bekenstein-Hawking entropy comes from the contribution of the field near the horizon. According to this idea, the entropy of Vaidya-deSitter spacetime is calculated. A difference from the static case is that the result proportional to the area of horizon relies on a time-dependent cut-off. The condition of local equilibrium near the horizon is used as a working postulate.

Thermoeconomic diagnosis and entropy generation paradox

DEFF Research Database (Denmark)

Sigthorsson, Oskar; Ommen, Torben Schmidt; Elmegaard, Brian

2017-01-01

In the entropy generation paradox, the entropy generation number, as a function of heat exchanger effectiveness, counter-intuitively approaches zero in two limits symmetrically from a single maximum. In thermoeconomic diagnosis, namely in the characteristic curve method, the exergy destruction...... to the entropy generation paradox, as a decreased heat exchanger effectiveness (as in the case of an operation anomaly in the component) can counter-intuitively result in decreased exergy destruction rate of the component. Therefore, along with an improper selection of independent variables, the heat exchanger...... increases in case of an operation anomaly in a component. The normalised exergy destruction rate as the dependent variable therefore resolves the relation of the characteristic curve method with the entropy generation paradox....

Black brane entropy and hydrodynamics

NARCIS (Netherlands)

Booth, I.; Heller, M.P.; Spaliński, M.

2010-01-01

A generalization of entropy to near-equilibrium phenomena is provided by the notion of a hydrodynamic entropy current. Recent advances in holography have lead to the formulation of fluid-gravity duality, a remarkable connection between the hydrodynamics of certain strongly coupled media and dynamics

Black brane entropy and hydrodynamics

NARCIS (Netherlands)

Booth, I.; Heller, M.P.; Spaliński, M.

2011-01-01

A generalization of entropy to near-equilibrium phenomena is provided by the notion of a hydrodynamic entropy current. Recent advances in holography have lead to the formulation of fluid-gravity duality, a remarkable connection between the hydrodynamics of certain strongly coupled media and dynamics

On variational definition of quantum entropy

International Nuclear Information System (INIS)

Belavkin, Roman V.

2015-01-01

Entropy of distribution P can be defined in at least three different ways: 1) as the expectation of the Kullback-Leibler (KL) divergence of P from elementary δ-measures (in this case, it is interpreted as expected surprise); 2) as a negative KL-divergence of some reference measure ν from the probability measure P; 3) as the supremum of Shannon’s mutual information taken over all channels such that P is the output probability, in which case it is dual of some transportation problem. In classical (i.e. commutative) probability, all three definitions lead to the same quantity, providing only different interpretations of entropy. In non-commutative (i.e. quantum) probability, however, these definitions are not equivalent. In particular, the third definition, where the supremum is taken over all entanglements of two quantum systems with P being the output state, leads to the quantity that can be twice the von Neumann entropy. It was proposed originally by V. Belavkin and Ohya [1] and called the proper quantum entropy, because it allows one to define quantum conditional entropy that is always non-negative. Here we extend these ideas to define also quantum counterpart of proper cross-entropy and cross-information. We also show inequality for the values of classical and quantum information

Twinning of Polymer Crystals Suppressed by Entropy

Directory of Open Access Journals (Sweden)

Nikos Ch. Karayiannis

2014-09-01

Full Text Available We propose an entropic argument as partial explanation of the observed scarcity of twinned structures in crystalline samples of synthetic organic polymeric materials. Polymeric molecules possess a much larger number of conformational degrees of freedom than low molecular weight substances. The preferred conformations of polymer chains in the bulk of a single crystal are often incompatible with the conformations imposed by the symmetry of a growth twin, both at the composition surfaces and in the twin axis. We calculate the differences in conformational entropy between chains in single crystals and chains in twinned crystals, and find that the reduction in chain conformational entropy in the twin is sufficient to make the single crystal the stable thermodynamic phase. The formation of cyclic twins in molecular dynamics simulations of chains of hard spheres must thus be attributed to kinetic factors. In more realistic polymers this entropic contribution to the free energy can be canceled or dominated by nonbonded and torsional energetics.

Progress in Preparation and Research of High Entropy Alloys

Directory of Open Access Journals (Sweden)

CHEN Yong-xing

2017-11-01

Full Text Available The current high entropy alloys' studies are most in block, powder, coating, film and other areas. There are few studies of high entropy alloys in other areas and they are lack of unified classification. According to the current high entropy alloys' research situation, The paper has focused on the classification on all kinds of high entropy alloys having been researched, introduced the selecting principle of elements, summarized the preparation methods, reviewed the research institutions, research methods and research contents of high entropy alloys, prospected the application prospect of high entropy alloys, put forward a series of scientific problems of high entropy alloys, including less research on mechanism, incomplete performance research, unsystematic thermal stability study, preparation process parameters to be optimized, lightweight high entropy alloys' design, the expansion on the research field, etc, and the solutions have been given. Those have certain guiding significance for the expansion of the application of high entropy alloys subjects in the future research direction.

Entropy and information causality in general probabilistic theories

International Nuclear Information System (INIS)

Barnum, Howard; Leifer, Matthew; Spekkens, Robert; Barrett, Jonathan; Clark, Lisa Orloff; Stepanik, Nicholas; Wilce, Alex; Wilke, Robin

2010-01-01

We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality (IC) recently proposed by Pawlowski et al (2009 arXiv:0905.2292). We consider two entropic quantities, which we term measurement and mixing entropy. In the context of classical and quantum theory, these coincide, being given by the Shannon and von Neumann entropies, respectively; in general, however, they are very different. In particular, while measurement entropy is easily seen to be concave, mixing entropy need not be. In fact, as we show, mixing entropy is not concave whenever the state space is a non-simplicial polytope. Thus, the condition that measurement and mixing entropies coincide is a strong constraint on possible theories. We call theories with this property monoentropic. Measurement entropy is subadditive, but not in general strongly subadditive. Equivalently, if we define the mutual information between two systems A and B by the usual formula I(A: B)=H(A)+H(B)-H(AB), where H denotes the measurement entropy and AB is a non-signaling composite of A and B, then it can happen that I(A:BC)< I(A:B). This is relevant to IC in the sense of Pawlowski et al: we show that any monoentropic non-signaling theory in which measurement entropy is strongly subadditive, and also satisfies a version of the Holevo bound, is informationally causal, and on the other hand we observe that Popescu-Rohrlich boxes, which violate IC, also violate strong subadditivity. We also explore the interplay between measurement and mixing entropy and various natural conditions on theories that arise in quantum axiomatics.

Permutation Entropy: New Ideas and Challenges

Directory of Open Access Journals (Sweden)

Karsten Keller

2017-03-01

Full Text Available Over recent years, some new variants of Permutation entropy have been introduced and applied to EEG analysis, including a conditional variant and variants using some additional metric information or being based on entropies that are different from the Shannon entropy. In some situations, it is not completely clear what kind of information the new measures and their algorithmic implementations provide. We discuss the new developments and illustrate them for EEG data.

High Entropy Random Selection Protocols

NARCIS (Netherlands)

H. Buhrman (Harry); M. Christandl (Matthias); M. Koucky (Michal); Z. Lotker (Zvi); B. Patt-Shamir; M. Charikar; K. Jansen; O. Reingold; J. Rolim

2007-01-01

textabstractIn this paper, we construct protocols for two parties that do not trust each other, to generate random variables with high Shannon entropy. We improve known bounds for the trade off between the number of rounds, length of communication and the entropy of the outcome.

Renyi entropy and conformal defects

Energy Technology Data Exchange (ETDEWEB)

Bianchi, Lorenzo [Humboldt-Univ. Berlin (Germany). Inst. fuer Physik; Hamburg Univ. (Germany). II. Inst. fuer Theoretische Physik; Meineri, Marco [Scuola Normale Superiore, Pisa (Italy); Perimeter Institute for Theoretical Physics, Waterloo, ON (Canada); Istituto Nazionale di Fisica Nucleare, Pisa (Italy); Myers, Robert C. [Perimeter Institute for Theoretical Physics, Waterloo, ON (Canada); Smolkin, Michael [California Univ., Berkely, CA (United States). Center for Theoretical Physics and Department of Physics

2016-04-18

We propose a field theoretic framework for calculating the dependence of Renyi entropies on the shape of the entangling surface in a conformal field theory. Our approach rests on regarding the corresponding twist operator as a conformal defect and in particular, we define the displacement operator which implements small local deformations of the entangling surface. We identify a simple constraint between the coefficient defining the two-point function of the displacement operator and the conformal weight of the twist operator, which consolidates a number of distinct conjectures on the shape dependence of the Renyi entropy. As an example, using this approach, we examine a conjecture regarding the universal coefficient associated with a conical singularity in the entangling surface for CFTs in any number of spacetime dimensions. We also provide a general formula for the second order variation of the Renyi entropy arising from small deformations of a spherical entangling surface, extending Mezei's results for the entanglement entropy.

Renyi entropy and conformal defects

International Nuclear Information System (INIS)

Bianchi, Lorenzo; Myers, Robert C.; Smolkin, Michael

2016-01-01

We propose a field theoretic framework for calculating the dependence of Renyi entropies on the shape of the entangling surface in a conformal field theory. Our approach rests on regarding the corresponding twist operator as a conformal defect and in particular, we define the displacement operator which implements small local deformations of the entangling surface. We identify a simple constraint between the coefficient defining the two-point function of the displacement operator and the conformal weight of the twist operator, which consolidates a number of distinct conjectures on the shape dependence of the Renyi entropy. As an example, using this approach, we examine a conjecture regarding the universal coefficient associated with a conical singularity in the entangling surface for CFTs in any number of spacetime dimensions. We also provide a general formula for the second order variation of the Renyi entropy arising from small deformations of a spherical entangling surface, extending Mezei's results for the entanglement entropy.

Information and Entropy

Science.gov (United States)

Caticha, Ariel

2007-11-01

What is information? Is it physical? We argue that in a Bayesian theory the notion of information must be defined in terms of its effects on the beliefs of rational agents. Information is whatever constrains rational beliefs and therefore it is the force that induces us to change our minds. This problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting method of Maximum relative Entropy (ME), which is designed for updating from arbitrary priors given information in the form of arbitrary constraints, includes as special cases both MaxEnt (which allows arbitrary constraints) and Bayes' rule (which allows arbitrary priors). Thus, ME unifies the two themes of these workshops—the Maximum Entropy and the Bayesian methods—into a single general inference scheme that allows us to handle problems that lie beyond the reach of either of the two methods separately. I conclude with a couple of simple illustrative examples.

ENTROPIES AND FLUX-SPLITTINGS FOR THE ISENTROPIC EULER EQUATIONS

Institute of Scientific and Technical Information of China (English)

无

2001-01-01

The authors establish the existence of a large class of mathematical entropies (the so-called weak entropies) associated with the Euler equations for an isentropic, compressible fluid governed by a general pressure law. A mild assumption on the behavior of the pressure law near the vacuum is solely required. The analysis is based on an asymptotic expansion of the fundamental solution (called here the entropy kernel) of a highly singular Euler-Poisson-Darboux equation. The entropy kernel is only H lder continuous and its regularity is carefully investigated. Relying on a notion introduced earlier by the authors, it is also proven that, for the Euler equations, the set of entropy flux-splittings coincides with the set of entropies-entropy fluxes. These results imply the existence of a flux-splitting consistent with all of the entropy inequalities.

The pigeon's discrimination of visual entropy: a logarithmic function.

Science.gov (United States)

Young, Michael E; Wasserman, Edward A

2002-11-01

We taught 8 pigeons to discriminate 16-icon arrays that differed in their visual variability or "entropy" to see whether the relationship between entropy and discriminative behavior is linear (in which equivalent differences in entropy should produce equivalent changes in behavior) or logarithmic (in which higher entropy values should be less discriminable from one another than lower entropy values). Pigeons received a go/no-go task in which the lower entropy arrays were reinforced for one group and the higher entropy arrays were reinforced for a second group. The superior discrimination of the second group was predicted by a theoretical analysis in which excitatory and inhibitory stimulus generalization gradients fall along a logarithmic, but not a linear scale. Reanalysis of previously published data also yielded results consistent with a logarithmic relationship between entropy and discriminative behavior.

The Conditional Entropy Power Inequality for Bosonic Quantum Systems

DEFF Research Database (Denmark)

de Palma, Giacomo; Trevisan, Dario

2018-01-01

We prove the conditional Entropy Power Inequality for Gaussian quantum systems. This fundamental inequality determines the minimum quantum conditional von Neumann entropy of the output of the beam-splitter or of the squeezing among all the input states where the two inputs are conditionally...... independent given the memory and have given quantum conditional entropies. We also prove that, for any couple of values of the quantum conditional entropies of the two inputs, the minimum of the quantum conditional entropy of the output given by the conditional Entropy Power Inequality is asymptotically...... achieved by a suitable sequence of quantum Gaussian input states. Our proof of the conditional Entropy Power Inequality is based on a new Stam inequality for the quantum conditional Fisher information and on the determination of the universal asymptotic behaviour of the quantum conditional entropy under...

Time-dependent entropy evolution in microscopic and macroscopic electromagnetic relaxation

International Nuclear Information System (INIS)

Baker-Jarvis, James

2005-01-01

This paper is a study of entropy and its evolution in the time and frequency domains upon application of electromagnetic fields to materials. An understanding of entropy and its evolution in electromagnetic interactions bridges the boundaries between electromagnetism and thermodynamics. The approach used here is a Liouville-based statistical-mechanical theory. I show that the microscopic entropy is reversible and the macroscopic entropy satisfies an H theorem. The spectral entropy development can be very useful for studying the frequency response of materials. Using a projection-operator based nonequilibrium entropy, different equations are derived for the entropy and entropy production and are applied to the polarization, magnetization, and macroscopic fields. I begin by proving an exact H theorem for the entropy, progress to application of time-dependent entropy in electromagnetics, and then apply the theory to relevant applications in electromagnetics. The paper concludes with a discussion of the relationship of the frequency-domain form of the entropy to the permittivity, permeability, and impedance

Minimal entropy approximation for cellular automata

International Nuclear Information System (INIS)

Fukś, Henryk

2014-01-01

We present a method for the construction of approximate orbits of measures under the action of cellular automata which is complementary to the local structure theory. The local structure theory is based on the idea of Bayesian extension, that is, construction of a probability measure consistent with given block probabilities and maximizing entropy. If instead of maximizing entropy one minimizes it, one can develop another method for the construction of approximate orbits, at the heart of which is the iteration of finite-dimensional maps, called minimal entropy maps. We present numerical evidence that the minimal entropy approximation sometimes outperforms the local structure theory in characterizing the properties of cellular automata. The density response curve for elementary CA rule 26 is used to illustrate this claim. (paper)

Entropy and Entanglement of the Electromagnetically Induced Transparency System

Institute of Scientific and Technical Information of China (English)

LIU Xiao-Juan; FANG Mao-Fa; ZHOU Qing-Ping

2004-01-01

@@ We study the entropy and the entanglement of an electromagnetically induced transparency system. The quantum entanglement between the atom and the two quantized laser fields is discussed by using quantum reduced entropy and that between the two quantized laser fields by using quantum relative entropy. We also examine whether influences of EIT on entropy and quantum entanglement of the system considered occur or not. Our results show that the minimum value of the atomic reduced entropy may be regarded as an entropy criterion on the electromagnetically induced transparency occurring.

Stock Selection for Portfolios Using Expected Utility-Entropy Decision Model

Directory of Open Access Journals (Sweden)

Jiping Yang

2017-09-01

Full Text Available Yang and Qiu proposed and then recently improved an expected utility-entropy (EU-E measure of risk and decision model. When segregation holds, Luce et al. derived an expected utility term, plus a constant multiplies the Shannon entropy as the representation of risky choices, further demonstrating the reasonability of the EU-E decision model. In this paper, we apply the EU-E decision model to selecting the set of stocks to be included in the portfolios. We first select 7 and 10 stocks from the 30 component stocks of Dow Jones Industrial Average index, and then derive and compare the efficient portfolios in the mean-variance framework. The conclusions imply that efficient portfolios composed of 7(10 stocks selected using the EU-E model with intermediate intervals of the tradeoff coefficients are more efficient than that composed of the sets of stocks selected using the expected utility model. Furthermore, the efficient portfolio of 7(10 stocks selected by the EU-E decision model have almost the same efficient frontier as that of the sample of all stocks. This suggests the necessity of incorporating both the expected utility and Shannon entropy together when taking risky decisions, further demonstrating the importance of Shannon entropy as the measure of uncertainty, as well as the applicability of the EU-E model as a decision-making model.

On thermodynamic limits of entropy densities

NARCIS (Netherlands)

Moriya, H; Van Enter, A

We give some sufficient conditions which guarantee that the entropy density in the thermodynamic limit is equal to the thermodynamic limit of the entropy densities of finite-volume (local) Gibbs states.

Low Streamflow Forcasting using Minimum Relative Entropy

Science.gov (United States)

Cui, H.; Singh, V. P.

2013-12-01

Minimum relative entropy spectral analysis is derived in this study, and applied to forecast streamflow time series. Proposed method extends the autocorrelation in the manner that the relative entropy of underlying process is minimized so that time series data can be forecasted. Different prior estimation, such as uniform, exponential and Gaussian assumption, is taken to estimate the spectral density depending on the autocorrelation structure. Seasonal and nonseasonal low streamflow series obtained from Colorado River (Texas) under draught condition is successfully forecasted using proposed method. Minimum relative entropy determines spectral of low streamflow series with higher resolution than conventional method. Forecasted streamflow is compared to the prediction using Burg's maximum entropy spectral analysis (MESA) and Configurational entropy. The advantage and disadvantage of each method in forecasting low streamflow is discussed.

Increased signaling entropy in cancer requires the scale-free property of protein interaction networks

Science.gov (United States)

Teschendorff, Andrew E.; Banerji, Christopher R. S.; Severini, Simone; Kuehn, Reimer; Sollich, Peter

2015-01-01

One of the key characteristics of cancer cells is an increased phenotypic plasticity, driven by underlying genetic and epigenetic perturbations. However, at a systems-level it is unclear how these perturbations give rise to the observed increased plasticity. Elucidating such systems-level principles is key for an improved understanding of cancer. Recently, it has been shown that signaling entropy, an overall measure of signaling pathway promiscuity, and computable from integrating a sample's gene expression profile with a protein interaction network, correlates with phenotypic plasticity and is increased in cancer compared to normal tissue. Here we develop a computational framework for studying the effects of network perturbations on signaling entropy. We demonstrate that the increased signaling entropy of cancer is driven by two factors: (i) the scale-free (or near scale-free) topology of the interaction network, and (ii) a subtle positive correlation between differential gene expression and node connectivity. Indeed, we show that if protein interaction networks were random graphs, described by Poisson degree distributions, that cancer would generally not exhibit an increased signaling entropy. In summary, this work exposes a deep connection between cancer, signaling entropy and interaction network topology. PMID:25919796

Entropy Measurement for Biometric Verification Systems.

Science.gov (United States)

Lim, Meng-Hui; Yuen, Pong C

2016-05-01

Biometric verification systems are designed to accept multiple similar biometric measurements per user due to inherent intrauser variations in the biometric data. This is important to preserve reasonable acceptance rate of genuine queries and the overall feasibility of the recognition system. However, such acceptance of multiple similar measurements decreases the imposter's difficulty of obtaining a system-acceptable measurement, thus resulting in a degraded security level. This deteriorated security needs to be measurable to provide truthful security assurance to the users. Entropy is a standard measure of security. However, the entropy formula is applicable only when there is a single acceptable possibility. In this paper, we develop an entropy-measuring model for biometric systems that accepts multiple similar measurements per user. Based on the idea of guessing entropy, the proposed model quantifies biometric system security in terms of adversarial guessing effort for two practical attacks. Excellent agreement between analytic and experimental simulation-based measurement results on a synthetic and a benchmark face dataset justify the correctness of our model and thus the feasibility of the proposed entropy-measuring approach.

On quantum Rényi entropies: A new generalization and some properties

International Nuclear Information System (INIS)

Müller-Lennert, Martin; Dupuis, Frédéric; Szehr, Oleg; Fehr, Serge; Tomamichel, Marco

2013-01-01

The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation

Chain rules for smooth min-and max-entropies

DEFF Research Database (Denmark)

Vitanov, Alexande; Dupont-Dupuis, Fréderic; Tomamichel, Marco

2013-01-01

The chain rule for the Shannon and von Neumann en- tropy, which relates the total entropy of a system to the entropies of its parts, is of central importance to information theory. Here, we consider the chain rule for the more general smooth min- and max-entropies, used in one-shot in formation...... theory. For these en- tropy measures, the chain rule no longer holds as an equality. How- ever, the standard chain rule for the von Neum ann entropy is re- trieved asymptotically when evaluating the smooth entropies for many identical and independently distributed states....

A note on entanglement entropy and quantum geometry

International Nuclear Information System (INIS)

Bodendorfer, N

2014-01-01

It has been argued that the entropy computed in the isolated horizon framework of loop quantum gravity is closely related to the entanglement entropy of the gravitational field, and that the calculation performed is not restricted to horizons. We recall existing work on this issue and explain how recent work on generalizing these computations to arbitrary spacetime dimensions D+1⩾3 supports this point of view and makes the duality between entanglement entropy and the entropy computed from counting boundary states manifest. In a certain semiclassical regime in 3+1 dimensions, this entropy is given by the Bekenstein–Hawking formula. (paper)

A review of entropy generation in microchannels

Directory of Open Access Journals (Sweden)

Mohamed M Awad

2015-12-01

Full Text Available In this study, a critical review of thermodynamic optimum of microchannels based on entropy generation analysis is presented. Using entropy generation analysis as evaluation parameter of microchannels has been reported by many studies in the literature. In these studies, different working fluids such as nanofluids, air, water, engine oil, aniline, ethylene glycol, and non-Newtonian fluids have been used. For the case of nanofluids, “nanoparticles” has been used in various kinds such as Al2O3 and Cu, and “base fluid” has been used in various kinds such as water and ethylene glycol. Furthermore, studies on thermodynamic optimum of microchannels based on entropy generation analysis are summarized in a table. At the end, recommendations of future work for thermodynamic optimum of microchannels based on entropy generation analysis are given. As a result, this article can not only be used as the starting point for the researcher interested in entropy generation in microchannels, but it also includes recommendations for future studies on entropy generation in microchannels.

Trajectories entropy in dynamical graphs with memory

Directory of Open Access Journals (Sweden)

Francesco eCaravelli

2016-04-01

Full Text Available In this paper we investigate the application of non-local graph entropy to evolving and dynamical graphs. The measure is based upon the notion of Markov diffusion on a graph, and relies on the entropy applied to trajectories originating at a specific node. In particular, we study the model of reinforcement-decay graph dynamics, which leads to scale free graphs. We find that the node entropy characterizes the structure of the network in the two parameter phase-space describing the dynamical evolution of the weighted graph. We then apply an adapted version of the entropy measure to purely memristive circuits. We provide evidence that meanwhile in the case of DC voltage the entropy based on the forward probability is enough to characterize the graph properties, in the case of AC voltage generators one needs to consider both forward and backward based transition probabilities. We provide also evidence that the entropy highlights the self-organizing properties of memristive circuits, which re-organizes itself to satisfy the symmetries of the underlying graph.

A gravitational entropy proposal

International Nuclear Information System (INIS)

Clifton, Timothy; Tavakol, Reza; Ellis, George F R

2013-01-01

We propose a thermodynamically motivated measure of gravitational entropy based on the Bel–Robinson tensor, which has a natural interpretation as the effective super-energy–momentum tensor of free gravitational fields. The specific form of this measure differs depending on whether the gravitational field is Coulomb-like or wave-like, and reduces to the Bekenstein–Hawking value when integrated over the interior of a Schwarzschild black hole. For scalar perturbations of a Robertson–Walker geometry we find that the entropy goes like the Hubble weighted anisotropy of the gravitational field, and therefore increases as structure formation occurs. This is in keeping with our expectations for the behaviour of gravitational entropy in cosmology, and provides a thermodynamically motivated arrow of time for cosmological solutions of Einstein’s field equations. It is also in keeping with Penrose’s Weyl curvature hypothesis. (paper)

Entropy of isolated quantum systems after a quench.

Science.gov (United States)

Santos, Lea F; Polkovnikov, Anatoli; Rigol, Marcos

2011-07-22

A diagonal entropy, which depends only on the diagonal elements of the system's density matrix in the energy representation, has been recently introduced as the proper definition of thermodynamic entropy in out-of-equilibrium quantum systems. We study this quantity after an interaction quench in lattice hard-core bosons and spinless fermions, and after a local chemical potential quench in a system of hard-core bosons in a superlattice potential. The former systems have a chaotic regime, where the diagonal entropy becomes equivalent to the equilibrium microcanonical entropy, coinciding with the onset of thermalization. The latter system is integrable. We show that its diagonal entropy is additive and different from the entropy of a generalized Gibbs ensemble, which has been introduced to account for the effects of conserved quantities at integrability.

ECG contamination of EEG signals: effect on entropy.

Science.gov (United States)

Chakrabarti, Dhritiman; Bansal, Sonia

2016-02-01

Entropy™ is a proprietary algorithm which uses spectral entropy analysis of electroencephalographic (EEG) signals to produce indices which are used as a measure of depth of hypnosis. We describe a report of electrocardiographic (ECG) contamination of EEG signals leading to fluctuating erroneous Entropy values. An explanation is provided for mechanism behind this observation by describing the spread of ECG signals in head and neck and its influence on EEG/Entropy by correlating the observation with the published Entropy algorithm. While the Entropy algorithm has been well conceived, there are still instances in which it can produce erroneous values. Such erroneous values and their cause may be identified by close scrutiny of the EEG waveform if Entropy values seem out of sync with that expected at given anaesthetic levels.

Entropy in the Tangled Nature Model of evolution

DEFF Research Database (Denmark)

Roach, Ty N.F.; Nulton, James; Sibani, Paolo

2017-01-01

Applications of entropy principles to evolution and ecology are of tantamount importance given the central role spatiotemporal structuring plays in both evolution and ecological succession. We obtain here a qualitative interpretation of the role of entropy in evolving ecological systems. Our...... interpretation is supported by mathematical arguments using simulation data generated by the Tangled Nature Model (TNM), a stochastic model of evolving ecologies. We define two types of configurational entropy and study their empirical time dependence obtained from the data. Both entropy measures increase...... logarithmically with time, while the entropy per individual decreases in time, in parallel with the growth of emergent structures visible from other aspects of the simulation. We discuss the biological relevance of these entropies to describe niche space and functional space of ecosystems, as well as their use...

Entropy of orthogonal polynomials with Freud weights and information entropies of the harmonic oscillator potential

Science.gov (United States)

Van Assche, W.; Yáñez, R. J.; Dehesa, J. S.

1995-08-01

The information entropy of the harmonic oscillator potential V(x)=1/2λx2 in both position and momentum spaces can be expressed in terms of the so-called ``entropy of Hermite polynomials,'' i.e., the quantity Sn(H):= -∫-∞+∞H2n(x)log H2n(x) e-x2dx. These polynomials are instances of the polynomials orthogonal with respect to the Freud weights w(x)=exp(-||x||m), m≳0. Here, a very precise and general result of the entropy of Freud polynomials recently established by Aptekarev et al. [J. Math. Phys. 35, 4423-4428 (1994)], specialized to the Hermite kernel (case m=2), leads to an important refined asymptotic expression for the information entropies of very excited states (i.e., for large n) in both position and momentum spaces, to be denoted by Sρ and Sγ, respectively. Briefly, it is shown that, for large values of n, Sρ+1/2logλ≂log(π√2n/e)+o(1) and Sγ-1/2log λ≂log(π√2n/e)+o(1), so that Sρ+Sγ≂log(2π2n/e2)+o(1) in agreement with the generalized indetermination relation of Byalinicki-Birula and Mycielski [Commun. Math. Phys. 44, 129-132 (1975)]. Finally, the rate of convergence of these two information entropies is numerically analyzed. In addition, using a Rakhmanov result, we describe a totally new proof of the leading term of the entropy of Freud polynomials which, naturally, is just a weak version of the aforementioned general result.

Entropy and wigner functions

Science.gov (United States)

Manfredi; Feix

2000-10-01

The properties of an alternative definition of quantum entropy, based on Wigner functions, are discussed. Such a definition emerges naturally from the Wigner representation of quantum mechanics, and can easily quantify the amount of entanglement of a quantum state. It is shown that smoothing of the Wigner function induces an increase in entropy. This fact is used to derive some simple rules to construct positive-definite probability distributions which are also admissible Wigner functions.

Entropy and Wigner Functions

OpenAIRE

Manfredi, G.; Feix, M. R.

2002-01-01

The properties of an alternative definition of quantum entropy, based on Wigner functions, are discussed. Such definition emerges naturally from the Wigner representation of quantum mechanics, and can easily quantify the amount of entanglement of a quantum state. It is shown that smoothing of the Wigner function induces an increase in entropy. This fact is used to derive some simple rules to construct positive definite probability distributions which are also admissible Wigner functions

Feasible Histories, Maximum Entropy

International Nuclear Information System (INIS)

Pitowsky, I.

1999-01-01

We consider the broadest possible consistency condition for a family of histories, which extends all previous proposals. A family that satisfies this condition is called feasible. On each feasible family of histories we choose a probability measure by maximizing entropy, while keeping the probabilities of commuting histories to their quantum mechanical values. This procedure is justified by the assumption that decoherence increases entropy. Finally, a criterion for identifying the nearly classical families is proposed

Regularities of changes of metal melting entropy

International Nuclear Information System (INIS)

Kats, S.A.; Chekhovskoj, V.Ya.

1980-01-01

Most trustworthy data on temperatures, heats and entropies of fusion of metals have been used as a basis to throw light on the laws governing variations of the entropy of metals fusion. The elaborated procedure is used to predict the entropies of the metals fusion whose thermodynamic properties under high temperatures have not yet been investigated

Enthalpy-entropy compensation: the role of solvation.

Science.gov (United States)

Dragan, Anatoliy I; Read, Christopher M; Crane-Robinson, Colyn

2017-05-01

Structural modifications to interacting systems frequently lead to changes in both the enthalpy (heat) and entropy of the process that compensate each other, so that the Gibbs free energy is little changed: a major barrier to the development of lead compounds in drug discovery. The conventional explanation for such enthalpy-entropy compensation (EEC) is that tighter contacts lead to a more negative enthalpy but increased molecular constraints, i.e., a compensating conformational entropy reduction. Changes in solvation can also contribute to EEC but this contribution is infrequently discussed. We review long-established and recent cases of EEC and conclude that the large fluctuations in enthalpy and entropy observed are too great to be a result of only conformational changes and must result, to a considerable degree, from variations in the amounts of water immobilized or released on forming complexes. Two systems exhibiting EEC show a correlation between calorimetric entropies and local mobilities, interpreted to mean conformational control of the binding entropy/free energy. However, a substantial contribution from solvation gives the same effect, as a consequence of a structural link between the amount of bound water and the protein flexibility. Only by assuming substantial changes in solvation-an intrinsically compensatory process-can a more complete understanding of EEC be obtained. Faced with such large, and compensating, changes in the enthalpies and entropies of binding, the best approach to engineering elevated affinities must be through the addition of ionic links, as they generate increased entropy without affecting the enthalpy.

Phonon broadening in high entropy alloys

Science.gov (United States)

Körmann, Fritz; Ikeda, Yuji; Grabowski, Blazej; Sluiter, Marcel H. F.

2017-09-01

Refractory high entropy alloys feature outstanding properties making them a promising materials class for next-generation high-temperature applications. At high temperatures, materials properties are strongly affected by lattice vibrations (phonons). Phonons critically influence thermal stability, thermodynamic and elastic properties, as well as thermal conductivity. In contrast to perfect crystals and ordered alloys, the inherently present mass and force constant fluctuations in multi-component random alloys (high entropy alloys) can induce significant phonon scattering and broadening. Despite their importance, phonon scattering and broadening have so far only scarcely been investigated for high entropy alloys. We tackle this challenge from a theoretical perspective and employ ab initio calculations to systematically study the impact of force constant and mass fluctuations on the phonon spectral functions of 12 body-centered cubic random alloys, from binaries up to 5-component high entropy alloys, addressing the key question of how chemical complexity impacts phonons. We find that it is crucial to include both mass and force constant fluctuations. If one or the other is neglected, qualitatively wrong results can be obtained such as artificial phonon band gaps. We analyze how the results obtained for the phonons translate into thermodynamically integrated quantities, specifically the vibrational entropy. Changes in the vibrational entropy with increasing the number of elements can be as large as changes in the configurational entropy and are thus important for phase stability considerations. The set of studied alloys includes MoTa, MoTaNb, MoTaNbW, MoTaNbWV, VW, VWNb, VWTa, VWNbTa, VTaNbTi, VWNbTaTi, HfZrNb, HfMoTaTiZr.

On quantum Rényi entropies: A new generalization and some properties

Energy Technology Data Exchange (ETDEWEB)

Müller-Lennert, Martin [Department of Mathematics, ETH Zurich, 8092 Zürich (Switzerland); Dupuis, Frédéric [Department of Computer Science, Aarhus University, 8200 Aarhus (Denmark); Szehr, Oleg [Department of Mathematics, Technische Universität München, 85748 Garching (Germany); Fehr, Serge [CWI (Centrum Wiskunde and Informatica), 1090 Amsterdam (Netherlands); Tomamichel, Marco [Centre for Quantum Technologies, National University of Singapore, Singapore 117543 (Singapore)

2013-12-15

The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation.

Analysis of complex time series using refined composite multiscale entropy

International Nuclear Information System (INIS)

Wu, Shuen-De; Wu, Chiu-Wen; Lin, Shiou-Gwo; Lee, Kung-Yen; Peng, Chung-Kang

2014-01-01

Multiscale entropy (MSE) is an effective algorithm for measuring the complexity of a time series that has been applied in many fields successfully. However, MSE may yield an inaccurate estimation of entropy or induce undefined entropy because the coarse-graining procedure reduces the length of a time series considerably at large scales. Composite multiscale entropy (CMSE) was recently proposed to improve the accuracy of MSE, but it does not resolve undefined entropy. Here we propose a refined composite multiscale entropy (RCMSE) to improve CMSE. For short time series analyses, we demonstrate that RCMSE increases the accuracy of entropy estimation and reduces the probability of inducing undefined entropy.

Fault detection of the connection of lithium-ion power batteries based on entropy for electric vehicles

Science.gov (United States)

Yao, Lei; Wang, Zhenpo; Ma, Jun

2015-10-01

This paper proposes a method of fault detection of the connection of Lithium-Ion batteries based on entropy for electric vehicle. In electric vehicle operation process, some factors, such as road conditions, driving habits, vehicle performance, always affect batteries by vibration, which easily cause loosing or virtual connection between batteries. Through the simulation of the battery charging and discharging experiment under vibration environment, the data of voltage fluctuation can be obtained. Meanwhile, an optimal filtering method is adopted using discrete cosine filter method to analyze the characteristics of system noise, based on the voltage set when batteries are working under different vibration frequency. Experimental data processed by filtering is analyzed based on local Shannon entropy, ensemble Shannon entropy and sample entropy. And the best way to find a method of fault detection of the connection of lithium-ion batteries based on entropy is presented for electric vehicle. The experimental data shows that ensemble Shannon entropy can predict the accurate time and the location of battery connection failure in real time. Besides electric-vehicle industry, this method can also be used in other areas in complex vibration environment.

Self-adjusting entropy-stable scheme for compressible Euler equations

Institute of Scientific and Technical Information of China (English)

程晓晗; 聂玉峰; 封建湖; LuoXiao-Yu; 蔡力

2015-01-01

In this work, a self-adjusting entropy-stable scheme is proposed for solving compressible Euler equations. The entropy-stable scheme is constructed by combining the entropy conservative flux with a suitable diffusion operator. The entropy has to be preserved in smooth solutions and be dissipated at shocks. To achieve this, a switch function, based on entropy variables, is employed to make the numerical diffusion term added around discontinuities automatically. The resulting scheme is still entropy-stable. A number of numerical experiments illustrating the robustness and accuracy of the scheme are presented. From these numerical results, we observe a remarkable gain in accuracy.

The Conditional Entropy Power Inequality for Bosonic Quantum Systems

Science.gov (United States)

De Palma, Giacomo; Trevisan, Dario

2018-06-01

We prove the conditional Entropy Power Inequality for Gaussian quantum systems. This fundamental inequality determines the minimum quantum conditional von Neumann entropy of the output of the beam-splitter or of the squeezing among all the input states where the two inputs are conditionally independent given the memory and have given quantum conditional entropies. We also prove that, for any couple of values of the quantum conditional entropies of the two inputs, the minimum of the quantum conditional entropy of the output given by the conditional Entropy Power Inequality is asymptotically achieved by a suitable sequence of quantum Gaussian input states. Our proof of the conditional Entropy Power Inequality is based on a new Stam inequality for the quantum conditional Fisher information and on the determination of the universal asymptotic behaviour of the quantum conditional entropy under the heat semigroup evolution. The beam-splitter and the squeezing are the central elements of quantum optics, and can model the attenuation, the amplification and the noise of electromagnetic signals. This conditional Entropy Power Inequality will have a strong impact in quantum information and quantum cryptography. Among its many possible applications there is the proof of a new uncertainty relation for the conditional Wehrl entropy.

Entanglement entropy evolution under double-trace deformation

Energy Technology Data Exchange (ETDEWEB)

Song, Yushu [College of Physical Science and Technology, Hebei University, Baoding (China)

2017-12-15

In this paper, we study the bulk entanglement entropy evolution in conical BTZ black bole background using the heat kernel method. This is motivated by exploring the new examples where the quantum correction of the entanglement entropy gives the leading contribution. We find that in the large black hole limit the bulk entanglement entropy decreases under the double-trace deformation which is consistent with the holographic c theorem and in the small black hole limit the bulk entanglement entropy increases under the deformation. We also discuss the minimal area correction. (copyright 2017 WILEY-VCH Verlag GmbH and Co. KGaA, Weinheim)

Applications of quantum entropy to statistics

International Nuclear Information System (INIS)

Silver, R.N.; Martz, H.F.

1994-01-01

This paper develops two generalizations of the maximum entropy (ME) principle. First, Shannon classical entropy is replaced by von Neumann quantum entropy to yield a broader class of information divergences (or penalty functions) for statistics applications. Negative relative quantum entropy enforces convexity, positivity, non-local extensivity and prior correlations such as smoothness. This enables the extension of ME methods from their traditional domain of ill-posed in-verse problems to new applications such as non-parametric density estimation. Second, given a choice of information divergence, a combination of ME and Bayes rule is used to assign both prior and posterior probabilities. Hyperparameters are interpreted as Lagrange multipliers enforcing constraints. Conservation principles are proposed to act statistical regularization and other hyperparameters, such as conservation of information and smoothness. ME provides an alternative to heirarchical Bayes methods

Transfer Entropy as a Log-Likelihood Ratio

Science.gov (United States)

Barnett, Lionel; Bossomaier, Terry

2012-09-01

Transfer entropy, an information-theoretic measure of time-directed information transfer between joint processes, has steadily gained popularity in the analysis of complex stochastic dynamics in diverse fields, including the neurosciences, ecology, climatology, and econometrics. We show that for a broad class of predictive models, the log-likelihood ratio test statistic for the null hypothesis of zero transfer entropy is a consistent estimator for the transfer entropy itself. For finite Markov chains, furthermore, no explicit model is required. In the general case, an asymptotic χ2 distribution is established for the transfer entropy estimator. The result generalizes the equivalence in the Gaussian case of transfer entropy and Granger causality, a statistical notion of causal influence based on prediction via vector autoregression, and establishes a fundamental connection between directed information transfer and causality in the Wiener-Granger sense.

Renormalization group flow of entanglement entropy on spheres

Energy Technology Data Exchange (ETDEWEB)

Ben-Ami, Omer; Carmi, Dean [Raymond and Beverly Sackler Faculty of Exact Sciences School of Physics and Astronomy,Tel-Aviv University, Ramat-Aviv 69978 (Israel); Smolkin, Michael [Center for Theoretical Physics and Department of Physics,University of California, Berkeley, CA 94720 (United States)

2015-08-12

We explore entanglement entropy of a cap-like region for a generic quantum field theory residing in the Bunch-Davies vacuum on de Sitter space. Entanglement entropy in our setup is identical with the thermal entropy in the static patch of de Sitter, and we derive a simple relation between the vacuum expectation value of the energy-momentum tensor trace and the RG flow of entanglement entropy. In particular, renormalization of the bare couplings and logarithmic divergence of the entanglement entropy are interrelated in our setup. We confirm our findings by recovering known universal contributions for a free field theory deformed by a mass operator as well as obtain correct universal behaviour at the fixed points. Simple examples of entanglement entropy flows are elaborated in d=2,3,4. In three dimensions we find that while the renormalized entanglement entropy is stationary at the fixed points, it is not monotonic. We provide a computational evidence that the universal ‘area law’ for a conformally coupled scalar is different from the known result in the literature, and argue that this difference survives in the limit of flat space. Finally, we carry out the spectral decomposition of entanglement entropy flow and discuss its application to the F-theorem.

Entanglement entropy after selective measurements in quantum chains

Energy Technology Data Exchange (ETDEWEB)

Najafi, Khadijeh [Department of Physics, Georgetown University,37th and O Sts. NW, Washington, DC 20057 (United States); Rajabpour, M.A. [Instituto de Física, Universidade Federal Fluminense,Av. Gal. Milton Tavares de Souza s/n, Gragoatá, 24210-346, Niterói, RJ (Brazil)

2016-12-22

We study bipartite post measurement entanglement entropy after selective measurements in quantum chains. We first study the quantity for the critical systems that can be described by conformal field theories. We find a connection between post measurement entanglement entropy and the Casimir energy of floating objects. Then we provide formulas for the post measurement entanglement entropy for open and finite temperature systems. We also comment on the Affleck-Ludwig boundary entropy in the context of the post measurement entanglement entropy. Finally, we also provide some formulas regarding modular hamiltonians and entanglement spectrum in the after measurement systems. After through discussion regarding CFT systems we also provide some predictions regarding massive field theories. We then discuss a generic method to calculate the post measurement entanglement entropy in the free fermion systems. Using the method we study the post measurement entanglement entropy in the XY spin chain. We check numerically the CFT and the massive field theory results in the transverse field Ising chain and the XX model. In particular, we study the post meaurement entanglement entropy in the infinite, periodic and open critical transverse field Ising chain and the critical XX model. The effect of the temperature and the gap is also discussed in these models.

Entanglement entropy after selective measurements in quantum chains

International Nuclear Information System (INIS)

Najafi, Khadijeh; Rajabpour, M.A.

2016-01-01

We study bipartite post measurement entanglement entropy after selective measurements in quantum chains. We first study the quantity for the critical systems that can be described by conformal field theories. We find a connection between post measurement entanglement entropy and the Casimir energy of floating objects. Then we provide formulas for the post measurement entanglement entropy for open and finite temperature systems. We also comment on the Affleck-Ludwig boundary entropy in the context of the post measurement entanglement entropy. Finally, we also provide some formulas regarding modular hamiltonians and entanglement spectrum in the after measurement systems. After through discussion regarding CFT systems we also provide some predictions regarding massive field theories. We then discuss a generic method to calculate the post measurement entanglement entropy in the free fermion systems. Using the method we study the post measurement entanglement entropy in the XY spin chain. We check numerically the CFT and the massive field theory results in the transverse field Ising chain and the XX model. In particular, we study the post meaurement entanglement entropy in the infinite, periodic and open critical transverse field Ising chain and the critical XX model. The effect of the temperature and the gap is also discussed in these models.

Deconstructing Cross-Entropy for Probabilistic Binary Classifiers

Directory of Open Access Journals (Sweden)

Daniel Ramos

2018-03-01

Full Text Available In this work, we analyze the cross-entropy function, widely used in classifiers both as a performance measure and as an optimization objective. We contextualize cross-entropy in the light of Bayesian decision theory, the formal probabilistic framework for making decisions, and we thoroughly analyze its motivation, meaning and interpretation from an information-theoretical point of view. In this sense, this article presents several contributions: First, we explicitly analyze the contribution to cross-entropy of (i prior knowledge; and (ii the value of the features in the form of a likelihood ratio. Second, we introduce a decomposition of cross-entropy into two components: discrimination and calibration. This decomposition enables the measurement of different performance aspects of a classifier in a more precise way; and justifies previously reported strategies to obtain reliable probabilities by means of the calibration of the output of a discriminating classifier. Third, we give different information-theoretical interpretations of cross-entropy, which can be useful in different application scenarios, and which are related to the concept of reference probabilities. Fourth, we present an analysis tool, the Empirical Cross-Entropy (ECE plot, a compact representation of cross-entropy and its aforementioned decomposition. We show the power of ECE plots, as compared to other classical performance representations, in two diverse experimental examples: a speaker verification system, and a forensic case where some glass findings are present.

Entropy per baryon in a 'many-worlds' cosmology

International Nuclear Information System (INIS)

Clutton-Brock, M.

1977-01-01

The universe is imagined split into infinitely many branches, or 'worlds', only one of which can be observed. The world has an entropy per baryon xi approximately 10 9 : other worlds can have all possible values of entropy per baryon. High-entropy worlds with xi > 5x10 11 do not form galaxies, but only giant black holes. Low entropy worlds with xi 5 do form galaxies, but only metal-poor dwarf galaxies with no planets. Life can evolve only in worlds with entropy per baryon in the range 3x10 5 11 , and life is abundant only in a much narrower range. (Auth.)

Towards operational interpretations of generalized entropies

DEFF Research Database (Denmark)

Topsøe, Flemming

Operationelle fortolkninger af nye entropimål, f.eks. af Tsallis entropi, angives med udgangspunkt i erkendelsesteoretiske betragtninger.......Operationelle fortolkninger af nye entropimål, f.eks. af Tsallis entropi, angives med udgangspunkt i erkendelsesteoretiske betragtninger....

Entropy Coding in HEVC

OpenAIRE

Sze, Vivienne; Marpe, Detlev

2014-01-01

Context-Based Adaptive Binary Arithmetic Coding (CABAC) is a method of entropy coding first introduced in H.264/AVC and now used in the latest High Efficiency Video Coding (HEVC) standard. While it provides high coding efficiency, the data dependencies in H.264/AVC CABAC make it challenging to parallelize and thus limit its throughput. Accordingly, during the standardization of entropy coding for HEVC, both aspects of coding efficiency and throughput were considered. This chapter describes th...

Self-adjusting entropy-stable scheme for compressible Euler equations

International Nuclear Information System (INIS)

Cheng Xiao-Han; Nie Yu-Feng; Cai Li; Feng Jian-Hu; Luo Xiao-Yu

2015-01-01

In this work, a self-adjusting entropy-stable scheme is proposed for solving compressible Euler equations. The entropy-stable scheme is constructed by combining the entropy conservative flux with a suitable diffusion operator. The entropy has to be preserved in smooth solutions and be dissipated at shocks. To achieve this, a switch function, which is based on entropy variables, is employed to make the numerical diffusion term be automatically added around discontinuities. The resulting scheme is still entropy-stable. A number of numerical experiments illustrating the robustness and accuracy of the scheme are presented. From these numerical results, we observe a remarkable gain in accuracy. (paper)

Entropy of the system formed in heavy ion collision

International Nuclear Information System (INIS)

Gudima, K.K.; Schulz, H.; Toneev, V.D.

1985-01-01

In frames of a cascade model the entropy evolution in a system producted in heavy ion collisions is investigated. Entropy calculation is based on smoothing of the distribution function over the momentum space by the temperature field introduction. The resulting entropy per one nucleon is shown to be rather sensitive to phase space subdivision into cells at the stage of free scattering of reaction products. Compared to recent experimental results for specific entropy values inferred from the composite particle yield of 4π measurements, it is found that cascade calculations do not favour some particular entropy model treatments and suggest smaller entropy values than following from consideration within equilibrium statistics

Entropy resistance minimization: An alternative method for heat exchanger analyses

International Nuclear Information System (INIS)

Cheng, XueTao

2013-01-01

In this paper, the concept of entropy resistance is proposed based on the entropy generation analyses of heat transfer processes. It is shown that smaller entropy resistance leads to larger heat transfer rate with fixed thermodynamic force difference and smaller thermodynamic force difference with fixed heat transfer rate, respectively. For the discussed two-stream heat exchangers in which the heat transfer rates are not given and the three-stream heat exchanger with prescribed heat capacity flow rates and inlet temperatures of the streams, smaller entropy resistance leads to larger heat transfer rate. For the two-stream heat exchangers with fixed heat transfer rate, smaller entropy resistance leads to larger effectiveness. Furthermore, it is shown that smaller values of the concepts of entropy generation numbers and modified entropy generation number do not always correspond to better performance of the discussed heat exchangers. - Highlights: • The concept of entropy resistance is defined for heat exchangers. • The concepts based on entropy generation are used to analyze heat exchangers. • Smaller entropy resistance leads to better performance of heat exchangers. • The applicability of entropy generation minimization is conditional

On the entropy variation in the scenario of entropic gravity

Science.gov (United States)

Xiao, Yong; Bai, Shi-Yang

2018-05-01

In the scenario of entropic gravity, entropy varies as a function of the location of the matter, while the tendency to increase entropy appears as gravity. We concentrate on studying the entropy variation of a typical gravitational system with different relative positions between the mass and the gravitational source. The result is that the entropy of the system doesn't increase when the mass is displaced closer to the gravitational source. In this way it disproves the proposal of entropic gravity from thermodynamic entropy. It doesn't exclude the possibility that gravity originates from non-thermodynamic entropy like entanglement entropy.

What is the entropy of the universe?

International Nuclear Information System (INIS)

Frampton, Paul H; Hsu, Stephen D H; Reeb, David; Kephart, Thomas W

2009-01-01

Standard calculations suggest that the entropy of our universe is dominated by black holes, whose entropy is of order their area in Planck units, although they comprise only a tiny fraction of its total energy. Statistical entropy is the logarithm of the number of microstates consistent with the observed macroscopic properties of a system, hence a measure of uncertainty about its precise state. Therefore, assuming unitarity in black hole evaporation, the standard results suggest that the largest uncertainty in the future quantum state of the universe is due to the Hawking radiation from evaporating black holes. However, the entropy of the matter precursors to astrophysical black holes is enormously less than that given by area entropy. If unitarity relates the future radiation states to the black hole precursor states, then the standard results are highly misleading, at least for an observer that can differentiate the individual states of the Hawking radiation.

What is the entropy of the universe?

Energy Technology Data Exchange (ETDEWEB)

Frampton, Paul H [Department of Physics and Astronomy, UNC-Chapel Hill, NC 27599 (United States); Hsu, Stephen D H; Reeb, David [Institute of Theoretical Science, University of Oregon, Eugene, OR 97403 (United States); Kephart, Thomas W, E-mail: frampton@physics.unc.ed, E-mail: hsu@uoregon.ed, E-mail: tom.kephart@gmail.co, E-mail: dreeb@uoregon.ed [Department of Physics and Astronomy, Vanderbilt University, Nashville, TN 37235 (United States)

2009-07-21

Standard calculations suggest that the entropy of our universe is dominated by black holes, whose entropy is of order their area in Planck units, although they comprise only a tiny fraction of its total energy. Statistical entropy is the logarithm of the number of microstates consistent with the observed macroscopic properties of a system, hence a measure of uncertainty about its precise state. Therefore, assuming unitarity in black hole evaporation, the standard results suggest that the largest uncertainty in the future quantum state of the universe is due to the Hawking radiation from evaporating black holes. However, the entropy of the matter precursors to astrophysical black holes is enormously less than that given by area entropy. If unitarity relates the future radiation states to the black hole precursor states, then the standard results are highly misleading, at least for an observer that can differentiate the individual states of the Hawking radiation.

Entropy of black holes with multiple horizons

Science.gov (United States)

He, Yun; Ma, Meng-Sen; Zhao, Ren

2018-05-01

We examine the entropy of black holes in de Sitter space and black holes surrounded by quintessence. These black holes have multiple horizons, including at least the black hole event horizon and a horizon outside it (cosmological horizon for de Sitter black holes and "quintessence horizon" for the black holes surrounded by quintessence). Based on the consideration that the two horizons are not independent each other, we conjecture that the total entropy of these black holes should not be simply the sum of entropies of the two horizons, but should have an extra term coming from the correlations between the two horizons. Different from our previous works, in this paper we consider the cosmological constant as the variable and employ an effective method to derive the explicit form of the entropy. We also try to discuss the thermodynamic stabilities of these black holes according to the entropy and the effective temperature.

Black hole entropy, curved space and monsters

International Nuclear Information System (INIS)

Hsu, Stephen D.H.; Reeb, David

2008-01-01

We investigate the microscopic origin of black hole entropy, in particular the gap between the maximum entropy of ordinary matter and that of black holes. Using curved space, we construct configurations with entropy greater than the area A of a black hole of equal mass. These configurations have pathological properties and we refer to them as monsters. When monsters are excluded we recover the entropy bound on ordinary matter S 3/4 . This bound implies that essentially all of the microstates of a semiclassical black hole are associated with the growth of a slightly smaller black hole which absorbs some additional energy. Our results suggest that the area entropy of black holes is the logarithm of the number of distinct ways in which one can form the black hole from ordinary matter and smaller black holes, but only after the exclusion of monster states

Quantum Entropy of Black Hole with Internal Global Monopole

Institute of Scientific and Technical Information of China (English)

HAN Yi-Wen; YANG Shu-Zheng; LIU Wen-Biao

2005-01-01

Using the generalized uncertainty relation, the new equation of state density is obtained, and then the entropy of black hole with an internal global monopole is discussed. The divergence that appears in black hole entropy calculation through original brick-wall model is overcome. The result of the direct proportion between black hole entropy and its event horizon area is drawn and given. The result shows that the black hole entropy must be the entropy of quantum state near the event horizon.

Quantum information entropies for a squared tangent potential well

International Nuclear Information System (INIS)

Dong, Shishan; Sun, Guo-Hua; Dong, Shi-Hai; Draayer, J.P.

2014-01-01

The particle in a symmetrical squared tangent potential well is studied by examining its Shannon information entropy and standard deviations. The position and momentum information entropy densities ρ s (x), ρ s (p) and probability densities ρ(x), ρ(p) are illustrated with different potential range L and potential depth U. We present analytical position information entropies S x for the lowest two states. We observe that the sum of position and momentum entropies S x and S p expressed by Bialynicki-Birula–Mycielski (BBM) inequality is satisfied. Some eigenstates exhibit entropy squeezing in the position. The entropy squeezing in position will be compensated by an increase in momentum entropy. We also note that the S x increases with the potential range L, while decreases with the potential depth U. The variation of S p is contrary to that of S x .

Entropy per baryon in a 'many-worlds' cosmology

Energy Technology Data Exchange (ETDEWEB)

Clutton-Brock, M [Manitoba Univ., Winnipeg (Canada)

1977-04-01

The universe is imagined split into infinitely many branches, or 'worlds', only one of which can be observed. The world has an entropy per baryon xi approximately 10/sup 9/: other worlds can have all possible values of entropy per baryon. High-entropy worlds with xi > 5x10/sup 11/ do not form galaxies, but only giant black holes. Low entropy worlds with xi < 3x10/sup 5/ do form galaxies, but only metal-poor dwarf galaxies with no planets. Life can evolve only in worlds with entropy per baryon in the range 3x10/sup 5/ < xi < 5x10/sup 11/, and life is abundant only in a much narrower range.

System Entropy Measurement of Stochastic Partial Differential Systems

Directory of Open Access Journals (Sweden)

Bor-Sen Chen

2016-03-01

Full Text Available System entropy describes the dispersal of a system’s energy and is an indication of the disorder of a physical system. Several system entropy measurement methods have been developed for dynamic systems. However, most real physical systems are always modeled using stochastic partial differential dynamic equations in the spatio-temporal domain. No efficient method currently exists that can calculate the system entropy of stochastic partial differential systems (SPDSs in consideration of the effects of intrinsic random fluctuation and compartment diffusion. In this study, a novel indirect measurement method is proposed for calculating of system entropy of SPDSs using a Hamilton–Jacobi integral inequality (HJII-constrained optimization method. In other words, we solve a nonlinear HJII-constrained optimization problem for measuring the system entropy of nonlinear stochastic partial differential systems (NSPDSs. To simplify the system entropy measurement of NSPDSs, the global linearization technique and finite difference scheme were employed to approximate the nonlinear stochastic spatial state space system. This allows the nonlinear HJII-constrained optimization problem for the system entropy measurement to be transformed to an equivalent linear matrix inequalities (LMIs-constrained optimization problem, which can be easily solved using the MATLAB LMI-toolbox (MATLAB R2014a, version 8.3. Finally, several examples are presented to illustrate the system entropy measurement of SPDSs.

Entropy budget of the earth,atmosphere and ocean system

Institute of Scientific and Technical Information of China (English)

GAN Zijun; YAN Youfangand; QI Yiquan

2004-01-01

The energy budget in the system of the earth, atmosphere and ocean conforms to the first law of thermodynamics, namely the law of conservation of energy, and it is balanced when the system is in a steady-state condition. However, the entropy budget following the second law of thermodynamics is unbalanced. In this paper, we deduce the expressions of entropy flux and re-estimate the earth, atmosphere and ocean annual mean entropy budget with the updated climatologically global mean energy budget and the climatologically air-sea flux data. The calculated results show that the earth system obtains a net influx of negative entropy (-1179.3 mWm-2K-1) from its surroundings, and the atmosphere and the ocean systems obtain a net input of negative entropy at about -537.4 mWm-2K-1 and -555.6 mWm-2K-1, respectively. Calculations of the entropy budget can provide some guidance for further understanding the spatial-temporal change of the local entropy flux, and the entropy production resulting from all kinds of irreversible processes inside these systems.

Entropy in the Tangled Nature Model of Evolution

Directory of Open Access Journals (Sweden)

Ty N. F. Roach

2017-04-01

Full Text Available Applications of entropy principles to evolution and ecology are of tantamount importance given the central role spatiotemporal structuring plays in both evolution and ecological succession. We obtain here a qualitative interpretation of the role of entropy in evolving ecological systems. Our interpretation is supported by mathematical arguments using simulation data generated by the Tangled Nature Model (TNM, a stochastic model of evolving ecologies. We define two types of configurational entropy and study their empirical time dependence obtained from the data. Both entropy measures increase logarithmically with time, while the entropy per individual decreases in time, in parallel with the growth of emergent structures visible from other aspects of the simulation. We discuss the biological relevance of these entropies to describe niche space and functional space of ecosystems, as well as their use in characterizing the number of taxonomic configurations compatible with different niche partitioning and functionality. The TNM serves as an illustrative example of how to calculate and interpret these entropies, which are, however, also relevant to real ecosystems, where they can be used to calculate the number of functional and taxonomic configurations that an ecosystem can realize.

Statistical-mechanical entropy by the thin-layer method

International Nuclear Information System (INIS)

Feng, He; Kim, Sung Won

2003-01-01

G. Hooft first studied the statistical-mechanical entropy of a scalar field in a Schwarzschild black hole background by the brick-wall method and hinted that the statistical-mechanical entropy is the statistical origin of the Bekenstein-Hawking entropy of the black hole. However, according to our viewpoint, the statistical-mechanical entropy is only a quantum correction to the Bekenstein-Hawking entropy of the black-hole. The brick-wall method based on thermal equilibrium at a large scale cannot be applied to the cases out of equilibrium such as a nonstationary black hole. The statistical-mechanical entropy of a scalar field in a nonstationary black hole background is calculated by the thin-layer method. The condition of local equilibrium near the horizon of the black hole is used as a working postulate and is maintained for a black hole which evaporates slowly enough and whose mass is far greater than the Planck mass. The statistical-mechanical entropy is also proportional to the area of the black hole horizon. The difference from the stationary black hole is that the result relies on a time-dependent cutoff

Crossing the entropy barrier of dynamical zeta functions

International Nuclear Information System (INIS)

Aurich, R.; Bolte, J.; Matthies, C.; Sieber, M.; Steiner, F.

1992-01-01

Dynamical zeta functions are an important tool to quantize chaotic dynamical systems. The basic quantization rules require the computation of the zeta functions on the real energy axis, where the Euler product representations running over the classical periodic orbits usually do not converge due to the existence of the so-called entropy barrier determined by the topological entropy of the classical system. We shown that the convergence properties of the dynamical zeta functions rewritten as Dirichlet series are governed not only by the well-known topological and metric entropy, but depend crucially on subtle statistical properties of the Maslow indices and of the multiplicities of the periodic orbits that are measured by a new parameter for which we introduce the notion of a third entropy. If and only if the third entropy is nonvanishing, one can cross the entropy barrier; if it exceeds a certain value, one can even compute the zeta function in the physical region by means of a convergent Dirichlet series. A simple statistical model is presented which allows to compute the third entropy. Four examples of chaotic systems are studied in detail to test the model numerically. (orig.)

Crossing the entropy barrier of dynamical zeta functions

Energy Technology Data Exchange (ETDEWEB)

Aurich, R.; Bolte, J.; Matthies, C.; Sieber, M.; Steiner, F. (Hamburg Univ. (Germany). 2. Inst. fuer Theoretische Physik)

1992-01-01

Dynamical zeta functions are an important tool to quantize chaotic dynamical systems. The basic quantization rules require the computation of the zeta functions on the real energy axis, where the Euler product representations running over the classical periodic orbits usually do not converge due to the existence of the so-called entropy barrier determined by the topological entropy of the classical system. We shown that the convergence properties of the dynamical zeta functions rewritten as Dirichlet series are governed not only by the well-known topological and metric entropy, but depend crucially on subtle statistical properties of the Maslow indices and of the multiplicities of the periodic orbits that are measured by a new parameter for which we introduce the notion of a third entropy. If and only if the third entropy is nonvanishing, one can cross the entropy barrier; if it exceeds a certain value, one can even compute the zeta function in the physical region by means of a convergent Dirichlet series. A simple statistical model is presented which allows to compute the third entropy. Four examples of chaotic systems are studied in detail to test the model numerically. (orig.).

Nonadditive entropy maximization is inconsistent with Bayesian updating

Science.gov (United States)

Pressé, Steve

2014-11-01

The maximum entropy method—used to infer probabilistic models from data—is a special case of Bayes's model inference prescription which, in turn, is grounded in basic propositional logic. By contrast to the maximum entropy method, the compatibility of nonadditive entropy maximization with Bayes's model inference prescription has never been established. Here we demonstrate that nonadditive entropy maximization is incompatible with Bayesian updating and discuss the immediate implications of this finding. We focus our attention on special cases as illustrations.

EEG entropy measures indicate decrease of cortical information processing in Disorders of Consciousness.

Science.gov (United States)

Thul, Alexander; Lechinger, Julia; Donis, Johann; Michitsch, Gabriele; Pichler, Gerald; Kochs, Eberhard F; Jordan, Denis; Ilg, Rüdiger; Schabus, Manuel

2016-02-01

Clinical assessments that rely on behavioral responses to differentiate Disorders of Consciousness are at times inapt because of some patients' motor disabilities. To objectify patients' conditions of reduced consciousness the present study evaluated the use of electroencephalography to measure residual brain activity. We analyzed entropy values of 18 scalp EEG channels of 15 severely brain-damaged patients with clinically diagnosed Minimally-Conscious-State (MCS) or Unresponsive-Wakefulness-Syndrome (UWS) and compared the results to a sample of 24 control subjects. Permutation entropy (PeEn) and symbolic transfer entropy (STEn), reflecting information processes in the EEG, were calculated for all subjects. Participants were tested on a modified active own-name paradigm to identify correlates of active instruction following. PeEn showed reduced local information content in the EEG in patients, that was most pronounced in UWS. STEn analysis revealed altered directed information flow in the EEG of patients, indicating impaired feed-backward connectivity. Responses to auditory stimulation yielded differences in entropy measures, indicating reduced information processing in MCS and UWS. Local EEG information content and information flow are affected in Disorders of Consciousness. This suggests local cortical information capacity and feedback information transfer as neural correlates of consciousness. The utilized EEG entropy analyses were able to relate to patient groups with different Disorders of Consciousness. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Quantum information entropies for a squared tangent potential well

Energy Technology Data Exchange (ETDEWEB)

Dong, Shishan [Information and Engineering College, DaLian University, 116622 (China); Sun, Guo-Hua, E-mail: sunghdb@yahoo.com [Centro Universitario Valle de Chalco, Universidad Autónoma del Estado de México, Valle de Chalco Solidaridad, Estado de México, 56615 (Mexico); Dong, Shi-Hai, E-mail: dongsh2@yahoo.com [Departamento de Física, Escuela Superior de Física y Matemáticas, Instituto Politécnico Nacional, Unidad Profesional Adolfo López Mateos, Edificio 9, México D.F. 07738 (Mexico); Department of Physics and Astronomy, Louisiana State University, Baton Rouge, LA 70803-4001 (United States); Draayer, J.P., E-mail: draayer@sura.org [Department of Physics and Astronomy, Louisiana State University, Baton Rouge, LA 70803-4001 (United States)

2014-01-10

The particle in a symmetrical squared tangent potential well is studied by examining its Shannon information entropy and standard deviations. The position and momentum information entropy densities ρ{sub s}(x), ρ{sub s}(p) and probability densities ρ(x), ρ(p) are illustrated with different potential range L and potential depth U. We present analytical position information entropies S{sub x} for the lowest two states. We observe that the sum of position and momentum entropies S{sub x} and S{sub p} expressed by Bialynicki-Birula–Mycielski (BBM) inequality is satisfied. Some eigenstates exhibit entropy squeezing in the position. The entropy squeezing in position will be compensated by an increase in momentum entropy. We also note that the S{sub x} increases with the potential range L, while decreases with the potential depth U. The variation of S{sub p} is contrary to that of S{sub x}.

Tsallis Entropy Theory for Modeling in Water Engineering: A Review

Directory of Open Access Journals (Sweden)

Vijay P. Singh

2017-11-01

Full Text Available Water engineering is an amalgam of engineering (e.g., hydraulics, hydrology, irrigation, ecosystems, environment, water resources and non-engineering (e.g., social, economic, political aspects that are needed for planning, designing and managing water systems. These aspects and the associated issues have been dealt with in the literature using different techniques that are based on different concepts and assumptions. A fundamental question that still remains is: Can we develop a unifying theory for addressing these? The second law of thermodynamics permits us to develop a theory that helps address these in a unified manner. This theory can be referred to as the entropy theory. The thermodynamic entropy theory is analogous to the Shannon entropy or the information theory. Perhaps, the most popular generalization of the Shannon entropy is the Tsallis entropy. The Tsallis entropy has been applied to a wide spectrum of problems in water engineering. This paper provides an overview of Tsallis entropy theory in water engineering. After some basic description of entropy and Tsallis entropy, a review of its applications in water engineering is presented, based on three types of problems: (1 problems requiring entropy maximization; (2 problems requiring coupling Tsallis entropy theory with another theory; and (3 problems involving physical relations.

Entropy of black holes with multiple horizons

Directory of Open Access Journals (Sweden)

Yun He

2018-05-01

Full Text Available We examine the entropy of black holes in de Sitter space and black holes surrounded by quintessence. These black holes have multiple horizons, including at least the black hole event horizon and a horizon outside it (cosmological horizon for de Sitter black holes and “quintessence horizon” for the black holes surrounded by quintessence. Based on the consideration that the two horizons are not independent each other, we conjecture that the total entropy of these black holes should not be simply the sum of entropies of the two horizons, but should have an extra term coming from the correlations between the two horizons. Different from our previous works, in this paper we consider the cosmological constant as the variable and employ an effective method to derive the explicit form of the entropy. We also try to discuss the thermodynamic stabilities of these black holes according to the entropy and the effective temperature.

The entropy concept for non-equilibrium states.

Science.gov (United States)

Lieb, Elliott H; Yngvason, Jakob

2013-10-08

In earlier work, we presented a foundation for the second law of classical thermodynamics in terms of the entropy principle. More precisely, we provided an empirically accessible axiomatic derivation of an entropy function defined on all equilibrium states of all systems that has the appropriate additivity and scaling properties, and whose increase is a necessary and sufficient condition for an adiabatic process between two states to be possible. Here, after a brief review of this approach, we address the question of defining entropy for non-equilibrium states. Our conclusion is that it is generally not possible to find a unique entropy that has all relevant physical properties. We do show, however, that one can define two entropy functions, called S - and S + , which, taken together, delimit the range of adiabatic processes that can occur between non-equilibrium states. The concept of comparability of states with respect to adiabatic changes plays an important role in our reasoning.

Configurational entropy of glueball states

Energy Technology Data Exchange (ETDEWEB)

Bernardini, Alex E., E-mail: alexeb@ufscar.br [Departamento de Física, Universidade Federal de São Carlos, PO Box 676, 13565-905, São Carlos, SP (Brazil); Braga, Nelson R.F., E-mail: braga@if.ufrj.br [Instituto de Física, Universidade Federal do Rio de Janeiro, Caixa Postal 68528, RJ 21941-972 (Brazil); Rocha, Roldão da, E-mail: roldao.rocha@ufabc.edu.br [CMCC, Universidade Federal do ABC, UFABC, 09210-580, Santo André (Brazil)

2017-02-10

The configurational entropy of glueball states is calculated using a holographic description. Glueball states are represented by a supergravity dual picture, consisting of a 5-dimensional graviton–dilaton action of a dynamical holographic AdS/QCD model. The configurational entropy is studied as a function of the glueball spin and of the mass, providing information about the stability of the glueball states.

A student's guide to entropy

CERN Document Server

Lemons, Don S

2013-01-01

Striving to explore the subject in as simple a manner as possible, this book helps readers understand the elusive concept of entropy. Innovative aspects of the book include the construction of statistical entropy, the derivation of the entropy of classical systems from purely classical assumptions, and a statistical thermodynamics approach to the ideal Fermi and ideal Bose gases. Derivations are worked through step-by-step and important applications are highlighted in over 20 worked examples. Nearly 50 end-of-chapter exercises test readers' understanding. The book also features a glossary giving definitions for all essential terms, a time line showing important developments, and list of books for further study. It is an ideal supplement to undergraduate courses in physics, engineering, chemistry and mathematics.

Zero-contingent entropy of quantum states of a Hydrogen atom

International Nuclear Information System (INIS)

Charvot, R.; Majernik, V.

1996-01-01

We calculated the zero-contingent entropy for the position of electron in H-atom as a function of its quantum numbers and compared it with the corresponding value of the Shannon entropy. The values of zero-contingent entropy of quantum states of H-atom correlate well with the corresponding values of Shannon's entropy. This points out that, besides the Shannon entropy, the zero-contingent entropy represents an appropriate, and mathematically rather simple, measure of the spreading out of the wave functions in H-atom. (authors)

Implication of Negative Entropy Flow for Local Rainfall

Directory of Open Access Journals (Sweden)

Zhaohui Li

2013-08-01

Full Text Available The relation between the atmospheric entropy flow field and local rainfall is examined in terms of the theory of dissipative structures. In this paper, the entropy balance equation in a form suitable for describing the entropy budget of the Earth’s atmosphere is derived starting from the Gibbs relation, and, as examples, the entropy flows of the two severe weather events associated with the development of an extratropical cyclone and a tropical storm are calculated, respectively. The results show that negative entropy flow (NEF has a significant effect on the precipitation intensity and scope with an apparent matching of the NEF’s pattern with the rainfall distribution revealed and, that the diagnosis of NEF is able to provide a good indicator for precipitation forecasting.

Fault Detection and Diagnosis for Gas Turbines Based on a Kernelized Information Entropy Model

Directory of Open Access Journals (Sweden)

Weiying Wang

2014-01-01

Full Text Available Gas turbines are considered as one kind of the most important devices in power engineering and have been widely used in power generation, airplanes, and naval ships and also in oil drilling platforms. However, they are monitored without man on duty in the most cases. It is highly desirable to develop techniques and systems to remotely monitor their conditions and analyze their faults. In this work, we introduce a remote system for online condition monitoring and fault diagnosis of gas turbine on offshore oil well drilling platforms based on a kernelized information entropy model. Shannon information entropy is generalized for measuring the uniformity of exhaust temperatures, which reflect the overall states of the gas paths of gas turbine. In addition, we also extend the entropy to compute the information quantity of features in kernel spaces, which help to select the informative features for a certain recognition task. Finally, we introduce the information entropy based decision tree algorithm to extract rules from fault samples. The experiments on some real-world data show the effectiveness of the proposed algorithms.

Fault detection and diagnosis for gas turbines based on a kernelized information entropy model.

Science.gov (United States)

Wang, Weiying; Xu, Zhiqiang; Tang, Rui; Li, Shuying; Wu, Wei

2014-01-01

Gas turbines are considered as one kind of the most important devices in power engineering and have been widely used in power generation, airplanes, and naval ships and also in oil drilling platforms. However, they are monitored without man on duty in the most cases. It is highly desirable to develop techniques and systems to remotely monitor their conditions and analyze their faults. In this work, we introduce a remote system for online condition monitoring and fault diagnosis of gas turbine on offshore oil well drilling platforms based on a kernelized information entropy model. Shannon information entropy is generalized for measuring the uniformity of exhaust temperatures, which reflect the overall states of the gas paths of gas turbine. In addition, we also extend the entropy to compute the information quantity of features in kernel spaces, which help to select the informative features for a certain recognition task. Finally, we introduce the information entropy based decision tree algorithm to extract rules from fault samples. The experiments on some real-world data show the effectiveness of the proposed algorithms.

Entropy generation of nanofluid flow in a microchannel heat sink

Science.gov (United States)

Manay, Eyuphan; Akyürek, Eda Feyza; Sahin, Bayram

2018-06-01

Present study aims to investigate the effects of the presence of nano sized TiO2 particles in the base fluid on entropy generation rate in a microchannel heat sink. Pure water was chosen as base fluid, and TiO2 particles were suspended into the pure water in five different particle volume fractions of 0.25%, 0.5%, 1.0%, 1.5% and 2.0%. Under laminar, steady state flow and constant heat flux boundary conditions, thermal, frictional, total entropy generation rates and entropy generation number ratios of nanofluids were experimentally analyzed in microchannel flow for different channel heights of 200 μm, 300 μm, 400 μm and 500 μm. It was observed that frictional and total entropy generation rates increased as thermal entropy generation rate were decreasing with an increase in particle volume fraction. In microchannel flows, thermal entropy generation could be neglected due to its too low rate smaller than 1.10e-07 in total entropy generation. Higher channel heights caused higher thermal entropy generation rates, and increasing channel height yielded an increase from 30% to 52% in thermal entropy generation. When channel height decreased, an increase of 66%-98% in frictional entropy generation was obtained. Adding TiO2 nanoparticles into the base fluid caused thermal entropy generation to decrease about 1.8%-32.4%, frictional entropy generation to increase about 3.3%-21.6%.

Solutions to the Cosmic Initial Entropy Problem without Equilibrium Initial Conditions

Directory of Open Access Journals (Sweden)

Vihan M. Patel

2017-08-01

Full Text Available The entropy of the observable universe is increasing. Thus, at earlier times the entropy was lower. However, the cosmic microwave background radiation reveals an apparently high entropy universe close to thermal and chemical equilibrium. A two-part solution to this cosmic initial entropy problem is proposed. Following Penrose, we argue that the evenly distributed matter of the early universe is equivalent to low gravitational entropy. There are two competing explanations for how this initial low gravitational entropy comes about. (1 Inflation and baryogenesis produce a virtually homogeneous distribution of matter with a low gravitational entropy. (2 Dissatisfied with explaining a low gravitational entropy as the product of a ‘special’ scalar field, some theorists argue (following Boltzmann for a “more natural” initial condition in which the entire universe is in an initial equilibrium state of maximum entropy. In this equilibrium model, our observable universe is an unusual low entropy fluctuation embedded in a high entropy universe. The anthropic principle and the fluctuation theorem suggest that this low entropy region should be as small as possible and have as large an entropy as possible, consistent with our existence. However, our low entropy universe is much larger than needed to produce observers, and we see no evidence for an embedding in a higher entropy background. The initial conditions of inflationary models are as natural as the equilibrium background favored by many theorists.

Configurational entropy of hydrogen-disordered ice polymorphs

International Nuclear Information System (INIS)

Herrero, Carlos P.; Ramírez, Rafael

2014-01-01

The configurational entropy of several H-disordered ice polymorphs is calculated by means of a thermodynamic integration along a path between a totally H-disordered state and one fulfilling the Bernal-Fowler ice rules. A Monte Carlo procedure based on a simple energy model is used, so that the employed thermodynamic path drives the system from high temperatures to the low-temperature limit. This method turns out to be precise enough to give reliable values for the configurational entropy s th of different ice phases in the thermodynamic limit (number of molecules N → ∞). The precision of the method is checked for the ice model on a two-dimensional square lattice. Results for the configurational entropy are given for H-disordered arrangements on several polymorphs, including ices Ih, Ic, II, III, IV, V, VI, and XII. The highest and lowest entropy values correspond to ices VI and XII, respectively, with a difference of 3.3% between them. The dependence of the entropy on the ice structures has been rationalized by comparing it with structural parameters of the various polymorphs, such as the mean ring size. A particularly good correlation has been found between the configurational entropy and the connective constant derived from self-avoiding walks on the ice networks

Characterizing time series via complexity-entropy curves

Science.gov (United States)

Ribeiro, Haroldo V.; Jauregui, Max; Zunino, Luciano; Lenzi, Ervin K.

2017-06-01

The search for patterns in time series is a very common task when dealing with complex systems. This is usually accomplished by employing a complexity measure such as entropies and fractal dimensions. However, such measures usually only capture a single aspect of the system dynamics. Here, we propose a family of complexity measures for time series based on a generalization of the complexity-entropy causality plane. By replacing the Shannon entropy by a monoparametric entropy (Tsallis q entropy) and after considering the proper generalization of the statistical complexity (q complexity), we build up a parametric curve (the q -complexity-entropy curve) that is used for characterizing and classifying time series. Based on simple exact results and numerical simulations of stochastic processes, we show that these curves can distinguish among different long-range, short-range, and oscillating correlated behaviors. Also, we verify that simulated chaotic and stochastic time series can be distinguished based on whether these curves are open or closed. We further test this technique in experimental scenarios related to chaotic laser intensity, stock price, sunspot, and geomagnetic dynamics, confirming its usefulness. Finally, we prove that these curves enhance the automatic classification of time series with long-range correlations and interbeat intervals of healthy subjects and patients with heart disease.

Maximum entropy tokamak configurations

International Nuclear Information System (INIS)

Minardi, E.

1989-01-01

The new entropy concept for the collective magnetic equilibria is applied to the description of the states of a tokamak subject to ohmic and auxiliary heating. The condition for the existence of steady state plasma states with vanishing entropy production implies, on one hand, the resilience of specific current density profiles and, on the other, severe restrictions on the scaling of the confinement time with power and current. These restrictions are consistent with Goldston scaling and with the existence of a heat pinch. (author)

Entropy of dynamical social networks

Science.gov (United States)

Zhao, Kun; Karsai, Marton; Bianconi, Ginestra

2012-02-01

Dynamical social networks are evolving rapidly and are highly adaptive. Characterizing the information encoded in social networks is essential to gain insight into the structure, evolution, adaptability and dynamics. Recently entropy measures have been used to quantify the information in email correspondence, static networks and mobility patterns. Nevertheless, we still lack methods to quantify the information encoded in time-varying dynamical social networks. In this talk we present a model to quantify the entropy of dynamical social networks and use this model to analyze the data of phone-call communication. We show evidence that the entropy of the phone-call interaction network changes according to circadian rhythms. Moreover we show that social networks are extremely adaptive and are modified by the use of technologies such as mobile phone communication. Indeed the statistics of duration of phone-call is described by a Weibull distribution and is significantly different from the distribution of duration of face-to-face interactions in a conference. Finally we investigate how much the entropy of dynamical social networks changes in realistic models of phone-call or face-to face interactions characterizing in this way different type human social behavior.

Quantum aspects of black hole entropy

Indian Academy of Sciences (India)

Quantum corrections to the semiclassical Bekenstein–Hawking area law for black hole entropy, obtained within the quantum geometry framework, are treated in some detail. Their ramification for the holographic entropy bound for bounded stationary spacetimes is discussed. Four dimensional supersymmetric extremal black ...

Entropies, Partitionings and Heart Rate Variability

Czech Academy of Sciences Publication Activity Database

Paluš, Milan; Zebrowski, J.

2009-01-01

Roč. 51, č. 2 (2009), s. 65-72 ISSN 0001-7604 Institutional research plan: CEZ:AV0Z10300504 Keywords : coarse-grained entropy rate * HR variability * entropy Subject RIV: BB - Applied Statistics, Operational Research http://www.activitas.org/index.php/nervosa/article/view/25

Gravitational entropy of nonstationary black holes and spherical shells

International Nuclear Information System (INIS)

Hiscock, W.A.

1989-01-01

The problem of defining the gravitational entropy of a nonstationary black hole is considered in a simple model consisting of a spherical shell which collapses into a preexisting black hole. The second law of black-hole mechanics strongly suggests identifying one-quarter of the area of the event horizon as the gravitational entropy of the system. It is, however, impossible to accurately locate the position of the global event horizon using only local measurements. In order to maintain a local thermodynamics, it is suggested that the entropy of the black hole be identified with one-quarter the area of the apparent horizon. The difference between the event-horizon entropy (to the extent it can be determined) and the apparent-horizon entropy may then be interpreted as the gravitational entropy of the collapsing shell. The total (event-horizon) gravitational entropy evolves in a smooth (C 0 ) fashion, even in the presence of δ-functional shells of matter

Ergodicity, Maximum Entropy Production, and Steepest Entropy Ascent in the Proofs of Onsager's Reciprocal Relations

Science.gov (United States)

Benfenati, Francesco; Beretta, Gian Paolo

2018-04-01

We show that to prove the Onsager relations using the microscopic time reversibility one necessarily has to make an ergodic hypothesis, or a hypothesis closely linked to that. This is true in all the proofs of the Onsager relations in the literature: from the original proof by Onsager, to more advanced proofs in the context of linear response theory and the theory of Markov processes, to the proof in the context of the kinetic theory of gases. The only three proofs that do not require any kind of ergodic hypothesis are based on additional hypotheses on the macroscopic evolution: Ziegler's maximum entropy production principle (MEPP), the principle of time reversal invariance of the entropy production, or the steepest entropy ascent principle (SEAP).

Self-Similar Solutions of Rényi’s Entropy and the Concavity of Its Entropy Power

Directory of Open Access Journals (Sweden)

Agapitos N. Hatzinikitas

2015-08-01

Full Text Available We study the class of self-similar probability density functions with finite mean and variance, which maximize Rényi’s entropy. The investigation is restricted in the Schwartz space S(Rd and in the space of l-differentiable compactly supported functions Clc (Rd. Interestingly, the solutions of this optimization problem do not coincide with the solutions of the usual porous medium equation with a Dirac point source, as occurs in the optimization of Shannon’s entropy. We also study the concavity of the entropy power in Rd with respect to time using two different methods. The first one takes advantage of the solutions determined earlier, while the second one is based on a setting that could be used for Riemannian manifolds.

Density estimation by maximum quantum entropy

International Nuclear Information System (INIS)

Silver, R.N.; Wallstrom, T.; Martz, H.F.

1993-01-01

A new Bayesian method for non-parametric density estimation is proposed, based on a mathematical analogy to quantum statistical physics. The mathematical procedure is related to maximum entropy methods for inverse problems and image reconstruction. The information divergence enforces global smoothing toward default models, convexity, positivity, extensivity and normalization. The novel feature is the replacement of classical entropy by quantum entropy, so that local smoothing is enforced by constraints on differential operators. The linear response of the estimate is proportional to the covariance. The hyperparameters are estimated by type-II maximum likelihood (evidence). The method is demonstrated on textbook data sets

An entropy-assisted musculoskeletal shoulder model.

Science.gov (United States)

Xu, Xu; Lin, Jia-Hua; McGorry, Raymond W

2017-04-01

Optimization combined with a musculoskeletal shoulder model has been used to estimate mechanical loading of musculoskeletal elements around the shoulder. Traditionally, the objective function is to minimize the summation of the total activities of the muscles with forces, moments, and stability constraints. Such an objective function, however, tends to neglect the antagonist muscle co-contraction. In this study, an objective function including an entropy term is proposed to address muscle co-contractions. A musculoskeletal shoulder model is developed to apply the proposed objective function. To find the optimal weight for the entropy term, an experiment was conducted. In the experiment, participants generated various 3-D shoulder moments in six shoulder postures. The surface EMG of 8 shoulder muscles was measured and compared with the predicted muscle activities based on the proposed objective function using Bhattacharyya distance and concordance ratio under different weight of the entropy term. The results show that a small weight of the entropy term can improve the predictability of the model in terms of muscle activities. Such a result suggests that the concept of entropy could be helpful for further understanding the mechanism of muscle co-contractions as well as developing a shoulder biomechanical model with greater validity. Copyright © 2017 Elsevier Ltd. All rights reserved.

New Definition and Properties of Fuzzy Entropy

Institute of Scientific and Technical Information of China (English)

Qing Ming; Qin Yingbing

2006-01-01

Let X = (x1,x2 ,…,xn ) and F(X) be a fuzzy set on a universal set X. A new definition of fuzzy entropy about a fuzzy set A on F(X), e*, is defined based on the order relation "≤" on [0,1/2] n. It is proved that e* is a σ-entropy under an additional requirement. Besides, some entropy formulas are presented and related properties are discussed.

Linking entropy flow with typhoon evolution: a case-study

International Nuclear Information System (INIS)

Liu, C; Xu, H; Liu, Y

2007-01-01

This paper is mainly aimed at investigating the relationship of entropy flow with an atmospheric system (typhoon), based on the observational analyses covering its whole life-cycle. The formula for calculating entropy flow is derived starting with the Gibbs relation with data from the NCEP/NCAR reanalysis. The results show that: (i) entropy flow characteristics at different vertical layers of the system are heterogeneous with predominant negative entropy flow in the large portion of the troposphere and positive ones at upper levels during its development; (ii) changes in the maximum surface wind velocity or the intensity of a typhoon are synchronous with the total entropy flow around the typhoon centre and its neighbourhood, suggesting that the growth of a severe atmospheric system relies greatly upon the negative entropy flow being strong enough, and that entropy flow analysis might provide a particular point of view and a powerful tool to understand the mechanism responsible for the life-cycle of an atmospheric system and associated weather events; and (iii) the horizontal pattern of negative entropy flow near the surface might contain some significant information conducive to the track forecast of typhoons

Entanglement Entropy for the charged BTZ black hole

International Nuclear Information System (INIS)

Larrañaga, A.

2011-01-01

Using the AdS/CFT correspondence we calculate the explicit form of the entanglement entropy for the charged BTZ (Banados-Teitelboim-Zanelli) black hole. The leading term in the large temperature expansion of the entropy function for this black hole reproduces its Bekenstein-Hawking entropy and the subleading term, representing the first corrections due to quantum entanglement, behaves as a logarithm of the BH entropy. It has also been obtained an inverse of area term in subleading order similar to the reported when considering Hawking radiation as quantum tunneling of particles through the event horizon

Entanglement entropy for descendent local operators in 2D CFTs

International Nuclear Information System (INIS)

Chen, Bin; Guo, Wu-Zhong; He, Song; Wu, Jie-qiang

2015-01-01

We mainly study the Rényi entropy and entanglement entropy of the states locally excited by the descendent operators in two dimensional conformal field theories (CFTs). In rational CFTs, we prove that the increase of entanglement entropy and Rényi entropy for a class of descendent operators, which are generated by L"("−")L̄"("−") onto the primary operator, always coincide with the logarithmic of quantum dimension of the corresponding primary operator. That means the Rényi entropy and entanglement entropy for these descendent operators are the same as the ones of their corresponding primary operator. For 2D rational CFTs with a boundary, we confirm that the Rényi entropy always coincides with the logarithmic of quantum dimension of the primary operator during some periods of the evolution. Furthermore, we consider more general descendent operators generated by ∑d_{_n__i_}_{_n__j_}(∏_iL_−_n__i∏_jL̄_−_n__j) on the primary operator. For these operators, the entanglement entropy and Rényi entropy get additional corrections, as the mixing of holomorphic and anti-holomorphic Virasoro generators enhance the entanglement. Finally, we employ perturbative CFT techniques to evaluate the Rényi entropy of the excited operators in deformed CFT. The Rényi and entanglement entropies are increased, and get contributions not only from local excited operators but also from global deformation of the theory.

The application of nonlinear metrics to assess organization differences in short recordings of paroxysmal and persistent atrial fibrillation

International Nuclear Information System (INIS)

Alcaraz, Raúl; Rieta, José Joaquín

2010-01-01

Atrial fibrillation (AF) is the most common arrhythmia in clinical practice. In the first stages of the disease, AF may terminate spontaneously and it is referred to as paroxysmal AF. The arrhythmia is called persistent AF when external intervention is required to its termination. In the present work, a method to non-invasively assess AF organization has been applied to discern between paroxysmal and persistent AF episodes at any time. Previous works have suggested that the probability of AF termination is inversely related to the number of reentries wandering throughout the atrial tissue. Given that it has also been hypothesized that the number of reentries is directly correlated with AF organization, a fast and robust method able to assess organization differences in AF could be of great interest. In fact, the distinction between paroxysmal and persistent episodes in patients without previously known AF history, making use of short ECG recordings, could contribute to taking earlier decisions on AF management in daily clinical practice, without the need to require 24 h or 48 h Holter recordings. The method was based on a nonlinear regularity index, such as sample entropy (SampEn), and evidenced to be a significant discriminator of the AF type. Its diagnostic accuracy of 91.80% was demonstrated to be superior to previously proposed parameters, such as dominant atrial frequency (DAF) and fibrillatory waves amplitude, and to others analyzed for the first time in this context, such as atrial activity mean power, 3 dB bandwidth around the DAF, first harmonic frequency, harmonic exponential decay, etc. Additionally, according to previous invasive works, paroxysmal AF episodes (0.0716 ± 0.0143) presented lower SampEn values and, consequently, more organized activity, than persistent episodes (0.1080 ± 0.0145)

Assessment of non-invasive time and frequency atrial fibrillation organization markers with unipolar atrial electrograms

International Nuclear Information System (INIS)

Alcaraz, Raúl; Hornero, Fernando; Rieta, José J

2011-01-01

The standard electrocardiogram (ECG) is the most common non-invasive way to study atrial fibrillation (AF). In this respect, previous works have shown that the surface lead V 1 reflects mainly the dominant atrial frequency (DAF) of the right atrium (RA), which has been widely used to study AF. In a similar way, AF organization and fibrillatory (f) wave amplitude are two recently proposed non-invasive AF markers. These markers need to be validated with invasive recordings in order to assess their capability to reliably reflect the internal fibrillatory activity dynamics. In this work, these two non-invasive metrics have been compared with similar measures recorded from two unipolar atrial electrograms (AEGs). For both ECG and AEG signals, AF organization has been computed by applying a nonlinear regularity index, such as sample entropy (SampEn), to the atrial activity (AA) and to its fundamental waveform, defined as the main atrial wave (MAW). The surface and epicardial f wave amplitude has been estimated through their mean power. Results obtained for 38 patients showed statistically significant correlations between the values measured from surface and invasive recordings, thus corroborating the usefulness of the aforesaid markers in the non-invasive study of AF. Precisely, for AF organization computed from the MAW, the correlation coefficients between surface and both AEGs were R = 0.926 (p < 0.001) and R = 0.932 (p < 0.001). For f wave amplitude, slightly lower significant relationships were noticed, the correlation coefficients being R = 0.765 (p < 0.001) and R = 0.842 (p < 0.001). These outcomes together with interesting linear relationships found among the parameters suggest that AF regularity estimated via SampEn and f wave amplitude can non-invasively characterize the epicardial activity related to AF

Optimized Kernel Entropy Components.

Science.gov (United States)

Izquierdo-Verdiguier, Emma; Laparra, Valero; Jenssen, Robert; Gomez-Chova, Luis; Camps-Valls, Gustau

2017-06-01

This brief addresses two main issues of the standard kernel entropy component analysis (KECA) algorithm: the optimization of the kernel decomposition and the optimization of the Gaussian kernel parameter. KECA roughly reduces to a sorting of the importance of kernel eigenvectors by entropy instead of variance, as in the kernel principal components analysis. In this brief, we propose an extension of the KECA method, named optimized KECA (OKECA), that directly extracts the optimal features retaining most of the data entropy by means of compacting the information in very few features (often in just one or two). The proposed method produces features which have higher expressive power. In particular, it is based on the independent component analysis framework, and introduces an extra rotation to the eigen decomposition, which is optimized via gradient-ascent search. This maximum entropy preservation suggests that OKECA features are more efficient than KECA features for density estimation. In addition, a critical issue in both the methods is the selection of the kernel parameter, since it critically affects the resulting performance. Here, we analyze the most common kernel length-scale selection criteria. The results of both the methods are illustrated in different synthetic and real problems. Results show that OKECA returns projections with more expressive power than KECA, the most successful rule for estimating the kernel parameter is based on maximum likelihood, and OKECA is more robust to the selection of the length-scale parameter in kernel density estimation.

A Note on Burg’s Modified Entropy in Statistical Mechanics

Directory of Open Access Journals (Sweden)

Amritansu Ray

2016-02-01

Full Text Available Burg’s entropy plays an important role in this age of information euphoria, particularly in understanding the emergent behavior of a complex system such as statistical mechanics. For discrete or continuous variable, maximization of Burg’s Entropy subject to its only natural and mean constraint always provide us a positive density function though the Entropy is always negative. On the other hand, Burg’s modified entropy is a better measure than the standard Burg’s entropy measure since this is always positive and there is no computational problem for small probabilistic values. Moreover, the maximum value of Burg’s modified entropy increases with the number of possible outcomes. In this paper, a premium has been put on the fact that if Burg’s modified entropy is used instead of conventional Burg’s entropy in a maximum entropy probability density (MEPD function, the result yields a better approximation of the probability distribution. An important lemma in basic algebra and a suitable example with tables and graphs in statistical mechanics have been given to illustrate the whole idea appropriately.

Holographic entanglement entropy in Lovelock gravities

NARCIS (Netherlands)

de Boer, J.; Kulaxizi, M.; Parnachev, A.

2011-01-01

We study entanglement entropies of simply connected surfaces in field theories dual to Lovelock gravities. We consider Gauss-Bonnet and cubic Lovelock gravities in detail. In the conformal case the logarithmic terms in the entanglement entropy are governed by the conformal anomalies of the CFT; we

Rényi entropy and conformal defects

International Nuclear Information System (INIS)

Bianchi, Lorenzo; Meineri, Marco; Myers, Robert C.; Smolkin, Michael

2016-01-01

We propose a field theoretic framework for calculating the dependence of Rényi entropies on the shape of the entangling surface in a conformal field theory. Our approach rests on regarding the corresponding twist operator as a conformal defect and in particular, we define the displacement operator which implements small local deformations of the entangling surface. We identify a simple constraint between the coefficient defining the two-point function of the displacement operator and the conformal weight of the twist operator, which consolidates a number of distinct conjectures on the shape dependence of the Rényi entropy. As an example, using this approach, we examine a conjecture regarding the universal coefficient associated with a conical singularity in the entangling surface for CFTs in any number of spacetime dimensions. We also provide a general formula for the second order variation of the Rényi entropy arising from small deformations of a spherical entangling surface, extending Mezei’s results for the entanglement entropy.

Entropy Evaluation Based on Value Validity

Directory of Open Access Journals (Sweden)

Tarald O. Kvålseth

2014-09-01

Full Text Available Besides its importance in statistical physics and information theory, the Boltzmann-Shannon entropy S has become one of the most widely used and misused summary measures of various attributes (characteristics in diverse fields of study. It has also been the subject of extensive and perhaps excessive generalizations. This paper introduces the concept and criteria for value validity as a means of determining if an entropy takes on values that reasonably reflect the attribute being measured and that permit different types of comparisons to be made for different probability distributions. While neither S nor its relative entropy equivalent S* meet the value-validity conditions, certain power functions of S and S* do to a considerable extent. No parametric generalization offers any advantage over S in this regard. A measure based on Euclidean distances between probability distributions is introduced as a potential entropy that does comply fully with the value-validity requirements and its statistical inference procedure is discussed.