References for the Holonomic Gradient Method (HGM) and the Holonomic Gradient Descent Method (HGD)

Papers and Tutorials

1. M.Adamer, A.Lorincz, A.L.Sattelberger, B.Sturmfels, Algebraic Analysis of Rotation Data arxiv: 1912.00396
2. Anna-Laura Sattelberger, Bernd Sturmfels, D-Modules and Holonomic Functions arxiv:1910.01395
3. N.Takayama, L.Jiu, S.Kuriki, Y.Zhang, Computations of the Expected Euler Characteristic for the Largest Eigenvalue of a Real Wishart Matrix, jmva
4. M.Harkonen, T.Sei, Y.Hirose, Holonomic extended least angle regression, arxiv:1809.08190
5. S.Mano, Partitions, Hypergeometric Systems, and Dirichlet Processes in Statistics, JSS Research Series in Statistics, 2018.
6. A.Kume, T.Sei, On the exact maximum likelihood inference of Fisher–Bingham distributions using an adjusted holonomic gradient method, doi (2018)
7. Yoshihito Tachibana, Yoshiaki Goto, Tamio Koyama, Nobuki Takayama, Holonomic Gradient Method for Two Way Contingency Tables, arxiv:1803.04170
8. F.H.Danufane, K.Ohara, N.Takayama, C.Siriteanu, Holonomic Gradient Method-Based CDF Evaluation for the Largest Eigenvalue of a Complex Noncentral Wishart Matrix (Title of the version 1: Holonomic Gradient Method for the Distribution Function of the Largest Root of Complex Non-central Wishart Matrices), arxiv:1707.02564
9. T.Koyama, An integral formula for the powered sum of the independent, identically and normally distributed random variables, arxiv:1706.03989
10. H.Hashiguchi, N.Takayama, A.Takemura, Distribution of Ratio of two Wishart Matrices and Evaluation of Cumulative Probability by Holonomic Gradient Method, arxiv:1610.09187
11. R.Vidunas, A.Takemura, Differential relations for the largest root distribution of complex non-central Wishart matrices, arxiv:1609.01799
12. S.Mano, The A-hypergeometric System Associated with the Rational Normal Curve and Exchangeable Structures, arxiv:1607.03569
13. M.Noro, System of Partial Differential Equations for the Hypergeometric Function 1F1 of a Matrix Argument on Diagonal Regions, ACM DL
14. Y.Goto, K.Matsumoto, Pfaffian equations and contiguity relations of the hypergeometric function of type (k+1,k+n+2) and their applications, arxiv:1602.01637
15. T.Koyama, Holonomic gradient method for the probability content of a simplex region with a multivariate normal distribution, arxiv:1512.06564
16. N.Takayama, S.Kuriki, A.Takemura, A-Hpergeometric Distributions and Newton Polytopes, arxiv:1510.02269
17. G.Weyenberg, R.Yoshida, D.Howe, Normalizing Kernels in the Billera-Holmes-Vogtmann Treespace, arxiv:1506.00142
18. C.Siriteanu, A.Takemura, C.Koutschan, S.Kuriki, D.St.P.Richards, H.Sin, Exact ZF Analysis and Computer-Algebra-Aided Evaluation in Rank-1 LoS Rician Fading, arxiv:1507.07056
19. K.Ohara, N.Takayama, Pfaffian Systems of A-Hypergeometric Systems II --- Holonomic Gradient Method, arxiv:1505.02947
20. T.Koyama, The Annihilating Ideal of the Fisher Integral, arxiv:1503.05261
21. T.Koyama, A.Takemura, Holonomic gradient method for distribution function of a weighted sum of noncentral chi-square random variables, arxiv:1503.00378
22. Y.Goto, Contiguity relations of Lauricella's F_D revisited, arxiv:1412.3256
23. T.Koyama, H.Nakayama, K.Ohara, T.Sei, N.Takayama, Software Packages for Holonomic Gradient Method, Mathematial Software --- ICMS 2014, 4th International Conference, Proceedings. Edited by Hoon Hong and Chee Yap, Springer lecture notes in computer science 8592, 706--712. DOI
24. N.Marumo, T.Oaku, A.Takemura, Properties of powers of functions satisfying second-order linear differential equations with applications to statistics, arxiv:1405.4451
25. J.Hayakawa, A.Takemura, Estimation of exponential-polynomial distribution by holonomic gradient descent arxiv:1403.7852
26. C.Siriteanu, A.Takemura, S.Kuriki, MIMO Zero-Forcing Detection Performance Evaluation by Holonomic Gradient Method arxiv:1403.3788
27. T.Koyama, Holonomic Modules Associated with Multivariate Normal Probabilities of Polyhedra, arxiv:1311.6905
28. T.Hibi, K.Nishiyama, N.Takayama, Pfaffian Systems of A-Hypergeometric Equations I, Bases of Twisted Cohomology Groups, arxiv:1212.6103 (major revision v2 of arxiv:1212.6103). Accepted version is at DOI
29. T.Hibi et al, Groebner Bases : Statistics and Software Systems , Springer, 2013.
30. Introduction to the Holonomic Gradient Method (movie), 2013. movie at youtube
31. T.Sei, A.Kume, Calculating the Normalising Constant of the Bingham Distribution on the Sphere using the Holonomic Gradient Method, Statistics and Computing, 2013, DOI
32. T.Koyama, A.Takemura, Calculation of Orthant Probabilities by the Holonomic Gradient Method, arxiv:1211.6822
33. T. Koyama, H. Nakayama, K. Nishiyama, N. Takayama, Holonomic Rank of the Fisher-Bingham System of Differential Equations, Journal of Pure and Applied Algebra (online), DOI
34. T. Koyama, H. Nakayama, K. Nishiyama, N. Takayama, Holonomic Gradient Descent for the Fisher-Bingham Distribution on the d-dimensional Sphere, Computational Statistics (2013) DOI
35. Hiroki Hashiguchi, Yasuhide Numata, Nobuki Takayama, Akimichi Takemura, Holonomic gradient method for the distribution function of the largest root of a Wishart matrix, Journal of Multivariate Analysis, 117, (2013) 296-312, DOI
36. Tomonari Sei, Hiroki Shibata, Akimichi Takemura, Katsuyoshi Ohara, Nobuki Takayama, Properties and applications of Fisher distribution on the rotation group, Journal of Multivariate Analysis, 116 (2013), 440--455, DOI
37. T.Koyama, A Holonomic Ideal which Annihilates the Fisher-Bingham Integral, Funkcialaj Ekvacioj 56 (2013), 51--61. DOI
38. Hiromasa Nakayama, Kenta Nishiyama, Masayuki Noro, Katsuyoshi Ohara, Tomonari Sei, Nobuki Takayama, Akimichi Takemura , Holonomic Gradient Descent and its Application to Fisher-Bingham Integral, Advances in Applied Mathematics 47 (2011), 639--658, DOI

1. H.Dwinwoodie, L.Matusevich, E. Mosteig, Transform methods for the hypergeometric distribution, Statistics and Computing 14 (2004), 287--297.

Three Steps of HGM

1. Finding a holonomic system satisfied by the normalizing constant. We may use computational or theoretical methods to find it. Groebner basis and related methods are used.
2. Finding an initial value vector for the holonomic system. This is equivalent to evaluating the normalizing constant and its derivatives at a point. This step is usually performed by a series expansion.
3. Solving the holonomic system numerically. We use several methods in numerical analysis such as the Runge-Kutta method of solving ordinary differential equations and efficient solvers of systems of linear equations.

Software Packages for HGM

• CRAN package hgm (for R).
• Some software packages are experimental and temporary documents are found in "asir-contrib manual" (auto-autogenerated part), or "Experimental Functions in Asir", or "miscellaneous and other documents" of the OpenXM documents or in this folder. The nightly snapshot of the asir-contrib can be found in the asir page below, or look up our cvsweb page.
  1. Command line interfaces are in the folder OpenXM/src/hgm in the OpenXM source tree. See OpenXM distribution page .
  2. Experimental version of hgm package for R (hgm_*tar.gz, hgm-manual.pdf) for the step 3. To install this package in R, type in

     R CMD install hgm_*.tar.gz
     

  3. The following packages are for the computer algebra system Risa/Asir. They are in the asir-contrib collection.
     • yang.rr (for Pfaffian systems) , nk_restriction.rr (for D-module integrations), tk_jack.rr (for Jack polynomials), ko_fb_pfaffian.rr (Pfaffian system for the Fisher-Bingham system), are for the steps 1 or 2.
     • nk_fb_gen_c.rr is a package to generate a C program to perform maximal Likehood estimates for the Fisher-Bingham distribution by HGD (holonomic gradient descent).
     • ot_hgm_ahg.rr (HGM for A-distributions, very experimental).

Programs to try examples of our papers

1. d-dimensional Fisher-Bingham System

 $OpenXM: OpenXM/src/hgm/doc/ref-hgm.html,v 1.31 2020/06/11 22:39:10 takayama Exp $