References

1

Acton, F. S., Numerical Methods that Usually Work, Chapter 17, The Mathematical Association of America, Washington, D. C., 1990 (updated from the 1970 edition). [ Introductory numerical methods book, fun and lively in style.]

2

Arts, E. H. L., and Korst, J.H.M., Simulated Annealing and Boltzmann Machines, Wiley (Interscience), New York, 1989.

3

Baker, J. E., Adaptive Selection Methods for Genetic Algorithms, pp. 101-111, Proceedings of an International Conference on Genetic Algorithms and their Applications (J. J. Grefenstette, editor), Lawrence Erlbaum Associates, Hillsdale, NJ.

4

Boggs, P.T., Byrd, R.H. and Schnabel, R.B., Eds., Numerical Optimization 1984, SIAM, Philadelphia, 1985. [ A collection of papers presented at the SIAM optimization conference, varied and interesting approaches.]

5

Booker, L. B., Improving Search in Genetic Algorithms, pp. 61-73, Genetic Algorithms and Simulated Annealing (L. Davis, editor), Pitman, London, 1987.

6

Bounds, D. G., New Optimization Methods from Physics and Biology, Nature 329, 215-218, 1987.

7

Cauchy, A., Methode Generale pour la Resolution des Systemes d'Equations Simultanees, Comp. Rend. Acad. Sci. Paris, 536-538, 1847. [ Advanced article, Cauchy's steepest descent method.]

8

Cavicchio, D. J., Adaptive Search Using Simulated Evolution, Ph.D. Thesis, University of Michigan, Ann Arbor, MI, 1970.

9

Ciarlet, P.G., Introduction to Numerical Linear Algebra and Optimization, Cambridge University Press, Cambridge, Great Britain, 1989. [ Advanced optimization book, theoretical angle.]

10

Concus, P., Golub, G. H and O'Leary, D.P., A Generalized Conjugate Gradient Method for the Numerical Solution of Elliptic Partial Differential Equations, Sparse Matrix Computations, J. R. Bunch and D. J. Rose, Eds., Academic Press, New York, 1976, 309-332. [ Advanced article describing preconditioned conjugate gradient applications.]

11

Dahlquist, G. and Bjork, A., Numerical Methods, Prentice-Hall, Englewood Cliffs, New Jersey, 1974. [ Classic numerical methods book, covers numerous areas in broad detail.]

12

Darwin, C., On The Origin of Species, 1st edition (facsimile - 1964), Harvard University Press, Cambridge, MA, 1859.

13

Davis, L., Handbook of Genetic Algorithms, Van Nostrand Reinhold, New York, NY, 1991.

14

Dawkins, R., The Blind Watchmaker, Penguin, London, 1986.

15

De Jong, K. A., An Analysis of the Behavior of a Class of Genetic Adaptive Systems, Ph.D. Thesis, University of Michigan, Ann Arbor, MI., 1975.

16

Dennis, J.E. Jr. and Schnabel, R.B., Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall, Englewood Cliffs, New Jersey, 1983. [ Advanced optimization book, providing theoretical background for algorithms.]

17

Dennis Jr., J.E. and More, J.J., Quasi-Newton Methods, Motivation and Theory, SIAM Review 19, 46-89, 1977. [ Advanced review of Quasi-Newton methods.]

18

Dembo, R.S. and Steihaug, T., Truncated-Newton Algorithms for Large-Scale Unconstrained Optimization, Math. Prog. 26, 190-212 (1983). [ Advanced article presenting the truncated Newton method in theoretical detail.]

19

Dixon, L.C.W., On the Impact of Automatic Differentiation on the Relative Performance of Parallel Truncated Newton and Variable Metric Algorithms, SIAM J. Opt. 1, 475-486, 1991. [ Review on automatic differentiation and its usage.]

20

Duff, I.S., Erisman, A. M. and Reid, J.K., Direct Methods for Sparse Matrices, Clarendon Press, Oxford (1986). [ Advanced textbook on direct methods for solving sparse linear systems.]

21

Evans, J.D., The Use of Pre-conditioning in Iterative Methods for Solving Linear Equations With Symmetric Positive Definite Matrices, J. Inst. Math. Applic. 4, 295-314, 1967. [ Advanced article introducing preconditioning for conjugate gradient methods.]

22

Fletcher, R., Practical Methods of Optimization, Second Edition, (A Wiley- Interscience Publication), John Wiley and Sons, Tiptree, Essex, Great Britain, 1987. [ Advanced book on optimization techniques.]

23

Fletcher, R. and Reeves, C.M., Function Minimization by Conjugate Gradients, Comp, J. 7, 149-154, 1964. [ Advanced article on using conjugate gradient for nonconvex functions.]

24

Floudas, C.A. and Pardalos, P. M., Eds., Recent Advances in Global Optimization, Princeton Series in Computer Science, Princeton University Press, New Jersey, 1991. [ Recent volume on various approaches to global optimization.]

25

George, A. and Liu, J.W., Computer Solution of Large Sparse Positive Definite Systems, Prentice-Hall, Englewood Cliffs, New Jersey, 1981. [ Advanced textbook on solving large sparse positive definite systems of equations.]

26

Gilbert, J.C. and Nocedal, J., Global Convergence Properties of Conjugate Gradient Methods for Optimization. SIAM J. Opt. 2, 21-42, 1992. [ Advanced article summa-
rizing the various conjugate gradient methods and their properties.]

27

Gilbert, J.C., and Lemarechal, C., Some Numerical Experiments with Variable-Storage Quasi-Newton Algorithms, Math. Prog. 45, 407-435, 1989. [ Advanced article describing practical experience with limited-memory Quasi-Newton methods on large-scale crystallography and meteorology problems.]

28

Gill, P.E., Murray, W. and Wright, M. H., Numerical Linear Algebra and Optimization, Volume 1, Addison-Wesley, Redwood City, California, 1991. [ Introductory numerical linear algebra and optimization book.]

29

Gill, P.E., Murray, W. and Wright, M.H., Practical Optimization, Academic Press, New York, 1983. [ Standard reference book on practical optimization methods.]

30

Gill, P.E., Murray, W., Saunders, M. A. and Wright, M.H., Computing Forward-Difference Intervals for Numerical Optimization, SIAM J. Sci. Stat. Comput. 4, 310-321, 1983. [ Advanced article, excellent description on choosing finite-difference intervals.]

31

Goldberg, D. E., Genetic Algorithms in Search, Optimization and Machine Learning, Addison Wesley, Reading, MA, 1989.

32

Golub, G.H. and Van Loan, C.F., Matrix Computations, Johns Hopkins University Press, Baltimore, Maryland, 1983. [ Excellent linear algebra book.]

33

Grefenstette, J. J., Optimization of Control Parameters for Genetic Algorithms, IEEE Trans. Syst., Man, Cyber. SMC-16, 122-128, 1986.

34

Grefenstette, J. J., Incorporating Problem Specific Knowledge into Genetic Algorithms, pp. 42-60, Genetic Algorithms and Simulated Annealing (L. Davis, editor), Pitman, London, 1987.

35

Griewank, A., On Automatic Differentiation, Mathematical Programming 1988, Kluwer Academic Publishers, Japan, 1988, pp. 83-107. [ Review on automatic differentiation.]

36

Hestenes, M.R., Conjugate Direction Methods in Optimization, Springer-Verlag, New York, 1980. [ Advanced textbook on methods related to conjugate gradient.]

37

Holland, J. H., Adaptation in Natural and Artificial Systems, University of Michigan Press, Ann Arbor, MI, 1975.

38

Hollstien, R. B., Artificial Genetic Adaptation in Computer Control Systems, Ph.D. Thesis, University of Michigan, Ann Arbor, MI., 1971.

39

Kirkpatrick, S., Gerlatt, C. D. Jr., and Vecchi, M. P., Optimization by Simulated Annealing, IBM Research Report RC 9355, 1982.

40

Kirkpatrick, S., Gerlatt, C. D. Jr., and Vecchi, M.P., Optimization by Simulated Annealing, Science 220, 671-680, 1983.

41

Kirkpatrick, S., Optimization by Simulated Annealing - Quantitative Studies, J. Stat. Phys. 34, 975-986, 1984.

42

Laarhoven, P. J. M. van, and Aarts, E. H. L., Simulated Annealing: Theory and Applications, Reidel, Dordrecht, Holland, 1987.

43

Lin, S., Computer Solutions of the Traveling Salesman Problem, Bell Syst. Tech. J. 44, 2245-2269, 1965.

44

Liu, D.C. and Nocedal, J., On the Limited Memory BFGS Method for Large Scale Optimization, Math. Prog. 45, 503-528, 1989. [ Advanced article presenting the limited-memory Quasi Newton method.]

45

Luenberger, D.G., Linear and Nonlinear Programming, Second Edition, Addison-Wesley, Reading, Massachusetts, 1984. [ Introductory optimization book, providing easy-to-grasp explanations of algorithmic strategies.]

46

Metropolis, N., Rosenbluth, A.W., Rosenbluth, M. N., Teller, A.H. and Teller, E., Equations of State Calculations by Fast Computing Machines, J. Chem. Phys. 21, 1087- 1092, 1958.

47

Nash, S.G., Solving Nonlinear Programming Problems using Truncated-Newton Techniques, Numerical Optimization 1984, P. T. Boggs, R. H. Byrd, and R. B. Schnabel, Eds., SIAM, Philadelphia, 1985, pp. 119-136. [ Advanced article presenting a practical truncated Newton algorithm.]

48

Nemhauser, G.L., Rinnooy Kan, A.H.G. and Todd, M.J., Eds., Handbook in Operations Research Management Science, Vol. 1, Optimization, Elsevier Science Publishers (North-Holland), Amsterdam, The Netherlands, and New York, 1989. [ Excellent volume on recent technique in optimization research.]

49

Parks, G. T., An Intelligent Stochastic Optimization Routine for Nuclear Fuel Cycle Design, Nucl. Technol. 89, 233-246, 1990.

50

Pincus, M., A Monte Carlo Method for the Approximate Solution of Certain Types of Constrained Optimization Problems, Oper. Res. 18, 1225-1228, 1970.

51

Powell, M.J.D., An Efficient Method for Finding the Minimum of a Function of Several Variables Without Calculating Derivatives, Comp. J. 7, 155-162, 1964. [ Advanced articles, presents Powell minimization method.]

52

Powell, M.J.D., Nonconvex Minimization Calculations and the Conjugate Gradient Method, Lecture Notes in Mathematics, Vol. 1066, pp. 122-141, 1984. [ Advanced review on conjugate gradient for nonconvex functions.]

53

Rall, L.B., Automatic Differentiation - Techniques and Applications, Lecture Notes in Computer Science 120, Springer-Verlag, Berlin, New York, 1981. [ Textbook on automatic differentiation.]

54

Randelman, R. E., and Grest, G.S., N-City Traveling Salesman Problem - Optimization by Simulated Annealings, J. Stat. Phys. 45, 885-890, 1986.

55

Schlick, T. and Overton, M., A Powerful Truncated Newton Method for Potential Energy Minimization, J. Comp. Chem. 8, 1025-1039, 1987. [ Article presenting development and application of a truncated Newton method to computational chemistry problems.]

56

Schlick, T. and Fogelson, A., TNPACK --- A Truncated Newton Minimization Package for Large-Scale Problems: I. Algorithm and Usage and II. Implementation Examples. ACM Trans. Math. Softw. 18, 41-111, 1992. [ Article describing a truncated-Newton minimization package TNPACK and illustrating its application in several scientific applications.]

57

Derreumaux, P., Zhang, G., Schlick, T., and Brooks, B., A Truncated Newton Minimizer Adapted for CHARMM and Biomolecular Applications, J. Comp. Chem. 15, 532-552, 1994. [ Article describing the adaptation of a minimization package for optimization of molecular structures.]

58

Schlick, T., Modified Cholesky Factorizations for Sparse Preconditioners, SIAM J. Sci. Stat. Comp. 14, 424-445, 1993. [ Article presenting practical strategies of choosing sparse preconditioners for optimization.]

59

Schlick, T., Optimization Methods in Computational Chemistry, Reviews in Computational Chemistry, Vol. III, K. B. Lipkowitz and D. B. Boyd, Eds., VCH Publisher, New York, pp 1-71, 1992. [ Review on optimization techniques in computational chemistry applications.]

60

Schnabel, R.B. and Eskow, E., A New Modified Cholesky Factorization, SIAM J. Sci. Stat. Comput. 11, 1136-1158, 1990. [ Advanced article presenting a new modified Cholesky factorization.]

61

Shanno, D.F., Conjugate Gradient Methods with Inexact Searches, Math. Oper. Res. 3, 244-256, 1978. [ Advanced article on conjugate gradient for nonconvex functions.]

62

Vanderbilt, D., and Louie, S. G., A Monte Carlo Simulated Annealing Approach to Optimization over Continuous Variables, J. Comput. Phys. 56, 259- 271, 1984.

63

Baeck, T., Evolutionary Algorithms in Theory and Practice, Oxford University Press, Oxford, 1995.

64

Hartmann D., Optimierung Balkenartiger Zylindeerschalen aus Stahlbeton mit Elastischem und Plastischem Werkstoffverhalten, Ph.D. Thesis, University of Dortmund, 1974.

65

Rechenberg I., Evolutionsstrategie: Optimierung Technischer Systeme nach Prinzipien der Biologischen Evolution, Frommann-Holzboog, Stuttgart, 1973.

66

Schwefel, H-P., Evolutionsstrategie und Numerische Optimierung, Dissertation, Technical University of Berlin, 1975.

67

Schwefel, H-P., Binäre Optimierung durch Somatische Mutation, Technical Report, Technical University of Berlin and Medical University of Hannover, 1975.

68

Schwefel, H-P., ``Collective Phenomena in Evolutionary Systems'', Preprints of the 31st Annual Meeting of the International Society for General System Research, Budapest 2, 1025-1033, 1987.

69

Schwefel, H-P., Evolution and Optimum Searching, Wiley Interscience, John Wiley & Sons, New York, 1995.