E-LOGOS 2008, 15(1)

The False Dilemma: Bayesian vs. Frequentist

Jordi Vallverdú
Philosophy Dept., Universitat Autònoma de Barcelona, E-0893 Bellaterra (BCN), Catalonia - Spain, Jordi.vallverdu@uab.es

Keywords: Bayesian, frequentist, statistics, causality, uncertainty.

There are two main opposing schools of statistical reasoning, frequentist and Bayesian approaches. Until recent days, the frequentist or classical approach has dominated the scientific research, but Bayesianism has reappeared with a strong impulse that is starting to change the situation. Recently the controversy about the primacy of one of the two approaches seems to be unfinished at a philosophical level, but scientific practices are giving an increasingly important position to the Bayesian approach. This paper eludes philosophical debate to focus on the pragmatic point of view of scientists' day-to-day practices, in which Bayesian methodology is very useful. Several facts and operational values are described as the core-set for understanding the change.

Prepublished online: April 30, 2008; Published: June 1, 2008  Show citation

ACS AIP APA ASA Harvard Chicago Chicago Notes IEEE ISO690 MLA NLM Turabian Vancouver
Vallverdú, J. (2008). The False Dilemma: Bayesian vs. Frequentist. E-LOGOS15(1), 
Download citation

References

  1. Altman, D.G. et al (2002, June 5th) "How Statistical Expertise is Used in Medical Research", JAMA, 287(21): 2817 2820. Go to original source...
  2. Anderson, D.R. et al (2000) "Null Hypothesis Testing: Problems, Prevalence, and an Alternative", Journal of Wildlife Management, 64(4): 912-923. Go to original source...
  3. Ashby, D. & Hutton, J.L. (1996) "Bayesian epidemiology", in Bayesian biostatistics, Berry D., Stangl D. (eds.), New York: Marcel Dekker.
  4. Ashby, D. & Smith A.F.M. (2000) "Evidence-based medicine as Bayesian decisionmaking", Statistics in Medicine, 19: 3291-3305. Basáñez, María Gloria et al (2004) "Bayesian statistics for parasitologists", TRENDS in Parasitology, 20 (2): 85-91. Go to original source...
  5. Berger, J.A. et al (1997) "Unified frequentist and Bayesian testing of a precise hypothesis", Stat. Sci., 12(3): 133-160. Go to original source...
  6. Berger, Z.D. (2003, September) "Bayesian and Frequentist Models: Legitimate Choices for Different Purposes", AEP, Vol. 13, No. 8: 583. Go to original source...
  7. Bernardo, J.M. & Smith, A.F.M. (1996) Bayesian theory, USA: John Wiley & Sons Ltd.
  8. Berry, Donald A. & Hochberg, Yosef (1999) "Bayesian perspectives on multiple comparisons", Journal of Statistical Planning and Inference, 82: 215-227. Go to original source...
  9. Black, Michael A. & Craig, Bruce, A. (2002) "Estimating disease prevalence in the absence of a gold standard", Statistics in Medicine, 21: 2653-2669. Go to original source...
  10. Bland, Martin J. & Altman, Douglas G. (1998, October 24th) "Bayesian and frequentists", British Medical Journal, 317: 1151-1160. Go to original source...
  11. Breslow, N. (1990) "Biostatics and Bayes", Statistical Science, 5(3): 269-298. Go to original source...
  12. Bynum, T.W. & Moor, J.H. (1998) The Digital Phoenix. How Computers Are Changing Philosophy, UK: Blackwell Publishers.
  13. Carlin, J.B. & Louis, T.A. (2000) Bayes and Empirical Bayes Methods for data Analysis, Boca Raton: Chapman & Hall.
  14. Chalober, Kathryn & Rhame, Frank S. (2001) "Quantifying and documenting prior beliefs in clinical trials", Statistics in Medicine, 20: 581-600. Go to original source...
  15. Chaloner, Kathryn & Verdinelli, Isabella (1995) "Bayesian Experimental Design: A Review", Statistical Science, 10(3): 273-304. Go to original source...
  16. Cheeseman, P. (1990) "On Finding the Most Probable Model", In J. Shrager & P. Langley (Eds.) Computational Models of Scientific Discovery and Theory Formation, San Mateo, CA: Morgan Kaufmann, 79-96.
  17. D'Agostini, G. (1998, November 24th) "Bayesian Reasoning Versus Conventional Statistics in High Energy Physics", invited talk at the XVIII International Workshop on Maximum Entropy and Bayesian Methods, Garching/München.
  18. Dale, Andrew I. (2003) Most Honourable Remembrance. The Life and Work of Thomas Bayes, USA: Springer-Verlag.
  19. De Finetti, Bruno (1937) "La Prevision: Ses Lois Logiques, Ses Sources Subjectives", Annals de l'Institute Henri Poincare, 7: 1-68.
  20. Dickersin, K. et al (2002, June 5th) "Association Between Time Interval to Publication and Statistical Significance", JAMA, 287(21): 2829-2830. Go to original source...
  21. Dosher, B.A. & Lu, Z.L. (2000) "Mechanisms of perceptual attention in precuing of location", Vision Research, 40: 1269-1292. Go to original source...
  22. Dunson, David B. (2001) "Commentary: Practical Advantages of Bayesian Analysis of Epidemiologic Data", American Journal of Epidemiology, 153 (12): 1222-1226. Go to original source...
  23. Earman, John (1992) Bayes or Bust?, Cambridge, MA: MIT Press.
  24. Editorial (1996, September 7th) "Bayesian statistical methods. A natural way to assess clinical evidence", British Medical Journal, 313: 569-570. Go to original source...
  25. Escoto, Ben (2003, September) Bayesianism and Simplicity, USA: Stanford University, Ph.D. Thesis.
  26. Estey, E.H. & Thall, P.F. (2003, July) "New Designs for Phase 2 Clinical Trials", Blood, 102(2): 442-448. Go to original source...
  27. Feinberg, S.E. & Schervish, M.J. (1986) "The relevance of Bayesian inference for the preservation of evidence and for legal decision making", Boston University Law Review, 66: 771-798.
  28. Fisher, Lloyd D. (1996) "Comments on Bayesian and Frequentist Analysis and Interpretation of Clinical Trials", Controlled Clinical Trials, 17: 423-434. Go to original source...
  29. Fisher, R.A. (1922) "On the mathematical foundations of theoretical statistics", Philosophical Transactions of the Royal Society, A: 222: 309-368. Go to original source...
  30. Freedman, Eric G. (1992) "Understanding Scientific Controversies from a Computational Perspective: The Case of Latent Learning", in Cognitive models of Science, Ronald Giere (ed), USA: University of Minnesota Press.
  31. Freedman, Lawrence (1996, September 7th) "Bayesian statistical methods", Editorial - British Medical Journal, 313: 569-570. Go to original source...
  32. Geisler, W.S. & Kersten, Daniel (2002, June) "Illusions, perception and Bayes", Nature Neuroscience, volume 5, no 6: 508-510. Go to original source...
  33. Geisler, W.S. & Diehl, R.L. (2003) "A Bayesian approach to the evolution of perceptual and cognitive systems", Cognitive Science, 27: 379-402. Go to original source...
  34. Gelman, A. et al (1996) Bayesian Data Analysis, Boca Raton: Chapman & Hall.
  35. Gigerenzer, Gerd et al (1990) The Empire of Chance. How probability changed science and everyday life, UK: Cambridge University Press. Go to original source...
  36. Giles, Jim (2002, August 1st) "When doubt is a sure thing", Nature, 418: 476-478. Go to original source...
  37. Glymour, Clark (2003, January) "Learning, prediction and causal Bayes nets", Trends in Cognitive Sciences, 7(1): 43-48. Go to original source...
  38. Grunkemeier, G.L. & Payne, N. (2002) "Bayesian Analysis: A New Statistical Paradigm for New Technology", Annals of Thoracic Surgery, 74: 1901-1908. Go to original source...
  39. Hacking, Ian (1972) "Likelihood", British Journal of Philosophy of Science, 23: 132-137. Go to original source...
  40. Hald, Anders (1988) A History of Probability and Statistics and Their Applications before 1750, New York: John Wiley & Sons.
  41. Horvitz, E.J. et al (1988, July) "Decision Theory in Expert Systems and Artificial Intelligence", International Journal of Approximate Reasoning, 2: 247-302. Go to original source...
  42. Horvitz, Eric J. (1993) "Automated reasoning for biology and medicine", in Advances in Computer Methods for Systematic Biology: Artificial Intelligence, Databases, and Computer Vision, USA: Johns Hopkins University Press. From opening talk, "Conference on AI in Systematic Biology", Napa Valley, California, September 1990.
  43. Howson, C. & Urbach, P. (1991, April 4th) "Bayesian reasoning in science", Nature, 350: 371-374. Go to original source...
  44. Howson, C. & Urbach, P. (1989) Scientific Reasoning: The Bayesian Approach, La Salle, IL: Open Court.
  45. Jasanoff, Sheila (1990) The Fifth Branch, USA: Harvard University Press.
  46. Kahneman, D. & Tversky, A. (1982), "Subjective probability: A judgment of representativeness", in Kahneman, D., Slovic, P. & Tversky, A. (eds.) Judgement Under Uncertainty: Heuristics and Biases, NY: Cambridge University Press. Go to original source...
  47. Kangas, A.S. & Kangas, Jyrki (2004) "Probability, possibility and evidence: approaches to consider risk and uncertainty in forestry decision analysis", Forest Policy and Economics, 6: 169-188. Go to original source...
  48. Knill, D.C., Kersten, D. & Yuille, A. in Perception as Bayesian Inference (eds. Knill, D.C. & Richards, R.W.) 1-21, USA: Cambridge University Press.
  49. Kurzweil, Raymond (1990) The Age of Intelligent Machines, Japan: Dai Nippon Printing, Co.
  50. Matthew, R. (1994) "Improving the odds of justice?", New Scientist, 142: 12-13.
  51. Mayo, Deborah G. (1997) "Error Statistics and Learning From Error: Making a Virtue of Necessity", Philosophy of Science (Proceedings), 64: 195-212. Go to original source...
  52. Meehl, P.E. & Rosen, A. (1955) "Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores", Psychological Bulletin, 52: 194- 216. Go to original source...
  53. Lampinen, J. & Vehtari, A. (2001) "Bayesian Approach for Neural Networks - Review and Case Studies", Neural Networks, 14(3): 7-24. Go to original source...
  54. Lilford, R.J. & Braunholtz, D. (1996, September 7th) "For Debate: The Statistical basis of public policy: a paradigm shift is overdue", British Medical Journal, 313: 603-607. Go to original source...
  55. Liu, Z., & Kersten, D. (1998) "2D observers for human 3D object recognition?", Vision Research, 38 (15/16): 2507-2519. Go to original source...
  56. Marr, D. (1982) Vision: A computational investigation into the human representation and processing of visual information, San Francisco: W.H. Freeman and Company.
  57. Miller, Catherine Gibbs (1980, March) Decision making and the Use of Technical Information at the U.S. Environmental Protection Agency, PhD. Thesis: Harvard University.
  58. Mossman, Douglas (2000) "The Meaning of Malingering Data: Further Applications of Bayes' Theorem", Behav. Sci. Law, 18: 761-779. Go to original source...
  59. NAS (1991) The Future of Statistical Software: Proceedings of a Forum (Panel on Guidelines for Statistical Software, National Research Council), USA: The National Academies Press.
  60. NAS (1993) Adverse Events Associated with Childhood Vaccines: Evidence Bearing on Causality, USA: The National Academies Press. I recommend the lecture of 2nd chapter, "Causality and Evidence".
  61. Neyman, J. & Pearson, E.S. (1928) "On the use and interpretation of certain test criteria for purposes of statistical inference. Part I and II", Biometrika, 20: 175-240 and 263-294. Go to original source...
  62. Paté-Cornell, Elisabeth (2002) "Fusion of Intelligence Information: A Bayesian Approach", Risk Analysis, 22(3): 445-454. Go to original source...
  63. Pinker, S. (1997) How the mind works, New York: Norton.
  64. Racine, A. et al (1986) "Bayesian Methods in Practice. Experiences in the Pharmaceutical Industry", Applied Statistics, 35 (2): 93-150. Go to original source...
  65. Ramsey, Frank P. (1931) "Truth and Probability", in Trench, Paul K (ed.) The Foundations of Mathematics and other Logical Essays, London: Truber and Co.
  66. Savage, Leonard J. (1954) The Foundations of Statistics, NY: John Wiley.
  67. Senn, Stephen (2003, August) "Bayesian, Likelihood and Frequentist Approaches to Statistics", Applied Clinical Trials - actmagazine.com, 35-38.
  68. Shiffrin, R.M., & Steyvers, M. (1997) "A model for recognition memory: REM: Retrieving effectively from memory", Psychonomic Bulletin and Review, 4: 145-166. Go to original source...
  69. Spiegelhalter, D.J. (1999, August 21st) "An introduction to Bayesian methods in health technology assessment (Statistical Data Included)", British Medical Journal. Go to original source...
  70. Stankiewicz, B.J., Legge, G.E., & Mansfield, J.S. (2000) "Optimal navigation strategies with varying visual input", Investigative Ophhalmology & Visual Science Supplement, (ARVO), 41/4.
  71. Sternberg, Maya (2001, February) "Discrepant Analysis Is Still at Large", Journal of Clinical Microbiology, 39 (2): 826-827. Go to original source...
  72. Sullivan, R.C. & Delaney, H.R. (1982) "Criminal investigations: A decision-making process", Journal of Police Science and Administration, 10: 335-343.
  73. Suppes, Patrick (1970) A Probabilistic Theory of Causality, Helsinki: North-Holland Publishing Company.
  74. Szolovits, Peter (1995) "Uncertainty and Decisions in Medical Informatics", Methods of Information in Medicine, 34: 111-121. Go to original source...
  75. Tan, S.B. (2001, July) "Bayesian Methods for Medical Research", Annals Academy of Medicine, 30(4): 444-446.
  76. Thagard, Paul (1988) Computational Philosophy of Science, USA: Massachusetts Institute of Technology
  77. Thagard, Paul (1992) Conceptual Revolutions, USA: Princeton University Press
  78. Thagard, Paul (1999) How Scientists Explain Disease, Princeton, NJ: Princeton University Press. Go to original source...
  79. Thagard, Paul (2000) Coherence in Thought and Action, USA: Massachusetts Institute of Technology
  80. Viola, Paul (1996, November) "Complex Feature Recognition: A Bayesian Approach for Learning to Recognize Objects", A.I. Memo No. 1591, MIT (MIT Artificial Intelligence Laboratory). Retrieved by anonymus ftp to publications.ai.mit.edu.
  81. Von Neumann, J. and Morgenstern, O. (1947) Theory of Games and Economic Behaviour, Princeton, NJ: Princeton University Press.
  82. Wang, Jixian et al (2002) "An approximate Bayesian risk-analysis for the gastrointestinal safety of ibuprofen", Pharmacoepidemiology and Drug Safety, 11: 695-701. Go to original source...
  83. Weatherford, Roy (1982) Philosophical Foundations of Probability Theory, USA: Routledge & Kegan Paul Ltd.
  84. Wilson, Greg (2003) "Tides of Change: is Bayesianism the new paradigm in statistics?", Journal of Statistical Planning and Inference, 113: 3171- 374. Go to original source...
  85. Zimmermann, H.J. (2000) "An application-oriented view of modeling uncertainty", European Journal of Operational Research, 122: 190-198. Go to original source...