ENSAE Paris - École d'ingénieurs pour l'économie, la data science, la finance et l'actuariat

Statistics 1

Teacher

DALALYAN Arnak

Department: Statistics

Objective

This course provides the mathematical foundations of statistical modeling, primarily within a parametric framework. The inferential approach is developed with a focus on parameter estimation methods. The properties of estimators, particularly in terms of optimality, will be studied.

Learning outcomes: At the end of the course, the student will be able to:

  • Identify the nature of a statistical model: regular, discrete, density-based, identifiable;
  • Apply general parametric estimation methods, such as the method of moments estimator, the maximum likelihood estimator, and the Bayesian estimator;
  • Analyze the asymptotic behavior of estimators;
  • Assess the optimality of parametric estimation methods;
  • State and apply the general principles for constructing confidence regions and use them in common scenarios.

Assessment:

  • 2/3 of the final grade will be based on the written end-of-semester exam;
  • 1/3 of the grade will be based on continuous assessment, itself composed of a mid-term exam (50%), an attendance grade (25%), and a participation grade (25%).

Planning

Numbers in brackets correspond to the sections of the lecture notes.

  • Session 1: Limit theorems [1.4] + Continuity theorems [1.5]
  • Session 2: Sample [4.1], empirical distribution function [4.2], Glivenko-Cantelli
  • Session 3: Substitution method [4.3], statistics Xn-bar and S^2 [4.5 without Proposition 4.4]
  • Session 4: Identifiable statistical model, density-based, discrete [5.1] + consistency [5.2]
  • Session 5: Risk [5.2.1] + comparison [5.2.2] + Cramér-Rao inequality
  • Session 6: van Trees inequality and examples
  • Session 7: Generalized method of moments [5.3]. Likelihood and log-likelihood
  • Session 8: MLE: behavior of the log-likelihood [5.5] and consistency [5.6]
  • Session 9: MLE: regularity conditions and asymptotic normality
  • Session 10: MLE: geometric interpretation, asymptotic efficiency, and examples
  • Sessions 11 and 12: Bayesian estimation
  • Session 13: Confidence sets

References

Lehmann E.L. et G. Casella (2003) Theory of point estimation, 2nd edition, Springer-Verlag [21 LEH 00 D]
Tsybakov A. (2006) Polycopié du cours de Statistique Appliquée, Université Pierre et Marie Curie. Available in PDF format on Pamplemousse.
Wasserman L. (2004) All of Statistics, Springer-Verlag [21 WAS 00 A]