We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Multiple Linear Regression and Correlation: A Geometric Analysis

Authors: Ben O'Neill
Abstract: In this review article we consider linear regression analysis from a geometric perspective, looking at standard methods and outputs in terms of the lengths of the relevant vectors and the angles between these vectors. We show that standard regression output can be written in terms of the lengths and angles between the various input vectors, such that this geometric information is sufficient in linear regression problems. This allows us to obtain a standard formula for multiple correlation and give a geometric interpretation to this. We examine how multicollinearity affects the total explanatory power of the data, and we examine a counter-intuitive phenomena called "enhancement" where the total information from the explanatory vectors is greater than the sum of the marginal parts.
Subjects: Methodology (stat.ME); Statistics Theory (math.ST)
Cite as: arXiv:2109.08519 [stat.ME]
  (or arXiv:2109.08519v1 [stat.ME] for this version)

Submission history

From: Ben O'Neill [view email]
[v1] Mon, 13 Sep 2021 09:32:01 GMT (268kb)

Link back to: arXiv, form interface, contact.