What is the difference between principal component analysis and common factor analysis?
Sarah Oconnor
Updated on February 26, 2026
CFA analyzes only the reliable common variance of data, while PCA analyzes all the variance of data. PCA tends to increase factor loadings especially in a study with a small number of variables and/or low estimated communality. Thus, PCA is not appropriate for examining the structure of data.
What is common factor analysis?
Common factor analysis, also called principal factor analysis (PFA) or principal axis factoring (PAF), seeks the fewest factors which can account for the common variance (correlation) of a set of variables.
Why do we use PCA?
The most important use of PCA is to represent a multivariate data table as smaller set of variables (summary indices) in order to observe trends, jumps, clusters and outliers. This overview may uncover the relationships between observations and variables, and among the variables.
What are the two types of factor analysis?
There are two types of factor analyses, exploratory and confirmatory. Exploratory factor analysis (EFA) is method to explore the underlying structure of a set of observed variables, and is a crucial step in the scale development process.
What are the different types of factor analysis?
There are mainly three types of factor analysis that are used for different kinds of market research and analysis.
- Exploratory factor analysis.
- Confirmatory factor analysis.
- Structural equation modeling.
What is principal component analysis in research?
Principal component analysis (PCA) is a technique for reducing the dimensionality of such datasets, increasing interpretability but at the same time minimizing information loss. It does so by creating new uncorrelated variables that successively maximize variance.
What is principal component analysis PCA when it is used?
Principal Component Analysis, or PCA, is a dimensionality-reduction method that is often used to reduce the dimensionality of large data sets, by transforming a large set of variables into a smaller one that still contains most of the information in the large set.
What is the difference between PC1 and PC2?
Why typically PC1 vs. PC2. Simply because those axes (Principal Components) are ordered by the % of variability they explain, being PC1 always the axis that explain more variability among the samples included in the test. PC2 is the second axes expalaining more variability, and so on.
What is the difference between the first and second principal component?
The first principal component is the direction in space along which projections have the largest variance. The second principal component is the direction which maximizes variance among all directions orthogonal to the first.
What does PCA tell us?
Principal Component Analysis (PCA) tells us how to represent a dataset in lower dimensions. It does so by rejecting the traditional axes and instead picking the directions of maximum variance of the data to serve as the axes. For instance, imagine we have a dataset D with 2 dimensional data that lies along the line y=x.
What is principal-axis factor analysis?
Also known as common factor analysis, principal-axis factor analysis attempts to find the least number of factors accounting for the common variance of a set of variables. PRINCIPAL-AXIS FACTOR ANALYSIS: “Principal-axis factor analysis attempts to simplify common variance amongst a set of different variables.”
How does PCA work?
In PCA, a computerized pump called the patient-controlled analgesia pump, which contains a syringe of pain medication as prescribed by a doctor, is connected directly to a patient’s intravenous (IV) line. In some cases, the pump is set to deliver a small, constant flow of pain medication.
How to do factor analysis?
Recruit a lot of respondents. Factor analysis relies on having lots of data.