Rank Factor Score in Factor Analysis

NCME 2025 Presentation

Ji Li, Xinya Liang, Jihong Zhang

Educational Statistics and Research Methods (ESRM) Program*

University of Arkansas

2025-04-24

Motivation

  • Latent traits or constructs (e.g., anxiety or satisfaction) measured via observed items.
  • Factor scores estimate these traits.
  • Existing scoring methods for factor analysis:
    • Thurstone’s Factor Score
    • Bartlett’s Factor Score
  • These struggle under model misspecification.

Thurstone Regression Scores

Factor scores are used to estimate individuals’ positions on unobserved latent variables based on their responses to observed items. Traditionally, these are computed using:

📘 Traditional Factor Scores

  • Thurstone Regression Scores (Ordinary Least Squares, OLS): ˆF(T)i=ΦΛ′Σ−1Yi
    • ˆF(T)i = estimated factor scores for individual i
    • Yi = vector of observed responses
    • Λ = factor loading matrix
    • Φ = factor covariance matrix
    • Σ = model-implied covariance of observed variables
      🔹 Minimizes squared differences between observed and predicted variables, but can be biased if the model is misspecified.

Bartlett Factor Scores

  • Bartlett Scores (Maximum Likelihood, ML): ˆF(B)i=(Λ′Ψ−1Λ)−1Λ′Ψ−1Yi
    • Ψ = diagonal matrix of residual variances (uniquenesses)
      🔹 Accounts for measurement error by giving less weight to noisy items.
      🔹 More precise under correct model assumptions, but sensitive to violations (e.g., error correlations or cross-loadings).

Network scores

🌐 Network Scores

  • Inspired by network psychometrics: ^NSi=HS⋅Yi
    • HS = hybrid centrality scores (e.g., rank the importance of items in terms of items’ closeness, betweenness, and influences in the network)
    • Ranks items by influence within an item correlation network.

Proposed Solution: Rank Factor Score

🚀 Rank Factor Score: Our Proposed Method

  • Use ranked factor loadings to compute factor scores, rather than using their original loading estimates: ˆF(R)i=rank(Λ)′⋅Yi

    • rank(Λ) = a function that ranks factor loadings

    🔹 Highest loading → highest rank → greatest weight
    🔹 Ranking can be global ranking (ranks all loadings) or factor-level ranking (rank loadings within each latent factor)

Proposed Solution: Rank Factor Score (Cont.)

✅ Why Rank?

  • Ranking reduces sensitivity to:
    • Estimation noise in Λ and Ψ
    • Violations of normality or residual independence
    • Cross-loading items
  • Connects to network-based intuition: “Importance, not exact magnitude”
  • Easy to compute and interpret
  • Particularly robust under model misspecification

Traditional vs. Rank Scores

Method Estimation Strengths
Thurstone OLS Simplicity
Bartlett ML Less bias
Rank Factor Score Rank-based Robust under misspecification

Simulation Overview

Study 1

  • Models:
    • 1-factor
    • 6 or 12 items/factor
  • Loadings: U(.3, .9), U(.7, .8), N(.6, .15), N(.75, .025)
  • Error correlation: ψ = 0, .20, .40
  • Sample sizes: N = 100, 500, 1000
  • 1,000 replications

Study 2

  • Model:
    • 3-factor
    • 6 items/factor
  • Loadings: U(.3, .9), U(.7, .8), N(.6, .15), N(.75, .025)
  • Error correlation: ψ = 0, .20, .40
  • Sample sizes: N = 100, 500, 1000
  • 1,000 replications

Analysis and Evaluation Metrics

All analysis models are simple structured models.

  • Factor score correlation (estimated vs. true)
  • Model fit indices:
    • CFI, TLI, RMSEA
  • K-S test for score distributions (upcoming)

Key Findings

  • Rank Factor Score ≈ Traditional scores when model is correct
  • Rank Factor Score > Traditional under severe misspecification
  • Strong performance with:
    • Weak loadings
    • Non-normality
    • Cross-loadings

Visual Summary for Study 1

Correlation Between Estimated and True Factor Scores for Uniform Distributions

Correlation Between Estimated and True Factor Scores for Uniform Distributions

Visual Summary for Study 1 (Cont.)

Correlation Between Estimated and True Factor Scores for Normal Distributions

Correlation Between Estimated and True Factor Scores for Normal Distributions

Visual Summary for Study 1 (Cont.)

Model Fit Indices (CFI, TLI, RMSEA) Comparison for Uniform Distributions

Model Fit Indices (CFI, TLI, RMSEA) Comparison for Uniform Distributions

Visual Summary for Study 1 (Cont.)

Model Fit Indices (CFI, TLI, RMSEA) Comparison for Normal Distributions

Model Fit Indices (CFI, TLI, RMSEA) Comparison for Normal Distributions

Visual Summary for Study 2

Correlation Between Estimated and True Factor Scores of factor 1 for Uniform Distributions

Correlation Between Estimated and True Factor Scores of factor 1 for Uniform Distributions

Visual Summary for Study 2 (Cont.)

Correlation Between Estimated and True Factor Scores of factor 1 for Normal Distributions

Correlation Between Estimated and True Factor Scores of factor 1 for Normal Distributions

Visual Summary for Study 2 (Cont.)

Model Fit Indices (CFI, TLI, RMSEA) Comparison of factor 1 for Uniform Distributions

Model Fit Indices (CFI, TLI, RMSEA) Comparison of factor 1 for Uniform Distributions

Visual Summary for Study 2 (Cont.)

Model Fit Indices (CFI, TLI, RMSEA) Comparison of factor 1 for Normal Distributions

Model Fit Indices (CFI, TLI, RMSEA) Comparison of factor 1 for Normal Distributions

Practical Implications

  • Models often misspecified in real research
  • Rank Factor Score offers more reliable estimates
  • Valuable in applied settings, especially education & psychometrics

Future Directions

  • Explore Rank Factor Score in real-world data
  • Evaluate factor-level ranking
  • Publish full simulation results (2025)

Thank You!

Questions?
Email: jili@uark.edu

1 / 22
Rank Factor Score in Factor Analysis NCME 2025 Presentation Ji Li, Xinya Liang, Jihong Zhang Educational Statistics and Research Methods (ESRM) Program* University of Arkansas 2025-04-24

  1. Slides

  2. Tools

  3. Close
  • Rank Factor Score in Factor Analysis
  • Motivation
  • Thurstone Regression Scores
  • Bartlett Factor Scores
  • Network scores
  • Proposed Solution: Rank Factor Score
  • Proposed Solution: Rank Factor Score (Cont.)
  • Traditional vs. Rank Scores
  • Simulation Overview
  • Analysis and Evaluation Metrics
  • Key Findings
  • Visual Summary for Study 1
  • Visual Summary for Study 1 (Cont.)
  • Visual Summary for Study 1 (Cont.)
  • Visual Summary for Study 1 (Cont.)
  • Visual Summary for Study 2
  • Visual Summary for Study 2 (Cont.)
  • Visual Summary for Study 2 (Cont.)
  • Visual Summary for Study 2 (Cont.)
  • Practical Implications
  • Future Directions
  • Thank You!
  • f Fullscreen
  • s Speaker View
  • o Slide Overview
  • e PDF Export Mode
  • r Scroll View Mode
  • ? Keyboard Help