ESRM 64103 - EXPERIMENTAL DESIGN IN EDUC

Spring 2025, Monday, 5:00-7:45PM, Classroom GRAD 229, 2025/01/13 - 2025/05/01

Lecture

Author

Jihong Zhang

Published

January 13, 2025

Modified

October 12, 2024

1 General Information

Course Code: ESRM 64103
Credits: 3 CH
Course time and location: Mon 17:00-19:45; GRAD 210
Instructor: Dr. Jihong Zhang
Contact Information: jzhang@uark.edu
Personal Website: http://jihongzhang.org
Office Location: GRAD 133B
Office Hours: Tu 1:30-4:30PM
Office Phone +1 479-575-5235
Semester: Spring 2025

2 Course Overview

2.1 Course Objectives:

The purpose of the course is to enhance your understanding of how to analyze and interpret research data using analysis-of-variance (ANOVA) techniques. The course builds upon your foundation from ESRM 6403 and will lead into the methods in subsequent ESRM courses. The specific educational objectives of the course are as follows:

To select appropriate statistical techniques given the research methods employed and research questions asked
To understand what affects each of the statistics discussed
We will use R language to display data and conduct statistical analyses. However, it is also necessary to build a mathematical framework to understand the nature of the procedures and to enable you to troubleshoot or design appropriate analysis strategies for unique research situations. Both computing skills and mathematical perspectives will be helpful in preparing for continued study of research methodology and applied statistics.
We will thoughtfully apply both descriptive and inferential methods to analyze the empirical data.
In addition to conducting analyses using statistical software, we will interpret, write, and discuss the results in accordance with APA format.
The course is not a mathematics course; however, students must have a conceptual understanding of each of the methods so that they will apply and interpret statistical techniques in an appropriate and, in some cases, creative fashion.

2.2 Course Topics

Identification of ANOVA Designs
Model Comparison: Two-Group Situation
Model Comparison: General Case of One-Way Designs
Tests of Comparisons
Multiple Comparisons
Brief Overview of Trend Analysis
Two-Way Between-Subjects Factorial Designs
Interactions and simple main effects
One-Way Within-Subjects Designs: Univariate Approach
Two-Way Within-Subjects Designs: Univariate Approach
Designs with both Between-Subjects and Within-Subjects Factors

2.3 Prerequisites

Educational Statistics and Data Processing (ESRM 64003) or an equivalent course with a grade of C or better.

2.4 Recommended Textbooks

Maxwell, S. E., Delaney, H. D., & Kelley K. (2017). Designing experiments and analyzing data: A model comparison perspective (3rd ed.). Routledge.

2.5 Resources

All course materials, such as the lecture notes, and the resources of homework and project instructions, will be posted on the Blackboard system (https://learn.uark.edu/webapps/login/). Because this course will cover the computer program practice, it is recommended to bring your own laptop to class. Except the exams, all course assignments will be submitted through the Blackboard system by the due date.

2.6 Attendance

In an in-person course at graduate level, there are not really any attendance issues. If you know that you will be out of town for a few days when an assignment is due, it is expected that you will make arrangements to complete the assignment before you leave. The deadlines are set as a designation of the maximum amount of time that you should allow.

3 Assignment

3.1 Homework

Homework will be provided for instructional and evaluation purposes. You will notice that there is homework due approximately every two weeks. The homework will be a set of questions related to the course materials including the lectures and the computer program practices. I highly recommend you finish your homework and submit it by the due date through my website (see Section 5 Homework portal). This will keep you on track to complete the course in the weeks allocated.

3.2 Class Project

Students will complete a project which is an ANOVA-related design analysis (e.g., factorial ANOVA, ANCOVA, repeated measures ANOVA, etc.) by analyzing the data based on your own research scenario and utilizing the theoretical knowledge and the computer program skills related to the contents of the lectures and the textbook.
Grading of the project will be based on both the adequacy and completeness of the work and the quality of the written communication.
The report of the project and your computer program code should be submitted by the due date through the Blackboard.
The project is recommended to be written in APA style.
The detailed instructions for the project will be provided.

3.3 Grading for Criteria

This is a Graduate level class. As such, students are expected to read the chapters of the textbooks and lecture notes, attend the in-person classes, carefully complete all assignments, and participate in class activities. Students who do this typically earn passing grades in the course. More specifically, the grades will be calculated based on the following point system:

Proportional Scoring
	Raw Score	Proportion
Homework 1	10	10%
Homework 2	10	10%
Homework 3	10	10%
Project Proposal	20	20%
Final Proposal Report	50	50%
Total	100	100%

Students earning A’s have mastered over 90% of the material. Conversely, students mastering less than 60% of the material do not earn a passing grade. The grading scale employed in this course is the following:

Percentage of Points	Grade
100-90	A
89-90	B
79-70	C
69-60	D
< 60	F

4 Academic Policies

4.1 AI Statement

Specific permissions will be provided to students regarding the use of generative artificial intelligence tools on certain graded activities in this course. In these instances, I will communicate explicit permission as well as expectations and any pertinent limitations for use and attribution. Without this permission, the use of generative artificial intelligence tools in any capacity while completing academic work submitted for credit, independently or collaboratively, will be considered academic dishonesty and reported to the Office of Academic Initiatives and Integrity.

4.2 Academic Integrity

As a core part of its mission, the University of Arkansas provides students with the opportunity to further their educational goals through programs of study and research in an environment that promotes freedom of inquiry and academic responsibility. Accomplishing this mission is only possible when intellectual honesty and individual integrity prevail.

Each University of Arkansas student is required to be familiar with and abide by the University’s Academic Integrity Policy at honesty.uark.edu/policy. Students with questions about how these policies apply to a particular course or assignment should immediately contact their instructor.

4.3 Emergency Preparedness

The University of Arkansas is committed to providing a safe and healthy environment for study and work. In that regard, the university has developed a campus safety plan and an emergency preparedness plan to respond to a variety of emergency situations. The emergency preparedness plan can be found at emergency.uark.edu. Additionally, the university uses a campus-wide emergency notification system, UARKAlert, to communicate important emergency information via email and text messaging. To learn more and to sign up: http://safety.uark.edu/emergency-preparedness/emergency-notification-system/

4.4 Inclement Weather

If you have any questions about whether or not class will be canceled due to inclement weather, please contact me. If I cancel class, I will notify you via email and/or Blackboard. In general, students need to know how and when they will be notified in the event that class is cancelled for weather-related reasons. Please see here for more information.

4.5 Access and Accommodations

Your experience in this class is important to me. University of Arkansas Academic Policy Series 1520.10 requires that students with disabilities are provided reasonable accommodations to ensure their equal access to course content. If you have already established accommodations with the Center for Educational Access (CEA), please request your accommodations letter early in the semester and contact me privately, so that we have adequate time to arrange your approved academic accommodations.

If you have not yet established services through CEA, but have a documented disability and require accommodations (conditions include but not limited to: mental health, attention-related, learning, vision, hearing, physical, health or temporary impacts), contact CEA directly to set up an Access Plan. CEA facilitates the interactive process that establishes reasonable accommodations. For more information on CEA registration procedures contact 479–575–3104, ada@uark.edu or visit cea.uark.edu.

4.6 Academic Support

A complete list and brief description of academic support programs can be found on the University’s Academic Support site, along with links to the specific services, hours, and locations. Faculty are encouraged to be familiar with these programs and to assist students with finding an using the support services that will help them be successful. Please see here for more information.

4.7 Religious Holidays

The university does not observe religious holidays; however Campus Council has passed the following resolution concerning individual observance of religious holidays and class attendance:

When members of any religion seek to be excused from class for religious reasons, they are expected to provide their instructors with a schedule of religious holidays that they intend to observe, in writing, before the completion of the first week of classes.

5 Homework Portal

Homework 0 (2 credit points)
Homework 1
Homework 2
Homework 3

6 Schedule

Following materials are only allowed for previewing for students registered in ESRM 64503. DO NOT DISTRIBUTE THEM on the internet. They will be removed after the course ended. All homework are due at noon on next Thursday.

Week	Date	Topic	Reading	HW
1	01/15	Lec1: Welcome to ESRM 64103	ITDS Ch.1
2	01/22	Lec2: Hypothesis testing
3	01/29	Lec3: One-way ANOVA		HW#1
4	02/05	Lec4: Comparison and Contrast (1)
5	02/12	Lec5: Comparison and Contrast (2)		HW#2
6	02/19	Lec6: Validity
7	02/26	Lec7: Blocking desing (1) and Project proposal prep
8	03/05	Lec8: Project Proposal Presentation
9	03/12	Lec9: Blocking design (2) and 2-Way ANOVA (1)
10	03/19	Lec10: 2-Way ANOVA (2)
11	03/26	Spring break: No Class
12	04/02	Lec11: Repeated Measure ANOVA
13	04/09	Lec12: ANCOVA		HW#3
14	04/16	Lec13: Mixed Design
15	04/23	2025 AERA Conference (April 23-27): No Class
16	04/30	Final Project		Project
17	05/07	Final Project

Citation

BibTeX citation:

@online{zhang2025,
  author = {Zhang, Jihong},
  title = {ESRM 64103 - {EXPERIMENTAL} {DESIGN} {IN} {EDUC}},
  date = {2025-01-13},
  url = {https://www.jihongzhang.org/posts/Lectures/2025-01-13-Experiment-Design/syllabus.html},
  langid = {en}
}

For attribution, please cite this work as:

Zhang, Jihong. 2025. “ESRM 64103 - EXPERIMENTAL DESIGN IN EDUC.” January 13, 2025. https://www.jihongzhang.org/posts/Lectures/2025-01-13-Experiment-Design/syllabus.html.

--- title: "ESRM 64103 - EXPERIMENTAL DESIGN IN EDUC" subtitle: "Spring 2025, Monday, 5:00-7:45PM, Classroom GRAD 229, 2025/01/13 - 2025/05/01" author: "Jihong Zhang" date: "Jan 13 2025" date-modified: "Oct 12 2024" categories: - Lecture draft: false draft-mode: unlinked sidebar: false format: html: code-tools: true code-line-numbers: false toc-depth: 2 toc-expand: true typst: df-print: tibble citation: type: webpage issued: 2025-01-13 --- # General Information ------------------------------------------------------------------------ - Course Code: ESRM 64103 - Credits: 3 CH - Course time and location: Mon 17:00-19:45; GRAD 210 - Instructor: Dr. Jihong Zhang - Contact Information: [jzhang\@uark.edu](mailto:jzhang@uark.edu) - Personal Website: <http://jihongzhang.org> - Office Location: GRAD 133B - Office Hours: Tu 1:30-4:30PM - Office Phone +1 479-575-5235 - Semester: Spring 2025 # Course Overview ## Course Objectives: The purpose of the course is to enhance your understanding of how to analyze and interpret research data using analysis-of-variance (ANOVA) techniques. The course builds upon your foundation from ESRM 6403 and will lead into the methods in subsequent ESRM courses. The specific educational objectives of the course are as follows: - To select appropriate statistical techniques given the research methods employed and research questions asked - To understand what affects each of the statistics discussed - We will use R language to display data and conduct statistical analyses. However, it is also necessary to build a mathematical framework to understand the nature of the procedures and to enable you to troubleshoot or design appropriate analysis strategies for unique research situations. Both computing skills and mathematical perspectives will be helpful in preparing for continued study of research methodology and applied statistics. - We will thoughtfully apply both descriptive and inferential methods to analyze the empirical data. - In addition to conducting analyses using statistical software, we will interpret, write, and discuss the results in accordance with APA format. - The course is not a mathematics course; however, students must have a conceptual understanding of each of the methods so that they will apply and interpret statistical techniques in an appropriate and, in some cases, creative fashion. ## Course Topics 1. Identification of ANOVA Designs 2. Model Comparison: Two-Group Situation 3. Model Comparison: General Case of One-Way Designs 4. Tests of Comparisons 5. Multiple Comparisons 6. Brief Overview of Trend Analysis 7. Two-Way Between-Subjects Factorial Designs 8. Interactions and simple main effects 9. One-Way Within-Subjects Designs: Univariate Approach 10. Two-Way Within-Subjects Designs: Univariate Approach 11. Designs with both Between-Subjects and Within-Subjects Factors ## Prerequisites Educational Statistics and Data Processing (ESRM 64003) or an equivalent course with a grade of C or better. ## Recommended Textbooks - Maxwell, S. E., Delaney, H. D., & Kelley K. (2017). *Designing experiments and analyzing data: A model comparison perspective* (3rd ed.). Routledge. ## Resources All course materials, such as the lecture notes, and the resources of homework and project instructions, will be posted on the Blackboard system (https://learn.uark.edu/webapps/login/). Because this course will cover the computer program practice, it is recommended to bring your own laptop to class. Except the exams, all course assignments will be submitted through the Blackboard system by the due date. ## Attendance In an in-person course at graduate level, there are not really any attendance issues. If you know that you will be out of town for a few days when an assignment is due, it is expected that you will make arrangements to complete the assignment before you leave. The deadlines are set as a designation of the maximum amount of time that you should allow. # Assignment ## Homework Homework will be provided for instructional and evaluation purposes. You will notice that there is homework due approximately every two weeks. The homework will be a set of questions related to the course materials including the lectures and the computer program practices. **I highly recommend you finish your homework and submit it by the due date through my website (see @sec-homeworkportal Homework portal)**. This will keep you on track to complete the course in the weeks allocated. ## Class Project - Students will complete a project which is an ANOVA-related design analysis (e.g., factorial ANOVA, ANCOVA, repeated measures ANOVA, etc.) by analyzing the data based on your own research scenario and utilizing the theoretical knowledge and the computer program skills related to the contents of the lectures and the textbook. - Grading of the project will be based on both the adequacy and completeness of the work and the quality of the written communication. - The report of the project and your computer program code should be submitted by the due date through the Blackboard. - The project is recommended to be written in APA style. - The detailed instructions for the project will be provided. ## Grading for Criteria This is a Graduate level class. As such, students are expected to read the chapters of the textbooks and lecture notes, attend the in-person classes, carefully complete all assignments, and participate in class activities. Students who do this typically earn passing grades in the course. More specifically, the grades will be calculated based on the following point system: | | Raw Score | Proportion | |-----------------------|-----------|------------| | Homework 1 | 10 | 10% | | Homework 2 | 10 | 10% | | Homework 3 | 10 | 10% | | Project Proposal | 20 | 20% | | Final Proposal Report | 50 | 50% | | **Total** | **100** | **100%** | : Proportional Scoring Students earning A's have mastered over 90% of the material. Conversely, students mastering less than 60% of the material do not earn a passing grade. The grading scale employed in this course is the following: | Percentage of Points | Grade | |----------------------|-------| | 100-90 | A | | 89-90 | B | | 79-70 | C | | 69-60 | D | | \< 60 | F | # Academic Policies ## AI Statement Specific permissions will be provided to students regarding the use of generative artificial intelligence tools on certain graded activities in this course. In these instances, I will communicate explicit permission as well as expectations and any pertinent limitations for use and attribution. Without this permission, the use of generative artificial intelligence tools in any capacity while completing academic work submitted for credit, independently or collaboratively, will be considered academic dishonesty and reported to the Office of Academic Initiatives and Integrity. ## Academic Integrity As a core part of its mission, the University of Arkansas provides students with the opportunity to further their educational goals through programs of study and research in an environment that promotes freedom of inquiry and academic responsibility. Accomplishing this mission is only possible when intellectual honesty and individual integrity prevail. Each University of Arkansas student is required to be familiar with and abide by the University's **Academic Integrity Policy** at [honesty.uark.edu/policy](https://honesty.uark.edu/policy). Students with questions about how these policies apply to a particular course or assignment should immediately contact their instructor. ## Emergency Preparedness The University of Arkansas is committed to providing a safe and healthy environment for study and work. In that regard, the university has developed a campus safety plan and an emergency preparedness plan to respond to a variety of emergency situations. The emergency preparedness plan can be found at [emergency.uark.edu](https://emergency.uark.edu). Additionally, the university uses a campus-wide emergency notification system, UARKAlert, to communicate important emergency information via email and text messaging. To learn more and to sign up: <http://safety.uark.edu/emergency-preparedness/emergency-notification-system/> ## Inclement Weather If you have any questions about whether or not class will be canceled due to inclement weather, please contact me. If I cancel class, I will notify you via email and/or Blackboard. In general, students need to know how and when they will be notified in the event that class is cancelled for weather-related reasons. Please see [here](http://safety.uark.edu/inclement-weather/) for more information. ## Access and Accommodations Your experience in this class is important to me. University of Arkansas [Academic Policy Series 1520.10](https://provost.uark.edu/policies/152010.php) requires that students with disabilities are provided reasonable accommodations to ensure their equal access to course content. If you have already established accommodations with the Center for Educational Access (CEA), please request your accommodations letter early in the semester and contact me privately, so that we have adequate time to arrange your approved academic accommodations. If you have **not** yet established services through CEA, but have a documented disability and require accommodations *(conditions include but not limited to: mental health, attention-related, learning, vision, hearing, physical, health or temporary impacts)*, contact CEA directly to set up an Access Plan. CEA facilitates the interactive process that establishes reasonable accommodations. For more information on CEA registration procedures contact 479–575–3104, [ada\@uark.edu](mailto:ada@uark.edu) or visit [cea.uark.edu.](https://cea.uark.edu/) ## Academic Support A complete list and brief description of academic support programs can be found on the University's Academic Support site, along with links to the specific services, hours, and locations. Faculty are encouraged to be familiar with these programs and to assist students with finding an using the support services that will help them be successful. Please see [here](http://www.uark.edu/academics/academic-support.php) for more information. ## Religious Holidays The university does not observe religious holidays; however Campus Council has passed the following resolution concerning individual observance of religious holidays and class attendance: > When members of any religion seek to be excused from class for religious reasons, they are expected to provide their instructors with a schedule of religious holidays that they intend to observe, in writing, before the completion of the first week of classes. # Homework Portal {#sec-homeworkportal} 1. Homework 0 (2 credit points) 2. Homework 1 3. Homework 2 4. Homework 3 # Schedule Following materials are only allowed for previewing for students registered in ESRM 64503. DO NOT DISTRIBUTE THEM on the internet. They will be removed after the course ended. **All homework are due at noon on next Thursday.** | Week | Date | Topic | Reading | HW | |:-----------|:-----------|:-----------|:-----------|:-----------| | 1 | 01/15 | Lec1: Welcome to ESRM 64103 | [ITDS Ch.1](https://rafalab.dfci.harvard.edu/dsbook-part-1/R/getting-started.html) | | | 2 | 01/22 | Lec2: Hypothesis testing | | | | 3 | 01/29 | Lec3: One-way ANOVA | | HW#1 | | 4 | 02/05 | Lec4: Comparison and Contrast (1) | | | | 5 | 02/12 | Lec5: Comparison and Contrast (2) | | HW#2 | | 6 | 02/19 | Lec6: Validity | | | | 7 | 02/26 | Lec7: Blocking desing (1) and Project proposal prep | | | | 8 | 03/05 | Lec8: Project Proposal Presentation | | | | 9 | 03/12 | Lec9: Blocking design (2) and 2-Way ANOVA (1) | | | | 10 | 03/19 | Lec10: 2-Way ANOVA (2) | | | | 11 | **03/26** | **Spring break: No Class** | | | | 12 | 04/02 | Lec11: Repeated Measure ANOVA | | | | 13 | 04/09 | Lec12: ANCOVA | | HW#3 | | 14 | 04/16 | Lec13: Mixed Design | | | | 15 | **04/23** | **2025 AERA Conference (April 23-27): No Class** | | | | 16 | 04/30 | Final Project | | Project | | 17 | 05/07 | Final Project | | |