Using Data in Decision Making

Data-driven instruction section title

The use of data is essential in identifying and implementing the changes necessary for more efficient and effective learning environments. Bernhardt (1998a) explains that data help organizations in several ways.

Using data in decision making.

Additional Data to be Analyzed

Four circles representing ELL data: demographics, perception, student learning, and school processes.

Bernhardt (1998b) also explains that there are factors over which educators have no control. These factors include students' backgrounds and demographics. In order to meet each student's needs, other factors should be considered.

This figure illustrates the data educators can collect from individual measures. The overlapping sections of the graphic demonstrate the enhanced levels of analyses that can be used when serving the individual needs of students.

(Adapted from Multiple Measures, Data Analysis [Bernhardt 1998b]).



Information icon

While Bernhardt uses a more detailed figure that demonstrates additional factors and variables, this course will only focus on these four major categories.



For more information, click the circles below.

Demographics

In the context of an educational setting, demographic data sheds light on the students being served. Demographics allow educators to analyze how well particular groups of students have been served in the past and if changes must be made to meet the needs of future students.

Disaggregation of Data

Student achievement data information graphic

Disaggregation of demographic data

  • allows educators to isolate and focus on the variations among different groups of the same population, and
  • helps schools understand if, and which, subgroups are responding to the school’s current programs and processes.

When looking at demographic data, an educator could review items associated with student achievement. Take a moment to review the graphic and consider how much can be learned through demographic data.

 



Information icon

Bernhardt suggests that it is best to disaggregate a few rather than many subpopulations. Having too many subgroups or very small group sizes may not be useful.



Perceptions

Perceptions graphic-gears in the human mind

Perceptions are a person's way of thinking about or understanding someone or something. For example, a small child may perceive all dogs to be friendly. As he grows older, he learns that some dogs can be aggressive or dangerous. His perception of dogs changed.

Perceptions are based on knowledge and previous personal experiences. A person's actions are guided by what he values, believes, and/or perceives. As educators, it is not only important to consider the perceptions of others, but to also consider one’s own perceptions, especially in the context of a classroom or school.

Think about the vast knowledge and personal experiences within one classroom. Students' perceptions of the educational setting may be influenced by their  

  • feelings about being part of a learning environment; 
  • values and beliefs about self, education, etc.;
  • attitudes about working with others, meeting a deadline, etc.; and 
  • observations of others within the classroom.

The list above provides only a few examples. It is challenging to think that our classrooms are filled with individuals—teachers and students—who have very different ways of thinking about and understanding their classroom, their school, their community, etc. These many, many perceptions should be considered when building efficient and effective learning environments. 

Positive and Negative Perceptions

Perceptions cause the same things to be seen as both positive or negative.

Think about your organization's vision, purpose, or mission. What were the beliefs or values upon which it was founded? How is it perceived by staff, students, families, and/or community members? Positive and negative perceptions affect an organization's ability to establish and build upon its goals and objectives.

Examples of areas organizations may find challenging to successfully implement include

  • programs,
  • processes,
  • curriculum guidelines,
  • instructional approaches, and
  • interventions.

These areas can be viewed both positively or negatively, depending on individual or public perception.

Assessing Perceptions

Key stakeholders iin assessing perception nclude students, parents, administrators, and teachers.

There are several approaches to assess the perceptions that make up an organization. The most common approach is the use of questionnaires. Other approaches include observations, person-to-person interviews, telephone surveys, and focus groups.

Remember, it is important to consider the perceptions of all stakeholders, including students, teachers, parents, and administrators.

Student Learning

Increases in student achievement and school improvement require educators to consistently measure student learning and to know how to use the data appropriately. Most educators evaluate outcomes of students' learning for accountability and for the improvement of instructional programs. These measures, however, can also provide guidance and inform decisions in other areas. Consider the three areas listed below.

Three areas for measuring student learning: individual student learning, curriculum development and revision, and graduation and drop-out rates.

Various Methods of Measuring Student Learning

Student learning should be measured through various methods. In addition, students should have more than one opportunity and assessment method to demonstrate their knowledge.

Academic tasks measurement marker

 

Academic tasks encompass more than a finished product. Teachers might assess less tangible objectives such as students' engagement with the learning or their performance in completing tasks.

 

 

 

Teacher-made measurement marker

 

Teacher-made assessments may include tests, quizzes, and informal assessments using rubrics.

 

 

Standardized assessments measurement marker

 

Standardized assessments may include norm-referenced and criterion-referenced assessments.

School Processes

School processes graphic

Of the four major measures of data (demographics, school processes, perception, and student learning), school processes are the only measures that educators have control of in an educational setting. Schools cannot control their student population, students’ social and educational backgrounds, or how students think, but schools can control what they are doing to help students learn (Bernhardt, 1998b).

"School processes include programs, curriculum, instruction and assessment strategies, interventions, and all other classroom practices that teachers use to help students learn" (Bernhardt, 2003, p. 1). 

 


Information icon

"School Processes" is the only measure of data controllable by schools.



School- and Classroom-Level Processes

School processes occur at two levels: school and classroom.

School-level Processes Classroom-level Processes

 

  • School purpose, vision, or mission statement
  • Instructional strategies, time, and components
  • Philosophies on behavior management
  • Student–teacher ratio
  • Relationships among students and between student(s) and teacher(s)

 

 

  • Teachers’ uses of instructional strategies and linguistic accommodations
  • Behavior management based on teachers’ expectations
  • Classroom procedures and routines
  • Relationships among students and between student(s) and teacher(s)

 



Reflection icon

Reflect on the following questions:

How do school-level and classroom-level processes correlate to achieve the school’s purpose or vision? 

How will educators know if certain school processes are building a continuum of student learning?

 


Consider All Variables

As Bernhardt (1998b) states, "Just looking at student achievement measures focuses teachers only on the results, it does not give them information about what they need to do to get different results" (p. 5).

In addition to analyzing assessment data, it is equally important to look at other variables (demographics, perceptions, student learning, and school processes), consider the context in which learning is occurring, and work to meet the needs of all students.

 

Major variables in educational settings: demographics, perceptions, student learning, school processes.