Why learning objectives are so important
Difficult concepts in statistics
24 June 2013Oh Ordinal data, what do we do with you?
8 July 2013Update in 2017
This is one of the most popular posts on this blog. You may also be interested in a case study of what happens when students do not get learning objectives: Why people hate statistics.
Original post:
The most useful thing I learned in my teacher training at Auckland College of Education in 1985 was to write learning objectives. Not many years, and two babies later, I began lecturing at the University of Canterbury in Management Science/Operations Research. I was the only academic staff member to have formal teacher-training. My first task, when put in charge of MSCI210, Statistical Methods for Management, was to write learning objectives. This was revolutionary, but the idea infiltrated through other courses over the years.
A learning objective states specifically what a student should be able to do.
Here are some examples of good learning objectives:
Students will be able to:
- Identify different levels of data in new scenarios.
- Explain in context a confidence interval.
- Determine which probability distribution out of binomial, poisson or normal is most appropriate to model in an unfamiliar situation.
- Compare two time series models of the same data and evaluate which is more appropriate in a given context.
Learning objectives need to be specific and measurable.
Here are some things that people might think are learning objectives, but are not:
- Students will understand the central limit theorem. (The term “understand” is not measurable)
- Students will learn about probability trees (“learn” is not measurable, and does not specify the level. Do students need to be able to interpret or create probability trees?)
There are vast numbers of resources on learning objectives online.
Here is one I liked, with Bloom’s taxonomy of levels of learning. These are higher and lower levels of learning objectives, ranging from being able to state principles, through to synthesis and evaluation.
http://teachonline.asu.edu/2012/07/writing-measurable-learning-objectives/
And here are some useful verbs to use when writing learning objectives;
http://www.schreyerinstitute.psu.edu/pdf/SampleVerbs_for_LearningObjectives.pdf
It is not difficult to find material on developing learning objectives.
Not just learning objectives
A course is more than the set of its learning objectives. The learning objectives specify the skills, but there are also attitudes and knowledge to be considered. The starting point for course design is the attitudes. What do we want the students to feel about the topics? What changes do we wish them to contemplate in their thinking? Then the skills and knowledge are specified, often starting at a quite general level, then working down to specifics.
For example, we might wish to teach about confidence intervals. We need to determine whether students need to be able to calculate them, interpret them, estimate or derive them. We need to decide which confidence intervals we are interested in – for means alone, or proportions and slopes as well? Sometimes I find there are concepts I wish to include in the learning objectives, but they don’t really work as objectives. These I put as “important concepts and principles”.
I have put an example of learning objectives and concepts and principles at the end of this post.
Learning objectives tell students what is important
Without learning objectives it is difficult for students to know what they are supposed to be learning. In a lecture, a teacher can talk extensively about a case, but unless she states explicitly, it can be difficult for the students to know where to direct their attention. Do they need to know the details of that specific case or what principles are they supposed to glean from the example? Or was it just a “war-story” to entertain the troops? Students can waste a great deal of time studying things that are not necessary, to the detriment of their learning as a whole. The uncertainty also causes unnecessary anxiety.
Learning objectives enable good assessment development
Each year as we wrote our assessments we would go through the learning objectives and make sure they were assessed. This way the assessment was fair and applied to the course. If we found it difficult to write a question to assess a learning objective we would think again about the learning objective, and what it is we really want the students to be able to do. It made it easier to write fair, comprehensive assessments.
Learning objectives encourage reflection and good course design and development
As instructors write and review the learning objectives in a course, they can identify the level of learning that is specified in each. At an entry-level course, it is acceptable to have a number of lower level learning objectives. However, there needs to be some serious thinking done if a post-graduate course is not mainly made up of higher level learning objectives. I have seen tests in stage 2 and 3 papers that tested mainly recall and common-sense. It was evident that the instructor had not thought clearly about the level of learning that was expected.
Sometimes we find we are assessing things we have not specifically taught the students. The use of learning objectives, linked with assessment design, helps us to identify the background knowledge that we assume students have. One colleague was frustrated that the students did not seem able to apply the statistical results to a managerial context. However, nowhere had she specified that students would be required to do so, and nowhere had she actually taught students how to do this. She also assumed a level of understanding of business, that was probably not appropriate in undergraduate students.
Like it or not, assessment drives learning
I spoke recently to a maths advisor who informed me that teachers should be teaching to the curriculum not to the assessments. I felt he was idealistic, and told him so. My experience is that university students will learn what is assessed, and nothing else. I don’t know at what age this begins, but I suspect National Testing, the bane of good education, has lowered the age considerably. How wonderful it would be if our students learned for the sheer joy of learning! Where there are assessments looming, I fear this is unlikely.
When we write exams we are also writing learning materials for future students. One of the most common ways to prepare for an assessment is to do exercises from previous assessments. So when we feel that students were not really coming to grips with a concept, we include questions in the assessment, that can then be used by future students for review.
Information promotes equity and reduces unnecessary stress
The use of learning objectives can help reduce the “gaming” aspects that can proliferate in the absence of clear information. This is apparent at present in the world of Year 13 Statistics in New Zealand. The information regarding the external standards for 2013 is still sketchy (1 July 2013). The exams are written by external examiners and will take place in November of this year. However there is still only vague and sometimes incorrect information as to exactly what may or may not be included in the exams. Because of this, teachers are trying to detect, from what is or isn’t in the formula sheet and the (not totally correct) exemplars what might be in the finals, and what to include in the school practice exams. I suspect that some teachers or areas have more information than others. The way to make this fairer is to specify what is included in the material that may be included, as learning objectives. Let us hope that some clarity comes soon, for the sake of the teachers and the students.
Your learning
So what were the learning objectives for this post?
As a result of reading this post, readers will
- Reflect on their methods of course development and assessment with respect to using learning objectives.
- find further resources on the internet regarding learning objectives.
- Make comments on the good and bad aspects of this post! (oops – I didn’t teach that one)
Coda – Example of some learning objectives
Here is a set of learning objectives for the final section of a service course in quantitative methods for management. It is based on Excel and traditional (normal-based) methods of statistical analysis. They are far from perfect, including several ideas in many of them.
Evidence Section Learning Objectives
E1. Explain the process underlying hypothesis tests.
E2. Interpret a p-value in context for a given set of hypotheses.
E3. Formulate a null and alternative hypothesis in words for problems involving means, proportions, differences of two means and differences of two proportions.
E4. Use Excel to perform a hypothesis test on one or two means and interpret the results.
E5. Use Excel to perform a hypothesis test on one or two proportions and interpret the results.
E6. Use Excel and PivotTables to perform a Chi-sq test on table data, and interpret the results.
E7. Explain the concept of Type I and Type II errors and identify which (or neither) has occurred in a given situation.
E8. Use Excel to plot bi-variate data, find the correlation; interpret the output.
E9. Use Excel to fit a linear regression line; interpret the output.
E10. Evaluate the validity of statements about the nature of statistical thinking, including the concepts of causation, sample size, models, experimentation, statistical significance, effect size and subjectivity.
E11. Determine which test is most appropriate in a given situation, from: test for a mean or a proportion, difference between proportions, difference of two means: independent samples or paired data, chi-sq test for independence, regression.
Important concepts or principles
E12. Inferential statistics uses information collected in a sample to make predictions or judgements about the population from which the data is drawn.
E13. An effect is statistically significant when there is evidence from the sample to reject the null hypothesis.
E14. The p-value for a hypothesis test of a claim about a population parameter is the probability of getting, by chance, a sample as least as extreme as the observed one if the null hypothesis is true.
33 Comments
I have always been puzzled that “understand” is not regarded as a measurable learning outcome. Understanding of core concepts is most definitely an outcome that I want from students taking my papers. I test students’ understanding in a variety of ways in order to get a handle on what is in essence a latent variable. I have heard it argued that “demonstrate understanding of” is the approved wording for a learning outcome, but that strikes me as largely a matter of semantics.
I don’t like “demonstrate understanding of” either, which is as you say a matter of semantics. I think “understand” is too vague. Explain, use, apply, comment on, could also refer to understanding, but are better indicators of the level of understanding implied.
I remain sceptical. Understanding is typically what I want from my students, and I believe it can be assessed in a variety of ways (as discussed by Diana Kornbrot below).
However, on reflection I think that the reason for my scepticism runs deeper. University lecturers managed for hundreds of years without the requirement to explicitly list learning outcomes. I attended some wonderful lecture courses as a undergraduate without a learning outcome in sight. I’m not saying that my lecturers didn’t think about what they wanted to achieve, simply that none of them found it helpful to publish a list of such outcomes for students (or perhaps even make explicit lists for themselves).
That said, I can be swayed by evidence! Are there published studies demonstrating that use of learning outcomes improves student learning in mathematics and statistics (having adjusted for other variables)?
it sounds actually odd for teacher to set various questions like state and explain or even identity and illustrate and tag a marks of 10 .. that is actually confusing the young scholars.
General objectives can use the word ‘understand’ because that is what you want the students to generally do. Its a broad statement or goal. However with specific objectives ‘understand’ is not observable or measurable. One does not know if a student understands unless they ‘explain’, ‘identify’, ‘state’ etc.
While I agree that Learning Objectives are important to the teacher, I disagree that the start of the lecture should consist of a slide that says “Learning objectives: by the end of this lecture you should…” This will switch the students off before you’ve begun.
If your learning objectives do not come across loud and clear through your lecture/lesson then it is not well structured and presented.
You criticise this teacher: “I spoke recently to a maths advisor who informed me that teachers should be teaching to the curriculum not to the assessments.” with “My experience is that university students will learn what is assessed, and nothing else.” So the real problem with the first teacher is that he was not assessing the full curriculum. If it’s in lectures then tell the students it could come up in the assesment.
I do agree that teachers need to start off any lesson with the goal in mind, but teachers need a “hook” that will engage ad excite the students right from the get go. Learning objectives such as “Students will know, or students will be able to do…” are not only for the students, but for the teachers as well. This is the foundation that keeps teachers from becoming off course, and it also helps students to stay on track as well. Using this as a rubric works well too, because students can refer to it, and make sure they are learning what they need to be learning throughout the lesson. Clear, simple, and explicit objectives will also help students to be less stressed. Often when the objectives are not clear, students end up trying to memorize every tiny detail within the lesson, and ultimately become stressed or overwhelmed. I don’t believe for a second any students wants to be lectured to. I feel any student learns better through a variety of hands on, visual, and auditory activities.
As a current student at uni that has 3 lectures that start off in this manner, I can say it just disengages me completely. Don’t tell me what I should be able to do or know, because it just confuses me from the get go. You want to engage me? Teach me what I need to know, talk about it… don’t have 3 slides about it.
Definitely not a hook for me, and judging from the numerous bored “oh god, here we go again” faces, it does not hook the 100 other odd students sitting with me. Perhaps if it was done in a format other than a boring old slide with dot points it could be considered a hook. But the same format every lecture every week across 3 topics? I’d rather swim for the bottom of the ocean than that crappy looking hook.
admirable support for GOOD learning objectives, in itself not an easy concept
a learning objective should be directly convertible into assessment items with marking criteria that are non-controversial to experts.
understanding is NOT vague if one can construct test items
e.g. understand principles of hypothesis testing
test item A: 2 groups compared on an attribute, p-values for mean difference = .001. are the groups different, e.g. 20 female students, 20 male students? are men and women different on this attribute? what additional information would be needed to interpret any difference? explain your answers.
test item B: groups compared on an attribute, p-values for mean difference = .09. are the groups different, e.g. 20 female students, 20 male students? are men and women different on this attribute? what additional information would be needed to interpret any difference? explain your answers.what additional information would be needed to interpret this difference? explain your answers
est item C: groups compared on an attribute, p-values for mean difference = .38. are the groups different, e.g. 20 female students, 20 male students? are men and women different on this attribute? what additional information would be needed to interpret any difference? explain your answers.what additional information would be needed to interpret this difference? explain your answers.
This also tests for understanding the concept of effect size
ps I am allergic to REFLECT. How would you know?
One could give an exemplary account of learning objectives due to PRIOR reflections on teaching, or a totally misguided account after reading dr. nic’s admirable blog
[…] The most useful thing I learned in my teacher training at Auckland College of Education in 1985 was to write learning objectives. Not many years, and two babies later, I began lecturing at the Univ… […]
[…] The most useful thing I learned in my teacher training at Auckland College of Education in 1985 was to write learning objectives. Not many years, and two babies later, I began lecturing at the Univ… […]
[…] The most useful thing I learned in my teacher training at Auckland College of Education in 1985 was to write learning objectives. Not many years, and two babies later, I began lecturing at the Univ… […]
[…] Learn and teach Statistics and Operations Research blog, “Why learning objectives are so important” […]
[…] Nick. (2013). Why learning objectives are so important. https://learnandteachstatistics.wordpress.com/2013/07/01/objectives/ […]
I like discussion on learning objectives. There has been great controversy on “will be able “and “should be able” .What is the proper way to write learning objectives ” will be able to” or “should be able to” and what is the implication for each?
[…] https://learnandteachstatistics.wordpress.com/2013/07/01/objectives/http://www.unesco.org/webworld/ramp/html/r8810e/r8810e04.htm […]
[…] https://learnandteachstatistics.wordpress.com/2013/07/01/objectives/ […]
[…] https://learnandteachstatistics.wordpress.com/2013/07/01/objectives/ […]
can you provide me with some references to pick up quotes and citations about the communication of objectives to foster the student’s motivation ,i need them to write a literature review
Hi Nah La
Thank you for your interest. You will need to find your own quotes and citations, as this will help you to learn.
Best wishes
Nic
[…] course was that there were no specific learning objectives. One of my most popular posts is on the need for learning objectives. Now I am not proposing that we slavishly tell students in each class what it is they are to learn, […]
[…] Why Learning Objectives are so important: https://learnandteachstatistics.wordpress.com/2013/07/01/objectives/ […]
[…] interesting blog post by Dr.Nic a statistics teacher looks at the importance and effectiveness of learning objectives and […]
[…] Why learning objects are so important? (2017) […]
[…] people what it is that you want them to take away from the training. Specified learning objectives help trainees to focus in on the most important parts of the […]
[…] https://learnandteachstatistics.wordpress.com/2013/07/01/objectives/ […]
God this annoyed me at first. I currently loath the kind of objectives that come out of blooms taxonomy (though I do find the taxonomy useful). To make matters worse when I went and read your examples I found they were really good (I really appreciated the concrete examples). I need to think a little more about how I use them myself now.
As a side note be wary of advocating Bloom or the vocabulary suggestions. These are massively misused. Your examples retained the simplicity and clarity that I desire that most examples of this lose. You used minimal vocabulary and words like compare, identify or explain rather then analysis, critique and evaluation which sound better but are actually less clear. You avoided things like identify three examples which sound precise but actually twist assessment (usually focusing on spending to long on simple examples rather then progressing when you are confident of student understanding). Finally you judge the end needs of the students to determine the verbs used. Most examples prioritise higher order skills (why I hate Bloom being used) just to prove they are developing critical skills.
You appear to use a small range of commonly understood verbs and match them against single word key concepts to design your objectives. At least that’s what I took away. Also really liked the concepts descriptions that allowed you to pull key ideas out of your objectives rather then shoehorning them in.
Finally thanks for reposting. This was an unexpected find that has made me rethink or at least clarify my position.
Thanks, Michael. It is a source of fascination how many views this particular post gets (one of the top 5). Simple is nearly always better in my world.
Great artice about learning objectives and its importance. If you want to read tips about writing learning objectives. Feel free to visit this site(https://blog.weevur.io/5-tips-for-writing-learning-objectives-for-online-learning-d5e6ea7a92a6).
[…] Dr Nic. Why learning objectives are so important from Learn and Teach Mathematics and Statistics with Dr. Nic. Christchurch, New Zealand. [2017]. [Accessed 2018 Mar 3]. Available from: https://learnandteachstatistics.wordpress.com/2013/07/01/objectives/ […]
the following link: http://www.schreyerinstitute.psu.edu/pdf/SampleVerbs_for_LearningObjectives.pdf (that you have included) does not seem to be available any more.
Thanks!
Dears
Plz give me an easy example ,in which i clearly diffirentiate between learning outcomes and learning objectivs. Plz