On Assessment, II

Last week, I had mentioned finding an essay I wrote about assessment in an Honors Calculus sequence I had designed.  I took some time to set the stage for this essay — so now it’s time to dive right in!

A caveat:  This essay was written in 2011.  I will attempt to keep as true to the original essay as I can, though I’ll edit for clarity and updated information/links, and will also [add commentary in square brackets].  So here goes!

“To educate is to illuminate the power of ideas.

This, of course, is an ideal — certainly not the last to be articulated, nor perhaps the highest. But putting practicality aside for the moment, how might we take on such a view of education?

Consider the example of planetary orbits.  Tying together history, technology, politics, physics, and mathematics through a discussion of Kepler’s laws is — yes — illuminating. Of course there is no single idea at play here, but consider this: Kepler was perhaps the first astrologer to become an astronomer.  He, in contrast to so many of his contemporaries, asked not only where a particular planet should be on some future date, but why it should be there.  In his mind, predicting the positions of celestial bodies for the purpose of casting horoscopes for royal personages was not enough — he wanted to know why. That, however, would have to wait until Newton and the application of calculus.  And the power of that idea!

There is no need to present further historical examples.  What is important, however, is to move beyond historical ideas and address the issue of the power of a student’s own ideas.  Two semesters of teaching Advanced Problem Solving [a course I taught at IMSA which emphasized the writing of original mathematics problems] have shown me that having students write original problems motivates them to learn.  They are timid at first — for how could they come up with an original problem?  But after some success, students are excited to create — and as a result, learn about a particular topic in a more profoundly personal way than they might have otherwise.  (Interestingly, the writing of original problems as a teaching tool is common in eighth-grade Japanese mathematics classrooms.  See The Teaching Gap by Stigler and Hiebert, ISBN 0-684-85274-8, pp. 6–41.)

Other assessments are more routine: students are informed that they need to be able to solve linear and quadratic equations, as well as graph linear and quadratic functions.  This is perhaps more manageable — the task is well-defined within narrow limits.  But it is rather different in nature than creating an original piece of work.

Abraham Maslow articulates a similar difference in a discussion of growth theory (see Toward a Psychology of Being by Abraham Maslow, ISBN 0-442-03805-4, p. 47).  Psychologically, why do children grow?  “We grow forward when the delights of growth and anxieties of safety are greater than the anxieties of growth and the delights of safety.”   From an educator’s point of view, this implies making the classroom a safe environment for creativity and exploration.

“The opposite of the subjective experience of delight (trusting himself), so far as the child is concerned, is the opinion of other people (love, respect, approval, admiration, reward from others, trusting others other than himself).”  (Maslow, same source, p. 51.)  Who comes to mind is the student afraid of enrolling in BC Fast-Track [the colloquial name of the Honors Calculus sequence at IMSA] because he or she might not earn an A.  [I did have a very capable student who was so concerned about grades, he opted to take the more traditional calculus sequence.  I actually met with his father, who wanted a guarantee that his son would earn an A in the course.  Given the nature of the course, there was naturally no way I could give such a guarantee.]  Or perhaps the student who shuns a difficult course and takes an easier one instead.  Grades are just that — opinions of other people.

The assignment of letter grades is not necessary for learning, but is merely practical for other reasons.  The assignment of letter grades does nothing to illuminate the power of ideas.

A quick Internet search reveals that the assignment of A–F letter grades is a fairly recent phenomenon, not making its way into high schools until the mid-twentieth century.  In the early twentieth century, grades of E (Excellent), S (Satisfactory), N (Needs improvement), and U (Unsatisfactory) were also used.

The question of whether a letter-grade system of evaluation is the best option for a school like IMSA is perhaps a worthwhile one (some argue against grades at all [this was the link, but it is now a dead end:  http://www.alfiekohn.org/teaching/fdtd-g.htm ]).  That is a question which cannot be answered in the short-term, if the question is considered relevant. So the question is this: given that letter grades need to be assigned this semester, what approach should be taken?

What do letter grades mean?

The only consensus I have heard, so far, is that earning a grade of A, B, or C means that a student exceeds, meets, or does not meet expectations.  Of course, this is reminiscent of E, S, and N.  Moreover, a grade of C is passing, so that a student receives credit for a course even if they do not meet expectations.

But this is not what the grades currently mean.  Essentially, points are assigned to hundreds of problems given throughout semester, whether on assignments, papers, quizzes, or exams — and an arbitrary weighted sum of these point assignments is converted to a letter.  (Of course letters may need to be converted to numbers so that they may be used by an online grade calculator to compute a number which is then converted back to a letter.)

What does this mean about meeting expectations?

Well, nothing really.  I would venture to suggest that “meeting expectations” currently means “enough A’s, but not too many C’s.”  Perhaps this is politically necessary, but expedient.  The performance of our students determines our expectations, rather than the other way around.”

 

On Assessment, I

While downsizing for a recent move, I decided to sort through dozens of folders (thousands of pages!) of old problems, notes, exams, essays, and other documents generated in the course of twenty-five years of teaching mathematics.  I found an essay written in 2011 which I though might be of some interest.

This essay might be considered a more thorough follow-up to The Problem with Grades, a satire on assessment practices which I’ve shared with you already.  The essential point in that essay was that how we typically assign grades is punitive:  begin with a given number of points (say, 100), punish students for making mistakes (subtract a certain number of points from 100), and then — magically! — the resulting number reflects a student’s understanding.  (If you think that this is in fact a really great way to assess a student’s learning, you probably should stop reading right here….)

The essay I’d like to share here was written in the context of teaching an Honors Calculus sequence I designed while at the Illinois Mathematics and Science Academy (IMSA).  So before diving in, let me take a few moments to set the stage.

We had quite a broad range of students at IMSA — and so when it came to teaching calculus, some students were bored by the “average” pace of the class.  Of course this happens in a typical classroom; the tendency is to teach to the middle, with the necessary consequence that some students fall behind, and others could benefit from a faster pace or more advanced problems.

Now mathematics educators are looking at ways to design classroom environments where students can work more independently, at their own pace, incorporating methodologies such as differentiated learning and/or competency-based learning.  These ideas could be the subject for wide-ranging (future) discussions; but in my case, I was working in an environment where all students did essentially the same work in the classroom, and assessments were fairly traditional.

In addition to creating a faster-paced, more conceptually oriented course, I incorporated two features into this Honors Sequence.  First, I had students write and solve their own original mathematics problems, as well as reflect on the problem-posing process.  I won’t say more about that here, since I’ve written about this type of assessment in a previous blog post.

Second, I experimented with a different way of assessing student understanding on exams.  Each exam had two components:  a Skills portion and a Conceptual portion.  The Skills portion was what you might expect — a set of problems which simply tested whether students could apply routine procedures.  The Conceptual portion was somewhat more challenging, and included nonroutine problems which were different from problems students had seen before, but which did not require any additional/specialized knowledge to solve beyond what was needed to solve the Skills problems.  (As part of the essay I will share, examples of both types of problems will be included.  I also discuss these ideas in more detail in a previous post, On Grading.)

Moreover, I graded these problems in a nonstandard say:  each problem was either Completely Correct (CC), meaning that perhaps aside from a simple arithmetic error or two, the problem was correctly solved; Essentially Correct (EC), meaning that the student had a viable approach to solving the problem, but was not able to use it to make significant progress on the problem; and Not Correct (NC), meaning that the approach taken by the student would not result in significant progress toward solving the problem.

Letter grades (a necessity where I taught, as they are in most schools) were assigned on the basis of how many problems were CC and EC on the Skills/Conceptual portions.  While I won’t go into great detail here, the salient features of this system are, in my mind:

  1.  Earning an A required a fair number of problems CC; in other words, a student couldn’t get an A just by amassing enough partial credit on problems — there needed to be some mastery;
  2.  Earning an A required as least some progress on the Conceptual problems; typically, I would include three such problems, which would be assessed more leniently than the Skills problems.  In order to earn an A, a student would need to make some progress on one or two of these.  I felt that an A student should be able to demonstrate some conceptual understanding of main ideas;
  3. A student could earn a B+ just by performing well on the Skills problems (or perhaps an A- for performing flawlessly), but an A was out of reach without some progress on the Conceptual problems;
  4. The approach was not punitive:  students were assigned CC/EC based on their progress toward the solution to a problem, not how far they fell short of a solution.

Such a system is not new; I have talked with colleagues who used a 0/1/2 system of grading, for example.  Whatever the format, the approach is more holistic.  And given that problems in mathematics typically admit more than one solution, the idea of creating a point-based rubric for all possible solution paths does, in some real sense, border on the insane.

I should also add that our instructional approach at IMSA was essentially inquiry-based.  While such a classroom environment is conducive to having students write original problems and using alternative assessment strategies, it is not strictly necessary.  I have incorporated both the elements described above in a more traditional classroom setting, but with varying degrees of success.  That discussion is necessarily for another time.

So much for a brief introduction!  I would also like to comment that teaching this Honors Sequence was perhaps my most enjoyable and successful teaching experience in the past few decades.  Students who completed the two-semester sequence left thinking about mathematics in a fundamentally different way, and I stay connected with a few of these students many years later.

Next week, I’ll introduce the essay proper, adding commentary as necessary to flesh out details of the course not addressed here, as well as making remarks which reflect my teaching this Honors sequence in the years since the essay was written.  Until then, I’ll leave you with the opening words:

“To educate is to illuminate the power of ideas…..”

The Problem with Calculus Textbooks (Reprise)

Simply put, most calculus textbooks are written in the wrong order.

Unfortunately, this includes the most popular textbooks used in colleges and universities today.

This problem has a long history, and will not be quickly solved for a variety of reasons. I think the solution lies ultimately with high quality, open source e-modules (that is, stand-alone tutorials on all calculus-related topics), but that discussion is for another time. Today, I want to address a more pressing issue: since many of us (including myself) must teach from such textbooks — now, long before the publishing revolution — how might we provide students a more engaging, productive calculus experience?

To be specific, I’ll describe some strategies I’ve used in calculus over the past several years. Once you get the idea, you’ll be able to look through your syllabus and find ways to make similar adaptations. There are so many different versions of calculus taught, there is no “one size fits all” solution. So here goes.

1. I now teach differentiation before limits. The reason is that very little intuition about limits is needed to differentiate quadratics, for example — but the idea of limits is naturally introduced in terms of slopes of secant lines. Once students have the general idea, I give them a list of the usual functions to differentiate. Now they generate the limits we need to study — completely opposite of introducing various limits out of context that “they will need later.”

Students routinely ask, “When am I ever going to use this?” At one time, I dismissed the question as irrelevant — surely students should know that the learning process is not one of immediate gratification. But when I really understood what they were asking — “How do I make sense of what you’re telling me when I have nothing to relate it to except the promise of some unknown future problem?” — I started to rethink how I presented concepts in calculus.

I also didn’t want to write my own calculus textbook from scratch — so I looked for ways to use the resources I already had. Simply doing the introductory section on differentiation before the chapter on limits takes no additional time in the classroom, and not much preparation on the part of the teacher. This point is crucial for the typical teacher — time is precious. What I’m advocating is just a reshuffling of the topics we (have to) teach anyway.

2. I no longer teach the chapter on techniques of integration as a “chapter.” In the typical textbook, nothing in this chapter is sufficiently motivated. So here’s what I do.

I teach the section on integration by parts when I discuss volumes. Finding volumes using cylindrical shells naturally gives rise to using integration by parts, so why wait? Incidentally, I also bring center of mass and Pappus’ theorem into play, as they also fit naturally here. The one-variable formulation of the center of mass gives rise to squares of functions, so I introduce integrating powers of trigonometric functions here. (Though I omit topics such as using integration by parts to integrate unfriendly powers of tangent and secant — I do not feel this is necessary given any mathematician I know would jump to Mathematica or similar software to evaluate such integrals.)

I teach trigonometric substitution (hyperbolic as well — that for another blog post) when I cover arc length and surface area — again, since integrals involving square roots arise naturally here.

Partial fractions can either be introduced when covering telescoping series, or when solving the logistic equation. (A colleague recommended doing series in the middle of the course rather then the end (where it would have naturally have fallen given the order of chapters in our text), since she found that students’ minds were fresher then — so I introduced partial fractions when doing telescoping series. I found this rearrangement to be a good suggestion, by the way. Thanks, Cornelia!)

3. I no longer begin Taylor series by introducing sequences and series in the conventional way. First, I motivate the idea by considering limits like

\displaystyle\lim_{x\to0}\dfrac{\sin x-x}{x^3}=-\dfrac16.

This essentially means that near 0, we can approximate \sin(x) by the cubic polynomial

\sin(x)\approx x-\dfrac{x^3}6.

In other words, the limits we often encounter while studying L’Hopital’s rule provide a good motivation for polynomial approximations. Once the idea is introduced, higher-order — eventually “infinite-order” — approximations can be brought in. Some algorithms approximate transcendental functions with polynomials — this provides food for thought as well. Natural questions arise: How far do we need to go to get a given desired accuracy? Will the process always work?

I won’t say more about this approach here, since I’ve written up a complete set of Taylor series notes. They were written for an Honors-level class, so some sections won’t be appropriate for a typical calculus course. They were also intended for use in an inquiry-based learning environment, and so are not in the usual “text, examples, exercise” order. But I hope they at least convey an approach to the subject, which I have adapted to a more traditional university setting as well. For the interested instructor, I also have compiled a complete Solutions Manual.

I think this is enough to give you the idea of my approach to using a traditional textbook. Every calculus teacher has their own way of thinking about the subject — as it should be. There is no reason to think that every teacher should teach calculus in the same way — but there is every reason to think that calculus teachers should be contemplating how to make this beautiful subject more accessible to their students.

Enumerating the Platonic Solids

The past few weeks, I outlined my approach to a series of lectures on polyhedra.  One of my constraints is that students will not have seen a lot of trigonometry yet, and will not have been exposed to three-dimensional Cartesian coordinates.  But there is Euler’s Formula!  I just finished a pair of lectures on the algebraic enumeration of the Platonic solids using Euler’s Formula, and I thought others might be interested as well.

As a reminder, Euler’s Formula states that if V, E, and F are the number of vertices, edges, and faces, respectively, on a convex polyhedron, then

V-E+F=2.

How might we use this formula to enumerate the Platonic Solids?  We need to make sure we agree on what a Platonic Solid is:  a convex polyhedron with all the same regular polygon for faces, and with the same number meeting at each vertex.

To use this definition, we will define a few more variables:  let p denote the number of sides on the regular polygons, and let q denote the number of polygons meeting at each vertex of the Platonic solid.  (Those familiar with polyhedra will recognize these as the usual variables.)

The trick is to count the number of sides and vertices on all the polygons in two different ways.  For example, since there are F polygons on the Platonic solid, each having p sides, there are a total of pF sides on all of the polygons.

CubeFaces.png

But notice that when we build a cube from six squares, two sides of the squares meet at each edge of the cube.  This implies that 2E also counts all of the sides on the polygons.  Since we are counting the same thing in two different ways, we have

pF=2E.

We may similarly count all the vertices on the polygons as well.  Of course since a regular polygon with p sides also has p vertices, there are pF vertices on all of the polygons.

But notice that when we put the squares together, three vertices from the squares meet at a vertex of the cube.  Thus, if there are V vertices on a Platonic Solid, and if q vertices of the polygons come together at each one, then it must be that qV is the total number of vertices on all of the polygons.  Again, having counted the same thing in two different ways, we have

pF=qV.

Thus, so far we have

V-E+F=2,\quad pF=2E,\quad pF=qV.

Note that we have three equations in five variables here; in general, such a system has infinitely many solutions.  But we have additional constraints here — note that all variables are counting some feature of a Platonic Solid, and so all must be positive integers.

Also, since a regular polygon has at least three sides, we must have p\ge3, and since at least three polygons must come together at the vertex of a convex polyhedron, we must also have q\ge3.

These additional constraints will guarantee a finite (as we know!) number of solutions.  So let’s go about solving this system.  The simplest approach is to solve the last two equations above for E and V and substitute into Euler’s Formula, yielding

\dfrac{pF}q-\dfrac{pF}2+F=2.

Now divide through by F and observe that F>0, so that

\dfrac pq-\dfrac p2+1>0.

Multiply through by 2q and rearrange terms, giving

pq-2p-2q<0.

How should we go about solving this inequality?  There’s a nice trick here:  add 4 to both sides so that the left-hand side factors nicely:

(p-2)(q-2)<4.

Now we are almost done!  Since p,q\ge3, then p-2 and q-2 must both be integers at least 1; but since their product must be less than 4, they can be at most 3.

This directly implies that p and q must be 3, 4, or 5.

This leaves only nine possibilities — but of course, not all options need be considered.  For example, if p=q=5, then

(p-2)(q-2)=9>4,

and so does not represent a valid solution.  But when p=3 and q=4, we have the octahedron, since p=3 means that the polygons on the Platonic Solid are equilateral triangles, and q=4 means that four triangles meet at each vertex.

So out of these nine possibilities to consider, there are just five options for p and q which satisfy the inequality (p-2)(q-2)<4.  And since each pair corresponds to a Platonic Solid, this implies that there are just five of them, as enumerated in the following table:

PlatonicChart

Actually, this implies that there are at most five Platonic Solids.  How do we know that twelve pentagons actually fit together exactly to form a regular dodecahedron?  A further argument is necessary here to be complete.  But for the purposes of my lectures, I just show images of these Platonic Solids, with the presumption that they do, in fact, exist.

Now keep in mind that in an earlier lecture, I enumerated the Platonic Solids using a geometrical approach; that is, by looking at those with triangular faces, square faces, etc.  I like the problem of enumerating the Platonic Solids since the geometric and algebraic methods are so different, and emphasize different aspects of the problem.  Further, both methods are fairly accessible to good algebra students.  The question of when to take an algebraic approach rather than a geometric approach to a geometry problem is frequently difficult for students to answer; hopefully, looking at this problem from both perspectives will give students more insight into this question.

 

Teaching Three-Dimensional Geometry, III

This is the last of a three-part series on teaching three-dimensional geometry.  A few weeks ago, I had begun describing how I would go about putting together a series of about 20 online videos on 3D geometry, each lasting 5–7 minutes.  I just finished a discussion of buckyballs, and why regardless of the number of hexagonal faces on a buckyball, there are always exactly 12 pentagonal faces.

Euler’s Formula was key.  We’ll look at another application of Euler’s Formula, but before doing so, I’d like to point out that students at this level have not encountered Cartesian coordinates in three dimensions, and so I need to find things to talk about at an accessible level.

On to the truncation of polyhedra!  Again, we can apply Euler’s Formula, but it helps to think about the process systematically.  You can count the number of vertices, edges, and faces on a truncated cube, for example, one at a time — but little is gained from a brute force approach.  By thinking more geometrically, we would notice that each edge of the original cube contributes two vertices to the truncated cube, giving a total of 24 vertices.

We can continue on in this fashion, counting as efficiently as possible.  This sets the stage for a discussion of Archimedean solids in general.  A proof of the enumeration of the Archimedean solids is beyond the scope of a single lecture, but the important geometrical ideas can still be addressed.

This concludes the set of lectures on polyhedra in three dimensions.  Of course there is a lot more that can be said, but I need to make sure I get to some other topics.

Like spherical geometry, for instance, next on the slate.  There are two approaches one typically takes, depending how you define a point in spherical geometry.  There is a nice duality of theorems if you define a Point in this new geometry as a pair of antipodal points on a sphere, and a Line as a great circle on a sphere.  Thus two distinct Lines uniquely determine a Point, and two distinct Points uniquely determine a line.

This is a bit abstract for a first go at spherical geometry, so I plan to define a Point as just an ordinary point on a sphere, and a Line as a great circle.  Two points no longer uniquely determine a Line, since there are infinitely many Lines through two antipodal Points.

But still, there are lots of interesting things to discuss.  For example, there is no such thing as a pair parallel lines on a sphere:  two distinct Lines always intersect.

Triangles are also intriguing.  On the sphere, the sides are also angles, measured by the angle subtended at the center of the sphere.  So all together, there are six angular measures in any triangle.

Since students will not have had a lot of exposure to trigonometry at this point, I won’t discuss many of the neat spherical trigonometric formulas.  But still, there is the fact the angle sum of a spherical triangle is always greater than 180^\circ.  And the fact that similarity and congruence on the sphere are the same concept, unlike in Euclidean geometry.  For example, if the angles in a Euclidean triangle are the same in pairs, the triangles are similar.  But on a sphere, if the angles of two spherical triangles measured the same in pairs, they would necessarily have to be congruent.

In other words, students are getting further exposure to non-Euclidean geometries.  (I did a lecture on inversive geometry in a previous section.)  One nice and accessible proof in spherical geometry is the proof that the area of a spherical triangle is proportional to its spherical excess — that is, how much the angle sum is greater than 180^\circ.  So there will be something  I can talk about without needing to say the proof is too complicated to include….

The final topic I plan to address is higher-dimensional geometry.  The first natural go-to here is the hypercube.  Students are always intrigued by a fourth spatial dimension.  Ask a typical student who hasn’t been exposed to these ideas what the fourth dimension is, and the answer you invariably get is “time.”  So you have to do some work getting them to think outside of that box they’ve lived in for so long.

One thing I like about hypercubes is the different ways you can visualize them in two dimensions.

Hypercube1

Viewed this way, you can see the black cube being moved along a direction perpendicular to itself to obtain the blue cube.  Of course the process is necessarily distorted since we’re looking at a static image.

Hypercube2

This perspective highlights a pair of opposite cubes — the green one in the middle, and the outer shell — and the six cubes adjacent to both.

Hypercube4

And this perspective is just aesthetically very pleasing, and also has the nice property that every one of the eight cubes looks exactly the same, except for a rotation.  Again, there won’t be any four-dimensional Cartesian coordinates, but still, there will be plenty to talk about.

I plan to wrap up the series with a discussion of volumes in higher dimensions.  As I mentioned last week, I’d like to discuss why you should avoid peeling a 100-dimensional potato….

Thinking by analogy, it is not difficult to motivate the fact that the volume of a sphere n dimensions is of the form

Kr^n.

Now let’s look at peeling a potato in three dimensions, assuming it’s roughly spherical.  If you were a practiced potato peeler, maybe you could get away with the thickness of your potato peels being, say, just 1% of the radius of your potato.  This leaves the radius of your peeled potato as 0.99r, and calculating a simple ratio reveals that you’ve got 0.99^3\approx0.97 of your potato left.

Extend this idea into higher dimensions.  If your potato-peeling expertise is as good in higher dimensions, you’ll have 0.99^n of your potato left, where n is the number of dimensions of your potato.  Now 0.99^{100}\approx 0.366, so after you’ve peeled your potato, you’ve only got about one-third of it left!

What’s happening here is that as you go up in dimension, there is more volume near the surface of objects than there is near the center.  This is difficult to intuit from two and three dimensions, where it seems the opposite is the case.  Nonetheless, this discussion gives at least some intuition about volumes in higher dimensions.

And that’s it!  I’m looking forward to making these videos; I actually made my first set of slides today.  As usual, if I come across anything startling or unusual during the process, I’ll be sure to post about it!