Where should we focus our efforts?

During the Second World War, Allied bombers were sustaining heavy damage from flak and bullets while flying missions over Germany. Many of these bombers failed to return to their bases in Britain. A study was conducted of the damage done to the planes that did make it back which resulted in a proposal to add armor to those areas that had sustained the greatest number of hits. This would have been a costly undertaking as it meant spending valuable resources on refitting the planes. Furthermore, the extra armor would make the bombers heavier and less maneuverable. Had this effort been carried out, it most likely would have failed.

From Digital Roam

Fortunately, a Hungarian mathematician, Abraham Wald, took another perspective. Why not reinforce those parts of the bomber that had not been hit? He had noticed a different pattern in the shot-up planes. Each had avoided damage in similar spots, and Wald reasoned that these were vital areas that needed to be protected. After all, these bombers had successfully returned from their missions in spite of the damage they had received.

The Allied Command followed Wald's suggestions. (A collection of his memos can be found here.) However, I believe some loud and persistent voices in education reform are missing the wisdom of his message. Recent videos developed by Students First exemplify this misunderstanding of what is vital to the success of the U.S. education system. (Students First is the group headed by former Chancellor of the Washington D.C. school system, Michelle Rhee.)

The video shown here suffers from the same problem that distracted the original researchers of the WWII British bombers. Students First is focusing on the testing data (where we were "hit") and ignoring what is really important in education. To continue the Olympic metaphor, it would be like judging our divers against those of other nations simply based on how long it takes to climb the ladder. It does not matter, which makes it a distraction, and a potentially costly one.

Dr. Yong Zhao explains the problem with this focus on using only tests to compare our educational system to other country's in his keynote at the AACTE 2012 Annual Meeting. The keynote starts about 18 minutes into the video.

Education reform groups like Students First say that our current standardized test results show that our education system is full of holes. The truth is that by that reasoning, "American education has always been bad." [32:33] Poor test scores are not a recent phenomenon. "We have had over a half-a-century of bad education according to some measures." [40:49]

Much like Wald did, Zhao interprets these "hits" differently. In the figure below, the countries on the left are the top ten countries in the Programme for International Sudent Assessment (PISA). Those on the right represent the leaders from the Global Entrepreneurship Monitor (GEM). 

"As you can see the two lists don't go together. Countries that have higher PISA scores have lower entrepreneur capabilities." [48:40] In other words, focusing on high test scores means embracing conformity at the expense of what has always been our national strength - creativity.

Unfortunately, the current wave of education reform focuses on the easy to observe gaps rather than our subtle and vital successes. Yes, we have holes but these holes have not kept us from being successful. Still, we seem committed to embracing standards-based test-prep while eliminating the aspects of our educational system that nurture creative thinking. If we do not listen to the wisdom of Wald and Zhao, we will spend a lot of resources to fix what is not really important and make our education system less flexible as a result.