I’m hesitant to jump in here without reading the entire thread, but I wanted to address this.
Evil enemy checking in: I am an editor and I work for the company that has a contract with the state of Florida to produce their standardized test. I do not work on the actual FCAT; rather, I work on the interpretive products that educators and parents use to prepare themselves and the students for the testing. The same company also produces TAKS as well as several other states’ assessments.
There seem to be some misconceptions about how the standardized tests are created and I wanted to clear those up. In general, I believe there is a need to assess achievement of learning so that appropriate help can be given to districts that need it. You have to measure something, somehow. For me, it’s the politicization of the results that I find distasteful with standardized testing, not so much the act of assessing learning. For example, I think basing teachers’ salaries or bonuses upon their students’ test results is ill-conceived at best. The reason for that is it’s a misuse of the assessment. Florida’s assessment assesses student achievement; not teacher achievement. If you want to measure how effective a teacher is, then a completely different assessment should be designed specifically addressing teaching standards. You don’t assess student learning standards and then measure teachers by that result. Unfortunately, that seems to be what a lot of states and districts are doing. So I think it’s very important to separate the issue of measuring student performance from measuring school or teacher performance.
In Florida, the Department of Education convenes committees of Florida educators to set the standards by which students will be assessed. These are called the Sunshine State Standards (SSS) and you can read them here. The material on the FCAT is based upon, and designed to specifically assess achievement of, these standards.
They are not unreasonable standards at all. Upthread, someone pointed out that it shouldn’t be unreasonable to expect tenth graders, for example, to be able to construct a basic sentence and perhaps communicate a basic idea in a short essay. The SSS lay out a list, from K-12, of all the skills that seem grade-level appropriate.
The State encourages Districts to adopt curriculum and purchase textbooks based upon these standards as well. So when people complain that educators are spending too much time ‘teaching to the test’ be aware that if the curriculum is based on the SSS and the test is based on the SSS, if teachers teach the basic curriculum laid out by the State of Florida (and designed by Florida teachers), then they are, in fact, teaching to the test. I don’t see anything wrong with that, knowing what I know about what’s in the SSS and what’s on the test.
In Florida, there is no possible way to ‘drill’ students on the ‘right’ answers for two reasons.
-
The items on FCAT are never released to the public while they can still appear on a ‘live’ test. Florida does release tests occasionally, (which you can see here) as well as sample test materials (here) annually, and when that happens, all of those questions (or items) are considered ‘dead’ and will never appear on a test again. There are also 30-40 different versions of each test at every grade level and in every subject area and all of those versions (called forms) having different questions on them. That means, for your average classroom, each kid in the room has a completely different form of the test from the kid sitting next to him, so there’s no single set of ‘right’ answers. And,
-
Florida requires performance tasks (PTs) in four subject areas (reading, writing, mathematics, and science) which requires activities such as constructing graphs, reading a passage and writing an 8-line answer to a question, writing a two-page essay in response to a prompt (in 45 minutes), and designing a science experiment and speculating on the hypothesis. You just don’t ‘drill’ kids on performance tasks. No flash card on this planet will teach you how to write an essay or construct a graph. Educators have to teach kids how to write essays, how to read and extrapolate, how to apply basic concepts, and how to think scientifically. If that’s ‘teaching to the test’ then I really don’t have any problem with that.
Students don’t have to do performance tasks in every year of testing, and those PT items are hand-scored, not scored by a machine. ‘Correct’ answers are determined by, again, committees comprised of Florida educators who determine a range of possible correct answers. They train the hand-scorers using rubrics that allow for the students to earn scores for creative outside-the-box solutions. If the students’ responses demonstrate that the students have mastered the material that the question is designed to assess, then the students will score well on that question. The multiple choice (MC) questions are all machine scored. Students get MC questions every year and encounter PT questions three times (from Grades 3–11) in four content areas.
For more information about how Florida’s test is designed and used throughout the state, you are welcome to look at The FCAT Handbook, a project that was near and dear to my heart, because it took about two years of my life to produce. I’m especially proud of the timeline graphic in the first section.
The last thing I wanted to say was that this post is not necessarily intended as a defense of NCLB or of standardized testing. My intent is to remove certain elements of the debate because they are based upon incorrect assumptions, such as ‘the teachers drill kids on all the right answers all day,’ or ‘the material on the test is never even covered in the classroom.’ (And how one could square up those two conflicting ideas, I can’t quite wrap my brain around.) I don’t think NCLB/standardized testing is the end-all, be-all answer to everything. I think it’s just one tool that could be used to decide which districts and schools need attention and to measure how American students are doing in the global market.
You may now resume bashing standardized testing.