ConnCAN's Push Polling And Inaccurate Reporting - Jonathan ...

by Jon Pelto from Wait, What

Last week, ConnCAN, the pro-charter school and ?education reform? advocacy group was trumpeting the results of a survey that they had conducted of Connecticut teachers.

The anti-tenure reformers claimed that their survey proved that (1) ?More than four out of five Connecticut public school educators say schools and districts ought to be able to dismiss teachers and administrators with a documented history of poor performance.? And (2) ?Nearly 60 percent say educators should be promoted and receive tenure based on their success with increasing student achievement growth.?

After reading their press release and related PR about their survey an observer would be left to believe that Connecticut educators support the positions being put forward by ConnCAN and Governor Malloy.

But their own data doesn?t back up the claims they are making.

In fact there isn?t even a question that would allow ConnCAN to intellectually claim that ?nearly 60 percent say educators should be promoted and receive tenure based on their success with increasing student achievement growth.

Here is how the question reads.

?Neither of these statements might match your opinion exactly but which one statement comes closer to your point of view?

The survey then has two options;

Option #1: ?It doesn?t make sense to award teachers tenure, promotions, and make other staffing decisions unless they have a proven track record of effectively increasing student growth.

Option #2: The length of time in the classroom is the most important factor in teacher development, therefore awarding tenure, promotions, and making other staffing decisions based solely on the length of time teaching is most fair.
Look how the questions are worded in such a way as to push people to the first option.

The core of the question asks whether teachers should be judged on having a ?proven track record of effectively increasing student growth? or whether the decision should be based ?solely on the length of time teaching.?

Meaning should teachers be judged on their ability to help children or only on the number of years in the classroom.

Talk about a loaded or leading question.

And although the survey asked about ?Student growth?, ConnCAN reported it as ?student achievement growth.?

Everyone knows that ?student growth? can be measured in a variety of ways but that ?student achievement growth? is measured by standardized test scores.

Not only did ConnCAN develop a survey that pushed people to the answers they wanted but in the end they reported results which actually changed the question.

I?ve seen a lot of surveys over the past thirty-five years and I?ve conducted many public opinion surveys but I?ve never seen a pollster or client change the wording ? after the fact ? in order to report that survey reveals some piece of information when, in fact, it does not.

The first question on the ConnCAN survey is a perfect example of persuasion or push polling;

ConnCAN asks ? Would you favor or oppose a policy that would?

?Ensure that evaluation systems provide teachers and principals with regular, timely feedback and opportunities for professional development based on the evaluation results.?

The question obviously implies that the evaluation system would be used exclusively for the teacher?s benefit and would lead to professional development opportunities for teachers. Furthermore, by including principals (along with teachers) the question suggests that the evaluation system is not aimed at teachers. (However, needless to say ConnCAN and Malloy?s proposals don?t include any meaningful evaluation system for principals and only go after teachers).

The question eliminates any of the concerns about ConnCAN?s teacher evaluation proposal and only highlights the positive elements of what a plan could look like.

Not surprisingly 96% of teachers say they strongly or somewhat agree with the proposed policy with 71% saying they strongly agree and 25% saying they somewhat agree.

Next comes the question that produces ConnCAN?s news that ?4 out of 5 educators say districts should be able to dismiss teachers with a documented history of poor performance.?

Read ConnCAN?s question very carefully ? it is a work of art. They ask would you favor or oppose a policy that would?

?Ensure schools and districts can dismiss teachers and principals with a documented history of poor performance, regardless of the person?s seniority.

As with the first question, this question pushes the respondent to the ?yes? position by putting in the ?positive? protection of the words ?documented history? and does not, in any way; define what would be included in the evaluation process. (The question makes absolutely no reference to the notion that evaluations might be based on student?s standardized test scores).

ConnCAN is able to claim that four out of five educators agree with that statement but even with the persuasive positive language (and no negative elements included) the number who ?strongly agree? with the statement is only 41 percent while another 41 percent ?somewhat support the statement.?

Compare the differences in the number of educators who agree with ConnCAN?s first question versus their second question.

Evaluation used to promote professional development: 71 percent strongly support

Evaluation used to dismiss teachers: 41 percent strongly support

Everyone wants to get rid of bad teachers but Connecticut educators understand that the key factor is how the evaluation system is developed and implemented. ConnCAN gets to the 80 percent number by only including the positive and removing anything that might be perceived as a negative.

ConnCAN uses the same technique in question after question.

One question asks if educators should ?earn and retain tenure based on their proven effectiveness with students in the classroom.? The question makes no mention of ?student achievement growth? (the references to standardized tests).

77% of teachers agree with that statement (35% strongly agree and 42% somewhat agree).

In another question, ConnCAN asks about a policy that would ?Promote and pay teachers and school leaders based on an evaluation system that takes into account students? achievement growth as well as contributions to the school, leadership skills, and professional practice.?

Here ConnCAN does have the words ?students achievement growth? but adds the qualifiers that teachers also be judged on their ?contributions to the school, leadership skills, and professional practice.?

?60% of teachers agree with that statement (24 percent strongly agree and 36 percent somewhat agree)

The ConnCAN Survey Results are posted here: http://www.conncan.org/sites/conncan.org/files/conncan_jan_2012_educator_survey.pdf

Source: http://blog.ctnews.com/kantrowitz/2012/03/04/conncans-push-polling-and-inaccurate-reporting/

karina smirnoff pumpkin cheesecake deviled eggs pie crust pie crust stuffing recipe happy thanksgiving