I am not a huge fan of standardized tests after the end of high school. I found the non-subject GREs were a complete waste of time, for example.
I think all my training made me do worse on the (non-subject) math GRE than I did on the SAT in high school. Those four years of training had made me much slower and more careful in my math work. This was extremely important for real world thinking, where problems might take days, months or even years, and a small mistake was very costly. (I had to learn to be even more careful in my professional work.) But it hurt me on a timed, standardized test, where the goal was to pick the right bubble.
Not “what is truth”, but definitely “how do we know truth?”. Trying to measure “critical thinking” is as ambitious as that.
When I google “critical thinking”, I get: “ Critical thinking is the intellectually disciplined process of actively and skillfully conceptualizing , applying, analyzing, synthesizing, and/or evaluating information gathered from, or generated by, observation, experience, reflection, reasoning, or communication, as a guide to belief and action.” That is a good start, as far as I’m concerned.
But maybe it’s better to just say we seem to have different ideas about how hard it is to measure critical thinking. If I read you right, you think that standardized tests represent an established and reliable method to do this. I am very skeptical about that. This may be something else we won’t be able to resolve in a forum like this one.
This is a good question that I don’t have an answer for. But in my mind, it is important to carve out an education focused on learning, thinking, and communicating from vocational training. This would include bachelors degrees in science and the arts from the traditional subjects, and maybe new ones consistent with this same mission.
There will always be some ambiguity between educating a person to “think” (being shorthand for learning, thinking, communicating), and vocational training. This can be dangerous. Paying 100K for a masters degree in creative writing is destructive for anybody not independently wealthy. But this doesn’t mean the degree is not worthwhile; it is just not vocational training, and we shouldn’t understand it economically as if it were.
Just as destructive would be treating a degree in art history as if it were supposed to be vocational training, and removing all support for it because it doesn’t function well in that role.
For pure research, this looks like politicians having larger discussions about the place of funding among our other priorities. It does not consist of trying to write standardized tests for individual research topics.
Similarly, for higher education, I do not think it should take the form of standardized tests. Instead, it should be a larger discussion about what education has done for free society over the last 25, 50, 100, 200 years, and what it can do in the future.