September 23, 2012

If a Realist tree falls in an Idealist forest...

This age old question has indeed puzzled me since I first heard it when I was around 10 years old. I found it fascinating to be stumped by such a simple question because it seemed to intuitively contain both a yes and no answer. 15 years later I understood why.

I have been mentoring Master students in Psychology over the past month in Philosophy of Science and Psychology. We have covered the basics of Idealism, Realism, Pragmatism, Positivism, Social Constructivism and all there is and more to these and other concepts. The most important question they've asked of me so far is probably 'Why do we have to know this?'. I give my explanation to this in a quite simple manner, we get better at research and in life in general. Then I realised something else.

Most people I have ever met, has heard the question 'If a tree falls in the forest, and no one is there to witness it, does it still make a sound? And how?'. I have never heard a satisfying answer, until I stumbled upon one myself (and I sure do hope I haven't read it somewhere, forgot, and now commit to the attribution error).

Just like Qualia, the answer depends on how you believe things exist.

If you believe that there does exist a world independent of your mind (roughly, Realism), you can define 'sound' as air compressing and decompressing, and, that this is the only necessary characteristic of 'sound' to allow its existence. Then yes. It does make a sound. We can 'know' this because the conclusion logically and necessarily follows both from the premise of our definition of sound as well as with the laws of physics.

If you however believe that there does not exist a world independent of your mind (roughly, Idealism), you can define 'sound' as sense data, and, that this is a necessary characteristic of 'sound' to allow its existence. Then no. It does not make a sound. We can 'know' this because the necessary condition following from our premise of our definition of sound is not met.

Or so I, amongst other examples, exemplify how philosophy can solve conundrums -let alone find and define logical and practical issues and weaknesses in our cognitive efforts in research and real life. Then I go on to say, but if the esteemed lecturers or the book says any different, then you should trust them (and not only for obvious reasons, but) -if philosophy teaches me anything, then it teaches me how little I can know (so if you are holding non-truths about the world -don't blame me!).

June 18, 2012

Between science(s) and (a) hard place(s)

Was reading a post on Psychology Today by Jonathan Wai and was displeased to note the stereotypic view coming from a physics major, alias 'Order'. While I shared my opinion on his comment, I decided I would like to share a simplistic view on this. Anyone more interested in the dividing of the sciences should take a course/read up on philosophy of science -very interesting indeed!

Why does the hierarchy exist at all? Well, the first reason would be chronological order of fields introduced in Western universities (an arbitrary reason). The second, comes from the philosophical viewpoint of Positivism -something that has been central to research within (mainly) Physics, Chemistry and Biology. When psychology started establishing itself as a solitary field, (around the 1880s/90s with Wundt/James/Hall establishing psychology laboratories) the view of a "researcher" as a general concept, was one of high dignification, as well as the rigor and high regard for positivistic science. Already here psychology decided to borrow from existing sciences to increase its credibility. Psychology copied its philosophical underpinnings (positivism), physical look (for example, introducing white lab coats for psychologists/experimenters to mimic MDs), calling participants subjects (because they were being 'subject'ed to a process, as well as, creating a power-relation between researchER and researchEE) and other (what would seem like) details in procedure and analysis. This, I believe was a misstep like no other, because, in my opinion psychology does not strictly live up to all the positivist ideals. I can go into this in excruciating detail, but will refrain unless asked [Or see my post 'Nonsense.' for a short intro].

I do not believe you can force a numerical structure on something that we can barely define yet. How is 'emotion' defined? Differently in nearly every research report about it (yes, yes, there are two general ideas about the concept, but I'm keeping this simple). The point is that it does not have a generally agreed upon experimental definition. Then how are we supposed to measure quantitatively its properties? Here, hard sciences usually lobby the; "ha! Told you they weren't a real science, they don't even know what they are studying!". And this is where I claim psychology is misunderstood. What is science? Exploring the physical world, gaining an understanding of how it works. So just because psychology hasn't yet defined all the properties within its field, it isn't a science? Isn't the argument the opposite? _Because_ we are, probably more so than most fields, trying to get to definitions, experimenting on flawed existing ones to make them better, and so on, should Psychology not be seen as a frontier for science?

Method. We have a hard time controlling for extraneous variables, indeed we do. Randomisation is a good help but it doesn't cover every single bias in every single experiment published. This is in my opinion, one of the most important flaws to be aware of in psychological science. Not too seldomly, the most pressing biases for the given experiment isn't controlled for, isn't discussed or in any other way documented. This gives rise to the retrospective, I-got-a-significant-result-with-a-decent-effect-but-was-it-really-the-intervention-that-caused-it, question.. (..yes that was a terribly worded and awkward sentence). It is right of everyone, from any field, to critici{s/z}e psychological experiments on the grounds of bias or uncontrolled for variables -because it leads to better experiments, better defined concepts, more rigorous methods and more reliable results. But. It is wrong to dismiss psychological experimenting like a naughty child _because we can't do better_! Yes we can! (Bob the Builder, retrieved 10:57, 18th of June 2012)

An example, by the way, of why I call these opinions simplistic. Just within psychology, we have a broad range of subfields, for example neuropsychology, and it is able to and does follow positivistic philosophy more closely than for example social psychology. It more closely resembles biology and chemistry, and often rely on those fields for answering parts of the questions posed. In either case, there are more arguments, more detailed arguments and the issue is far more complex than what the above may make it seem like.

April 14, 2012

The reason why 'I'm Christian unless you're gay" sets a new standard. 2 Extended Thoughts

This is my opinion, my reason, why I choose to accept the assumptions proposed by science, as opposed to any other method of understanding the world.

We the people have different methods of dealing with the world, importance, I believe, is not to be put on _which type_ of method is chosen, but rather _the consequence_ of which one we choose. My choice of method is dependent on its predictability and utility, for others it may be a sense of being taken care of or a sense of safety. No reason is better or worse, true or false, they are merely different depending on what we need and perhaps, what we are raised to/have a disposition for/through experience develops a need for.

We thus choose method depending on what we need to rely on to give us the most compelling reasons for believing in it in the first place. In turn, the most compelling reason is the one that satisfies whatever need we have to be satisfied. Circular arguments do not get more circular than this, allow me to explicate.

Choices on method are varied and great in number, one may choose Religion A, B or C, a modified version A', B' or C', an individually modified one A'', B'' or C'', various forms of pseudosciences or sciences. Even within pseudoscience and science we tend to form smaller groups, similar to the previous contention that religion subdivides to a whole range of different methods of dealing with the world.

It comes down to that Individual A and Individual B are both as compelled to believe what its community tells them. Or, are as compelled to believe the conclusions they come to themselves when reviewing the canons of their method. Even justification for the individual is of the same valence. I.e. subjective feeling about one's chosen method, I believe for psychological reasons, differs little between Individual A and Individual B.

My assertion is that science is a better method of dealing with the world because it has enormous predictive capability compared to any other method. It allows me to understand the world in a rhetoric and structure that satisfies my need for knowledge and stability. This is what is important to me personally.

Utility can be discussed endlessly, especially from a utilitarian perspective and the issue when discussed in folk tongue usually comes down to that of source. Who came up with what? Religion is the source vs Science is the source.

I can understand an argument for religion which states that people with a religion have been behind discoveries as well as atheists. However, this to me is a misconception, the purpose is not to deny religion, but what is to be discussed is not which method the individual relies on but the canons upon which the discoveries have stemmed from. A religious/atheist/XYZ person, relying on the canons of science to find information, uses science to direct the subject matter of his research.

Very few groundbreaking discoveries can be made from the bible, especially since it is not to be added to or explicitly changed -because it would not be God's word (sorry, interpretation of God's word). The same sentences are reinterpreted to fit our everchanging societies, which I think is good and well. Issues evolve however when there are clear contradictions, such as homosexuality being explicitly condemned in the bible but increasingly accepted in society. As a consequence, Individual B has a choice to modify her private belief to that of C or modify her method by changing it to B' or B'' so as to fit her private beliefs more congruently.

On the side of Science, its canons are rarely stable. In between revolutions, which change the fundamental foundations of our understanding of the world around us, we have the incremental progress within those foundations with additions, refinements and revokements. The best part is, even the lenses we use to see the structure of science through are subject to this process. Also, it matters little what one believes in science in respect to what is found in research. I may not like or believe that Theory A is false but I do not get to have an opinion unless it is backed up with value-free experiments/data (in which case it ceases to be opinion). This, to a certain extent, safeguards experiments from being entangled with what we _want_ the world to contain as opposed to what it _does_ contain. It doesn't matter that people believe or not in the theory of evolution, as of yet thousands of experiments support it, and not one has been able to falsify it. I am thus forced to accept the assumptions of evolution regardless of how I subjectively see it, unless I can think of an even more compelling account of how to explain how life evolved from single-cell organisms to the variet of flora and fauna we see around us today.

These arguments persuade me to use the methods given by science to deal with the world around me. Just as a Christian, Muslim or any other religiously affiliated person would agree upon; the world (and indeed universe) is an absolutely stunning, awe-inspiring and mesmerising environment to be allowed to be a part of.

April 13, 2012

The reason why "I'm Christian unless you're gay" sets a new standard.

Before I even start, I need to say this. I deliberately use trivial, black/white, crude groupings (religious people, atheists etc.) in this OP. I do it only because it is not the point of this piece to divide and define, it is to illuminate the difficulties and issues they pose to each of us and each other. I am fully aware of that these groups I am about to mention are far from homogenous, again, the point is to illuminate the difficulty in communication between individuals rather than anything else.

Needless to recount, atheists and religious people struggle to get along. The YouTube Chronicles (I made it up, don't search for it) of atheist/religious videos are always filled with comments from both sides arguing their basis of opinion. Atheist videos usually attract atheists and top comments are usually aimed at religious people and vice versa. So why care? Easy. It doesn't help. Why? Easy. We do not communicate with equal rhetoric. So? Complicated.. please read on.

I've come across thunderf00t (YouTube celeb advocating atheism) and his, to a large extent, opposite, Eric Hovind (YouTube celeb advocating Christianity). Recently, at the 2012 Reason Rally, they attempted to discuss what was what and immediately got stuck in rhetoric cobweb. From an outside perspective it was quite easy to see what was going on. Eric Hovind asked questions stemming from his world view (which, amongst other things, include the belief in a Christian God). The issue from thunderf00t's perspective was that, the questions posed included assumptions that did not exist in _his_ world view. Let me take you through a thought-experiment.

Forget for a moment everything you have ever heard or experienced. You are now a speck of dust floating around with no reflective-of-the-world thoughts, in fact you have no thoughts at all. About anything. In an instant, you turn into a human being. Now, as you begin to explore the world around you, you have to make assumptions. From one of my first philosophy courses, I remember my professor slowly moving one of his feet forward, tapping the ground in front of him -to make sure it would hold his weight. The point he was making was that, we make assumptions about the most minute things. We assume that the ground in front of us is stable and will carry us -and so we do not hesitate to walk with strong stride from point A to point B. Now, in thunderf00t's world view, he can concede to that 'The universe exists', because it is something we have to _assume_ and probably should because it helps us understand something about everything around us. The important point being, he cannot _know_ if the universe exists, and to a certain extent, it doesn't matter -it is an assumption we have to make regardless of if it is true or not. Let's make more assumptions, 'I exist', 'other people exist' and let me add another two assumptions; I feel and think, others feel and think. Personally, I stop adding assumptions when they have no utility; when an assumption would not gain me a wider perspective of how the world works around me. For example, it is useful to assume that I feel and think, as well as, others feel and think -because it makes social encounters just _that_ much easier. Now, another important thing with assumptions is this; I can make any assumption I like, but, it usually requires me to assume a bunch of other things. For example, the assumption "I think and feel" must be preceded by assumptions such as, physical materia exists, there exist an entity within my physical boundary that I use to be able to think and feel. Assumptions are only accepted if they can help us understand the world, for example, assuming that a spaghetti monster exists is redundant because it doesn't help me understand the world any better. Ok, enough introduction of assumptions I think, onwards to the mistake religious people make about atheists.

A religious person would say "God exists". For an atheist, the number of assumptions to be made about the world to accept this assumption are far too many. We must assume that not only does physical materia exist but also non-physical materia, we must not only assume there is an entity that can see/hear/feel etc. everything but also that this entity can decide what to and not to do with us humans -we then must assume creation, maintenance, changes etc.. These assumptions are far from all of the assumptions we have to make in order to accomodate "God exists" in our assumption-structure of the world. Add to this that, in our world view, we are already making a lot of assumptions on how to find things out about the world -assuming that mathematics can say something about the world, assume that physics can say something about the world and so on. The reason we would rather assume that Physics can tell us things about the world instead of a God, is at least binary. One, relying on Physics instead of God involves far fewer assumptions about the world, but more importantly, two; the reliance on Physics has utility in that we can test and see if an assumptions holds up or not. This is what "prediction" or "predictive power" is all about. Assuming that Physics can tell us something about the world, is strengthened by that we can use the tools taught by Physics to answer questions about the world. Why are we stuck on earth? Why does a rock fall down if I drop it instead of float or fall up? Physics teaches us the assumption that there exist something called gravity, a concept we assume to exist. Why would we rely on this information? Well, because it has predictive power; it tells us something about the world that we can use to our advantage. Assuming that gravity exists is something we do everyday -without even doing it! We don't open a window and walk straight out, because, we assume that gravity will pull us very quickly towards the ground and (depending on height) may kill us. Therefore, questions such as "do you exist?" cannot be answered; it is an assumption we make about the world that helps us live our lives, nothing more, nothing less. It is not true or false and it would not matter if it was true or false -because, _regardless_ if it is true or false, we _have to_ assume it because it is something that helps us live our lives -it has utility to assume it. However, assuming that "God exists", does not help us understand anything over and above the toolbox that the sciences provide for us. Morals exist without God, love exists without God also hate exists without God. Alright, enough about explaining what religious people often do not understand about atheists. Let me flip the table over.

Unfortunately, these mistakes in understanding people we have in front of us is far from unique to religious people. Atheists do it to a large extent as well, and, it does not help us to understand each other. An atheist usually holds the misconception that 'you' believe something that 'I' don't, and imaginary friend that will hold your hand through adulthood -and we say -prove it! Smiling smuggishly, sniggering to ourselves. Well, this is an error exactly mirroring the one religious people make about atheists. The error we make is to assume that the way in which we find out information about the world is the best way for _other world views_ to find out information _about their assumptions_. _This is not true_. We therefore make the same mistake by asking a question that cannot be answered from within a religious person's world view. I.e. in the same way that "is it true?" is an unanswerable question, so is "prove it". In conclusion, it is not fair to ask of another world view to do something that can only be done from one of those world views. It involves the assumption that one's world view is the only 'true' one, from which other's should be judged and hence make the mistake of mistaking assumptions for true or false. Bad atheist!

Apart from these philosophical-specific issues, the psychological and societal specific issues are that these types of discussions _only_ contribute to _one thing_, misunderstanding. Atheists scoffing at the ignorance of religious people and religion devaluing moral character of atheism. I have long tried to ameliorate the difficulties that arise between religious and scientific minded people (no, they are not mutually exclusive groupings). I have tried to explain the above numerous times to both camps without succeeding in building a bridge. Then I read this; I'm Christian unless you're gay. and realized something absolutely terrible (bar for a moment that that OP contains subject matter far outweighing what mine does).

When having read both that piece and the responses to it, it became abundantly clear that Dan Pearce had succeeded where so many fail. Where Richard Dawkins and other more aggressive atheists have failed. Dan Pearce succeeded in building a bridge between two vastly different world views. It is a feat in itself. Something I know from experience is such an extreme catalyst between religious and atheists, is the matter of homosexuality. I started in much more modest differences and failed miserably, why the #"¤! did Dan Pearce succeed? The reasons are many and he succeeded in combining them in such a way that fostered understanding for the two world-views, separately, but at the same time, with the same words. Dan used 'simple' rhetoric, natural, everyday language that everyone understands. He levels himself, first, lower than one thinks of oneself, secondly, he puts himself off of the continuum of where he first places Westboro Baptist Church and then Christians and atheists. He thus ingeniously pushes religious and atheists closer together on the continuum by using an extreme reference point. He abides to universal feelings like love and hate, exemplifies them both and levels you and I down to his level, the level in which we are all human. It is a lesson in humility and we are all in the same boat. We have all made ourselves feel better by beating down on others -regardless of what we have targeted with our hateful comments. He then pushes his point home with powerful conviction; everyone has a right and wrong, but really it doesn't matter because we cannot change others by hating them. He does not contend to change others by loving them, but changing ourselves by loving others. We don't have to resort to the trivial and detrimental comment-flinging, it doesn't help me, myself. Showing others love does not mean one condones a behaviour or disposition that we think is right or wrong. Showing love to someone does not promote or deny something someone is, rather, it promotes ourselves in who we are. Ultimately, he sums it up himself (please read his whole OP by the link provided above);

"Because what you’ll find, and I promise you this, is that the more you put your arm around those that you might naturally look down on, the more you will love yourself. And the more you love yourself, the less need you’ll ever have to find fault or be better than others. And the less we all find fault or have a need to be better than others, the quicker this world becomes a far better place to live."

Dan Pearce set a new standard in the rhetoric of fostering understanding for fellow human beings.

Note on bias, prediction and utility from a Critical Realist perspective.

We all live by strong biases, egocentric, in the sense that we have only a first person perspective from our own standpoint (assumption 1 & 2 and there are plenty more where those came from! Also, egocentric is used without judgemental value in this context). Naturally, we can observe and evaluate, sympathise and empathise with others but my argument does not revolve around the observer's perspective. Rather, it is about the 'data' given, that which is worked from, from the egocentric individuals' perspective. In real life (IRL for my fellow computer-geeks), we assume, interpret and justify actions of others and oneself (most oftenly) in response to situations, actions and relations. While I could turn this OP into a discussion of awareness and applied criticality to one's preceding actions in a specific situation which would affect it and account for parts of one's response-actions -it is beyond the scope of this specific piece (nevertheless very interesting). The issue is that we are not good with assumptions of others' behaviour -even folk psychology requires more than one perspective to account for a situation and these are most often generalisations beyond justification. We are subject to environmental influences in decision making, intraindividual bias both from biological limitations to attention, interpretation and retention and from previous experience, anecdotes, interindividual bias from differing norms depending on who you are interacting with and lastly a cognitive bias in which we reinterpret, change, remove and add information in retrospect to a given situation (this is, by the way, not an exhaustive list of our phallacies). Psychological research on the subject of bias is overwhelmingly in favour of our poor ability to accurately account for situations and others' part in it, let alone our own involvement in the situation (excuse the lack of references, what I have in mind is mostly eye-witness and implicit priming research).

Indeed it is a central reason as to why we are told to write dispassionately and technically when presenting our experiments. It has several important consequences; the first is that it forces one to distance oneself from one's own interpretation (if one is given) and secondly, the observer (the reader) is given a value-free account of someone's interpretation of their data. This contributes to allow the viewing of an experiment critically, without having to be bound to criticise the discourse itself for bias. An example would be selective portrayal of results, choosing to present only results supportive of one's hypothesis when there are other parts of it that would speak against or support a null hypothesis; this is a bias not controlled for by writing dispassionately, but, it becomes much clearer to the reader if this is what the author has done. It is thus a safeguard, but does not guarantee, against portraying instead of presenting and is the best way we have been able to come up with. So far.

This is to me reason alone why reliance on accounts from only a few individuals is worth very little as basis of understanding for social phenomena, in scientific discourse. It does have worth -and can have worth to others- but all too often the consequences of which are overlooked or not mapped out. For my own private empathy/sympathy register, it is fascinating to be allowed entry into an individual's world -a perspective one would not have unless one was either a member of the same group or the individual oneself. It fosters understanding for something I previously dismissed or was ignorant of. One gains a larger perspective -but(!)- only in the realm of one's own assumptions and cognising when observing social phenomena from one's individual, private/personal, view of the world. It also adds another bias to one's framework; new assumptions are made upon the limited perspective of this, one, or a few individuals -which does not necessarily account for other "similar" individuals.

Understanding social phenomena is a different thing when we are discussing the basic scientific principle of prediction (and its utility). Scientific research demands predictability and an unspoken assumption is for it to have utility, i.e. the consequences of any prediction must aim to explicate and elucidate a proposed relationship -it must hold without our intervention/involvement/observation of it. This prediction is then evaluated for its utility by how well (or not) the proposed relationship predicts a future social phenomena.

We assume there is a mechanism by which an observed action is caused but we are well aware of that, because of our biases and limitations, we may perhaps only come as close as these biases and limitations allow us. We have however still an excellent way of understanding how close we actually are to explaining 'what actually happens' because of the consequences of our prediction's implementation. If X then Y. X. Y? Y'? Y''? Z? While social phenomena are far from as simplistic as an X and Y relation, social scientists are creative in testing these predictions -sometimes they lead us down a garden path, sometimes they reveal more or less solid predictions. The point is, of all the assumptions made in this OP, being aware of one's shortcomings is a crucial way of both understanding why one's research showed the results it did (regardless if it fits or not with what one _wants_ to find), communicating a _needed_ skeptic perspective, guides one to see potential bias in others' research as well as leaves one open to (and happy for(!)) criticism from others. We cannot afford to 'believe in' our theories and hypotheses, they introduce a bias that can be veiled by scientific discourse and very concretely limits a potentially wider/better (in regard of predictability) perspective of a social phenomena.

March 13, 2012

More responses, this time Daniel Simons/Dave Nussbaum

Daniel Simons
"The expectancy effects study is rhetorically powerful but proves little. In their Experiment 1, Doyen et al. tested the same hypothesis about priming stereotypes that Bargh tested. But in Experiment 2, Doyen et al. tested a hypothesis about experimenter expectancies. That is a completely different hypothesis. The second study tells us that experimenter expectancies can affect walking speed. But walking speed surely can be affected by more than one thing. So Experiment 2 does not tell us to what extent, if any at all, differences in walking speed were caused by experimenter expectancies in Bargh’s experiment (or for that matter, anywhere else in the natural world outside of Doyen’s lab). This is the inferential error of confusing causes of effects with effects of causes. Imagine that Doyen et al. had clubbed the subjects in the elderly-prime condition in the knee; most likely that would have slowed them down. But would we take that as evidence that Bargh et al. had done the same?"

I was waiting for this to be said. Thank you, sir.


"The inclusion of Experiment 2 served a strong rhetorical function, by planting in the audience’s mind the idea that the difference between Bargh vs Doyen Exp 1 was due to expectancy effects (and Ed Yong picked up and ran with this suggestion by referring to Clever Hans). But scientifically, all it shows is that expectancy effects can influence the dependent variable in the Bargh experiment. That’s not nothing, but anybody who already believes that experiments need to be double-blind should have seen that coming. If we had documentary evidence that in the actual 1996 studies Bargh et al. did not actually eliminate expectancy effects, that would be relevant. (We likely never will have such evidence; see next point.) But Experiment 2 does not shed nearly as much light as it appears to"

Which was an idea popularised by Ed Yong. Nevertheless, it is a free-standing experiment including assumptions that were not present in Bargh's study.


"That is, just because the original study could reject the null and the replication could not, that doesn’t mean that the replication is significantly different from the original study. If you are going to say you failed to replicate the original result, you should conduct a test of that difference.

As far as I can tell neither Doyen et al. nor Pashler et al. did that. So I did. I converted each study’s effect to an r effect size and then comparing the studies with a z test of the difference between independent rs, and indeed Doyen et al. and Pashler et al. each differed from Bargh’s original experiments. So this doesn’t alter the present discussion. But as good practice, the replication reports should have reported such tests."

Again an insightful view of current events.


Dave Nussbaum contributes greatly to the understanding of conceptual and direct replication and the importance of these concepts. It also comes closer to my own opinion on why the Perception-Behaviour Link-experiments would be hard to 'replicate'.



It is motivating to see the discourse focuses more and more on underlying issues rather than the symptoms. I am inclined to, still, believe that the controversy surrounding the specific Bargh study has to do with the underlying theory. I am however leaving that in my literature review, time to focus on the presentation of it instead ^^.

March 12, 2012

Matthew Lieberman's response and solution

There was a solution posted in a recently started blog by Matthew Lieberman that focuses on direct/conceptual replications. His solution is indeed a very interesting one; add to the curriculum of graduate students in their first or second year that they replicate findings of studies previously nominated to be so. While comments on it are pessimistic (with justified reasoning), I do hope it resonates within the scholarly psychology community.

A personal take on Lieberman's response is that I probably would not have minded to see this added to my own curriculum. I may not be all too pleased but considering how much one would learn by replicating something that has worked before, I may not be too peeved about it. Also, getting a name on a publication would be a pretty sweet bonus. Of my severely limited insight into other universities 'caring and nurturing' of aspiring scientists, some are better (and some worse) in picking up their students and involving them in the ongoing research. Maybe Lieberman's idea would go a decent amount of the way to attenuate this issue as well.

March 11, 2012

Ed Yong's response and a few comments

Ed Yong's initial coverage* of Doyen's** and Bargh's*** study was, in my opinion, quite brutal. I have been taught through my undergraduate to criticise constructively and I do not think the initial post has the depth to do so. For example, a close look at Doyen's study indicates that one of the few last alternatives at explaining participant's slower walking speed was experimenter expectation (and a very well conducted piece of research to demonstrate it). The difference in the walk-fast/expect-fast condition was explained by the difference between manual and automatic measuring, not so in the walk-slow/expect-slow condition. I wrote this in my previous blog entry too, but with a different emphasis. This finding means that an environmental stimuli (experimenter expectation manifested in subtle behaviour) was internalised by the participants and subsequently affected observable behaviour (walking slower). This entails that the Doyen study, in fact, supports the original proposition of the Perception-Behaviour Link. This mitigates my criticism of Bargh's work, since, the theory from which he based his 1996 experiment was conceptually replicated in the Doyen study. The PBL is not mentioned in Ed Yong's initial coverage.

In Ed Yong's reply**** to Bargh, he mentions Doyen to "[have] timed volunteers with infrared censors rather than a stopwatch" But they timed both with sensors and manually. This was one of the central reasons that they came to the conclusion that experimenter expectation was the only alternative left to explain their result.

It does strike me from having reviewed large parts of the literature surrounding priming that the published articles are all conceptual replications. The studies following Bargh et al. (1996) have differences in methodology to that study. The issue that has been raised in comments to Bargh's reply to Ed Yong is that "purer" replications that have not given the same results are subject to the file-drawer phenomenon. I.e. publishers have not accepted them and so they've been put in the file-drawer. The issue with this statement is obviously that it is very hard to know (for an outsider like myself) if publishers have denied these studies because they show null-results (not very exciting and from comments it seems there are other rather valid reasons for them not to publish these) or if they contain errors of various types (making them unpublishable).

In either case, I believe I argue in my literature review, strongly, for the theory underlying priming (the Perception-Behaviour Link) but at the same time believe that researchers are getting ahead of themselves and testing advanced hypotheses, when really what this theory needs is the grunt-work of establishing even its simplest tenets. Be that an actual replication of the methodology in Bargh et al. (1996), even though I believe there exist other research more suitable to exemplify the Perception-Behaviour Link.

I should have chosen another topic to do my 30-page literature review on.

*http://blogs.discovermagazine.com/notrocketscience/2012/01/18/primed-by-expectations-%e2%80%93-why-a-classic-psychology-experiment-isn%e2%80%99t-what-it-seemed/
**http://dx.doi.org/10.1371/journal.pone.0029081
***http://www.yale.edu/acmelab/articles/bargh_chen_burrows_1996.pdf
****http://blogs.discovermagazine.com/notrocketscience/2012/03/10/failed-replication-bargh-psychology-study-doyen/

March 9, 2012

Bargh, Doyen and conclusions thereof.

I have just witnessed an interesting phenomenon.

I am concurrently to writing this blog-post, writing a literature review on priming and the Perception-Behaviour Link*. Another paper whom closely replicated the findings of Bargh et al. (1996)*, Doyen et al. (2012)**, were unable to replicate findings as well as provide an interesting demonstration of experimenter expectation. It is however presumptious to assume that the original literature* then also is explained by this bias. The reason is given in a reply by Bargh*** to the Doyen study, basically stating that the experiment was run as a blind study and so experimenter expectation can be safely ruled out. While Bargh's reply unfortunately contains personal attacks and evidence towards being technologically unwilling, he is defended by others in that his experiment _has_ been replicated successfully and that one study cannot refute several made on the same topic. The studies given (by others than Bargh -he did not give any studies as support in his criticism) as support for this claim are these; Elderly prime effect on simulated driving speed, Gay male prime effect on hostility, elderly or youth prime effect on walking time and accessibility as precursor to goal-fulfilment and high vs. low self-conscious difference in being primed by an elderly stereotype on walking speed (xps 2 & 3). I have reviewed one of these in my literature review and it is at best a conceptual replication with several issues in methodology and statistical interpretation (specifics available on request).

In my book, it is not enough to conceptually replicate, since one is then stuck with reviewing another piece of research with its own flaws and fallacies. Granted, Doyen comes close to replicating but did differ on the point of blind experimenters (it was one of the manipulations in Doyen). The assumption was that Bargh's work was non-blind (something I came to the conclusion of as well, although I've read the paper a gazillion times). This was not the case, and hence, it is also a conceptual replication. What _is_ interesting with the Doyen study is that it still supports the PBL, albeit unintentionally. The most important statistic presented is the believe-slow-walking speed comparison between automatic and manual measurement. Believe-fast-walking's significant difference was removed when considering both automatic and manual, not so for believe-slow. A last alternative for this significant difference is then experimenter expectation. The thing is though, experimenter expectation is also an environmental stimuli that is unconsciously internalised and evidently had an effect on observable behaviour! Well, this is what the Preception-Behaviour Link strictly posits.

Again, it is a bit of a shame that many of the arguments Bargh uses in his criticism of the Doyen study are arbitrary, unsupported and, on occasion, false in light of other research (even some from the area of priming)****. It does however not reflect on his prior research. In conclusion, Doyen does not specifically cut Bargh's research down, but rather, introduces another concept able to be accounted for within the Perception-Behaviour Link's framework.

On a second note, if you have unpublished research on the replication of Bargh et al.'s 1996 study, I would very much like to read it. I believe it is of central importance to be open-minded to one's own fallacies and others' criticism (even if I very much like the Perception-Behaviour Link theory), the only way is forward and it is only obstructed when self-preserving opinions and values are set before empirical research.

*Bargh, J.A., Chen, M., & Burrows, L. (1996). Automaticity of social behaviour: Direct effects of trait construct and stereotype activation on action. Journal of Personality and Social Psychology, 72, 230-244.
**Doyen, S., Klein, O., Pichon, C., & Cleeremans, A. (2012). Behavioural priming: It's all in the mind, but whose mind? doi:10.1371/journal.pone.0029081
***Bargh, J.A. (2012, March 5). The natural unconscious: Nothing in their heads. [Web log post]. Retrieved from http://www.psychologytoday.com/blog/the-natural-unconscious/201203/nothing-in-their-heads.´
****See comment section of Bargh's blog post, specifically the one referring to Assimilation and Contrasting (which is found in Dijksterhuis, A., Spears, R., Postmes, T., Stapel, D.A., van Knippenberg, A., & Scheepers, D. (1998). Seeing one thing and doing another: Contrast effects in automatic behaviour. Journal of Personality and Social Psychology, 75, 862-871.)

Labels

a. charles catania (1) abstract (1) accident (1) account (1) actualisation (2) actualization (1) addicted to love (1) addiction (1) affordance (5) affordances (15) alternative environments (2) alternative objects (2) an ecological approach to psychology (1) anthony chemero (1) anthrocentrism (1) anti (2) anti-representationalism (3) anti-representationalist (2) applied psychology (1) arguments against representationalism (1) atheism (1) atheist (1) autocatakinetic (1) baby (1) Bargh (4) behaviour (3) bias (1) Big Bang (1) brain in a vat (1) british psychological association (1) canons (1) cartesian dualism (1) chance (1) chaos theory (1) Chemero (1) christian (2) christianity (1) clinical psychology (4) cognition (7) cognitive (3) cognitive psychology (10) cognitive psychology in crisis (5) coincidence (1) computationalism (1) computer (1) computer-gaming (1) conceptual (2) conflict resolution (1) conflicts (1) contrast between computation and ecological strategy (1) created depictions (1) crib (1) critical (1) critical realism (4) cusp catastrophe (1) Daniel (1) daniel fishman (1) Dave (1) definition (3) dependence (2) depicted environments (2) depicted objects (2) depiction (1) depictions (5) dichotomization (1) dichotomized perception (1) dichotomizing (1) direct (2) direct perception (6) Doyen (4) dualism (1) dynamic (3) dynamic systems (2) dynamic systems theory (1) Earp (1) ecological psychology (18) Ed (2) elderly (2) embodied (4) embodied cognition (15) embodied emotion (1) embodied psychology (1) embodiment (1) emotion (1) emotions (1) energy propagation (1) english (1) ensammast (1) entropy (1) entropy debt (1) environment (1) epistemology (5) eric (1) eric charles (8) ethical problems (1) ethics (1) exemplification (1) exist (3) existence (3) experience (2) explanations of (1) field potentials (1) Foddy (1) gaming (1) gay (2) gender neutral pronoun (1) Gibson (3) Gigerenzer (1) Golonka (3) hard sciences (4) harry heft (1) heterogeneity (1) hie (2) hier (2) hier's (1) hierself (1) history of psychology (1) homogeneity (1) homosexuality (1) hovind (1) how multiple integrations make human intelligence (1) human system (1) humanity (1) i (1) I do apologise but (1) I'm (2) illusions (1) individual (1) infant (1) interception (1) introduction (1) issue editor's foreword (1) John Locke (1) joshua w clegg (1) kent (1) league of legends (1) lieberman (1) Linda Smith (1) link (2) logic (1) logical abstraction (1) love (1) lyrics (1) lyrik (1) master thesis (7) matthew (1) mental disorders (1) metafor (1) metaforer (1) method (1) Milgram (1) Milgram misunderstood (1) mobile (1) modeling (1) more than concepts (1) Müller-Lyer illusion (1) natural science of behaviour (1) norman henry anderson (1) Nussbaum (1) obediance to authority (1) objective (3) observation (1) observe (1) occam's razor (1) of (2) online gaming (1) ontology (6) overmedication (1) peace (1) perception (9) personality (1) perspective (5) philosophy (7) philosophy of mind (4) philosophy of psychology (15) philosophy of science (6) positivism (4) potential (1) pragmatic case studies (1) prediction (1) priming (3) programmed depictions (1) psychiatry (1) psychology (8) psychology of philosophy (1) radical embodied cognitive science (6) random (1) reading list (1) realisation (1) realism (2) rECS (4) relationship (3) religion (1) replication (1) replications (1) representation (3) representationalism (7) representationalist (2) representations (3) reproducibility (1) research (2) retraction (2) review of general psychology (8) Savulescu (1) science (5) screen (1) screen-presented (1) self-development (1) self-organisation (1) self-realization (1) Simons (1) simulation (1) social (3) social construction (3) social constructionism (2) soft sciences (4) sports (1) stability (1) stanley messer (1) statistics (1) stereotype (2) stereotypes (1) study (1) subjective (5) Sunday musings (1) sverige (1) system (1) task (1) task analysis (1) taxonomy (1) teaching example (1) text (1) the empirical study of epistemology and phenomenology (1) the fragmented object (1) the self (2) thermodynamic psychology (3) Thermodynamics (1) thesis experiment (1) three laws of information integration (1) thunderf00t (1) thunderfoot (1) traditional psychology (1) unconscious (1) understanding (1) unified psychology (7) universe (1) unless (2) utility (1) virtual (4) virtual affordances (6) virtual agent (2) virtual agents (1) virtual environment (4) virtual environments (1) virtual interception task (2) Wilson (3) world view (1) Wudarczyk (1) Yong (2) you're (2)