Hi there,
I am a psychology researcher and new to this forum. I am currently trying to figure out if there is an appropriate statistical test that I can use to compare the outcome of two separate experimental studies that I have performed. Let me briefly explain the scenario...
I conducted an initial study which involved priming people to think about death or some other topic before presenting them with word fragments that could be completed in a death-related or death-neutral fashion (i.e. to assess whether or not those primed with death would produce a greater number of death-related word fragment completions). For instance, participants were presented with a word fragment such as D_ _ d that could be completed as dead/died or dust. The measure I used was a standard measure in this particular research area but I discovered that participants tended to favour certain word fragment completions over others irrespective of priming etc. For instance, participants completed the word fragment such as Coff_ _ as Coffee 70/72 times. Upon further investigation, I discovered that participants were biased towards particular word fragment completions that had higher word frequencies, suggesting that the measure had some element of bias rather than having constructed word fragments with counter-balanced death-related and death-neutral completions of similar word frequency. This appeared to be what was biasing participants' responses towards particular word fragments.
Following this finding, I decided to create a new measure with word fragments which could be completed with a death-related or death-neutral word fragment of equivalent word frequency (i.e. within a 10% frequency range according to a standard word frequency corpus). After constructing the measure, I ran a similar experiment to the first study and found that participants responses were no longer biased towards the new measure. In other words, there was a more even spread in their responses between death-neutral and death-related word fragment completions of similar word frequency. For instance, participants responded to the word fragment _ie with Die about 24 times and with Lie 32 times.
What I was wondering is whether there was some sort of analysis that I could perform comparing the two sets of data in order to demonstrate that the new measure was less prone to bias? For instance, is there a sensible way of comparing participants' scores on the _ie word fragment vs the Coff_ _ word fragment described above that would demonstrate that participants in the second study appeared to be less biased towards particular word fragment completions?
Any help with this problem would be much appreciated!!!
I am a psychology researcher and new to this forum. I am currently trying to figure out if there is an appropriate statistical test that I can use to compare the outcome of two separate experimental studies that I have performed. Let me briefly explain the scenario...
I conducted an initial study which involved priming people to think about death or some other topic before presenting them with word fragments that could be completed in a death-related or death-neutral fashion (i.e. to assess whether or not those primed with death would produce a greater number of death-related word fragment completions). For instance, participants were presented with a word fragment such as D_ _ d that could be completed as dead/died or dust. The measure I used was a standard measure in this particular research area but I discovered that participants tended to favour certain word fragment completions over others irrespective of priming etc. For instance, participants completed the word fragment such as Coff_ _ as Coffee 70/72 times. Upon further investigation, I discovered that participants were biased towards particular word fragment completions that had higher word frequencies, suggesting that the measure had some element of bias rather than having constructed word fragments with counter-balanced death-related and death-neutral completions of similar word frequency. This appeared to be what was biasing participants' responses towards particular word fragments.
Following this finding, I decided to create a new measure with word fragments which could be completed with a death-related or death-neutral word fragment of equivalent word frequency (i.e. within a 10% frequency range according to a standard word frequency corpus). After constructing the measure, I ran a similar experiment to the first study and found that participants responses were no longer biased towards the new measure. In other words, there was a more even spread in their responses between death-neutral and death-related word fragment completions of similar word frequency. For instance, participants responded to the word fragment _ie with Die about 24 times and with Lie 32 times.
What I was wondering is whether there was some sort of analysis that I could perform comparing the two sets of data in order to demonstrate that the new measure was less prone to bias? For instance, is there a sensible way of comparing participants' scores on the _ie word fragment vs the Coff_ _ word fragment described above that would demonstrate that participants in the second study appeared to be less biased towards particular word fragment completions?
Any help with this problem would be much appreciated!!!