Home General Asylum

General audio topics that don't fit into specific categories.

Re: A/B testing methodology question

"Everybody was certainly aware that I was going to be implementing a tweak. But their eyes were closed from the start to finish for each run, and I did not say anything while the music was playing the entire time."

If everybody knew what you were going to do the test was contaminated. I suggest repeating it and randomly not apply the tweak. See what happens then. The problem with eyes closed is that people can still sense time passed, your movement, other peoples' movements etc. Like I said before. Tooooo many variables.



This post is made possible by the generous support of people like you and our sponsors:
  Parts Connexion  


Follow Ups Full Thread
Follow Ups


You can not post to an archived thread.