Wednesday, February 22, 2012

How to Design the Rice Experiment

"The first principle is that you must not fool yourself—and you are the easiest person to fool."

– Richard Feynman

The rice experiment, as popularized by businessman Masaru Emoto, is a good example of how not to design a scientific experiment. I will explain why at the end. First, I will explain how I would design a rice experiment. I am not a scientist, but I try to stay scientifically literate. If anyone has suggestions on how to improve this design, let me know.

To be clear, I am not planning on doing this experiment, as I will explain afterward.

My Hypothetical Rice Experiment:

1: Prepare good words and bad words on opaque adhesive labels. The labels need to be opaque enough so that they cannot be read through the back of glass jars.

2: For a control, I would prepare labels with no words. I would also prepare labels with neutral words. I would also prepare good, bad, and neutral words in a foreign language that I don't understand. All the labels would be prepared under the same hygienic conditions and cut in identical shapes.

3: Have all the words recorded separately in a ledger.

4: Sterilize dozens of jars, seals, and lids. This will zero out the bacteria count. Let them dry.

5: Have someone other than me apply the labels to the jars.

6: Have that person cover the labels with identical strips of lightly adhesive opaque paper. At the end of the experiments these covers will be removed. This will double-blind the experiment.

7: Have a third person rearrange the jars before delivering them to me. This will randomize the experiment.

8: The ledger from step 2 records what words are used, though I don't know which ones are on which jars. The words should be categorized at the outset: good, bad, neutral, or blank. Words should also be categorized as English or foreign. The word categories have to be established at the outset to prevent fudging afterward.

9: Set the labeled empty jars in a relatively non-hygienic place so they can attain similar levels of light contamination. Totally sterilized jars may preserve rice indefinitely.

10: Cook some rice and put the same amount in each jar. A few ounces on the bottom will do. All we want is to be able to look inside the jar without the labels and their covers blocking the view.

11: Set the jars in an array that I can check every day. The jars would be numbered so I can track the progress of each jar individually.

12: See which jars get moldy first. Keep watching as other succumb. I would set a deadline of maybe 60 days.

13: The reveal. After the 60 days, look at the jars and their corresponding labels. Compare with the ledger and mark each jar as good, bad, or neutral. If the results are:

  • 12 good English words and 12 good foreign words = all pristine
  • 12 neutral English words, 12 neutral foreign words, and 12 blank = all somewhat moldy
  • 12 bad English words and 12 bad foreign words = all very moldy

This, or something close, would be an extremely significant result. But I expect the onset of mold will be random and will not track with any good word or bad word labels in any statistically significant way. Mold will slightly favor one category of words over another, just as a matter of statistical noise. The math for this is well worked out. The more jars I use for each category, the smaller this statistical noise becomes. If I do the experiment with 30 jars for each category, I would get very high resolution, low noise results.

14: Submit for peer review. I would explain the process described above. My test would satisfy the basics of what we want from a well designed experiment: it's double-blinded, randomized, controlled, and uses an OK sample size. Negative results would be expected and not terribly interesting. (Sometimes negative results are groundbreaking, like the Michelson-Morley experiment that set the stage for Einstein's Relativity.) In the rice experiment, a positive result would be extremely surprising. The way this is designed, a positive result would have a rock solid foundation. Just one more step would be needed:

15: See if anyone reproduces the results under similar experimental conditions. If no one can reproduce my results, there's a good chance I falsified my data or was just plain sloppy.

16: If the results are positive, conduct the experiment for the James Randi Educational Foundation (JREF). If it does show evidence of paranormal activity that can be verified under scientific controls, I will win $1,000,000. And that's a lot of money! I would like to have that prize! But it's been available for decades and no one has won it yet.

How to Backpedal:

Let's say I was invested (monetarily or emotionally) in the results coming out positive—but they came out negative. There are some tricks, fallacies of special pleading, I can play on myself. These might help me to dismiss my own results or fudge them in my favor:

Anomaly hunting: Maybe some seals were red and some were beige. Maybe the red ones were moldier to a slightly higher degree that statistical noise would predict. Maybe the vibrations inherent in color caused the differences in moldiness. Of course, that's not what we were testing, that's a patterns identified after the fact. If you want to test for color, put that in the ledger at the outset. Don't shoehorn an identified pattern after the fact.

For some real adventures in anomaly hunting, look at the number juggling people apply to the Egyptian pyramids. You can take a rich batch of numbers and combine them into all sorts of flukes that match physical constants or astronomical distances. James Randi shows how you can do the same anomaly hunting with the Washington Monument in his great book Flim-Flam.

Blame science or Western thinking: This is the common tack of accusing the skeptical mindset of spoiling the results. The experiment above is designed without appealing to any particular cultural heritage. The design is based on me preventing myself from introducing bias. If scientific thinking is such a party-pooper, how has it been so successful in shaping every little bit of technology we use?

Science, skepticism, critical thinking—these have produced plenty of reliable results, like cars and air travel. Telekinesis, for example, has not delivered comparable goods for human transport.

Those YouTube Videos and Why I Will Not Conduct My Own Experiment Design:

The rice experiment, as popularized online, has no controls, no blind (let alone double-blind), and operates on the smallest possible sample size. It is a race to see which rice gets moldy first. If the bad word rice gets moldy first (it's a 50-50 shot) a naïve person might claim confirmation. If the good word rice gets moldy first, a naïve person might think, "I must have done something wrong," or "I got so impatient waiting for mold, maybe my impatience threw it off." Such a person may be less likely to post their results on YouTube.

Now, I have no plans to conduct my hypothetical experiment. It's a lot of work putting together a well-controlled study. And I'm very confident the results would be uninteresting. You might say, "Put your money where your mouth is. Do the experiment!" In a sense I am putting my money where my mouth is. If I'm wrong, I am giving away, for free, a great way to win a cool million from the JREF. Have at it.

20 comments:

Anonymous said...

Sheepskin demands precise focus to assist maintain that smooth and observe immediately after the shape and size. In line with the Kiwi Sheepskins internet internet site, also soft laundry washing detergents consist [url=http://www.dalinsell.co.uk/]Ugg Boots sale[/url]
of digestive enzymes and also chemical compounds that will injury the carpet. The specific most dependable resolution to clear Classic Tall Ugg boots carpets is usually to rinse these sometimes together with goods http://www.vbboots.co.uk
particular to be able to sheepskin focus.
You could uncover that the motor of your respective automatic refrigerator retains on operating quite repeatedly. If this is actually the scenario then you should investigate the gasket about the door. Be particular it is tight enough and no air can pass by way of it.
Those slayings, in Chilpancingo, an hour north of the resort of Acapulco, marked the worst attack against the Mexican army in its half-century battle against drug gangs. After the gruesome discovery, the government held a higher-profile ceremony aimed at reassuring the nation it would not surrender. Officials also released the names of the troops just as the navy did Monday when it honored Angulo.
Children sheepskin ugg boots are accessible in lots of diverse colours like pink, blue, sand for example and give a comfy really feel. in spite inside of the actuality that you simply merely desire to buy them assure that you merely merely have certain size. gentle in as well a lot weight and distinctive in [url=http://www.vbboots.co.uk/]Ugg Boots cheap[/url]
layout these boots maximizes comfort level and mark their advent as in among the trendiest assertion pieces in today's complete globe of fashion..

Anonymous said...

What's up, all the time i used to check weblog posts here in the early hours in the break of day, for the reason that i love to find out more and more.
Also visit my web-site ... http://www.xxxvideofix.com/

Anonymous said...

magnificent submit, very informative. I ponder why the other specialists of this sector
do not realize this. You must proceed your writing.
I am sure, you've a great readers' base already!
Here is my site click the up coming website page

Anonymous said...

What a data of un-ambiguity and preserveness of precious know-how on the topic of unpredicted feelings.
My blog : http://www.teenpornsexpussy.com

Anonymous said...

I simply couldn't depart your website before suggesting that I extremely loved the usual info an individual provide on your guests? Is going to be back ceaselessly to investigate cross-check new posts
My webpage: nude girls

Anonymous said...

[url=http://loveepicentre.com/faq.php][img]http://loveepicentre.com/uploades/photos/11.jpg[/img][/url]
who is mimi haas dating [url=http://loveepicentre.com/articles.php]ecommerce dating[/url] dating men who won't commit
dating more than one people [url=http://loveepicentre.com/]dating books on cd[/url] speed dating in columbus
cum dating [url=http://loveepicentre.com/testimonials.php]savannah dating review[/url] dating for teenagers

Anonymous said...

[url=http://loveepicentre.com/articles.php][img]http://loveepicentre.com/uploades/photos/7.jpg[/img][/url]
diasbled lesbians dating and classifieds [url=http://loveepicentre.com/]all online dating singles[/url] sacramento asian dating site
christians mingle dating site [url=http://loveepicentre.com/advice.php]how to online adult dating[/url] men on the mines dating site
carbon-14 dating [url=http://loveepicentre.com/]gay dating simulation[/url] gay dating sites canada

Anonymous said...

[url=http://loveepicentre.com/][img]http://loveepicentre.com/uploades/photos/12.jpg[/img][/url]
ninemsn online dating site [url=http://loveepicentre.com/taketour.php]submissive girls dating naked nude[/url] dating pictures asia
hotel for dating in faisalabad [url=http://loveepicentre.com/]australian dating customs[/url] singles online dating
reno lesbian dating [url=http://loveepicentre.com/success_stories.php]liberal dating personals[/url] lehigh valley speed dating

Anonymous said...

[url=http://loveepicentre.com/success_stories.php][img]http://loveepicentre.com/uploades/photos/11.jpg[/img][/url]
uranium series dating [url=http://loveepicentre.com/success_stories.php]dating woman stuttering[/url] elaine dating keith hernandez
rush limbaugh carol costello dating [url=http://loveepicentre.com/testimonials.php]services dating[/url] dating queers
new york dating [url=http://loveepicentre.com/taketour.php]dating montague fishing reels[/url] indian dating personals

Anonymous said...

[url=http://loveepicentre.com/faq.php][img]http://loveepicentre.com/uploades/photos/12.jpg[/img][/url]
dating in the quad cities [url=http://loveepicentre.com/map.php]fossil radioactive dating[/url] dating cjat
millioniare dating websites [url=http://loveepicentre.com/articles.php]speed dating reno nevada[/url] dynasty lovers dating sim cheats
dating coaches georgia [url=http://loveepicentre.com/articles.php]who is dave mustaine dating[/url] abu dhabi dating

Anonymous said...

[url=http://loveepicentre.com/advice.php][img]http://loveepicentre.com/uploades/photos/3.jpg[/img][/url]
kelley earnhardt dating [url=http://loveepicentre.com/faq.php]california highend dating services gay[/url] dating pages
adult wap dating [url=http://loveepicentre.com/advice.php]free dating in[/url] hays kansas dating
free online dating vt [url=http://loveepicentre.com/map.php]christian dating plano texas[/url] unraveling dating codes

Anonymous said...

[url=http://loveepicentre.com/testimonials.php][img]http://loveepicentre.com/uploades/photos/1.jpg[/img][/url]
worlds largest dating sites and profiling [url=http://loveepicentre.com/]tony bruno dating game[/url] funny dating sayings
nsa erotic dating services [url=http://loveepicentre.com/advice.php]black girl dating[/url] the math behind radioactive carbon dating
dating brianj1973 personals brianj 73 [url=http://loveepicentre.com/advice.php]canada dating free online[/url] dating services-new hampshire

Anonymous said...

[url=http://loveepicentre.com][img]http://loveepicentre.com/uploades/photos/5.jpg[/img][/url]
europe single dating site [url=http://loveepicentre.com/success_stories.php]free interracial dating online[/url] online dating site for singles cupid
free polyamory dating [url=http://loveepicentre.com/]jim south carolina dating[/url] carbon dating system accuracy
dating sites worcester [url=http://loveepicentre.com/taketour.php]millionaire dating site uk[/url] chubby dating guys

Anonymous said...

the teachings of don juan ebook http://audiobookscollection.co.uk/de/Systeme-Analyse-Design/c2450/?page=4 give away free ebook get paid [url=http://audiobookscollection.co.uk/fr/Early-Civilizations-in-the-Americas-Index/p133561/]snapshots from hell ebook[/url] ncert disaster management x ebook

Anonymous said...

sony ebook reader prs-505 500 http://audiobookscollection.co.uk/es/Oracle-DBA-Guide-to-Data-Warehousing-and-Star-Schemas/p175753/ free ebook ellen hopkins [url=http://audiobookscollection.co.uk/es/Aquatic-Chemical-Kinetics-Reaction-Rates-of-Processes-in-Natural-Waters/p217387/]free sookie stackhouse ebook[/url] spellwork ebook

Anonymous said...

sharing purchased sony ebook http://audiobookscollection.co.uk/Heart-of-the-Comet-A-Bantam-Spectra-Book/p208082/ trout fishing tips ebook filefactory [url=http://audiobookscollection.co.uk/fr/The-Blackwell-Companion-to-the-Sociology-of-Families/p161302/]book reader ebook[/url] henry huggins ebook

Anonymous said...

free precalculus ebook http://audiobooksworld.co.uk/es/Webster-s-Rwanda-English-Thesaurus-Dictionary/p226633/ the chase ebook torrent [url=http://audiobooksworld.co.uk/it/A-Knizek/m1346/]download this ebook file messaging control[/url] environmental technology ebook
[url=http://audiobooksworld.co.uk/fr/Exercise-Fitness/c1021/?page=2][img]http://audiobooksworld.co.uk/image/1.gif[/img][/url]

Anonymous said...

act 2008 software http://buyoemsoftware.co.uk/category-100-110/Internet?page=46 small business ecommerce software website [url=http://buyoemsoftware.co.uk/product-37030/Veronisoft-IP-Monitor-Portable-1-3]wintv usb software[/url] word recognition software
[url=http://buyoemsoftware.co.uk/it/category-1/Sisteme-Operative]Sisteme Operative - Software Store[/url] what is acl software
[url=http://buyoemsoftware.co.uk/de/product-35446/OdinShare-Odin-U-Disk-Encrypt-Creator-5-5][img]http://buyoem.co.uk/image/2.gif[/img][/url]

Anonymous said...

[url=http://certifiedpharmacy.co.uk/products/relafen.htm][img]http://onlinemedistore.com/9.jpg[/img][/url]
garden city pharmacy http://certifiedpharmacy.co.uk/products/kamasutra-contoured-condoms.htm midwestern university college of pharmacy [url=http://certifiedpharmacy.co.uk/products/maxalt.htm]mexican pharmacy no rx needed[/url]
average cost of tuition for pharmacy school http://certifiedpharmacy.co.uk/products/suhagra.htm pharmacy counter [url=http://certifiedpharmacy.co.uk/products/rocaltrol.htm]rocaltrol[/url]
pharmacy degree ferris state http://certifiedpharmacy.co.uk/products/mobic.htm foreign pharmacy degrees recognized by fpgee [url=http://certifiedpharmacy.co.uk/testimonials.htm]penn presbyterian medical center pharmacy[/url]
scriptx pharmacy http://certifiedpharmacy.co.uk/products/glucotrol-xl.htm costo wholesale pharmacy [url=http://certifiedpharmacy.co.uk/products/lasuna.htm]lasuna[/url]

Anonymous said...

[url=http://certifiedpharmacy.co.uk/products/topamax.htm][img]http://onlinemedistore.com/10.jpg[/img][/url]
st louis pharmacy rep http://certifiedpharmacy.co.uk/products/trazodone.htm requirements for admission to school of pharmacy madison [url=http://certifiedpharmacy.co.uk/products/dramamine.htm]giant eagle pharmacy four dollar drug list[/url]
bi lo pharmacy http://certifiedpharmacy.co.uk/products/mentax.htm cephalexin tablets pharmacy storage [url=http://certifiedpharmacy.co.uk/categories/women-s-health.htm]women s health[/url]
online pharmacy usa http://certifiedpharmacy.co.uk/catalogue/c.htm mexican pharmacy shipping [url=http://certifiedpharmacy.co.uk/products/avodart.htm]recent events in pharmacy[/url]
how to become a pharmacy technician http://certifiedpharmacy.co.uk/products/amaryl.htm understanding pharmacy clean room designs [url=http://certifiedpharmacy.co.uk/products/zyban.htm]zyban[/url]