Slide 1:

J: Hi, I'm Jenn Wortman Vaughan...
H: ... and I'm Hanna Wallach

H: So, as some of you may already know, we started faculty jobs this
year and this made us very happy and we were very excited!

Slides 2-6:

H & J: Yay/woo!!!!

Slide 7:

J: Now that we've moved up in the world we decided to organize a NIPS
workshop on Computational Social Science and the Wisdom of Crowds

Slide 8-13:

H: But it turns out that now we're professors we have to work all the
time and we're really really busy... too busy to even work on our skit

Slide 14:

J: But during the workshop we had a brilliant idea! Could we solve
this problem by appealing to the wisdom of crowds???

Slide 15:

H: So we decided to crowdsource our skit on Mechanical Turk!! We gave
turkers the workshop URL and asked them to write our skit for us

Slide 16:

J: The results were mixed...

Slide 17:

H: There was the person who didn't submit anything at all, but still
expected to be paid their 20 cents...

Slide 18:

J: ... and there was the person who simply pasted in all of the text
from the workshop website.

Slide 19:

H: There was the totally incoherent submission <reads it>

Slide 20-21:

J: We also had several that summarized individual papers, so here we
have a picture summarizing "Markets as a Forecasting Tool" and here's
another one summarizing "Synchronous Experiments on Mechanical Turk"

Slide 22:

H: Some people submitted outlines for skits about individual papers,
including this one that came with commentary...

Slide 23:

J: ... and this one which we actually kinda liked, but unfortunately
we're not sufficiently important and powerful and intimidating yet to
convince our graduate students to perform on stage

Slide 24:

H: <plays Never Gonna Give You Up>

Slide 25:

J: In the end the total cost of the skit was $2...

H: ... plus $0.99 for the Rick Astley MP3, so we think that was pretty
successful, just like the workshop itself.