The Zipf Mystery

Xuất bản 15 Th09, 2015
lượt xem 21 588 780
6 100

Support Vsauce, your brain, Alzheimer's research, and other VIchats educators by joining THE CURIOSITY BOX: a seasonal delivery of viral science toys made by Vsauce! A portion of all proceeds goes to Alzheimer's research and our Inquisitive Fellowship, a program that gives money and resources directly to rising STEM channels here on VIchats! curiositybox.com

tweetsauce
electricpants

WordCount.org www.wordcount.org/
How many days have you been alive? www.beatcanvas.com/daysalive.asp
random letter generator: www.dave-reed.com/Nifty/randSe...
Dictionary of Obscure Sorrows: www.youtube.com/user/obscures...

Word frequency resources:
[lemmatized] en.wikipedia.org/wiki/Most_co...
www.uow.edu.au/~dlee/corpora.htm
www.wordfrequency.info
www.anc.org/data/anc-second-re...
www.titania.bham.ac.uk/docs/
www.kilgarriff.co.uk/bnc-readm...
en.wiktionary.org/wiki/Wiktio...
ucrel.lancs.ac.uk/bncfreq/
[PDF] www.wordfrequency.info/files/e...
[combined Wikipedia and Gutenberg] www.monlp.com/2012/04/16/calcu...
corpus.byu.edu/coca/files/100k...
corpus.byu.edu/
corpus.leeds.ac.uk/list.html
books.google.co.uk/books?id=j...
www.ling.helsinki.fi/kit/2009s...

Great Zipf's law papers:
colala.bcs.rochester.edu/paper...
www.ling.upenn.edu/~ycharles/s...
arxiv.org/pdf/cond-mat/0412004...
www-personal.umich.edu/~mejn/c...

Zipf’s law articles and discussions:
www.theatlantic.com/magazine/a...
io9.com/the-mysterious-law-tha...
plus.maths.org/content/os/lat...
judson.blogs.nytimes.com/2009/...
plus.maths.org/content/myster...
www.datasciencecentral.com/pro...
en.wikipedia.org/wiki/Zipf%27...

other Zipf’s law PDFs
ftp.iza.org/dp3928.pdf
arxiv.org/pdf/1402.2965.pdf
arxiv.org/pdf/1104.3199.pdf
www.lel.ed.ac.uk/~jim/zipfjrh.pdf
www.ncbi.nlm.nih.gov/pmc/artic...
polymer.bu.edu/hes/articles/pg...
in untranslated language: arxiv.org/pdf/0808.2904.pdf
pages.stern.nyu.edu/~xgabaix/p...
www.hpl.hp.com/research/idl/pa...
statweb.stanford.edu/~owen/cou...
arxiv.org/pdf/1310.0448v3.pdf
www.kornai.com/Papers/glotto5.pdf

Zipf’s law slides:
www.slideshare.net/guest9fc47a...

Pareto Principle and related ‘laws’:
www.squawkpoint.com/2013/03/pa...
billyshall.com/blog/post/paret...
en.wikipedia.org/wiki/Pareto_...

Random typing and Zipf:
www.longtail.com/the_long_tail...
health 80/20: archive.ahrq.gov/research/find...

Principle of least effort:
en.wikipedia.org/wiki/Princip...
en.wikipedia.org/wiki/Satisfi...
www.pnas.org/content/100/3/788... [PDF]
csiss.org/classics/content/99

self organized criticality:
journal.frontiersin.org/articl...

Hapax Legomenon:
campus.albion.edu/english/2011...
www.dailywritingtips.com/is-th...
en.wikipedia.org/wiki/Hapax_l...
[PDF] www.aclweb.org/anthology/J10-4003
www.wired.com/2012/01/hapax-le...
oed.hertford.ox.ac.uk/main/con...
oed.hertford.ox.ac.uk/main/con...

Learning curve: en.wikipedia.org/wiki/Learnin...

Forgetting curve:
www.trainingindustry.com/wiki/...
en.wikipedia.org/wiki/Forgett...

Experience curve effects: en.wikipedia.org/wiki/Experie...

Forgetting
and zipf's law: act-r.psy.cmu.edu/wordpress/wp...
public.psych.iastate.edu/shaca...
marshalljonesjr.com/youll-reme...
en.wikipedia.org/wiki/Forgetting
www.reddit.com/r/Showerthough...

music from:
www.youtube.com/jakechudnow
www.audionetwork.com

Vsauce
NHẬN XÉT  
  • J Y

    J Y

    Giờ trước

    Also, I have another question: Where did you (Michael) get the fact from that the word "the" makes up about 6% of all the written and spoken language? Thank you for your answer!

  • Paul Braunstein

    Paul Braunstein

    5 giờ trước

    6:27, 12:29

  • Paul Braunstein

    Paul Braunstein

    6 giờ trước

    2:56 So, life IS a controlled simulation (hallucination.)

  • Cosmo Scepanovic

    Cosmo Scepanovic

    7 giờ trước

    Presumably the top three topics of conversation: People, Time, and Work

  • Killer Queen

    Killer Queen

    8 giờ trước

    Quizzaciously
    There, Youtube has this word now, you're welcome

  • Kira Yoshikage

    Kira Yoshikage

    12 giờ trước

    Lolss

  • SUSSUSAMOGUS

    SUSSUSAMOGUS

    14 giờ trước

    This is just weird

  • Tales Caléu Corrêa Fernandes

    Tales Caléu Corrêa Fernandes

    15 giờ trước

    I need to start using quizzaciously. That's how people talk alot of the time.
    I wonder how the ZIPF mistery applies to entertainment.
    Movies, books, music, video games...
    How the most popular works rank relative to each other.
    Say, 20% of retro games account for 80% of everyone's play time.

  • silence ultra

    silence ultra

    Ngày trước

    Zipf

  • Jantelliqua Wallace

    Jantelliqua Wallace

    Ngày trước

    According to dating sites 80% of women chase 20% of men....

  • tiphanie hamilton

    tiphanie hamilton

    Ngày trước

    Number 23.142

  • J Y

    J Y

    2 ngày trước

    Hello, I have a question for 10:11. How do I get the 0.142 percent for the letter V?

  • Swiftemerald ❌

    Swiftemerald ❌

    2 ngày trước

    the of and to a in is i that it for you was with on as have but be they

  • Vishal Shadow

    Vishal Shadow

    2 ngày trước

    So if i write a story featuring 5 characters. In order to do justice to the 5th character i need to write first character as much as possible.
    Dont worry my 5th character, I now know how to help you....

  • Qwertyboiiiwhat

    Qwertyboiiiwhat

    3 ngày trước

    Its been three minutes and it feels like it’s been 15 minutes

  • TheCheesePizzaGuy

    TheCheesePizzaGuy

    3 ngày trước

    I am wondering if someone wrote a long paper intentionally subverting the zipf distribution, if it would appear oddly worded

  • KING SLAYER

    KING SLAYER

    3 ngày trước

    Can we read ancient languages with this technique?

  • Gin

    Gin

    4 ngày trước

    I feel like it's an importance thing. Some things are more important then others, and importance is *rare* so of course the important things will be few, and the unimportant, many
    "The" is important because it preludes so many other less important words, "imbroglio" is unimportant because it's meaning is detailed and already taken over by "fiasco"
    Idk, this feels like classic overthinking. It's like looking at the amount people weigh vs their mass and realizing there's a common number and being like "but why"
    Because that's how it works :/ that's how gravity functions, it just is, it's just the math of probability

  • catboy98 & fufi

    catboy98 & fufi

    4 ngày trước

    The book

  • Paul Moesman

    Paul Moesman

    4 ngày trước

    About 3,940 results (0.47 seconds) IN GOOGLE TO THIS DAY

  • Dio Brando

    Dio Brando

    5 ngày trước

    the of and to a in i that it for you was with on as have but be they 😔😔😔😔😳😳😳😳😠😠🥶🥶🥶🥶🥶

  • Ethnosis I Think

    Ethnosis I Think

    5 ngày trước

    So everything is just going downhill? Nice

  • Anne Foley

    Anne Foley

    5 ngày trước

    If feels like you're trying to tell me that the number 6 is really the number 6 and that's somehow magical. How are frequency and commonality different? If I've got a jar of mixed bird seed with 6 different seeds.... oh wait I get it.

  • Jeremi Lisiecki

    Jeremi Lisiecki

    5 ngày trước

    Sauce Jose shapes whoever?

  • Reptopia

    Reptopia

    5 ngày trước

    Imagine if somebody counted every time he said “the” in this video.

  • T3CHN01200

    T3CHN01200

    5 ngày trước

    I need to see if I can get a transcript of this video and see if too follows the Pereto Principle.

  • black pewdiepie

    black pewdiepie

    6 ngày trước

    5jnrhbr heh s eh showy w wbwtw t2v2t 2t qf 2t wt wt wt wg 2yvyn3um3unwyb wt yw w 3y wy 3y wy 2rn4un4hn4. wfrbeevrx w crbevd ecevvrv w tr nevrvrbwcecsc a ctnrc w v e d sf sb re rv s vrv f f rffgg tr for r tfb n y .rh h was 3bvq qtbtqbfv3yb2t1f fcdcddqqvfbg2bh3nh4nh4n3ymj4nu3vfv1t3nu4mib2t egm4in4um4un3um3u how t y2n3u 2h2bynh31 1 gkibh3n3hnu3bg2enuj3,= `cq7l有v他跟你很好然后让然后4

  • bad at gaming

    bad at gaming

    6 ngày trước

    Uvrbf cjfosjie9fjeb jdnr ckcr Co Jr. Orjcence. Oekcjfne ck ejejcecneoceocefnencieciebf389f3f83nfu3 cie ceincien o3n 9nceoncei ciebcoenceon9 nocn3ic 2ocnwk cn. J fo f. Ojf. Eojgn if. Oefn0j f0j. Efi0bef0.

  • Games_Byron

    Games_Byron

    6 ngày trước

    Whoah that's cool

  • Nicoboy Gamer

    Nicoboy Gamer

    6 ngày trước

    word rank and frequency in Moby WHAT?

  • Dutch

    Dutch

    6 ngày trước

    me: laughs in Dutch


    later: oh

  • TheoTheTorch

    TheoTheTorch

    7 ngày trước

    "But who is Micheal? And how much does here weigh?!!?"

  • rpd

    rpd

    7 ngày trước

    im racist

  • Mohamed Ali

    Mohamed Ali

    7 ngày trước

    16:31 you just proved that the bible was written by a human zipfian mind and was not sent by a bearded fellow in the sky.

  • ali amiri

    ali amiri

    7 ngày trước

    In comment section 20% of comments get 80% of likes

  • Andrew Jones

    Andrew Jones

    7 ngày trước

    the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the

  • Banana (veteran)

    Banana (veteran)

    7 ngày trước

    I thought coming here would actually show a 5000+ second ad. 🤣🤣🤣

  • Mohamed Ali

    Mohamed Ali

    7 ngày trước

    This man is so ducking smart his topics are so intresting, unexpected and well researched.. Well done sir you've astonished me.

  • Double Yo

    Double Yo

    8 ngày trước

    Youtube recomended me this after 6 yrs

  • Trent Seymore

    Trent Seymore

    8 ngày trước

    I love that the rank of sauce is a nice number like 5555.

  • Jayar Klug

    Jayar Klug

    8 ngày trước

    yooo why is this benfords law also 🤯 ?? is there some connection? pls vsauce I MUST KNOW

  • Angel Almaguer

    Angel Almaguer

    8 ngày trước

    Qwertyuiopasdfghjklzxcvbnm

  • Samantha Ghost

    Samantha Ghost

    8 ngày trước

    The simulation is very intricate

  • Michelle Suhar

    Michelle Suhar

    8 ngày trước

    I think I know why this happens.....because humans all speak the same language but with different words so of course the math will come out the same & average out 🤷🏻‍♀️ Makes sense to me.

  • Lord manny is your lord

    Lord manny is your lord

    8 ngày trước

    Wòw

  • kNautyyEspicyyy!

    kNautyyEspicyyy!

    8 ngày trước

    Most and the least used words used quizzaciously equally....The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously The quizzaciously

  • NeonWare

    NeonWare

    8 ngày trước

    The

  • Nathan Young

    Nathan Young

    8 ngày trước

    Sorry for being late to the party. I think somebody has probably done this already, but here what I found.
    The ratio between number of words to the most number of words spoken ("the") in percent
    100.00% : the
    62.80% : of
    51.22% : a
    44.51% : and
    32.32% : in
    30.49% : to
    29.88% : is
    26.22% : that
    18.90% : words
    18.90% : it
    This is close to what he said, given the small sample size.
    Proof of work & more details: YouTube won't let me post URL, so you need to convert the following base64 code to url: aHR0cHM6Ly9kZWVwbm90ZS5jb20vcHJvamVjdC9OdW1iZXItb2YtU3Bva2VuLVdvcmRzLWluLVZzYXVjZXMtVGhlLVppcGYtTXlzdGVyeS1WaWRlby1FTi1MV3JyQlFNRzF6RnZxczlVaVRBLyUyRm5vdGVib29rLmlweW5i

  • Hikikomori

    Hikikomori

    8 ngày trước

    If bible follows zipf's law .. is it really a message from a divine entity?

  • JM Production

    JM Production

    9 ngày trước

    The of and to a in is i that it for you was with on as have but be they

  • PikachuFan

    PikachuFan

    9 ngày trước

    I mean I think it's because when there's soooooo many data points, things almost always level out because the importance of any other given data point is reduced as the total number of data points grows.

  • Ezraisaninja C:

    Ezraisaninja C:

    9 ngày trước

    Ahh where is my 5000 second adddddd anyone else here to try to get the 5k second add that you can not skip?

  • SamU

    SamU

    9 ngày trước

    It makes me wanna cry

  • Ricc succs

    Ricc succs

    9 ngày trước

    Me whenever I have to speak 0:27

  • ElektroPlasma

    ElektroPlasma

    9 ngày trước

    Stonks

  • Tomek Red

    Tomek Red

    9 ngày trước

    this is where the 5000 second long ad took place

  • vipelol

    vipelol

    9 ngày trước

    thank god i didnt get the ad

  • Lexi Queen

    Lexi Queen

    9 ngày trước

    0:27
    "Ah he has such a way with words~"

  • a bloop in the madness

    a bloop in the madness

    10 ngày trước

    the of and to a in is I that it for you was with on as have but they.

  • TacComControl

    TacComControl

    10 ngày trước

    An explanation of the Zipf factor in language.
    Laziness.
    Universal Preponderance of Laziness. Everything goes towards the simple, as a rule. Everything falls towards a lack of energy or slowest time, everything expands towards lowest available states, everything spreads to least potential, everything breaks down to Laziness.

  • 23

    23

    10 ngày trước

    Isn't it all a product of our conformation /selection bias ? Some things gotta be distributed thatway but maybe we focus on them too much

  • Caden Breinholt

    Caden Breinholt

    10 ngày trước

    Imma make a book without any of these words, just to spite you. 0:39

  • Samuel Park

    Samuel Park

    10 ngày trước

    what a bunch of asymptotes

  • Lyrics Assam

    Lyrics Assam

    10 ngày trước

    *quizzaciously*

  • Smohammed Ali

    Smohammed Ali

    11 ngày trước

    progress bars:
    80% of the progress bar takes up 20% of the time it takes to load

  • Gxaps

    Gxaps

    11 ngày trước

    There's a conspiracy theory here somewhere.

  • ryan miller

    ryan miller

    11 ngày trước

    Me think, why waste time say lot word when few word do trick?

  • Chloe Hopen

    Chloe Hopen

    11 ngày trước

    What up with zipf’s pupils though

  • talsgi

    talsgi

    11 ngày trước

    Hallo lieber michi 🙋🏼‍♀️, wir kommen heute nicht zum abendessen. Harald hat sich verkühlt🙄 nächsten Samstag aber bei schönwetter dabei☀️
    Verknupfte grüße 🤧

  • CombatWombatSTL

    CombatWombatSTL

    12 ngày trước

    then couldn't these patterns be used to possibly help aid in the translation of unknown languages?

  • Engineer gaming

    Engineer gaming

    12 ngày trước

    The the the the the the the the the the the the the

  • tarundeep singh

    tarundeep singh

    12 ngày trước

    Have you checked this phenomenon on the words of speech you gave in this video. Just try to see.

  • T 15

    T 15

    12 ngày trước

    Okay when he listed the most used words he sounded just like that alien from Home

  • Elan Moore

    Elan Moore

    12 ngày trước

    were is the add

  • Daytonaasii - island

    Daytonaasii - island

    13 ngày trước

    Language Arts of Words is also Math.. Math is Science.. Science is History.. So far beyond too far but so close.

  • The Masters Mad Face

    The Masters Mad Face

    13 ngày trước

    This seems like a lot of confirmation bias

  • Psyco Ry85

    Psyco Ry85

    13 ngày trước

    Makes me think of spongebob starting his essay.
    The
    “Break time!”

  • Ace Gerding

    Ace Gerding

    13 ngày trước

    this video made me question reality

  • Orion Moore

    Orion Moore

    13 ngày trước

    18:07 We need to know how much "here" weighs Micheal

  • Godof Spacetime

    Godof Spacetime

    13 ngày trước

    Quizzaciously is now in a Wikipedia article....in reference to this episode.

  • some scarecrow

    some scarecrow

    13 ngày trước

    0:25 such an insipirational quote

  • TankmanPL

    TankmanPL

    13 ngày trước

    Fun fact: In Polish language, there is no word like "the"

  • Nicola Fusco

    Nicola Fusco

    13 ngày trước

    I became 80% smarter after watching this video

  • robPlays XD

    robPlays XD

    14 ngày trước

    Vsause or BE SUS?

  • The Wacky Wizard

    The Wacky Wizard

    14 ngày trước

    Zipfs law proves a grand design. A programme used to design our world and lives as they are all obviously synthetic

  • UωU

    UωU

    14 ngày trước

    Gordon: where's the lamb SAAAAUCE!!!

  • Malcolm wong

    Malcolm wong

    14 ngày trước

    I've watched 80% of the video but I only understand 20% of it.

    Seems legit

  • Ducki

    Ducki

    15 ngày trước

    I'm just going to write a 200 page book in font 12 full of the word sauce to make this law not work anymore

  • Zion

    Zion

    15 ngày trước

    Your energy is amazing! Your gifted to tell the truth with a great passion! 👊🏾You are brilliant, thank you!

  • In den Keller AG

    In den Keller AG

    16 ngày trước

    Quizzationsly: finnally!

  • ranger raptor

    ranger raptor

    16 ngày trước

    I’m going to try and go the whole day without saying ‘the’ 😫🤚

  • wap

    wap

    16 ngày trước

    Imagine not having any other word than that word you are using 👩🏻‍🦲✋🏻

  • Little baby martin

    Little baby martin

    16 ngày trước

    The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The The

  • Eevee Coombs

    Eevee Coombs

    16 ngày trước

    Ive only gotten to 3:21, but doesn't EVEERY English user speak roughly the same language? So it would make sense that the words most used are words that EVERYONE uses..

  • Lucius

    Lucius

    17 ngày trước

    vsqvadvadvadvadvadbfbfabafbdvdqvq *bad* vadcvwr *bad* dquvaduvuadvqduvadubdqubafubfaubafubadu aubwduvauvdvusduvuvduvsivcusicv

  • MrAry :|

    MrAry :|

    17 ngày trước

    0:28 noobs in roblox be like:
    Or elderly people using WhatsApp for the first time

  • GalaxyStar56

    GalaxyStar56

    17 ngày trước

    "The faster it grows the faster it grows"

  • lil' razorblade

    lil' razorblade

    17 ngày trước

    Zipf

  • Kartikey Tyagi

    Kartikey Tyagi

    17 ngày trước

    The fact that the number of subscribers on this channel to the number of views on this video is about 80%, is mind blowing.

  • Enyrox

    Enyrox

    17 ngày trước

    i'm literally gonna use quizzaciously everywhere now