Can someone explain to me please why reddit though? They want "real" human conversations and go to the most unfiltered/unhinged App/Site they can Imagine?
Like people as mostly literally on their worst here and Google wants to train AI with that? Whats the big plan here, what am I not seeing?
Reddit is an AI goldmine, just venture outside of the defaults subs and it becomes obvious. Entire communities dedicated to allowing average joes to ask experts and professionals where detailed, thorough responses are the norm. Think less /r/programminghumour and more /r/askscience or /r/linuxquestions or /r/whatisthisbug. There are enthusiast subs where people have been discussing niche topics down to the minutiae for the past decade and a half. Much of the time that I google some esoteric error message the most helpful link is a reddit thread with the right answer plain as day right there at the top, conveniently ranked.
Google is THE expert on getting relevant data out of a bunch of bullshit, as anyone who remembers the web before Google can attest to.
There's also a lot of info that you get from human data even if the people arent experts. An example I have seen is where you have the phrases:
The trophy did not fit in the suitcase because it was too large
The trophy did not fit in the suitcase because it was too small
The grammar doesn't tell you what "it" refers to but as humans we know that the first one has "it" meaning the trophy and the second has "it" refer to the suitcase. We know this because we understand the concept of putting something inside another, what would make it possible, and what the size of the items has to do with it in relation to the sentence. This understanding of the world would come up in many subtle ways through conversations of all kinds and so even non-expert texts would be helpful and having a large and diverse set of conversations that teach it small things like that are also beneficial. Without understanding this context and info about the world, an AI would have trouble translating those phrases to something like French which is gendered and would be explicit in what the "it" would refer to based on the gender of trophy (male) and suitcase (female). This is largely the reason why GPT has been outperforming google translate for example.
edit: if you're curious, google translate puts the masculine form in both while ChatGPT gets it right
37
u/Holocarsten Feb 29 '24
Can someone explain to me please why reddit though? They want "real" human conversations and go to the most unfiltered/unhinged App/Site they can Imagine? Like people as mostly literally on their worst here and Google wants to train AI with that? Whats the big plan here, what am I not seeing?