The era of fake writing is upon us

Share it with your friends Like

Thanks! Share it with your friends!

Close

Computers just got a lot better at mimicking our language.

Join the Open Sourced Reporting Network: http://www.vox.com/opensourcednetwork

Something big happened in the past year: Researchers created computer programs that can write long passages of coherent, original text.

Language models like GPT-2, Grover, and CTRL create text passages that seem written by someone fluent in the language, but not in the truth. That AI field, Natural Language Processing (NLP), didn’t exactly set out to create a fake news machine. Rather, it’s the byproduct of a line of research into massive pretrained language models: Machine learning programs that store vast statistical maps of how we use our language. So far, the technology’s creative uses seem to outnumber its malicious ones. But it’s not difficult to imagine how these text-fakes could cause harm, especially as these models become widely shared and deployable by anyone with basic know-how. Read more here: https://www.vox.com/recode/2020/3/4/21163743/ai-language-generation-fake-text-gpt2

Open Sourced is a year-long reporting project from Recode by Vox that goes deep into the closed ecosystems of data, privacy, algorithms, and artificial intelligence. Learn more at http://www.vox.com/opensourced

This project is made possible by the Omidyar Network. All Open Sourced content is editorially independent and produced by our journalists.

Watch all episodes of Open Sourced right here on YouTube: http://bit.ly/2tIHftD

Try out natural language generation and detection with these tools:
https://demo.allennlp.org/next-token-lm
https://talktotransformer.com/
https://transformer.huggingface.co/
https://grover.allenai.org/
https://www.ai21.com/haim
http://gltr.io/
https://play.aidungeon.io/
https://huggingface.co/openai-detector/

Sources:
https://ruder.io/nlp-imagenet/
https://medium.com/@ageitgey/deepfaking-the-news-with-nlp-and-transformer-models-5e057ebd697d
https://openai.com/blog/better-language-models/
https://blog.einstein.ai/introducing-a-conditional-transformer-language-model-for-controllable-generation/
https://veredshwartz.blogspot.com/2019/08/text-generation.html
http://www.mattkenney.me/gpt-2-345/
http://www.mattkenney.me/gpt-2/
https://jalammar.github.io/illustrated-gpt2/
https://mc.ai/introduction-to-language-modelling-and-deep-neural-network-based-text-generation/
https://fortune.com/2020/01/20/natural-language-processing-business/
https://www.vox.com/future-perfect/2019/2/14/18222270/artificial-intelligence-open-ai-natural-language-processing
https://www.newyorker.com/magazine/2019/10/14/can-a-machine-learn-to-write-for-the-new-yorker
https://www.youtube.com/watch?v=GEtbD6pqTTE
https://arxiv.org/pdf/1905.12616.pdf
https://arxiv.org/abs/1911.03343
https://arxiv.org/abs/1904.09751
https://techscience.org/a/2019121801/
https://www.middlebury.edu/institute/sites/www.middlebury.edu.institute/files/2019-11/The%20Industrialization%20of%20Terrorist%20Propaganda%20-%20CTEC.pdf?fv=TzdJnlDw
http://newsyoucantuse.com/
https://aiweirdness.com/post/168051907512/the-first-line-of-a-novel-by-an-improved-neural
https://aiweirdness.com/post/159302925452/the-neural-network-generated-pickup-lines-that-are
https://www.nytimes.com/interactive/2018/10/26/opinion/halloween-spooky-costumes-machine-learning-generator.html
https://aiweirdness.com/post/160985569682/paint-colors-designed-by-neural-network-part-2
https://www.reddit.com/r/SubSimulatorGPT2/
https://twitter.com/dril_gpt2
https://cloud.google.com/text-to-speech/

Vox.com is a news website that helps you cut through the noise and understand what’s really driving the events in the headlines. Check out http://www.vox.com.

Watch our full video catalog: http://goo.gl/IZONyE
Follow Vox on Facebook: http://goo.gl/U2g06o
Or Twitter: http://goo.gl/XFrZ5H

Comments

Vox says:

To learn more about this technology, and try it out yourself, check out the links in the description box. Thanks for watching! -joss

TruDragon88 says:

Vox, you guys are AMAZING . Never stop what you do

jon dogg says:

Maybe yoda was a prototype android and his ai language programme was dyslexic. Back to front his speech was. 😉

PMG4 User says:

Why the Apple IIGS on the thumbnail?

Patrick Wang says:

Isn’t that called a human?

florensix says:

Bruh, this would make writing essays for English class so easy.

gokul balagopal Payyanur says:

Humans control AI so we can train it to be good

Rory Green says:

OK BOOMER…

Jake Mccallum says:

I just got a text that I sent it and it doesn’t look good on the email address so that you would like it if I can do that I will was a way I wanna is it was like I gotta do I gotta is a time of day you could just be a good boy you know you don’t have a lot.

zedanga saleh says:

Good morning for the first time in the UK so I can get a power supply for the first time in the UK so I can get a power supply for the first time in the UK so I can get a power supply for the first time to get to do it tomorrow I will and I will and I am looking for a few others like I'm going fast and the promised land in English regards I am not able to fit the bill and I by wanted to let you know that a googleplex the game is t shirt and tie in a few months when I get a bike you are not the named addressee s and the promised the game I am

Wando The Wonderful says:

Trump really used one of these models to run on his Twitter feed didn’t he.

tsubasa198 says:

Yo, why did Vox make a video about themselves.

Kevin Hauser says:

This is horrible content. And box gets millions from msm

Juan Cabrera says:

Blockchain is how you can verify an online identity.

daren martin says:

I have to go to the store and get some rest and feel better soon and that is why I am asking for a friend to talk to you about it when I get home and let me know if you need anything else from me please let me know.

This is what I've got by just clicking the suggested words. 👀

Joaquín Ramírez says:

I’m not a real person

Ling YT says:

Ever heard of A.I instagram bot profile

Ashirbad Behera says:

ki will 6hkkjoii in the future if you have to be any problem in the future if you have to be any problem in the future if you have to be any problem in the future if you have to be any problem in the future if you have to be any problem in the future please reply back if i oki to go with you to know what I am a very happy with it and the print is not the same to me as a lower rate for this position as an sample in this case it cell is the print button to be able in this case is closed and bjp in this weather in this email has not the named recipients in a few weeks back I in a tier of a tier quality to go college and bjp to go with a lower middle East countries

Random Joe says:

0:42 there’s an overwatch reference

TeddyRuxpin says:

So we finally learned how Vice creates their bazaar news articles

Patrick Jenkins says:

"The only problem is that it's easier for them to write FICTION than to write FACTS."….As far as POLITICS go, that seems suspiciously convenient. 😳

incredulous kirk says:

"the only problem is that it's easier for them to write fiction than fact….." not unlike our American news media. 😂

Xavier Kumari says:

Wonder how society will react when robots get a computer virus

Eve Kohley says:

so what are left wing manifestos?

DaredevilZ says:

That explains the absurd answers on Yahoo answers

diulikadikaday says:

"Be sceptical about everything you read on the internet"
-Albert Einstein

Patricia Cárdenas says:

Well. This is terrifying.

TBNREnderman says:

I am not able to make a Chemistry joke but All the Good ones that are not in the office today but I will be there at the same time I don't have a car so I can get the money to you

Playing Games says:

Quora now makes complete sense.

Write a comment

*

Area 51
Ringing

Answer