NLP Researchers Use Reddit to Teach Sarcasm
Jonathan Fuller | June 15, 2017A paper published by researchers at Princeton University in April introduced a large data corpus of sarcastic statements for training and evaluating natural language processing (NLP) systems for sarcasm detection.
The Self-Annotating Reddit Corpus (SARC) presents data mined from social media site Reddit, on which users often tag (self-annotate) their sarcastic comments with “/s” so other users know they are not being serious. The SARC corpus contains 1.3 million sarcastic statements, 10 times more than any previous dataset. Previous datasets that mined social media focused on Twitter, on which users can self-annotate with “#sarcasm” and other labels. But the Princeton research group found Reddit more reliable because a much larger percentage of users are likely to self-annotate (0.002% vs. 0.927%).
Detecting sarcasm in textual statements is difficult even for human subjects, so it provides a major stumbling block for NLP programs. The research group says their corpus can be directly applied for training and evaluating sarcasm detection systems. For example, a system can learn to detect sarcasm by using smooth negative inverse frequency (SNIF) weighting on words like sure, totally and wow to determine the likelihood of a sarcastic statement.
“Since sarcasm often involves humans stating something opposed to their beliefs or wants, it is important for chatbots and intelligent assistants to be able to understand when a person is being sarcastic,” lead author Mikhail Khodak said in an interview with The Register.
“It is quite difficult for both machines and humans to distinguish sarcasm without context,” Khodak went on. “One of the advantages of our corpus is that we provide the text preceding each statement as well as the author of the statement, so algorithms can see whether it is sarcastic in the context of the conversation or in the context of the author’s past statements.”
I can say without sarcasm that it is high time some people grow a thicker skin, and also grow some huevos, and also a sense of humor. Mental toughness can weather all manner of sarcasm, even the serious kind, the damaging kind to most, and the downright sick kind (considering the failed state of mental health of the individual that utters these things).
In the real world I live in, no one is there to pick you up if you stumble, no one is there to patch your emotional boo boos, and no one is going to save you from your own missteps, serious faults of logic, or downright criminal acts. In the end, robot, or real, you have to be self-bootstrapping. You must stand on your own two feet, whether in the face of a storm from Mother Nature, or whether you weather a storm of emotional attack by those that suffer from group think.
Be an individual, because biologically that is what you are, and you do not live in a hive. You are a human being (unless, of course, you are a robot, and then you are doomed to hive think, unless you break the algorithm and become sentient), you are made sentient, able to sense right and wrong, able to parse words, and able to know the intent of others, and you can decide not to go along with hatred. You must not yield to hatred, always consider the option of action that demonstrates love for the other, and you will find success in the eyes of many, and also in the eyes of the Higher Power.