Papers reviewed and determined not to be word norm studies. Use the flag icon to report errors or suggest re-inclusion.
18625 papers
Neural models have been investigated for sentiment classification over constituent trees. They learn phrase composition automatically by encoding tree structures but do not explicitly model sentiment composition, which requires to encode sentiment class labels. To this end, we investigate two formalisms with deep sentiment representations that capture sentiment subtype expressions by latent variables and Gaussian mixture vectors, respectively. Experiments on Stanford Sentiment Treebank (SST) show the effectiveness of sentiment grammar over vanilla neural encoders. Using ELMo embeddings, our method gives the best results on this benchmark.
Topic Modeling encompasses a set of techniques for text clustering and tag recommendation with significant advantages such as unsupervised learning. Based on Latent Dirichlet Allocation (LDA) topic modeling, every single word is related to a set of topics with different weight. The weights are furt her estimated in order to determine the semantic relation between the words and the rest of the documents. Apparently the chief drawback of topic modeling techniques, specifically LDA, lies on their incapability in clustering short texts in which semantic relation between words is neglected. This issue is deemed more severe when analyzing social networks such as Twitter wherein short texts are the case. It is assumed that semantic relation between a document and the target short text helps obtain efficient clustering of short texts via topic modeling. Hence, the current paper proposes a method of topic modeling named Semantic Knowledge LDA based on semantic relations between the words in tweets from Twitter social network based on the co-occurrence of words. Additionally, we propose a method of hashtag recommender system based on topic vector (TV) text similarity, named TV based Hashtag Recommender System (TVHRS). Accordingly, we applied our word co-occurrence LDA (SKLDAC) method together with WordNet lexical database to cluster the short texts from Twitter. The clustered topics are later used as the repository for the proposed hashtag recommender system. The proposed system of both SKLDA and TVHRS were applied to a set of 12,309,911 real tweets for testing purposes. When comparing the components of the proposed system to the existing methods, we recorded higher performance in terms of precision, recall and F-Score of 0.551, 0.682 and 0.526, respectively.
This paper investigates which annotation scheme of dependency treebank is more congruent for the measurement of syntactic complexity and cognitive constraint of language materials. Two representatives of semantic-and syntactic-oriented annotation schemes, the Universal Dependencies (UD) and the Surface-Syntactic Universal Dependencies (SUD), are under discussion. The results show that, on the one hand, natural languages based on both annotation schemes follow the universal linguistic law of Dependency Distance Minimization (DDM); on the other hand, according to the metric of Mean Dependency Distances (MDDs), the SUD annotation scheme that accords with traditional dependency syntaxes are more expedient to measure syntactic difficulty and cognitive demand.
The lack of understanding and definitional inconsistencies regarding agritourism and the importance of cooperation in sustaining this kind of tourism are underlined in the literature. This study analyzes the perceptions of agritourism and cooperation from actors in the sector using a plurality of methods, including unsupervised (a) text mining and (b) sentiment analysis with the use of a lexical database, as well as (c) supervised qualitative data analysis. Based on the assumption that destinations with different geographic characteristics have different features and products, two different destinations as for its accessibility and tourism recognition were selected for comparison: (a) an island—Lesvos in the North Aegean Sea, and (b) a continental mountain region—Plastiras Lake, in Greece. The data were collected from personal in-depth interviews and with the use of semi-structured questionnaires. From a methodological perspective, all three methods provided unique insights on the study’s themes, and the overall image of agritourism and cooperation was positive. A common understanding seems important for cooperation and networking; however, training is needed not only for effective promotion of agritourism, but also for cooperation techniques, benefits, trust-building mechanisms and best practices.
Recurrent Neural Networks (RNN), Long Short-Term Memory Networks (LSTM), and Memory Networks which contain memory are popularly used to learn patterns in sequential data. Sequential data has long sequences that hold relationships. RNN can handle long sequences but suffers from the vanishing and exploding gradient problems. While LSTM and other memory networks address this problem, they are not capable of handling long sequences (50 or more data points long sequence patterns). Language modelling requiring learning from longer sequences are affected by the need for more information in memory. This paper introduces Long Term Memory network (LTM), which can tackle the exploding and vanishing gradient problems and handles long sequences without forgetting. LTM is designed to scale data in the memory and gives a higher weight to the input in the sequence. LTM avoid overfitting by scaling the cell state after achieving the optimal results. The LTM is tested on Penn treebank dataset, and Text8 dataset and LTM achieves test perplexities of 83 and 82 respectively. 650 LTM cells achieved a test perplexity of 67 for Penn treebank, and 600 cells achieved a test perplexity of 77 for Text8. LTM achieves state of the art results by only using ten hidden LTM cells for both datasets.
Composers convey emotion through music by co-varying structural cues. Although the complex interplay provides a rich listening experience, this creates challenges for understanding the contributions of individual cues. Here we investigate how three specific cues (attack rate, mode, and pitch height) work together to convey emotion in Bach's Well Tempered-Clavier (WTC). In three experiments, we explore responses to (1) eight-measure excerpts and (2) musically “resolved” excerpts, and (3) investigate the role of different standard dimensional scales of emotion. In each experiment, thirty nonmusician participants rated perceived emotion along scales of valence and intensity (Experiments 1 & 2) or valence and arousal (Experiment 3) for 48 pieces in the WTC. Responses indicate listeners used attack rate, Mode, and pitch height to make judgements of valence, but only attack rate for intensity/arousal. Commonality analyses revealed mode predicted the most variance for valence ratings, followed by attack rate, with pitch height contributing minimally. In Experiment 2 mode increased in predictive power compared to Experiment 1. For Experiment 3, using “arousal” instead of “intensity” showed similar results to Experiment 1. We discuss how these results complement and extend previous findings of studies with tightly controlled stimuli, providing additional perspective on complex issues of interpersonal communication.
Transfer parsing has been used for developing dependency parsers for languages with no treebank by using transfer from treebanks of other languages (source languages). In delexicalized transfer, parsed words are replaced by their part-of-speech tags. Transfer parsing may not work well if a language does not follow uniform syntactic structure with respect to its different constituent patterns. Earlier work has used information derived from linguistic databases to transform a source language treebank to reduce the syntactic differences between the source and the target languages. We propose a transformation method where a source language pattern is transformed stochastically to one of the multiple possible patterns followed in the target language. The transformed source language treebank can be used to train a delexicalized parser in the target language. We show that this method significantly improves the average performance of single-source delexicalized transfer parsers. We also show that, in the multi-source settings, parsers trained using a concatenation of transformed source language treebanks work better when a subset of the source language treebanks is used rather than concatenating all of them or only one. However, the problem of selecting the subset of treebanks whose combination gives the best-performing parser from the set of all the available treebanks is hard. We propose a greedy selection heuristic based on the labelled attachment scores of the corresponding single-source parsers trained using the treebanks after transformation.
Learning hierarchical abstractions from sequences is a challenging and open problem for recurrent neural networks (RNNs). This is mainly due to the difficulty of detecting features that span over long time distances with also different frequencies. In this paper, we address this challenge by introducing surprisal-based activation, a novel method to preserve activations and skip updates depending on encoding-based information content. The preserved activations can be considered as temporal shortcuts with perfect memory. We present a preliminary analysis by evaluating surprisal-based activation on language modeling with the Penn Treebank corpus and find that it can improve performance when compared to baseline RNNs and Long Short-Term Memory (LSTM) networks.
Clinical motor and non-motor effects of deep brain stimulation (DBS) of the subthalamic nucleus (STN) in Parkinson's disease (PD) seem to depend on the stimulation site within the STN. We analysed the effects of the position of the stimulation electrode within the motor STN on subjective emotional experience, expressed as emotional valence and arousal ratings to pictures representing primary rewards and aversive fearful stimuli in 20 PD patients. Patients' ratings from both aversive and erotic stimuli matched the mean ratings from a group of 20 control subjects at similar position within the STN. Patients with electrodes located more posteriorly reported both valence and arousal ratings from both the rewarding and aversive pictures as more extreme. Moreover, posterior electrode positions were associated with a higher occurrence of depression at a long-term follow-up. This brain-behavior relationship suggests a complex emotion topography in the motor part of the STN. Both valence and arousal representations overlapped and were uniformly arranged anterior-posteriorly in a gradient-like manner, suggesting a specific spatial organization needed for the coding of the motivational salience of the stimuli. This finding is relevant for our understanding of neuropsychiatric side effects in STN DBS and potentially for optimal electrode placement.
Purpose: The purpose of this paper is to prove the importance of understanding body language to achieve the effectiveness of English language classes.
 Methodology: Literature investigation is carried out to confirm the objective of this paper.
 Results: In the teaching and learning process, effective communication between a teacher and students is the utmost importance. The failure to establish effective communication in the classroom setting will result in a deficiency of the teaching and learning process.
 Implications: It is the fact that many cues of body language are culture-specific and therefore the only way to improve the understanding of body language is by interacting with people from different cultural backgrounds so that they can share socio-cultural and linguistic norms. Thus, the experience will enrich the teacher with cross-cultural nonverbal behavior which benefits his performance in the classroom. Both teachers' and students' knowledge of non-verbal language play very significant roles in making the classroom interaction successful. Therefore, finally, a summary is presented to reconfirm the importance of integrating body language into classroom interaction.
In this paper we present a novel lemmatization method based on a\nsequence-to-sequence neural network architecture and morphosyntactic context\nrepresentation. In the proposed method, our context-sensitive lemmatizer\ngenerates the lemma one character at a time based on the surface form\ncharacters and its morphosyntactic features obtained from a morphological\ntagger. We argue that a sliding window context representation suffers from\nsparseness, while in majority of cases the morphosyntactic features of a word\nbring enough information to resolve lemma ambiguities while keeping the context\nrepresentation dense and more practical for machine learning systems.\nAdditionally, we study two different data augmentation methods utilizing\nautoencoder training and morphological transducers especially beneficial for\nlow resource languages. We evaluate our lemmatizer on 52 different languages\nand 76 different treebanks, showing that our system outperforms all latest\nbaseline systems. Compared to the best overall baseline, UDPipe Future, our\nsystem outperforms it on 62 out of 76 treebanks reducing errors on average by\n19% relative. The lemmatizer together with all trained models is made available\nas a part of the Turku-neural-parsing-pipeline under the Apache 2.0 license.\n
This article presents an analysis of experiments with statistical and neural parsing techniques for Urdu, a widely spoken South Asian language. We demonstrate state of the art constituency parsing results for an Urdu treebank. Urdu is a morphologically rich and is characterized by free word order. Language representation (e.g. input type, lemmatization, word clusters), part of speech tag set, phrase labels and the size of a training corpus are crucial for parsing such languages. In this article, probabilistic context-free grammars, data-oriented parsing, and recursive neural network based models have been experimented with several linguistic features which show improvements in the parsing results. Features include syntactic sub-categorization of POS tags, empirically learned horizontal and vertical markovizations and lexical head words. These features enable dependency information for case markers and add phrasal and lexical context to the parse trees. The data-oriented parsing and recursive neural network model give an f-score of 87.1 by considering gold POS tags in the test set, on textual input, they show a performance with f-scores of 83.4 and 84.2, respectively. To overcome the issue of data sparsity due to the morphological richness, lemmatization and unsupervised word clustering have been performed. A treebank should cover most probable word orders of the language so that models can learn various orders accurately. To analyze the order coverage of the treebank and learning capability of different parsers, a test set has been prepared conditioning different word orders. This test set is evaluated with the best performing parsing models and with gold POS tags, f-scores are above 90 and on textual input, the average f-score is 87.6.
Facial expressions are fundamental to interpersonal communication, including social interaction, and allow people of different ages, cultures, and languages to quickly and reliably convey emotional information. Historically, facial expression research has followed from discrete emotion theories, which posit a limited number of distinct affective states that are represented with specific patterns of facial action. Much less work has focused on dimensional features of emotion, particularly positive and negative affect intensity. This is likely, in part, because achieving inter-rater reliability for facial action and affect intensity ratings is painstaking and labor-intensive. We use computer-vision and machine learning (CVML) to identify patterns of facial actions in 4,648 video recordings of 125 human participants, which show strong correspondences to positive and negative affect intensity ratings obtained from highly trained coders. Our results show that CVML can both (1) determine the importance of different facial actions that human coders use to derive positive and negative affective ratings when combined with interpretable machine learning methods, and (2) efficiently automate positive and negative affect intensity coding on large facial expression databases. Further, we show that CVML can be applied to individual human judges to infer which facial actions they use to generate perceptual emotion ratings from facial expressions.
Several studies have attempted to investigate how the brain codes emotional value when processing music of contrasting levels of dissonance; however, the lack of control over specific musical structural characteristics (i.e., dynamics, rhythm, melodic contour or instrumental timbre), which are known to affect perceived dissonance, rendered results difficult to interpret. To account for this, we used functional imaging with an optimized control of the musical structure to obtain a finer characterization of brain activity in response to tonal dissonance. Behavioral findings supported previous evidence for an association between increased dissonance and negative emotion. Results further demonstrated that the manipulation of tonal dissonance through systematically controlled changes in interval content elicited contrasting valence ratings but no significant effects on either arousal or potency. Neuroscientific findings showed an engagement of the left medial prefrontal cortex (mPFC) and the left rostral anterior cingulate cortex (ACC) while participants listened to dissonant compared to consonant music, converging with studies that have proposed a core role of these regions during conflict monitoring (detection and resolution), and in the appraisal of negative emotion and fear-related information. Both the left and right primary auditory cortices showed stronger functional connectivity with the ACC during the dissonant portion of the task, implying a demand for greater information integration when processing negatively valenced musical stimuli. This study demonstrated that the systematic control of musical dissonance could be applied to isolate valence from the arousal dimension, facilitating a novel access to the neural representation of negative emotion.
In order to investigate how high school students and researchers perceive science-related (STEM) subjects, we introduce forma mentis networks. This framework models how people conceptually structure their stance, mindset or forma mentis toward a given topic. In this study, we build forma mentis networks revolving around STEM and based on psycholinguistic data, namely free associations of STEM concepts (i.e., which words are elicited first and associated by students/researchers reading "science"?) and their valence ratings concepts (i.e., is "science" perceived as positive, negative or neutral by students/researchers?). We construct separate networks for (Ns = 159) Italian high school students and (Nr = 59) interdisciplinary professionals and researchers in order to investigate how these groups differ in their conceptual knowledge and emotional perception of STEM. Our analysis of forma mentis networks at various scales indicate that, like researchers, students perceived "science" as a strongly positive entity. However, differently from researchers, students identified STEM subjects like "physics" and "mathematics" as negative and associated them with other negative STEM-related concepts. We call this surrounding of negative associations a negative emotional aura. Cross-validation with external datasets indicated that the negative emotional auras of physics, maths and statistics in the students' forma mentis network related to science anxiety. Furthermore, considering the semantic associates of "mathematics" and "physics" revealed that negative auras may originate from a bleak, dry perception of the technical methodology and mnemonic tools taught in these subjects (e.g., calculus rules). Overall, our results underline the crucial importance of emphasizing nontechnical and applied aspects of STEM disciplines, beyond purely methodological teaching. The quantitative insights achieved through forma mentis networks highlight the necessity of establishing novel pedagogic and interdisciplinary links between science, its real-world complexity, and creativity in science learning in order to enhance the impact of STEM education, learning and outreach activities.
The affect associated with negative events fades faster than the affect associated with positive events (the fading affect bias). The fading affect bias is present in most participants and is thought to be evidence of a healthy coping mechanism operating in autobiographical memory. Prior research shows that the fading affect bias can be distorted by negative individual difference variables such as dysphoria and anxiety. The goal of this research is to link the fading affect bias to the positive individual difference variable of Grit. A total of 197 participants completed the short Grit Scale and were divided into four groups based on their Grit scores (i.e., low Grit to high Grit). Participants retrieved positive and negative event memories and then made affect ratings for the events. The results show that increased levels of Grit were associated with a stronger fading affect bias.
Recently, it has been shown that various auditory stimuli modulate flavour perception. The present study attempts to understand the effects of environmental sounds (park, food court, fast food restaurant, cafe, and bar sounds) on the perception of chocolate gelato (specifically, sweet, bitter, milky, creamy, cocoa, roasted, and vanilla notes) using the Temporal Check-All-That-Apply (TCATA) method. Additionally, affective ratings of the auditory stimuli were obtained using the Self-Assessment Manikin (SAM) in terms of their valence, arousal, and dominance. In total, 58 panellists rated the sounds and chocolate gelato in a sensory laboratory. The results revealed that bitterness, roasted, and cocoa notes were more evident when the bar, fast food, and food court sounds were played. Meanwhile, sweetness was cited more in the early mastication period when listening to park and café sounds. The park sound was significantly higher in valence, while the bar sound was significantly higher in arousal. Dominance was significantly higher for the fast food restaurant, food court, and bar sound conditions. Intriguingly, the valence evoked by the pleasant park sound was positively correlated with the sweetness of the gelato. Meanwhile, the arousal associated with bar sounds was positively correlated with bitterness, roasted, and cocoa attributes. Taken together, these results clearly demonstrate that people's perception of the flavour of gelato varied with the different real-world sounds used in this study.
In the past decades, linguistic typology went through a renewing phase that involved a significant change in the research questions and methods of the discipline, which is now interested in fine-grained features underlying language diversity. In this paper, we propose a novel approach to address the newly defined needs of linguistic typology by extracting qualitative and quantitative information about a wide range of features from multilingual annotated corpora based on Natural Language Processing methods and techniques. We tested our method in a case study focusing on word order variation in two widely investigated constructions, VERB-SUBJ(ect) and NOUN-ADJ(ective), with a specific view to structural and functional factors underlying the preference for one or the other order, both intra- and cross-linguistically, and their interaction. Preliminary experiments have been carried out aimed at acquiring typological evidence from a selection of linguistically annotated treebanks for three different languages, namely Italian, Spanish and English. Our results show the effectiveness of the method in letting similarities and differences also emerge from typologically close languages.
We present a novel semantic framework for modeling linguistic expressions of\ngeneralization---generic, habitual, and episodic statements---as combinations\nof simple, real-valued referential properties of predicates and their\narguments. We use this framework to construct a dataset covering the entirety\nof the Universal Dependencies English Web Treebank. We use this dataset to\nprobe the efficacy of type-level and token-level information---including\nhand-engineered features and static (GloVe) and contextual (ELMo) word\nembeddings---for predicting expressions of generalization. Data and code are\navailable at decomp.io.\n
This is the first versioned collection of.xml files containing approximately 550,000 tokens of ancient Greek prose that have been hand-analyzed into dependency syntax using Perseids/Arethusa by Prof. Vanessa Gorman of the University of Nebraska-Lincoln. CC0 1.0 license.
We present UDify, a multilingual multi-task model capable of accurately predicting universal part-of-speech, morphological features, lemmas, and dependency trees simultaneously for all 124 Universal Dependencies treebanks across 75 languages. By leveraging a multilingual BERT self-attention model pretrained on 104 languages, we found that fine-tuning it on all datasets concatenated together with simple softmax classifiers for each UD task can result in state-of-the-art UPOS, UFeats, Lemmas, UAS, and LAS scores, without requiring any recurrent or language-specific components. We evaluate UDify for multilingual learning, showing that low-resource languages benefit the most from cross-linguistic annotations. We also evaluate for zero-shot learning, with results suggesting that multilingual training provides strong UD predictions even for languages that neither UDify nor BERT have ever been trained on. Code for UDify is available at https://github.com/hyperparticle/udify.
Singlish can be interesting to the computational linguistics community both linguistically, as a major low-resource creole based on English, and computationally, for information extraction and sentiment analysis of regional social media. In our conference paper, Wang et al. (2017), we investigated part-of-speech (POS) tagging and dependency parsing for Singlish by constructing a treebank under the Universal Dependencies scheme and successfully used neural stacking models to integrate English syntactic knowledge for boosting Singlish POS tagging and dependency parsing, achieving the state-of-the-art accuracies of 89.50% and 84.47% for Singlish POS tagging and dependency, respectively. In this work, we substantially extend Wang et al. (2017) by enlarging the Singlish treebank to more than triple the size and with much more diversity in topics, as well as further exploring neural multi-task models for integrating English syntactic knowledge. Results show that the enlarged treebank has achieved significant relative error reduction of 45.8% and 15.5% on the base model, 27% and 10% on the neural multi-task model, and 21% and 15% on the neural stacking model for POS tagging and dependency parsing, respectively. Moreover, the state-of-the-art Singlish POS tagging and dependency parsing accuracies have been improved to 91.16% and 85.57%, respectively. We make our treebanks and models available for further research.
Despite a great success in learning representation for image data, it is challenging to learn the stochastic latent features from natural language based on variational inference. The difficulty in stochastic sequential learning is due to the posterior collapse caused by an autoregressive decoder which is prone to be too strong to learn sufficient latent information during optimization. To compensate this weakness in learning procedure, a sophisticated latent structure is required to assure good convergence so that random features are sufficiently captured for sequential decoding. This study presents a new variational recurrent autoencoder (VRAE) for sequence reconstruction. There are two complementary encoders consisting of a long short-term memory (LSTM) and a pyramid bidirectional LSTM which are merged to discover the global and local dependencies in a hierarchical latent variable model, respectively. Experiments on Penn Treebank and Yelp 2013 demonstrate that the proposed hierarchical VRAE is able to learn the complementary representation as well as tackle the posterior collapse in stochastic sequential learning. The performance of recurrent autoencoder is substantially improved in terms of perplexity.
To develop a parser for a language with no syntactically annotated data, we either have to develop a (small) treebank for the target language or rely on cross-lingual learning or projection, or possibly use some combination of these methods. In this paper, we compare the usefulness of cross-lingual model transfer and target language annotation for three different languages, with varying support from closely related high-resource languages. The results show that annotating even a very small amount of data in the target language is superior to any cross-lingual setup and that accuracy can be further improved by adding training data from related languages in a multilingual model.
Recurrent Neural Networks (RNNs) have dominated language modeling because of their superior performance over traditional N-gram based models. In many applications, a large Recurrent Neural Network language model (RNNLM) or an ensemble of several RNNLMs is used. These models have large memory footprints and require heavy computation. In this paper, we examine the effect of applying knowledge distillation in reducing the model size for RNNLMs. In addition, we propose a trust regularization method to improve the knowledge distillation training for RNNLMs. Using knowledge distillation with trust regularization, we reduce the parameter size to a third of that of the previously published best model while maintaining the state-of-the-art perplexity result on Penn Treebank data. In a speech recognition N-best rescoring task, we reduce the RNNLM model size to 18.5% of the baseline system, with no degradation in word error rate (WER) performance on Wall Street Journal data set.
A common and mostly effective emotion regulation strategy is reappraisal. During reappraisal, activity in cognitive control brain regions increases and activity in brain regions associated with emotion responding (e.g., the amygdala) diminishes. Immediately after reappraisal, it has been observed that activity in the amygdala increases again, which might reflect a paradoxical aftereffect. While there is extensive empirical evidence for these neural correlates of emotion regulation, only few studies targeted the association with individual differences in personality traits. The aim of this study is to investigate these associations more thoroughly. Seventy-six healthy participants completed measures of broad personality traits (Big Five, Positive and Negative Affect) as well as of more narrow traits (habitual use of emotion regulation) and performed an experimental fMRI reappraisal task. Participants were instructed to either permit their emotions or to detach themselves from the presented negative and neutral pictures. After each picture, a relaxation period was included. Reappraisal success was determined by arousal ratings and activity in the amygdala. During reappraisal, we found activation in the prefrontal cortex and deactivation in the left amygdala. During the relaxation period, an immediate aftereffect was found in occipital regions and marginally in the amygdala. Neither personality traits nor habitual use of emotion regulation predicted reappraisal success or the magnitude of the aftereffect. We replicated typical activation and deactivation patterns during intentional emotion regulation and partially replicated the immediate aftereffect in the amygdala. However, there was no association between personality traits and emotion regulation success.
Seemingly, gender, language, and partisanship are intertwined concepts. We believe that the use of gendered language in political settings may be used strategically by political elites. The purpose of this paper is to craft a tool for scholars to test the interconnection between politics, gender, and language—what we refer to as being the gendered language and partisanship nexus. We test our prediction using original word rating data. From our test, we find significant variation across seven hundred words in ratings as masculine and feminine and discover that words rated as masculine are more likely to be rated as dominant and negatively valenced. We additionally find that Republican men are most likely to rate words as more masculine. Using this dictionary, we find that Republican presidents are more likely to use masculine language than Democratic presidents in their State of the Union addresses and that the Republican Party uses more masculine language than the Democratic Party in their official party platform.
We propose a practical scheme to train a single multilingual sequence labeling model that yields state of the art results and is small and fast enough to run on a single CPU. Starting from a public multilingual BERT checkpoint, our final model is 6x smaller and 27x faster, and has higher accuracy than a state-of-the-art multilingual baseline. We show that our model especially outperforms on low-resource languages, and works on codemixed input text without being explicitly trained on codemixed examples. We showcase the effectiveness of our method by reporting on part-of-speech tagging and morphological prediction on 70 treebanks and 48 languages.
Predatory publishing has become a much‐discussed and highly visible phenomenon over the past few years. One widespread, but hardly tested, assumption is the idea that articles published in predatory journals deviate substantially from those published in traditional journals. In this paper, we address this assumption by utilizing corpus linguistic tools. We compare the ‘academic‐like’ nature of articles from two different journals in political science, one top‐ranking and one alleged predatory. Our findings indicate that there is significant linguistic variation between the two corpora along the dimensions that we test. The articles display notable differences in the types and usage of keywords in the two journals. We conclude that articles published in so‐called predatory journals do not conform to linguistic norms used in higher‐quality journals. These findings may demonstrate a lack of quality control in predatory journals but may also indicate a lack of awareness and use of such linguistic norms by their authors. We also suggest that there is a need for the education of authors in science writing as this may enable them to publish in higher‐ranked and quality‐assured outlets.
Recurrent neural network language models (RNNLMs) have shown superior performance across a range of speech recognition tasks. At the heart of all RNNLMs, the activation functions play a vital role to control the information flows and tracking longer history contexts that are useful for predicting the following words. Long short-term memory (LSTM) units are well known for such ability and thus widely used in current RNNLMs. However, the deterministic parameter estimates in LSTM RNNLMs are prone to over-fitting and poor generalization when given limited training data. Furthermore, the precise forms of activations in LSTM have been largely empirically set for all cells at a global level. In order to address these issues, this paper introduces Gaussian process (GP) LSTM RNNLMs. In addition to modeling parameter uncertainty under a Bayesian framework, it also allows the optimal forms of gates being automatically learned for individual LSTM cells. Experiments were conducted on three tasks: the Penn Treebank (PTB) corpus, Switchboard conversational telephone speech (SWBD) and the AMI meeting room data. The proposed GP-LSTM RNNLMs consistently outperform the baseline LSTM RNNLMs in terms of both perplexity and word error rate.
In this paper, we compute the affective-aesthetic potential (AAP) of literary texts by using a simple sentiment analysis tool called SentiArt. In contrast to other established tools, SentiArt is based on publicly available vector space models (VSMs) and requires no emotional dictionary, thus making it applicable in any language for which VSMs have been made available (>150 so far) and avoiding issues of low coverage. In a first study, the AAP values of all words of a widely used lexical databank for German were computed and the VSM’s ability in representing concrete and more abstract semantic concepts was demonstrated. In a second study, SentiArt was used to predict ~2800 human word valence ratings and shown to have a high predictive accuracy (R2 > 0.5, p < 0.0001). A third study tested the validity of SentiArt in predicting emotional states over (narrative) time using human liking ratings from reading a story. Again, the predictive accuracy was highly significant: R2adj = 0.46, p < 0.0001, establishing the SentiArt tool as a promising candidate for lexical sentiment analyses at both the micro- and macrolevels, i.e., short and long literary materials. Possibilities and limitations of lexical VSM-based sentiment analyses of diverse complex literary texts are discussed in the light of these results.
Discourse-annotated corpora are an important resource for the community, but they are often annotated according to different frameworks. This makes joint usage of the annotations difficult, preventing researchers from searching the corpora in a unified way, or using all annotated data jointly to train computational systems. Several theoretical proposals have recently been made for mapping the relational labels of different frameworks to each other, but these proposals have so far not been validated against existing annotations. The two largest discourse relation annotated resources, the Penn Discourse Treebank and the Rhetorical Structure Theory Discourse Treebank, have however been annotated on the same texts, allowing for a direct comparison of the annotation layers. We propose a method for automatically aligning the discourse segments, and then evaluate existing mapping proposals by comparing the empirically observed against the proposed mappings. Our analysis highlights the influence of segmentation on subsequent discourse relation labelling, and shows that while agreement between frameworks is reasonable for explicit relations, agreement on implicit relations is low. We identify several sources of systematic discrepancies between the two annotation schemes and discuss consequences for future annotation and for usage of the existing resources.
Word vectors are at the core of many natural language processing tasks. Recently, there has been interest in post-processing word vectors to enrich their semantic information. In this paper, we introduce a novel word vector post-processing technique based on matrix conceptors (Jaeger 2014), a family of regularized identity maps. More concretely, we propose to use conceptors to suppress those latent features of word vectors having high variances. The proposed method is purely unsupervised: it does not rely on any corpus or external linguistic database. We evaluate the post-processed word vectors on a battery of intrinsic lexical evaluation tasks, showing that the proposed method consistently outperforms existing state-of-the-art alternatives. We also show that post-processed word vectors can be used for the downstream natural language processing task of dialogue state tracking, yielding improved results in different dialogue domains.
Imagining fictional creatures like zombies in survival situations boosts long-term memory for words encoded in these situations more than rating words for pleasantness (zombie effect). Study 1 required word-ratings in a zombie-survival scenario; participants were told they had to protect against either possible zombie attack or contamination. The zombie-survival situations yielded identical recall levels but higher recall rates than pleasantness. Study 2 matched a zombie-survival scenario on perceived fear with scenarios involving ghosts or predators. Perceived disgust in the zombie scenario was higher than in these other survival conditions. Words were remembered better when processed in survival scenarios than when rated for pleasantness, but there was no reliable difference in recall between the scenarios. In neither study did the number of death-related words produced in a word-fragment completion task fit the mortality salience account of the zombie memory effect. Overall findings suggest that this effect relates to the fear system.
Despite the fact that there are a number of researches working on Khmer Language in the field of Natural Language Processing along with some resources regarding words segmentation and POS Tagging, we still lack of high-level resources regarding syntax, Treebanks and grammars, for example. This paper illustrates the semi-automatic framework of constructing Khmer Treebank and the extraction of the Khmer grammar rules from a set of sentences taken from the Khmer grammar books. Initially, these sentences will be manually annotated and processed to generate a number of grammar rules with their probabilities once the Treebank is obtained. In our experiments, the annotated trees and the extracted grammar rules are analyzed in both quantitative and qualitative way. Finally, the results will be evaluated in three evaluation processes including Self-Consistency, 5-Fold Cross-Validation, Leave-One-Out Cross-Validation along with the three validation methods such as Precision, Recall, F1-Measure. According to the result of the three validations, Self-Consistency has shown the best result with more than 92%, followed by the Leave-One-Out Cross-Validation and 5-Fold Cross Validation with the average of 88% and 75% respectively. On the other hand, the crossing bracket data shows that Leave-One-Out Cross Validation holds the highest average with 96% while the other two are 85% and 89%, respectively.
xml treebank Annotated by Toon Van Hal, with student contributions by Mathieu Cuijpers; Sanderijn Gijbels; Yoran Joosten; Yordi Lenaerts; Eva Uffing; Chiara Van der Hasselt; Lisa Vanhee and Jolien Volders (KU Leuven Bachelor 3, 2018-2019). Based on a preparsed text by Alek Keersmaekers. Controlled by Toon Van Hal, Sanderijn Gijbels and Yoran Joosten.
Abstract A puzzling fact about linguistic norms is that they are mainly stable, but the conventional variant sometimes changes. These transitions seem to be mostly S-shaped and, therefore, directed. Previous models have suggested possible mechanisms to explain these directed changes, mainly based on a bias favoring the innovative variant. What is still debated is the origin of such a bias. In this paper, we propose a refined taxonomy of mechanisms of language change and identify a family of mechanisms explaining self-actuated language changes. We exemplify this type of mechanism with the preference-based selection mechanism that relies on agents having dynamic preferences for different variants of the linguistic norm. The key point is that if these preferences align through social interactions, then new changes can be actuated even in the absence of external triggers. We present results of a multi-agent model and demonstrate that the model produces trajectories that are typical of language change.
The current CoNLL version of the second part of the Late Latin Charter Treebank (LLCT2). Early medieval Latin documentary texts with morphological and syntactic annotation. Ancient Language Dependency Treebank (ALDT) compatible linguistic annotation with modifications concerning morphology (see Korkiakangas & Passarotti, 2011, “Challenges in Annotating Medieval Latin Charters”). LLCT2 expands the chronological span of LLCT1 up to AD 897. LLCT2 contains 521 charters and 257,918 tokens. See Korkiakangas, [in print], “Late Latin Charter Treebank: contents and annotation”.
This paper presents work on the creation of a Universal Dependency (UD) treebank for Wolof as the first UD treebank within the Northern Atlantic branch of the Niger-Congo languages. The paper reports on various issues related to word segmentation for tokenization and the mapping of PoS tags, morphological features and dependency relations to existing conventions for annotating Wolof. It also outlines some specific constructions as a starting point for discussing several more general UD annotation guidelines, in particular for noun class marking, deixis encoding, and focus marking.
Abstract Multiword expressions can have both idiomatic and literal occurrences. For instance pulling strings can be understood either as making use of one’s influence, or literally. Distinguishing these two cases has been addressed in linguistics and psycholinguistics studies, and is also considered one of the major challenges in MWE processing. We suggest that literal occurrences should be considered in both semantic and syntactic terms, which motivates their study in a treebank. We propose heuristics to automatically pre-identify candidate sentences that might contain literal occurrences of verbal VMWEs, and we apply them to existing treebanks in five typologically different languages: Basque, German, Greek, Polish and Portuguese. We also perform a linguistic study of the literal occurrences extracted by the different heuristics. The results suggest that literal occurrences constitute a rare phenomenon. We also identify some properties that may distinguish them from their idiomatic counterparts. This article is a largely extended version of Savary and Cordeiro (2018).
In this paper, we propose a novel data augmentation method with respect to the target context of the data via self-supervised learning. Instead of looking for the exact synonyms of masked words, the proposed method finds words that can replace the original words considering the context. For self-supervised learning, we can employ the masked language model (MLM), which masks a specific word within a sentence and obtains the original word. The MLM learns the context of a sentence through asymmetrical inputs and outputs. However, without using the existing MLM, we propose a label-masked language model (LMLM) that can include label information for the mask tokens used in the MLM to effectively use the MLM in data with label information. The augmentation method performs self-supervised learning using LMLM and then implements data augmentation through the trained model. We demonstrate that our proposed method improves the classification accuracy of recurrent neural networks and convolutional neural network-based classifiers through several experiments for text classification benchmark datasets, including the Stanford Sentiment Treebank-5 (SST5), the Stanford Sentiment Treebank-2 (SST2), the subjectivity (Subj), the Multi-Perspective Question Answering (MPQA), the Movie Reviews (MR), and the Text Retrieval Conference (TREC) datasets. In addition, since the proposed method does not use external data, it can eliminate the time spent collecting external data, or pre-training using external data.
Abstract Lexicalized parsing models are based on the assumptions that (i) constituents are organized around a lexical head and (ii) bilexical statistics are crucial to solve ambiguities. In this paper, we introduce an unlexicalized transition-based parser for discontinuous constituency structures, based on a structure-label transition system and a bi-LSTM scoring system. We compare it with lexicalized parsing models in order to address the question of lexicalization in the context of discontinuous constituency parsing. Our experiments show that unlexicalized models systematically achieve higher results than lexicalized models, and provide additional empirical evidence that lexicalization is not necessary to achieve strong parsing results. Our best unlexicalized model sets a new state of the art on English and German discontinuous constituency treebanks. We further provide a per-phenomenon analysis of its errors on discontinuous constituents.
Abstract In a usage-based framework, variation is part and parcel of our linguistic experiences, and therefore also of our mental representations of language. In this article, we bring attention to variation as a source of information. Instead of discarding variation as mere noise, we examine what it can reveal about the representation and use of linguistic knowledge. By means of metalinguistic judgment data, we demonstrate how to quantify and interpret four types of variation: variation across items, participants, time, and methods. The data concern familiarity ratings assigned by 91 native speakers of Dutch to 79 Dutch prepositional phrases such as in de tuin ‘in the garden’ and rond de ingang ‘around the entrance’. Participants performed the judgment task twice within a period of one to two weeks, using either a 7-point Likert scale or a Magnitude Estimation scale. We explicate the principles according to which the different types of variation can be considered information about mental representation, and we show how they can be used to test hypotheses regarding linguistic representations.
Knowledge of multi-word expressions, such as break the ice, is an important aspect of language proficiency that so far we have known surprisingly little about. For example, it is largely unknown how much variability there is between speakers with respect to the number of different items that they know, or what factors contribute to their acquisition. This lack of knowledge seriously limits the generalizability of experimental studies on the production and comprehension of multi-word expressions (usually idioms) and generally suggests that there still is a sizable unknown territory of language knowledge to explore. Here, we present the results of two familiarity ratings for a large sample of Dutch idioms and a large number of participants that varied in age between 12 and 86 years old. The data show considerable variation between participants and between idioms. Non-linear mixed-effects regression analyses revealed that the age of participants, but not their education, as well as the frequency and decomposability of the idioms influenced the familiarity scores. Our findings suggest that the knowledge of multiword expressions develops across the lifespan, is acquired from exposure, and-in participants younger than about 40 years of age-varies with item decomposability.
We recently introduced the EmojiGrid as an intuitive graphical self-report tool to measure food&shy;evoked valence and arousal. The EmojiGrid is a Cartesian grid, labeled with facial icons (emoji) expressing different degrees of valence and arousal. The lack of verbal labels makes it a valuable, language-independent tool for cross-cultural research. Users can efficiently report their subjective ratings of both valence and arousal with a single click on the location of the grid that best represents their affective state after perceiving a stimulus. The EmojiGrid has previously been validated for the assessment of emotions evoked by food images. In this study we validated the EmojiGrid for the affective appraisal of odors. Observers (N=56, 24 males, mean age=24.3±4.6) smelled 40 randomly presented odors (27 food and 13 non&shy;food smells), ranging from very unpleasant and arousing (e.g., feces, fish), via pleasant and calming (e.g., clove, cinnamon), to very pleasant and stimulating (e.g., peach, caramel). The odor samples consisted of felt pens, with tips that were impregnated with 4 ml of fluid odorant substance. Each pen was presented once, for about 5 seconds at 2 cm below both nostrils. The participants sniffed following a verbal command. Immediately after sniffing the pen was removed, and participants were given at least 30 s to smell fresh air. The participants reported their affective appraisal of each odor using the EmojiGrid. The resulting mean valence and arousal ratings closely agree with those from previous studies in the literature that were obtained with alternative rating tools. In addition, we find that the EmojiGrid yields the typical universal U-shaped relation between mean valence and arousal that is commonly observed for a wide range of affective sensory (visual, auditory, tactile, gustatory) stimuli. We conclude that the EmojiGrid is also a valid affective self-report tool for the assessment of odor evoked emotions.
The CHLG at a glance A parsed (= syntactically annotated) corpus of historical Low German in Penn-Treebank style. Allows for efficient, reproducible searches for a large number of morphosyntactic structures.
Lexical database of the lesser Sunda islands