Papers reviewed and determined not to be word norm studies. Use the flag icon to report errors or suggest re-inclusion.
18625 papers
Alterations in fear learning/generalization are considered to be relevant mechanisms engendering the development of anxiety disorders being the most prevalent mental disorders. Although anxiety disorders almost exclusively have their first onset in childhood and adolescence, etiological research focuses on adult individuals. In this study, we evaluated findings of a recent meta-analysis of genome-wide association studies in adult anxiety disorders with significant associations of four single nucleotide polymorphisms (SNPs) in a large cohort of 347 healthy children (8-12 years) characterized for dimensional anxiety. We investigated the modulation of anxiety parameters by these SNPs in a discriminative fear conditioning and generalization paradigm in the to-date largest sample of children. Results extended findings of the meta-analysis showing a genomic locus on 2p21 to modulate anxious personality traits and arousal ratings. These SNPs might, thus, serve as susceptibility markers for a shared risk across pathological anxiety, presumably mediated by alterations in arousal.
According to World Intellectual Property Organization (2017) report, over 3 million patents exist in the patent database, but only certain numbers have commercial potential. Generally, to assess the commercial potential of patent, it consumes time and requires various expertise. Currently, several models have been developed to address this matter, which to assess using questionnaire tool for portfolios by human. So that occurs bias any limitation exists that our research will address by artificial intelligence. Hence, this research applies a Natural Language Programming to assess for commercial potential of patent, consisting of five steps - (i) Morphological analysis based on the Lexical database, (ii) Syntactic analysis of sentence to check syntax sentence patterns, (iii) Sematic analysis to interpret the meaning of words derived from the previous step, (iv) Discourse integration from context of domain together with the main sentence providing more accurate sentence analysis, and (v) Pragmatic analysis to ensure the correct meaning of interpretation. Then, the obtained data is used to determine criterion factors and formulate the model for assessing commercial potential of patent using Natural Language programming. This finding should deliver an alternative effective patent assessment system, which addresses some current deficiency in patent's assessment for commercial potential.
We describe a cross-lingual transfer method for dependency parsing that takes into account the problem of word order differences between source and target languages. Our model only relies on the Bible, a considerably smaller parallel data than the commonly used parallel data in transfer methods. We use the concatenation of projected trees from the Bible corpus, and the gold-standard treebanks in multiple source languages along with cross-lingual word representations. We demonstrate that reordering the source treebanks before training on them for a target language improves the accuracy of languages outside the European language family. Our experiments on 68 treebanks (38 languages) in the Universal Dependencies corpus achieve a high accuracy for all languages. Among them, our experiments on 16 treebanks of 12 non-European languages achieve an average UAS absolute improvement of 3.3% over a state-of-the-art method.
The paper aims to examine how the acoustic input (the surface form) and the abstract linguistic representation (the underlying representation) interact during spoken word recognition by investigating left-dominant tone sandhi, a tonal alternation in which the underlying tone of the first syllable spreads to the sandhi domain. We conducted two auditory-auditory priming lexical decision experiments on Shanghai left-dominant sandhi words with less-frequent and frequent Shanghai users, in which each disyllabic target was preceded by monosyllabic primes either sharing the same underlying tone, surface tone, or being unrelated to the tone of the first syllable of the sandhi targets. Results showed a surface priming effect but not an underlying priming effect in younger speakers who used Shanghai less frequently, but no surface or underlying priming effect in older speakers who used Shanghai more often. Moreover, the surface priming did not interact with speakers' familiarity ratings to the sandhi targets. These patterns suggest that left-dominant Shanghai sandhi words may be represented in the sandhi form in the mental lexicon. The results are discussed in the context of how phonological opacity, productivity, the non-structure-preserving nature of tone spreading, and speakers' semantic knowledge influence the representation and processing of tone sandhi words.
Lexical simplification (LS) aims to replace complex words in a given sentence with their simpler alternatives of equivalent meaning. Recently unsupervised lexical simplification approaches only rely on the complex word itself regardless of the given sentence to generate candidate substitutions, which will inevitably produce a large number of spurious candidates. We present a simple BERT-based LS approach that makes use of the pre-trained unsupervised deep bidirectional representations BERT. Despite being entirely unsupervised, experimental results show that our approach obtains obvious improvement than these baselines leveraging linguistic databases and parallel corpus, outperforming the state-of-the-art by more than 11 Accuracy points on three well-known benchmarks.
Borderline personality disorder (BPD) is a diagnosis characterized by intense and labile emotion; dialectical behavior therapy, a common treatment for BPD, aims to reduce the intensity and lability of clients' emotion through multiple methods, some of which occur in the therapy session, with the expectation that changes will generalize to the rest of clients' lives. However, little research has examined how BPD clients' affect presents and varies in session or whether affect in session reflects patients' patterns of affect outside of treatment. This study had 2 aims: (a) to explore changes in clients' positive and negative affect in therapy, and (b) to assess if the severity of client psychopathology relates to affect in treatment. Positive and negative affect ratings were collected from clients (N = 73) at the start and end of every individual therapy session (total sessions = 1,474). Hierarchical linear modeling and linear regression were used to examine patterns of affect and assess the relationship between affect and severity. Results indicated that positive affect increased while negative affect decreased between the start and end of sessions, with the same pattern of change in presession affect from week to week. In addition, increased BPD severity was associated with lower presession positive affect ratings and higher negative affect ratings. Further exploration is needed to assess which dialectical behavior therapy treatment processes contribute to changes in in-session affect and how in-session affect relates to treatment outcomes. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
In this paper, we present a Linguistic Informed Multi-Task BERT (LIMIT-BERT) for learning language representations across multiple linguistic tasks by Multi-Task Learning (MTL). LIMIT-BERT includes five key linguistic syntax and semantics tasks: Part-Of-Speech (POS) tags, constituent and dependency syntactic parsing, span and dependency semantic role labeling (SRL). Besides, LIMIT-BERT adopts linguistics mask strategy: Syntactic and Semantic Phrase Masking which mask all of the tokens corresponding to a syntactic/semantic phrase. Different from recent Multi-Task Deep Neural Networks (MT-DNN) (Liu et al., 2019), our LIMIT-BERT is linguistically motivated and learning in a semi-supervised method which provides large amounts of linguistic-task data as same as BERT learning corpus. As a result, LIMIT-BERT not only improves linguistic tasks performance but also benefits from a regularization effect and linguistic information that leads to more general representations to help adapt to new tasks and domains. LIMIT-BERT obtains new state-of-the-art or competitive results on both span and dependency semantic parsing on Propbank benchmarks and both dependency and constituent syntactic parsing on Penn Treebank.
Abstract Generating novel design concepts is a cornerstone for producing innovative products. Although many methods have been proposed for supporting the task, their performance depends on human ability. The goal of this research is to build a method supporting designers to generate novel design concepts with the knowledge of what factors have positive effects on the novelty. Toward the goal, this research assumes that the more distant two function concepts chosen, the more novel idea would come up with by the combination of the two concepts. Based on the assumption, this paper introduces a notion of novelty potential of the combination of two function concepts, and proposes a method to assess it by the function similarity. It is calculated with the integration of a lexical database for natural language called WordNet and a distributional semantics method called word2vec. The proposed method is adapted to case studies in which students perform design concept generation for given design tasks. The correlation analysis is performed to verify the assessment performance of the proposed method. This paper discusses its possibility based on the results of the case studies.
Encoding and retrieval of emotionally arousing stimuli depend on the activation of multiple interconnected brain regions, with people showing differences in their individual strength of emotional perception and recollection. Understanding the association between these brain regions and the behavioral outcome might therefore have important clinical implications as dysfunctional emotional memory processes are characteristic of many psychiatric disorders. Based on behavioral and fMRI data collected from healthy young adults (N = 1'385), we investigated brain activation patterns, arousal ratings and memory performance during encoding and retrieval of negative and neutral pictures. We performed multi-voxel pattern analysis (MVPA) and voxel-wise association analyses. Subjects' individual strength of perceived arousal at encoding and subjects' memory performance at recognition could be predicted from the fMRI data of the respective tasks by using a topographically identical network of brain regions. This network was mainly left lateralized including dense clusters of voxels in the occipital and parietal lobe and including the amygdala. Voxel-wise association analyses confirmed the close link between the brain activation of both tasks and their relation to the respective behavioral outcome. These results point to the importance of the here identified brain network for emotional memory processes in health and, possibly, disease.
There are few studies of user interaction with music libraries comprising solely of unfamiliar music, despite such music being represented in national music information centre collections. We aim to develop a system that encourages exploration of such a library. This study investigates the influence of 69 users’ pre-existing musical genre and feature preferences on their ongoing continuous real-time psychological affect responses during listening and the acoustic features of the music on their liking and familiarity ratings for unfamiliar art music (the collection of the Australian Music Centre) during a sequential hybrid recommender-guided interaction. We successfully mitigated the unfavorable starting conditions (no prior item ratings or participants’ item choices) by using each participant’s pre-listening music preferences, translated into acoustic features and linked to item view count from the Australian Music Centre database, to choose their seed item. We found that first item liking/familiarity ratings were on average higher than the subsequent 15 items and comparable with the maximal values at the end of listeners’ sequential responses, showing acoustic features to be useful predictors of responses. We required users to give a continuous response indication of their perception of the affect expressed as they listened to 30-second excerpts of music, with our system successfully providing either a “similar” or “dissimilar” next item, according to—and confirming—the utility of the items’ acoustic features, but chosen from the affective responses of the preceding item. We also developed predictive statistical time series analysis models of liking and familiarity, using music preferences and preceding ratings. Our analyses suggest our users were at the starting low end of the commonly observed inverted-U relationship between exposure and both liking and perceived familiarity, which were closely related. Overall, our hybrid recommender worked well under extreme conditions, with 53 unique items from 100 chosen as “seed” items, suggesting future enhancement of our approach can productively encourage exploration of libraries of unfamiliar music.
Purpose This paper aims to describe the structure of an aligned Serbian-German literary corpus (SrpNemKor) contained in a digital library Bibliša. The goal of the research was to create a benchmark Serbian-German annotated corpus searchable with various query expansions. Design/methodology/approach The presented research is particularly focused on the enhancement of bilingual search queries in a full-text search of aligned SrpNemKor collection. The enhancement is based on using existing lexical resources such as Serbian morphological electronic dictionaries and the bilingual lexical database Termi. Findings For the purpose of this research, the lexical database Termi is enriched with a bilingual list of German-Serbian translated pairs of lexical units. The list of correct translation pairs was extracted from SrpNemKor, evaluated and integrated into Termi. Also, Serbian morphological e-dictionaries are updated with new entries extracted from the Serbian part of the corpus. Originality/value A bilingual search of SrpNemKor in Bibliša is available within the user-friendly platform. The enriched database Termi enables semantic enhancement and refinement of user’s search query based on synonyms both in Serbian and German at a very high level. Serbian morphological e-dictionaries facilitate the morphological expansion of search queries in Serbian, thereby enabling the analysis of concepts and concept structures by identifying terms assigned to the concept, and by establishing relations between terms in Serbian and German which makes Bibliša a valuable Web tool that can support research and analysis of SrpNemKor.
Topic Modeling encompasses a set of techniques for text clustering and tag recommendation with significant advantages such as unsupervised learning. Based on Latent Dirichlet Allocation (LDA) topic modeling, every single word is related to a set of topics with different weight. The weights are furt her estimated in order to determine the semantic relation between the words and the rest of the documents. Apparently the chief drawback of topic modeling techniques, specifically LDA, lies on their incapability in clustering short texts in which semantic relation between words is neglected. This issue is deemed more severe when analyzing social networks such as Twitter wherein short texts are the case. It is assumed that semantic relation between a document and the target short text helps obtain efficient clustering of short texts via topic modeling. Hence, the current paper proposes a method of topic modeling named Semantic Knowledge LDA based on semantic relations between the words in tweets from Twitter social network based on the co-occurrence of words. Additionally, we propose a method of hashtag recommender system based on topic vector (TV) text similarity, named TV based Hashtag Recommender System (TVHRS). Accordingly, we applied our word co-occurrence LDA (SKLDAC) method together with WordNet lexical database to cluster the short texts from Twitter. The clustered topics are later used as the repository for the proposed hashtag recommender system. The proposed system of both SKLDA and TVHRS were applied to a set of 12,309,911 real tweets for testing purposes. When comparing the components of the proposed system to the existing methods, we recorded higher performance in terms of precision, recall and F-Score of 0.551, 0.682 and 0.526, respectively.
This paper investigates which annotation scheme of dependency treebank is more congruent for the measurement of syntactic complexity and cognitive constraint of language materials. Two representatives of semantic-and syntactic-oriented annotation schemes, the Universal Dependencies (UD) and the Surface-Syntactic Universal Dependencies (SUD), are under discussion. The results show that, on the one hand, natural languages based on both annotation schemes follow the universal linguistic law of Dependency Distance Minimization (DDM); on the other hand, according to the metric of Mean Dependency Distances (MDDs), the SUD annotation scheme that accords with traditional dependency syntaxes are more expedient to measure syntactic difficulty and cognitive demand.
The lack of understanding and definitional inconsistencies regarding agritourism and the importance of cooperation in sustaining this kind of tourism are underlined in the literature. This study analyzes the perceptions of agritourism and cooperation from actors in the sector using a plurality of methods, including unsupervised (a) text mining and (b) sentiment analysis with the use of a lexical database, as well as (c) supervised qualitative data analysis. Based on the assumption that destinations with different geographic characteristics have different features and products, two different destinations as for its accessibility and tourism recognition were selected for comparison: (a) an island—Lesvos in the North Aegean Sea, and (b) a continental mountain region—Plastiras Lake, in Greece. The data were collected from personal in-depth interviews and with the use of semi-structured questionnaires. From a methodological perspective, all three methods provided unique insights on the study’s themes, and the overall image of agritourism and cooperation was positive. A common understanding seems important for cooperation and networking; however, training is needed not only for effective promotion of agritourism, but also for cooperation techniques, benefits, trust-building mechanisms and best practices.
Recurrent Neural Networks (RNN), Long Short-Term Memory Networks (LSTM), and Memory Networks which contain memory are popularly used to learn patterns in sequential data. Sequential data has long sequences that hold relationships. RNN can handle long sequences but suffers from the vanishing and exploding gradient problems. While LSTM and other memory networks address this problem, they are not capable of handling long sequences (50 or more data points long sequence patterns). Language modelling requiring learning from longer sequences are affected by the need for more information in memory. This paper introduces Long Term Memory network (LTM), which can tackle the exploding and vanishing gradient problems and handles long sequences without forgetting. LTM is designed to scale data in the memory and gives a higher weight to the input in the sequence. LTM avoid overfitting by scaling the cell state after achieving the optimal results. The LTM is tested on Penn treebank dataset, and Text8 dataset and LTM achieves test perplexities of 83 and 82 respectively. 650 LTM cells achieved a test perplexity of 67 for Penn treebank, and 600 cells achieved a test perplexity of 77 for Text8. LTM achieves state of the art results by only using ten hidden LTM cells for both datasets.
Composers convey emotion through music by co-varying structural cues. Although the complex interplay provides a rich listening experience, this creates challenges for understanding the contributions of individual cues. Here we investigate how three specific cues (attack rate, mode, and pitch height) work together to convey emotion in Bach's Well Tempered-Clavier (WTC). In three experiments, we explore responses to (1) eight-measure excerpts and (2) musically “resolved” excerpts, and (3) investigate the role of different standard dimensional scales of emotion. In each experiment, thirty nonmusician participants rated perceived emotion along scales of valence and intensity (Experiments 1 & 2) or valence and arousal (Experiment 3) for 48 pieces in the WTC. Responses indicate listeners used attack rate, Mode, and pitch height to make judgements of valence, but only attack rate for intensity/arousal. Commonality analyses revealed mode predicted the most variance for valence ratings, followed by attack rate, with pitch height contributing minimally. In Experiment 2 mode increased in predictive power compared to Experiment 1. For Experiment 3, using “arousal” instead of “intensity” showed similar results to Experiment 1. We discuss how these results complement and extend previous findings of studies with tightly controlled stimuli, providing additional perspective on complex issues of interpersonal communication.
Transfer parsing has been used for developing dependency parsers for languages with no treebank by using transfer from treebanks of other languages (source languages). In delexicalized transfer, parsed words are replaced by their part-of-speech tags. Transfer parsing may not work well if a language does not follow uniform syntactic structure with respect to its different constituent patterns. Earlier work has used information derived from linguistic databases to transform a source language treebank to reduce the syntactic differences between the source and the target languages. We propose a transformation method where a source language pattern is transformed stochastically to one of the multiple possible patterns followed in the target language. The transformed source language treebank can be used to train a delexicalized parser in the target language. We show that this method significantly improves the average performance of single-source delexicalized transfer parsers. We also show that, in the multi-source settings, parsers trained using a concatenation of transformed source language treebanks work better when a subset of the source language treebanks is used rather than concatenating all of them or only one. However, the problem of selecting the subset of treebanks whose combination gives the best-performing parser from the set of all the available treebanks is hard. We propose a greedy selection heuristic based on the labelled attachment scores of the corresponding single-source parsers trained using the treebanks after transformation.
Learning hierarchical abstractions from sequences is a challenging and open problem for recurrent neural networks (RNNs). This is mainly due to the difficulty of detecting features that span over long time distances with also different frequencies. In this paper, we address this challenge by introducing surprisal-based activation, a novel method to preserve activations and skip updates depending on encoding-based information content. The preserved activations can be considered as temporal shortcuts with perfect memory. We present a preliminary analysis by evaluating surprisal-based activation on language modeling with the Penn Treebank corpus and find that it can improve performance when compared to baseline RNNs and Long Short-Term Memory (LSTM) networks.
Clinical motor and non-motor effects of deep brain stimulation (DBS) of the subthalamic nucleus (STN) in Parkinson's disease (PD) seem to depend on the stimulation site within the STN. We analysed the effects of the position of the stimulation electrode within the motor STN on subjective emotional experience, expressed as emotional valence and arousal ratings to pictures representing primary rewards and aversive fearful stimuli in 20 PD patients. Patients' ratings from both aversive and erotic stimuli matched the mean ratings from a group of 20 control subjects at similar position within the STN. Patients with electrodes located more posteriorly reported both valence and arousal ratings from both the rewarding and aversive pictures as more extreme. Moreover, posterior electrode positions were associated with a higher occurrence of depression at a long-term follow-up. This brain-behavior relationship suggests a complex emotion topography in the motor part of the STN. Both valence and arousal representations overlapped and were uniformly arranged anterior-posteriorly in a gradient-like manner, suggesting a specific spatial organization needed for the coding of the motivational salience of the stimuli. This finding is relevant for our understanding of neuropsychiatric side effects in STN DBS and potentially for optimal electrode placement.
Purpose: The purpose of this paper is to prove the importance of understanding body language to achieve the effectiveness of English language classes.
 Methodology: Literature investigation is carried out to confirm the objective of this paper.
 Results: In the teaching and learning process, effective communication between a teacher and students is the utmost importance. The failure to establish effective communication in the classroom setting will result in a deficiency of the teaching and learning process.
 Implications: It is the fact that many cues of body language are culture-specific and therefore the only way to improve the understanding of body language is by interacting with people from different cultural backgrounds so that they can share socio-cultural and linguistic norms. Thus, the experience will enrich the teacher with cross-cultural nonverbal behavior which benefits his performance in the classroom. Both teachers' and students' knowledge of non-verbal language play very significant roles in making the classroom interaction successful. Therefore, finally, a summary is presented to reconfirm the importance of integrating body language into classroom interaction.
In this paper we present a novel lemmatization method based on a\nsequence-to-sequence neural network architecture and morphosyntactic context\nrepresentation. In the proposed method, our context-sensitive lemmatizer\ngenerates the lemma one character at a time based on the surface form\ncharacters and its morphosyntactic features obtained from a morphological\ntagger. We argue that a sliding window context representation suffers from\nsparseness, while in majority of cases the morphosyntactic features of a word\nbring enough information to resolve lemma ambiguities while keeping the context\nrepresentation dense and more practical for machine learning systems.\nAdditionally, we study two different data augmentation methods utilizing\nautoencoder training and morphological transducers especially beneficial for\nlow resource languages. We evaluate our lemmatizer on 52 different languages\nand 76 different treebanks, showing that our system outperforms all latest\nbaseline systems. Compared to the best overall baseline, UDPipe Future, our\nsystem outperforms it on 62 out of 76 treebanks reducing errors on average by\n19% relative. The lemmatizer together with all trained models is made available\nas a part of the Turku-neural-parsing-pipeline under the Apache 2.0 license.\n
Singlish can be interesting to the computational linguistics community both linguistically, as a major low-resource creole based on English, and computationally, for information extraction and sentiment analysis of regional social media. In our conference paper, Wang et al. (2017), we investigated part-of-speech (POS) tagging and dependency parsing for Singlish by constructing a treebank under the Universal Dependencies scheme and successfully used neural stacking models to integrate English syntactic knowledge for boosting Singlish POS tagging and dependency parsing, achieving the state-of-the-art accuracies of 89.50% and 84.47% for Singlish POS tagging and dependency, respectively. In this work, we substantially extend Wang et al. (2017) by enlarging the Singlish treebank to more than triple the size and with much more diversity in topics, as well as further exploring neural multi-task models for integrating English syntactic knowledge. Results show that the enlarged treebank has achieved significant relative error reduction of 45.8% and 15.5% on the base model, 27% and 10% on the neural multi-task model, and 21% and 15% on the neural stacking model for POS tagging and dependency parsing, respectively. Moreover, the state-of-the-art Singlish POS tagging and dependency parsing accuracies have been improved to 91.16% and 85.57%, respectively. We make our treebanks and models available for further research.
Despite a great success in learning representation for image data, it is challenging to learn the stochastic latent features from natural language based on variational inference. The difficulty in stochastic sequential learning is due to the posterior collapse caused by an autoregressive decoder which is prone to be too strong to learn sufficient latent information during optimization. To compensate this weakness in learning procedure, a sophisticated latent structure is required to assure good convergence so that random features are sufficiently captured for sequential decoding. This study presents a new variational recurrent autoencoder (VRAE) for sequence reconstruction. There are two complementary encoders consisting of a long short-term memory (LSTM) and a pyramid bidirectional LSTM which are merged to discover the global and local dependencies in a hierarchical latent variable model, respectively. Experiments on Penn Treebank and Yelp 2013 demonstrate that the proposed hierarchical VRAE is able to learn the complementary representation as well as tackle the posterior collapse in stochastic sequential learning. The performance of recurrent autoencoder is substantially improved in terms of perplexity.
To develop a parser for a language with no syntactically annotated data, we either have to develop a (small) treebank for the target language or rely on cross-lingual learning or projection, or possibly use some combination of these methods. In this paper, we compare the usefulness of cross-lingual model transfer and target language annotation for three different languages, with varying support from closely related high-resource languages. The results show that annotating even a very small amount of data in the target language is superior to any cross-lingual setup and that accuracy can be further improved by adding training data from related languages in a multilingual model.
Recurrent Neural Networks (RNNs) have dominated language modeling because of their superior performance over traditional N-gram based models. In many applications, a large Recurrent Neural Network language model (RNNLM) or an ensemble of several RNNLMs is used. These models have large memory footprints and require heavy computation. In this paper, we examine the effect of applying knowledge distillation in reducing the model size for RNNLMs. In addition, we propose a trust regularization method to improve the knowledge distillation training for RNNLMs. Using knowledge distillation with trust regularization, we reduce the parameter size to a third of that of the previously published best model while maintaining the state-of-the-art perplexity result on Penn Treebank data. In a speech recognition N-best rescoring task, we reduce the RNNLM model size to 18.5% of the baseline system, with no degradation in word error rate (WER) performance on Wall Street Journal data set.
A common and mostly effective emotion regulation strategy is reappraisal. During reappraisal, activity in cognitive control brain regions increases and activity in brain regions associated with emotion responding (e.g., the amygdala) diminishes. Immediately after reappraisal, it has been observed that activity in the amygdala increases again, which might reflect a paradoxical aftereffect. While there is extensive empirical evidence for these neural correlates of emotion regulation, only few studies targeted the association with individual differences in personality traits. The aim of this study is to investigate these associations more thoroughly. Seventy-six healthy participants completed measures of broad personality traits (Big Five, Positive and Negative Affect) as well as of more narrow traits (habitual use of emotion regulation) and performed an experimental fMRI reappraisal task. Participants were instructed to either permit their emotions or to detach themselves from the presented negative and neutral pictures. After each picture, a relaxation period was included. Reappraisal success was determined by arousal ratings and activity in the amygdala. During reappraisal, we found activation in the prefrontal cortex and deactivation in the left amygdala. During the relaxation period, an immediate aftereffect was found in occipital regions and marginally in the amygdala. Neither personality traits nor habitual use of emotion regulation predicted reappraisal success or the magnitude of the aftereffect. We replicated typical activation and deactivation patterns during intentional emotion regulation and partially replicated the immediate aftereffect in the amygdala. However, there was no association between personality traits and emotion regulation success.
We propose a practical scheme to train a single multilingual sequence labeling model that yields state of the art results and is small and fast enough to run on a single CPU. Starting from a public multilingual BERT checkpoint, our final model is 6x smaller and 27x faster, and has higher accuracy than a state-of-the-art multilingual baseline. We show that our model especially outperforms on low-resource languages, and works on codemixed input text without being explicitly trained on codemixed examples. We showcase the effectiveness of our method by reporting on part-of-speech tagging and morphological prediction on 70 treebanks and 48 languages.
Seemingly, gender, language, and partisanship are intertwined concepts. We believe that the use of gendered language in political settings may be used strategically by political elites. The purpose of this paper is to craft a tool for scholars to test the interconnection between politics, gender, and language—what we refer to as being the gendered language and partisanship nexus. We test our prediction using original word rating data. From our test, we find significant variation across seven hundred words in ratings as masculine and feminine and discover that words rated as masculine are more likely to be rated as dominant and negatively valenced. We additionally find that Republican men are most likely to rate words as more masculine. Using this dictionary, we find that Republican presidents are more likely to use masculine language than Democratic presidents in their State of the Union addresses and that the Republican Party uses more masculine language than the Democratic Party in their official party platform.
Recurrent neural network language models (RNNLMs) have shown superior performance across a range of speech recognition tasks. At the heart of all RNNLMs, the activation functions play a vital role to control the information flows and tracking longer history contexts that are useful for predicting the following words. Long short-term memory (LSTM) units are well known for such ability and thus widely used in current RNNLMs. However, the deterministic parameter estimates in LSTM RNNLMs are prone to over-fitting and poor generalization when given limited training data. Furthermore, the precise forms of activations in LSTM have been largely empirically set for all cells at a global level. In order to address these issues, this paper introduces Gaussian process (GP) LSTM RNNLMs. In addition to modeling parameter uncertainty under a Bayesian framework, it also allows the optimal forms of gates being automatically learned for individual LSTM cells. Experiments were conducted on three tasks: the Penn Treebank (PTB) corpus, Switchboard conversational telephone speech (SWBD) and the AMI meeting room data. The proposed GP-LSTM RNNLMs consistently outperform the baseline LSTM RNNLMs in terms of both perplexity and word error rate.
In this paper, we compute the affective-aesthetic potential (AAP) of literary texts by using a simple sentiment analysis tool called SentiArt. In contrast to other established tools, SentiArt is based on publicly available vector space models (VSMs) and requires no emotional dictionary, thus making it applicable in any language for which VSMs have been made available (>150 so far) and avoiding issues of low coverage. In a first study, the AAP values of all words of a widely used lexical databank for German were computed and the VSM’s ability in representing concrete and more abstract semantic concepts was demonstrated. In a second study, SentiArt was used to predict ~2800 human word valence ratings and shown to have a high predictive accuracy (R2 > 0.5, p < 0.0001). A third study tested the validity of SentiArt in predicting emotional states over (narrative) time using human liking ratings from reading a story. Again, the predictive accuracy was highly significant: R2adj = 0.46, p < 0.0001, establishing the SentiArt tool as a promising candidate for lexical sentiment analyses at both the micro- and macrolevels, i.e., short and long literary materials. Possibilities and limitations of lexical VSM-based sentiment analyses of diverse complex literary texts are discussed in the light of these results.
Discourse-annotated corpora are an important resource for the community, but they are often annotated according to different frameworks. This makes joint usage of the annotations difficult, preventing researchers from searching the corpora in a unified way, or using all annotated data jointly to train computational systems. Several theoretical proposals have recently been made for mapping the relational labels of different frameworks to each other, but these proposals have so far not been validated against existing annotations. The two largest discourse relation annotated resources, the Penn Discourse Treebank and the Rhetorical Structure Theory Discourse Treebank, have however been annotated on the same texts, allowing for a direct comparison of the annotation layers. We propose a method for automatically aligning the discourse segments, and then evaluate existing mapping proposals by comparing the empirically observed against the proposed mappings. Our analysis highlights the influence of segmentation on subsequent discourse relation labelling, and shows that while agreement between frameworks is reasonable for explicit relations, agreement on implicit relations is low. We identify several sources of systematic discrepancies between the two annotation schemes and discuss consequences for future annotation and for usage of the existing resources.
Knowledge of multi-word expressions, such as break the ice, is an important aspect of language proficiency that so far we have known surprisingly little about. For example, it is largely unknown how much variability there is between speakers with respect to the number of different items that they know, or what factors contribute to their acquisition. This lack of knowledge seriously limits the generalizability of experimental studies on the production and comprehension of multi-word expressions (usually idioms) and generally suggests that there still is a sizable unknown territory of language knowledge to explore. Here, we present the results of two familiarity ratings for a large sample of Dutch idioms and a large number of participants that varied in age between 12 and 86 years old. The data show considerable variation between participants and between idioms. Non-linear mixed-effects regression analyses revealed that the age of participants, but not their education, as well as the frequency and decomposability of the idioms influenced the familiarity scores. Our findings suggest that the knowledge of multiword expressions develops across the lifespan, is acquired from exposure, and-in participants younger than about 40 years of age-varies with item decomposability.
Predatory publishing has become a much‐discussed and highly visible phenomenon over the past few years. One widespread, but hardly tested, assumption is the idea that articles published in predatory journals deviate substantially from those published in traditional journals. In this paper, we address this assumption by utilizing corpus linguistic tools. We compare the ‘academic‐like’ nature of articles from two different journals in political science, one top‐ranking and one alleged predatory. Our findings indicate that there is significant linguistic variation between the two corpora along the dimensions that we test. The articles display notable differences in the types and usage of keywords in the two journals. We conclude that articles published in so‐called predatory journals do not conform to linguistic norms used in higher‐quality journals. These findings may demonstrate a lack of quality control in predatory journals but may also indicate a lack of awareness and use of such linguistic norms by their authors. We also suggest that there is a need for the education of authors in science writing as this may enable them to publish in higher‐ranked and quality‐assured outlets.
In order to investigate how high school students and researchers perceive science-related (STEM) subjects, we introduce forma mentis networks. This framework models how people conceptually structure their stance, mindset or forma mentis toward a given topic. In this study, we build forma mentis networks revolving around STEM and based on psycholinguistic data, namely free associations of STEM concepts (i.e., which words are elicited first and associated by students/researchers reading "science"?) and their valence ratings concepts (i.e., is "science" perceived as positive, negative or neutral by students/researchers?). We construct separate networks for (Ns = 159) Italian high school students and (Nr = 59) interdisciplinary professionals and researchers in order to investigate how these groups differ in their conceptual knowledge and emotional perception of STEM. Our analysis of forma mentis networks at various scales indicate that, like researchers, students perceived "science" as a strongly positive entity. However, differently from researchers, students identified STEM subjects like "physics" and "mathematics" as negative and associated them with other negative STEM-related concepts. We call this surrounding of negative associations a negative emotional aura. Cross-validation with external datasets indicated that the negative emotional auras of physics, maths and statistics in the students' forma mentis network related to science anxiety. Furthermore, considering the semantic associates of "mathematics" and "physics" revealed that negative auras may originate from a bleak, dry perception of the technical methodology and mnemonic tools taught in these subjects (e.g., calculus rules). Overall, our results underline the crucial importance of emphasizing nontechnical and applied aspects of STEM disciplines, beyond purely methodological teaching. The quantitative insights achieved through forma mentis networks highlight the necessity of establishing novel pedagogic and interdisciplinary links between science, its real-world complexity, and creativity in science learning in order to enhance the impact of STEM education, learning and outreach activities.
It is possible to include complicated structures into an individual syntactic tree, to enhance the usefulness of parsed text corpus. In this part, existing works on Thai treebank construction have been developed in order to address the lack of high-level syntactic resources. However, it has yet to be sufficient for Thai Natural Language Processing. Furthermore, Thai treebanks have either syntactic or dependency structure only. This paper presents a construction of hybrid structural Thai treebank which includes both syntactic/dependency structure, a tool for conversion between constituency and dependency parse tree, and a web-based GUI for parse tree visualization. Towards the hybrid treebank construction, hundreds of constituent tree are manually annotated with predicate header to each phrase. Once the set of annotated constituent trees are obtained, the conversion procedure will be performed by determining the annotated head and its dependents. As our experiments, features of hybrid treebank are extracted and illustrated. Finally, difficulties and issues in constructing the hybrid Thai treebank are discussed.
Global Bible Initiative (GBI) have developed Hebrew OT treebanks and Greek NT syntactic treebanks. The treebanks were first generated with a parser using computerized Hebrew and Greek grammars and then proofed verse by verse by Hebrew and Greek Scholars. All the corrections made by the scholars were kept as disambiguation data.
 The phrase structures in the trees have been used to build interlinears, concordances, and translation memories which operate not only on the word level, but on the phrase and clause levels as well. The syntactic relations (dependencies) in the trees have also been used to do smart search where we can find texts that are different in form but similar in meaning.
 Recently, we have also used the trees to improve the accuracy of automatic word alignment and explore tree-based interactive machine translation of the Bible. The auto aligner can be used to the Hebrew and Greek texts to translations in various languages. The interactive machine translation will speed up Bible translation without compromising quality by providing real time suggestions and checking.
 We have already contributed two sets of Greek trees to Creative Commons, the Nestle 1904 version and the SBLGNT version. We also have trees for NA27 and NA28, but we do not own the texts. The Hebrew OT treebank we developed was owned by the Groves Center. We are also capable of creating new treebanks with the parser, grammar, and disambiguation data we own if we are given a text that is morphologically tagged.
Abstract The goal of this study is to demonstrate how network science and graph theory tools and concepts can be effectively used for exploring and comparing semantic spaces of word embeddings and lexical databases. Specifically, we construct semantic networks based on word2vec representation of words, which is “learnt” from large text corpora (Google news, Amazon reviews), and “human built” word networks derived from the well-known lexical databases: WordNet and Moby Thesaurus. We compare “global” (e.g., degrees, distances, clustering coefficients) and “local” (e.g., most central nodes and community-type dense clusters) characteristics of considered networks. Our observations suggest that human built networks possess more intuitive global connectivity patterns, whereas local characteristics (in particular, dense clusters) of the machine built networks provide much richer information on the contextual usage and perceived meanings of words, which reveals interesting structural differences between human built and machine built semantic networks. To our knowledge, this is the first study that uses graph theory and network science in the considered context; therefore, we also provide interesting examples and discuss potential research directions that may motivate further research on the synthesis of lexicographic and machine learning based tools and lead to new insights in this area.
The purpose of this paper is to examine the characteristics of the additions of sounds as a product of changing North Korean linguistic norms reflected in Korean and grammar textbooks. The writing of Saisiot from the Enlightenment period to the Japanese colonial period have been a topic of frequent discussion. The publication of “The Theory of Korean” in the Enlightenment period established the Hangeul writing system, so writings produced using various writing systems were found in contemporary textbooks. “A Proposal for a Unified Korean Spelling System” was later published by the Japanese Government-General of Korea, but Korean spoken in North Korea has changed since the national liberation from Japanese colonial rule. Today’s North Korean grammar textbooks differentiate between the addition of ㄴand ㄷ. These additions are known as the Saisori phenomenon. After liberation, “jeoleumbu(絶音符)” or “saipyo(’)” were written between compound words, but this is no longer the case. This difference is one example of how Korean in North and South Korea differs with regard to the Saisori phenomenon, which is known as the addition of sound, and the writing of Saisiot. This study analyzed North Korean and grammar textbooks to determine how North Korean linguistic norms have changed over time.
The semantic analysis field has a crucial role to play in the research related to text analytics. Calculating the semantic similarity between sentences is a long-standing problem in the area of natural language processing, and it differs significantly as the domain of operation differs. In this paper, we present a methodology that can be applied across multiple domains by incorporating corpora-based statistics into a standardized semantic similarity algorithm. To calculate the semantic similarity between words and sentences, the proposed method follows an edge-based approach using a lexical database. When tested on both benchmark standards and mean human similarity dataset, the methodology achieves a high correlation value for both word (r = 0.8753) and sentence similarity (r = 0.8793) concerning Rubenstein and Goodenough standard and the SICK dataset (r = 0.83241) outperforming other unsupervised models.
It has been shown that implicit connectives can be exploited to improve the performance of the models for implicit discourse relation recognition (IDRR). An important property of the implicit connectives is that they can be accurately mapped into the discourse relations conveying their functions. In this work, we explore this property in a multi-task learning framework for IDRR in which the relations and the connectives are simultaneously predicted, and the mapping is leveraged to transfer knowledge between the two prediction tasks via the embeddings of relations and connectives. We propose several techniques to enable such knowledge transfer that yield the state-of-the-art performance for IDRR on several settings of the benchmark dataset (i.e., the Penn Discourse Treebank dataset).
We present our CHARLES-SAARLAND system for the SIGMORPHON 2019 Shared Task on Crosslinguality and Context in Morphology, in task 2, Morphological Analysis and Lemmatization in Context. We leverage the multilingual BERT model and apply several fine-tuning strategies introduced by UDify demonstrating exceptional evaluation performance on morpho-syntactic tasks. Our results show that fine-tuning multilingual BERT on the concatenation of all available treebanks allows the model to learn cross-lingual information that is able to boost lemmatization and morphology tagging accuracy over fine-tuning it purely monolingually. Unlike UDify, however, we show that when paired with additional character-level and word-level LSTM layers, a second stage of fine-tuning on each treebank individually can improve evaluation even further. Out of all submissions for this shared task, our system achieves the highest average accuracy and f1 score in morphology tagging and places second in average lemmatization accuracy.
Tree-LSTMs have been used for tree-based sentiment analysis over Stanford Sentiment Treebank, which allows the sentiment signals over hierarchical phrase structures to be calculated simultaneously. However, traditional tree-LSTMs capture only the bottom-up dependencies between constituents. In this paper, we propose a tree communication model using graph convolutional neural network and graph recurrent neural network, which allows rich information exchange between phrases constituent tree. Experiments show that our model outperforms existing work on bidirectional tree-LSTMs in both accuracy and efficiency, providing more consistent predictions on phrase-level sentiments.
Animal phobias are one of the most prevalent mental disorders. We analysed how fear and disgust, two emotions involved in their onset and maintenance, are elicited by common phobic animals. In an online survey, the subjects rated 25 animal images according to elicited fear and disgust. Additionally, they completed four psychometrics, the Fear Survey Schedule II (FSS), Disgust Scale - Revised (DS-R), Snake Questionnaire (SNAQ), and Spider Questionnaire (SPQ). Based on a redundancy analysis, fear and disgust image ratings could be described by two axes, one reflecting a general negative perception of animals associated with higher FSS and DS-R scores and the second one describing a specific aversion to snakes and spiders associated with higher SNAQ and SPQ scores. The animals can be separated into five distinct clusters: (1) non-slimy invertebrates; (2) snakes; (3) mice, rats, and bats; (4) human endo- and exoparasites (intestinal helminths and louse); and (5) farm/pet animals. However, only snakes, spiders, and parasites evoke intense fear and disgust in the non-clinical population. In conclusion, rating animal images according to fear and disgust can be an alternative and reliable method to standard scales. Moreover, tendencies to overgeneralize irrational fears onto other harmless species from the same category can be used for quick animal phobia detection.
This paper suggests one way to enhance the ability of Chinese learners to analyze sentences. It is building a treebank and visualizing it as a syntactic tree(or parsed tree) and providing it to learners. The process of building a treebank, which is the most important key in this method, is divided into three parts and described in detail.
BACKGROUND: The tendency to inhibit anger (anger-in) is associated with increased pain. This relationship may be explained by the negative affectivity hypothesis (anger-in increases negative affect that increases pain). Alternatively, it may be explained by the cognitive resource hypothesis (inhibiting anger limits attentional resources for pain modulation). METHODS: A well-validated picture-viewing paradigm was used in 98 healthy, pain-free individuals who were low or high on anger-in to study the effects of anger-in on emotional modulation of pain and attentional modulation of pain. Painful electrocutaneous stimulations were delivered during and in between pictures to evoke pain and the nociceptive flexion reflex (NFR; a physiological correlate of spinal nociception). Subjective and physiological measures of valence (ratings, facial/corrugator electromyogram) and arousal (ratings, skin conductance) were used to assess reactivity to pictures and emotional inhibition in the high anger-in group. RESULTS: The high anger-in group reported less unpleasantness, showed less facial displays of negative affect in response to unpleasant pictures, and reported greater arousal to the pleasant pictures. Despite this, both groups experienced similar emotional modulation of pain/NFR. By contrast, the high anger-in group did not show attentional modulation of pain. CONCLUSIONS: These findings support the cognitive resource hypothesis and suggest that overuse of emotional inhibition in high anger-in individuals could contribute to cognitive resource deficits that in turn contribute to pain risk. Moreover, anger-in likely influenced pain processing predominantly via supraspinal (e.g., cortico-cortical) mechanisms because only pain, but not NFR, was associated with anger-in.