Papers reviewed and determined not to be word norm studies. Use the flag icon to report errors or suggest re-inclusion.
18625 papers
Since the beginning of psychology, researchers have tried to understand beauty. Here, we address two of the oldest questions about it. First, Fechner (1876) claimed that beauty is immediate pleasure, and that an object’s pleasure determines its value. Focusing on the first claim, if beauty is pleasure then inability to experience pleasure (anhedonia) should prevent the experience of beauty. Second, ever since Fechner, psychologists have asked how much beauty depends on the object versus the observer. We address this by determining the relative contribution of shared versus individual taste for diverse images. We asked 757 participants to rate how intensely they felt beauty from each image. We used 900 OASIS images along with their available valence (pleasure vs. displeasure) and arousal ratings. We then obtained self-reports of anhedonia (TEPS), mood, and depression (PHQ-9). The feeling of beauty is closely related to pleasure (r = 0.75), yet unrelated to arousal. For normally beautiful images, the feeling of beauty is correlated with anhedonia (r ~ −0.3) and mood (r ~ 0.3), yet unrelated to depression. Follow-up repeated measures show that shared taste contributes only one third (19%) as much as personal taste (58%) to beauty-rating variance. Addressing age-old questions, these results indicate that beauty is a kind of pleasure, and that beauty is more relative than absolute, i.e., 1.7 times more correlated with individual than with shared taste.
<h3>Introduction</h3><br> Chinese Abstract Meaning Representation was developed by <a href="https://www.brandeis.edu/">Brandeis University</a> and <a href="http://en.njnu.edu.cn/">Nanjing Normal University</a> and is comprised of semantic representations of a set of Chinese sentences from Chinese Treebank 8.0 (<a href="../../../LDC2013T21">LDC2013T21</a>). <br> Abstract Meaning Representation (AMR) captures "who is doing what to whom" in a sentence. Each sentence is paired with a graph that represents its whole-sentence meaning in a tree structure. LDC has released the following AMR English data sets: Abstract Meaning Representation (AMR) Annotation Release 1.0 (<a href="../../../LDC2014T12">LDC2014T12</a>) and Abstract Meaning Representation (AMR) Annotation Release 2.0 (<a href="../../../LDC2017T10">LDC2017T10</a>). <br> Chinese AMR is based on the annotation methodology developed for English with adaptations for handling specific Chinese phenomena. The goal of the Chinese AMR project is to create a large aligned AMR corpus, of which this data set is the first release. For more information about the project, see the <a href="http://www.cs.brandeis.edu/~clp/camr/camr.html">Chinese AMR homepage</a>. <br> <h3>Data</h3><br> The text is extracted from the 10,325 sentences of the weblog and discussion forum portions of Chinese Treebank 8.0. Annotations were applied to 10,149 sentences, with 176 sentences unannotated. <br> The data is divided into training, development and test sets. These three files are presented as plain text in UTF-8 encoding. <br> <h3>Samples</h3><br> Please view this <a href="desc/addenda/LDC2019T07.txt">sample</a>. <br> <h3>Updates</h3><br> None at this time. </br> Portions © 2019 Bin Li, © 2001, 2004, 2005, 2007, 2009, 2010, 2013, 2019 Trustees of the University of Pennsylvania
The article is the first attempt to single out and describe categorical features of the fixed phrase scheme «Самое + V inf!». The status of the investigated syntactic model as a sentence of the phraseologized type was confirmed. The fixed phrase scheme expresses two enantiosemic meanings and is characterized by the existence of two structural variants. The first one is represented by the compulsory unchangeable component самое in combination with infinitive; herewith the initial meaning of the lexeme самое is absolutely de-actualized, both compulsory components do not have paradigmatic characteristics. The non-grammatical combination of the defining pronoun with the infinitive determines a high degree of phraseologization of the syntactic sentence model. The inner form of the lexeme самое is modern when the compulsory component самое stands with a noun, which leads to the maintaining of its morphological paradigm. The fixed phrase scheme does not possess syntactic paradigm. The idiomaticity of the first fixed phrase scheme variant is determined by the nonderivability of the meaning «expediency / inexpediency of smth» from the meanings of the separate lexical components; the nonderivability of the modus meaning of the component (semes «approval», «intensity», «expressivity»), the nonderivability of the syntactic meaning of the sentence model that is formally represented by the combination of the defining pronoun and the infinitive, contradictory to the grammatical norms, as well as of the stylistic seme «colloquialism». Besides, when this sentence is analyzed logically we can distinguish two propositions («now it is time» and «to learn»), which are represented by the simple sentence. Thus, the syntactic seme represented the meaning of structural and semantic sentence type is also idiomatic. While realizing the second, enantiosemic meaning of the fixed phrase scheme, the semes «negation», the modus component (semes «irony», «expressivity», etc.), syntactic seme and colloquial styleme are idiomatic. All these make the fixed phrase scheme the effective tool of communication in the conditions of the colloquial speech.
Brinkman et al. (2019) recently introduced an innovative metric—infoVal—to assess the informational value of classification images (CIs) relative to a random distribution. Although this measure constitutes a valuable tool to distinguish random from nonrandom CIs, we identified two noteworthy discrepancies between the mathematical formalization of the infoVal metric and the authors’ computation. Specifically, the computation was based on the one norm instead of the Euclidean norm, and the k constant was omitted in the denominator of the ratio that produces infoVal. Accordingly, the simulations and experimental results reported by Brinkman et al. do not build on the correct infoVal computation but on a biased index. Importantly, this discrepancy in the computation affects the statistical power and Type I and error rate of the metric. Here we clarify the nature of the discrepancies in the computation and run Brinkman et al.’s Simulation 1 anew with the correct values, to illustrate their consequences. Overall, we found that relying on the miscomputed infoVal metric can lead to misguided conclusions, and we urge researchers to use the correct values.
Human emotion plays an important role in our daily life.EEG-based emotion recognition is expected to facilitate our understanding of the neural mechanisms as well as applications of emotion recognition.Most EEG-based emotion recognition studies have employed the classical event-related approach, which may not be the most suitable tool for naturalistic situations with continuous audio-visual emotional information streams.In the present study, we explored emotion recognition using EEG-based inter-subject correlation (ISC) features.ISC measures the consistency of neural responses across a group of participants exposed to identical complex and continuous stimuli, characterizing the neural responses from a multi-person perspective.Using a publicly available EEG-based emotion database named DEAP, in which 32 participants watched 40 video clips with different emotional properties, ISCs over left parietal cortex and frontal region are found to be significantly correlated with arousal ratings and valence ratings, respectively (arousal: r=0.41, p=0.008; valence
For more than four decades, the Eep Talstra Centre for Bible and Computer (ETCBC) has been building a richly-annotated linguistic database of the Hebrew Bible. This contribution describes the processes of data creation of this database and its underlying methodological principles. These principles which can be labeled as “bottom-up” and “form-to-function” stem from a deep concern to do justice to the biblical text itself and to prevent it from being overruled by thematic or theological considerations.BR The database facilitates the application of computational linguistics and digital humanities to the Hebrew Bible, and supports biblical exegesis, Bible translation as well as the study of the Bible as a language corpus. In recent years, the ETCBC database has been transformed to an open tool, which can be consulted online and be downloaded as a package for anyone who wants to use it for more advanced computational analysis of the Hebrew Bible.BR A research project on syntactic variation in the Hebrew Bible demonstrated the interaction of presumed data of origin (e.g., early versus late texts), genre (e.g., prose or poetry), text type (e.g., narrative and direct speech), and syntactic environment (e.g., main versus subordinate clauses). Regarding the realization of the copula “to be” for example, it can be observed that the narrative text type and the direct speech sections differ considerably in the alleged early texts of the Bible and that the direct speech in the early corpus shows similarities with the Late Biblical Hebrew corpus.BR Regarding the complexity of tree structures, it can be observed that changes in the average size of tree structures take place in main clauses, and only later, or not at all, in subordinate clauses. This agrees with a well-known principle in linguistics, the so-called Penthouse Principle, that accounts for the distinction between “innovative” main clauses and “conservative” subordinate clauses.BR Such distribution patterns which can only be discovered with a computational full corpus analysis are helpful to get a better understanding of diachronic language development of Classical Hebrew in the intersection of oral and written text transmission.
This chapter introduces an intelligent computer-assisted language learning system for Chinese miscollocation detection that integrates natural language processing with corpora. It presents the design of a syntax-based Chinese collocation checker under a data-driven language learning framework in which Chinese collocation errors can be identified and corrected via monolingual and bilingual corpus tools. The Chinese collocation checker is based on a Chinese dependency parser trained from the Sinica Chinese Treebank that can extract dependency relations in a Chinese sentence such as subject-verb and verb-object. A large Chinese corpus of approximately 0.1 billion words was processed using the dependency parser. Its output was used to develop a Chinese dependency relations database. When a Chinese sentence is input to the system, it will be parsed by the Chinese dependency parser, which will output the dependency relations in the sentence. Each of these dependency relations is automatically checked against the Chinese dependency relations database. Those that are not attested in the Chinese dependency relations database are treated as potential miscollocations and prompted to the users for scrutiny. Meanwhile, collocation candidates derived from the Chinese dependency relations database are automatically suggested to the users. It is argued that while these collocation candidates may potentially help learners correct some collocation errors, the process is very time-consuming and sometimes futile, as there is no support for the users’ first language. A new tool combining a web-based bilingual concordancer and a bilingual dictionary such as Linguee and Youdao Dictionary is found to be more efficient and may suit most learners’ needs. The design of the proposed Chinese collocation checker and its integration with bilingual concordancers under the data-driven language learning framework are discussed. The theoretical implications of the proposed method in relation to second language acquisition theories are also explored.
Electronic cigarettes (e-cigarettes) are a controversial public health topic due to their increasing popularity among youth and the uncertainty about their risks and benefits. Researchers have started to assess the valence of media content about e-cigarette use, mostly using expert coding. The current study aims to offer a methodological framework and guideline when using crowdsourcing to rate the valence of e-cigarette media content. Specifically, we present (1) an experiment to determine rating instructions that would result in reliable valence ratings and (2) an analysis to identify the optimal number of raters needed to replicate these ratings. Specifically, we compared ratings produced by crowdsourced raters instructed to rate from several different perspectives (e.g., objective vs. subjective) and determined the instructions that led to reliable ratings. We then used bootstrapping methods and a set of criteria to identify the minimum number of raters needed to replicate these ratings. Results suggested that when rating e-cigarette valence, instructing raters to rate from their own subjective perspective produced reliable results, and nine raters were deemed the optimal number of raters. We expect these findings to inform future content analyses of e-cigarette valence. The study procedures can be applied to crowdsourced content analyses of other health-related media content to determine appropriate rating instructions and the number of raters.
The annotation guidelines for Universal Dependencies (UD) stipulate that the basic units of dependency annotation are syntactic words, but it is not clear what are syntactic words in Japanese. Departing from the long tradition of using phrasal units called bunsetsu for dependency parsing, the current UD Japanese treebanks adopt the Short Unit Words. However, we argue that they are not syntactic word as specified by the annotation guidelines. Although we find non-mainstream attempts to linguistically define Japanese words, such definitions have never been applied to corpus annotation. We discuss the costs and benefits of adopting the rather unfamiliar criteria.
Fuzzy Semantic Similarity Measures are algorithms that are able to compare two or more short texts that contain human perception based words and return a numeric measure of similarity of meaning between them. Such similarity is computed using a weighting, comprised of the semantic and the syntactic composition of the short text. Similarities of individual words are computed through the use of a corpus, and ontological structures based on both WordNet - a well-known lexical database of English, and on category specific fuzzy ontologies created from the derivation of Type-I or Type-II interval fuzzy sets from human perceptions of fuzzy words. Currently, linguistic hedges are not utilized in the similarity calculation within fuzzy semantic similarity measures and are ignored. This paper describes a study, which aims to capture human perceptions for linguistic hedges typically used in natural language. Twelve linguistic hedges used within natural language are selected and an experiment is conducted to capture human perceptions of the impact of hedges on fuzzy category words. A dataset of hedge sentence pairs is created and rated in terms of similarity by human participants. Excellent inter-rater correlations and inter-class correlations are established between the average human ratings and an established fuzzy semantic similarity measure.
This paper presents a new schema to annotate Chinese Treebanks on the character level. The original Universal Dependencies (UD) and Surface-Syntactic Universal Dependencies (SUD) projects provide token-level resources with rich morphosyntactic language details. However, without any commonly accepted word definition for Chinese, the dependency parsing always faces the dilemma of word segmentation. Therefore we present a character-level annotation schema integrated into the existing Universal Dependencies schema as an extension.
This paper describes the application of annotation engineering techniques for the construction of a corpus for Role and Reference Grammar (RRG). RRG is a semantics-oriented formalism for natural language syntax popular in comparative linguistics and linguistic typology, and predominantly applied for the description of non-European languages which are less-resourced in terms of natural language processing. Because of its cross-linguistic applicability and its conjoint treatment of syntax and semantics, RRG also represents a promising framework for research challenges within natural language processing. At the moment, however, these have not been explored as no RRG corpus data is publicly available. While RRG annotations cannot be easily derived from any single treebank in existence, we suggest that they can be reliably inferred from the intersection of syntactic and semantic annotations as represented by, for example, the Universal Dependencies (UD) and PropBank (PB), and we demonstrate this for the English Web Treebank, a 250,000 token corpus of various genres of English internet text. The resulting corpus is a gold corpus for future experiments in natural language processing in the sense that it is built on existing annotations which have been created manually. A technical challenge in this context is to align UD and PB annotations, to integrate them in a coherent manner, and to distribute and to combine their information on RRG constituent and operator projections. For this purpose, we describe a framework for flexible and scalable annotation engineering based on flexible, unconstrained graph transformations of sentence graphs by means of SPARQL Update.
Humans receive a constant stream of input that potentially influence their affective experience. Despite intensive research on affect, it is still largely unknown how various sources of information are integrated into the single, unified affective features that accompany consciousness. Here, we aimed to investigate how a stream of evocative input we receive is dynamically represented in self-reported affect. In 4 experiments, participants viewed a number of sequentially presented images and reported their momentary affective experience on valence and arousal scales. The number and duration of images in a trial varied across studies. In Study 4, we also measured participants' physiological responses while they viewed images. We formulated and compared several models with respect to their capacity to predict self-reported affect based on normative image ratings, physiological measurements, and prior affective experience (measured in the previous trial). Our data best supported a model incorporating a temporally sensitive averaging mechanism for affective integration that assigns higher weights to affectively more potent and recently represented stimuli. Crucially, affective averaging of sensory information and prior affect accounted for distinct contributions to currently experienced affect. Taken together, the current study provides evidence that prior affect and integrated affective impact of stimuli partly shape currently experienced affect. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
This paper presents some preliminary results of the SIDE project, which aims at investigatingthe emotional content of idioms from both a behavioral and computational point of view. In this first work, we collected affective ratings for a set of 45 Italian verb-noun idioms and 45 Italian non-idiomatic verb-noun pairs and then performed a computational study to analyze the role of linguistic information in determining the affective rating of idioms and non-idioms. To this end, we exploited an existing vector-based computational model to calculate a distributional polarity score. The correlation analysis between such a score and human-rated valence revealed a high correlation among the variables as well as a significantly lower polarity score of idioms with respect to non-idioms reflecting their stronger negative content.
Neste artigo, detalhamos a metodologia utilizada na construção do Porttinari-base Propbank, um Propbank padrão-ouro com mais de 45 mil argumentos anotados sobre as dependências sintáticas do treebank Porttinari-base. Apresentamos os desafios subjacentes e as soluções adotadas na anotação de argumentos e predicados, e relatamos os resultados de um estudo sobre concordâncias na anotação. Nosso objetivo é duplo: apresentar o Porttinari-base Propbank enquanto recurso do PLN e, secundariamente, provocar reflexões acerca dos diálogos entre PLN e teorias linguísticas.
Collective behaviors are observed throughout nature, from bacterial colonies to human societies. Important theoretical breakthroughs have recently been made in understanding why animals produce group behaviors and how they coordinate their activities, build collective structures, and make decisions. However, standardized experimental methods to test these findings have been lacking. Notably, easily and unambiguously determining the membership of a group and the responses of an individual within that group is still a challenge. The radial arm maze is presented here as a new standardized method to investigate collective exploration and decision-making in animal groups. This paradigm gives individuals within animal groups the opportunity to make choices among a set of discrete alternatives, and these choices can easily be tracked over long periods of time. We demonstrate the usefulness of this paradigm by performing a set of refuge-site selection experiments with groups of fish. Using an open-source, robust custom image-processing algorithm, we automatically counted the number of animals in each arm of the maze to identify the majority choice. We also propose a new index to quantify the degree of group cohesion in this context. The radial arm maze paradigm provides an easy way to categorize and quantify the choices made by animals. It makes it possible to readily apply the traditional uses of the radial arm maze with single animals to the study of animal groups. Moreover, it opens up the possibility of studying questions specifically related to collective behaviors.
While considerable attention has been given to the analysis of texts written by depressed individuals, few studies were interested in evaluating and improving lexical resources for supporting the detection of signs of depression in text. In this paper, we present a search-based methodology to evaluate existing depression lexica. To meet this aim, we exploit existing resources for depression and language use and we analyze which elements of the lexicon are the most effective at revealing depression symptoms. Furthermore, we propose innovative expansion strategies able to further enhance the quality of the lexica.
In this paper we address extractive summarization of long threads in online discussion fora. We present an elaborate user evaluation study to determine human preferences in forum summarization and to create a reference data set. We showed long threads to ten different raters and asked them to create a summary by selecting the posts that they considered to be the most important for the thread. We study the agreement between human raters on the summarization task, and we show how multiple reference summaries can be combined to develop a successful model for automatic summarization. We found that although the inter-rater agreement for the summarization task was slight to fair, the automatic summarizer obtained reasonable results in terms of precision, recall, and ROUGE. Moreover, when human raters were asked to choose between the summary created by another human and the summary created by our model in a blind side-by-side comparison, they judged the model’s summary equal to or better than the human summary in over half of the cases. This shows that even for a summarization task with low inter-rater agreement, a model can be trained that generates sensible summaries. In addition, we investigated the potential for personalized summarization. However, the results for the three raters involved in this experiment were inconclusive. We release the reference summaries as a publicly available dataset.
This study introduces the second release of the Tool for the Automatic Analysis of Lexical Sophistication (TAALES 2.0), a freely available and easy-to-use text analysis tool. TAALES 2.0 is housed on a user’s hard drive (allowing for secure data processing) and is available on most operating systems (Windows, Mac, and Linux). TAALES 2.0 adds 316 indices to the original tool. These indices are related to word frequency, word range, n-gram frequency, n-gram range, n-gram strength of association, contextual distinctiveness, word recognition norms, semantic network, and word neighbors. In this study, we validated TAALES 2.0 by investigating whether its indices could be used to model both holistic scores of lexical proficiency in free writes and word choice scores in narrative essays. The results indicated that the TAALES 2.0 indices could be used to explain 58% of the variance in lexical proficiency scores and 32% of the variance in word-choice scores. Newly added TAALES 2.0 indices, including those related to n-gram association strength, word neighborhood, and word recognition norms, featured heavily in these predictor models, suggesting that TAALES 2.0 represents a substantial upgrade.
It is generally believed that concepts can be characterized by their properties (or features). When investigating concepts encoded in language, researchers often ask subjects to produce lists of properties that describe them (i.e., the Property Listing Task, PLT). These lists are accumulated to produce Conceptual Property Norms (CPNs). CPNs contain frequency distributions of properties for individual concepts. It is widely believed that these distributions represent the underlying semantic structure of those concepts. Here, instead of focusing on the underlying semantic structure, we aim at characterizing the PLT. An often disregarded aspect of the PLT is that individuals show intersubject variability (i.e., they produce only partially overlapping lists). In our study we use a mathematical analysis of this intersubject variability to guide our inquiry. To this end, we resort to a set of publicly available norms that contain information about the specific properties that were informed at the individual subject level. Our results suggest that when an individual is performing the PLT, he or she generates a list of properties that is a mixture of general and distinctive properties, such that there is a non-linear tendency to produce more general than distinctive properties. Furthermore, the low generality properties are precisely those that tend not to be repeated across lists, accounting in this manner for part of the intersubject variability. In consequence, any manipulation that may affect the mixture of general and distinctive properties in lists is bound to change intersubject variability. We discuss why these results are important for researchers using the PLT.
First release of DravLex
Customers’ opinions on social network platforms are known to influence peer behaviour (Bai, 2011; Eirinaki, Pisal, &amp; Singh, 2012). Customers are also known to be more engaged in sharing their experiences by writing online reviews and recommendations that may be useful to others (Cantallops &amp; Salvi, 2014; Tang &amp; Guo, 2015; Xu &amp; Li, 2016). Actually, user-generated content (UGC) on social network platforms has emerged as an important source for understanding and managing consumers’ expectations, particularly using automated and semi-automated knowledge extraction techniques from text such as text mining and sentiment analysis (Zhang, Zeng, Li, Wang, &amp; Zuo, 2009). This research analyses dimensions of online customer engagement and associated concepts in customers’ reviews through (i) a global sentiment analysis using positive, neutral and negative sentiments and (ii) a topic-sentiment analysis to capture latent topics in online reviews. Furthermore, it examines what influences customers to contribute their online reviews, beyond the features of each focal company or brand. The research methodology is based on a text mining approach, using the MeaningCloud tool. The study focuses on Yelp.com reviews and includes a random sample of 15,000 unique reviews of restaurants, hotels and nightlife entertainment in eleven cities in the USA. An innovative customer engagement dictionary is created, based on previously validated scales using known dimensions of engagement, experience, emotions and brand advocacy, and extended using WordNet 2.1 lexical database. The research findings reveal a high impact of the engagement cognitive processing dimension and hedonic experience on customers’ review endeavour. The study results further indicate that customers seem to be more engaged in positively advocating a company/brand than the contrary. The findings will help social network managers to reinforce their platforms.
Theory-driven text analysis has made extensive use of psychological concept dictionaries, leading to a wide range of important results. These dictionaries have generally been applied through word count methods which have proven to be both simple and effective. In this paper, we introduce Distributed Dictionary Representations (DDR), a method that applies psychological dictionaries using semantic similarity rather than word counts. This allows for the measurement of the similarity between dictionaries and spans of text ranging from complete documents to individual words. We show how DDR enables dictionary authors to place greater emphasis on construct validity without sacrificing linguistic coverage. We further demonstrate the benefits of DDR on two real-world tasks and finally conduct an extensive study of the interaction between dictionary size and task performance. These studies allow us to examine how DDR and word count methods complement one another as tools for applying concept dictionaries and where each is best applied. Finally, we provide references to tools and resources to make this method both available and accessible to a broad psychological audience.
In this study we developed and evaluated a crowdsourcing-based latent semantic analysis (LSA) approach to computerized summary scoring (CSS). LSA is a frequently used mathematical component in CSS, where LSA similarity represents the extent to which the to-be-graded target summary is similar to a model summary or a set of exemplar summaries. Researchers have proposed different formulations of the model summary in previous studies, such as pregraded summaries, expert-generated summaries, or source texts. The former two methods, however, require substantial human time, effort, and costs in order to either grade or generate summaries. Using source texts does not require human effort, but it also does not predict human summary scores well. With human summary scores as the gold standard, in this study we evaluated the crowdsourcing LSA method by comparing it with seven other LSA methods that used sets of summaries from different sources (either experts or crowdsourced) of differing quality, along with source texts. Results showed that crowdsourcing LSA predicted human summary scores as well as expert-good and crowdsourcing-good summaries, and better than the other methods. A series of analyses with different numbers of crowdsourcing summaries demonstrated that the number (from 10 to 100) did not significantly affect performance. These findings imply that crowdsourcing LSA is a promising approach to CSS, because it saves human effort in generating the model summary while still yielding comparable performance. This approach to small-scale CSS provides a practical solution for instructors in courses, and also advances research on automated assessments in which student responses are expected to semantically converge on subject matter content.
The broad use of computer-supported collaborative-learning (CSCL) environments (e.g., instant messenger–chats, forums, blogs in online communities, and massive open online courses) calls for automated tools to support tutors in the time-consuming process of analyzing collaborative conversations. In this article, the authors propose and validate the cohesion network analysis (CNA) model, housed within the ReaderBench platform. CNA, grounded in theories of cohesion, dialogism, and polyphony, is similar to social network analysis (SNA), but it also considers text content and discourse structure and, uniquely, uses automated cohesion indices to generate the underlying discourse representation. Thus, CNA enhances the power of SNA by explicitly considering semantic cohesion while modeling interactions between participants. The primary purpose of this article is to describe CNA analysis and to provide a proof of concept, by using ten chat conversations in which multiple participants debated the advantages of CSCL technologies. Each participant’s contributions were human-scored on the basis of their relevance in terms of covering the central concepts of the conversation. SNA metrics, applied to the CNA sociogram, were then used to assess the quality of each member’s degree of participation. The results revealed that the CNA indices were strongly correlated to the human evaluations of the conversations. Furthermore, a stepwise regression analysis indicated that the CNA indices collectively predicted 54% of the variance in the human ratings of participation. The results provide promising support for the use of automated computational assessments of collaborative participation and of individuals’ degrees of active involvement in CSCL environments.
To push the state of the art in text mining applications, research in natural language processing has increasingly been investigating automatic irony detection, but manually annotated irony corpora are scarce. We present the construction of a manually annotated irony corpus based on a fine-grained annotation scheme that allows for identification of different types of irony. We conduct a series of binary classification experiments for automatic irony recognition using a support vector machine (SVM) that exploits a varied feature set and compare this method to a deep learning approach that is based on an LSTM network and (pre-trained) word embeddings. Evaluation on a held-out corpus shows that the SVM model outperforms the neural network approach and benefits from combining lexical, semantic and syntactic information sources. A qualitative analysis of the classification output reveals that the classifier performance may be further enhanced by integrating implicit sentiment information and context- and user-based features.
Bilingual termbanks are important for many natural language processing applications, especially in translation workflows in industrial settings. In this paper, we apply a log-likelihood comparison method to extract monolingual terminology from the source and target sides of a parallel corpus. The initial candidate terminology list is prepared by taking all arbitrary n-gram word sequences from the corpus. Then, a well-known statistical measure (the Dice coefficient) is employed in order to remove any multi-word terms with weak associations from the candidate term list. Thereafter, the log-likelihood comparison method is applied to rank the phrasal candidate term list. Then, using a phrase-based statistical machine translation model, we create a bilingual terminology with the extracted monolingual term lists. We integrate an external knowledge source—the Wikipedia cross-language link databases—into the terminology extraction (TE) model to assist two processes: (a) the ranking of the extracted terminology list, and (b) the selection of appropriate target terms for a source term. First, we report the performance of our monolingual TE model compared to a number of the state-of-the-art TE models on English-to-Turkish and English-to-Hindi data sets. Then, we evaluate our novel bilingual TE model on an English-to-Turkish data set, and report the automatic evaluation results. We also manually evaluate our novel TE model on English-to-Spanish and English-to-Hindi data sets, and observe excellent performance for all domains.
Modern data-driven spoken language systems (SLS) require manual semantic annotation for training spoken language understanding parsers. Multilingual porting of SLS demands significant manual effort and language resources, as this manual annotation has to be replicated. Crowdsourcing is an accessible and cost-effective alternative to traditional methods of collecting and annotating data. The application of crowdsourcing to simple tasks has been well investigated. However, complex tasks, like cross-language semantic annotation transfer, may generate low judgment agreement and/or poor performance. The most serious issue in cross-language porting is the absence of reference annotations in the target language; thus, crowd quality control and the evaluation of the collected annotations is difficult. In this paper we investigate targeted crowdsourcing for semantic annotation transfer that delegates to crowds a complex task such as segmenting and labeling of concepts taken from a domain ontology; and evaluation using source language annotation. To test the applicability and effectiveness of the crowdsourced annotation transfer we have considered the case of close and distant language pairs: Italian–Spanish and Italian–Greek. The corpora annotated via crowdsourcing are evaluated against source and target language expert annotations. We demonstrate that the two evaluation references (source and target) highly correlate with each other; thus, drastically reduce the need for the target language reference annotations.
Although Modern Standard Arabic is taught in schools and used in written communication and TV/radio broadcasts, all informal communication is typically carried out in dialectal Arabic. In this work, we focus on the design of speech tools and resources required for the development of an Automatic Speech Recognition system for the Tunisian dialect. The development of such a system faces the challenges of the lack of annotated resources and tools, apart from the lack of standardization at all linguistic levels (phonological, morphological, syntactic and lexical) together with the mispronunciation dictionary needed for ASR development. In this paper, we present a historical overview of the Tunisian dialect and its linguistic characteristics. We also describe and evaluate our rule-based phonetic tool. Next, we go deeper into the details of Tunisian dialect corpus creation. This corpus is finally approved and used to build the first ASR system for Tunisian dialect with a Word Error Rate of 22.6%.
Engineering activities often produce considerable documentation as a by-product of the development process. Due to their complexity, technical analysts can benefit from text processing techniques able to identify concepts of interest and analyze deficiencies of the documents in an automated fashion. In practice, text sentences from the documentation are usually transformed to a vector space model, which is suitable for traditional machine learning classifiers. However, such transformations suffer from problems of synonyms and ambiguity that cause classification mistakes. For alleviating these problems, there has been a growing interest in the semantic enrichment of text. Unfortunately, using general-purpose thesaurus and encyclopedias to enrich technical documents belonging to a given domain (e.g. requirements engineering) often introduces noise and does not improve classification. In this work, we aim at boosting text classification by exploiting information about semantic roles. We have explored this approach when building a multi-label classifier for identifying special concepts, called domain actions, in textual software requirements. After evaluating various combinations of semantic roles and text classification algorithms, we found that this kind of semantically-enriched data leads to improvements of up to 18% in both precision and recall, when compared to non-enriched data. Our enrichment strategy based on semantic roles also allowed classifiers to reach acceptable accuracy levels with small training sets. Moreover, semantic roles outperformed Wikipedia- and WordNET-based enrichments, which failed to boost requirements classification with several techniques. These results drove the development of two requirements tools, which we successfully applied in the processing of textual use cases.
The study of biological point-light displays (PLDs) has fascinated researchers for more than 40 years. However, the mechanisms underlying PLD perception remain unclear, partly due to difficulties with precisely controlling and transforming PLD sequences. Furthermore, little agreement exists regarding how transformations are performed. This article introduces a new free-access program called PLAViMoP (Point-Light Display Visualization and Modification Platform) and presents the algorithms for PLD transformations actually included in the software. PLAViMoP fulfills two objectives. First, it standardizes and makes clear many classical spatial and kinematic transformations described in the PLD literature. Furthermore, given its optimized interface, PLAViMOP makes these transformations easy and fast to achieve. Overall, PLAViMoP could directly help scientists avoid technical difficulties and make possible the use of PLDs for nonacademic applications.
Best-worst scaling is a judgment format in which participants are presented with a set of items and have to choose the superior and inferior items in the set. Best-worst scaling generates a large quantity of information per judgment because each judgment allows for inferences about the rank value of all unjudged items. This property of best-worst scaling makes it a promising judgment format for research in psychology and natural language processing concerned with estimating the semantic properties of tens of thousands of words. A variety of different scoring algorithms have been devised in the previous literature on best-worst scaling. However, due to problems of computational efficiency, these scoring algorithms cannot be applied efficiently to cases in which thousands of items need to be scored. New algorithms are presented here for converting responses from best-worst scaling into item scores for thousands of items (many-item scoring problems). These scoring algorithms are validated through simulation and empirical experiments, and considerations related to noise, the underlying distribution of true values, and trial design are identified that can affect the relative quality of the derived item scores. The newly introduced scoring algorithms consistently outperformed scoring algorithms used in the previous literature on scoring many-item best-worst data.
This paper applies computational methods of authorship attribution to shed light on a still open question concerning two Latin works of the twelfth century: are the anonymous authors of the Translatio s. Nicolai (ca. 1101–1108) and the Gesta principum polonorum (ca. 1113–1117) one and the same person? The Translatio was written by the so-called Monk of Lido and describes Venice’s role in the First Crusade. The Gesta were written by the so-called Gallus Anonymous and contain a panegyric of the contemporary Polish ruler, Bolesław III the Wry-Mouthed (r. 1102–1138). This study attributes authorship to these works within four corpora of Latin texts composed between the tenth and twelfth centuries, each with between 39 and 116 texts written by between 15 and 22 different authors. The goal of including four corpora is to see how robust the similarity between the target texts is to changes in text length, genre, and class balance in the corpora. In each corpus, nine different distance metrics and one machine-learning algorithm are used to classify the authors of the Translatio and Gesta. I conclude that it is highly likely that Gallus and Monk were indeed one and same anonymous author, and highlight the effectiveness of the Bray–Curtis distance and logistic regression as methods of attribution.
While several automatic keyphrase extraction (AKE) techniques have been developed and analyzed, there is little consensus on the definition of the task and a lack of overview of the effectiveness of different techniques. Proper evaluation of keyphrase extraction requires large test collections with multiple opinions, currently not available for research. In this paper, we (i) present a set of test collections derived from various sources with multiple annotations (which we also refer to as opinions in the remained of the paper) for each document, (ii) systematically evaluate keyphrase extraction using several supervised and unsupervised AKE techniques, (iii) and experimentally analyze the effects of disagreement on AKE evaluation. Our newly created set of test collections spans different types of topical content from general news and magazines, and is annotated with multiple annotations per article by a large annotator panel. Our annotator study shows that for a given document there seems to be a large disagreement on the preferred keyphrases, suggesting the need for multiple opinions per document. A first systematic evaluation of ranking and classification of keyphrases using both unsupervised and supervised AKE techniques on the test collections shows a superior effectiveness of supervised models, even for a low annotation effort and with basic positional and frequency features, and highlights the importance of a suitable keyphrase candidate generation approach. We also study the influence of multiple opinions, training data and document length on evaluation of keyphrase extraction. Our new test collection for keyphrase extraction is one of the largest of its kind and will be made available to stimulate future work to improve reliable evaluation of new keyphrase extractors.
Network models are an increasingly popular way to abstract complex psychological phenomena. While studying the structure of network models has led to many important insights, little attention has been paid to how well they predict observations. This is despite the fact that predictability is crucial for judging the practical relevance of edges: for instance in clinical practice, predictability of a symptom indicates whether an intervention on that symptom through the symptom network is promising. We close this methodological gap by introducing nodewise predictability, which quantifies how well a given node can be predicted by all other nodes it is connected to in the network. In addition, we provide fully reproducible code examples of how to compute and visualize nodewise predictability both for cross-sectional and time series data.
This article presents a methodological review of 54 meta-analyses of the effectiveness of clinical psychological treatments, using standardized mean differences as the effect size index. We statistically analyzed the distribution of the number of studies of the meta-analyses, the distribution of the sample sizes in the studies of each meta-analysis, the distribution of the effect sizes in each of the meta-analyses, the distribution of the between-studies variance values, and the Pearson correlations between effect size and sample size in each meta-analysis. The results are presented as a function of the type of standardized mean difference: posttest standardized mean difference, standardized mean change from pretest to posttest, and standardized mean change difference between groups. These findings will help researchers design future Monte Carlo and theoretical studies on the performance of meta-analytic procedures, based on the manipulation of realistic model assumptions and parameters of the meta-analyses. Furthermore, the analysis of the distribution of the mean effect sizes through the meta-analyses provides a specific guide for the interpretation of the clinical significance of the different types of standardized mean differences within the field of the evaluation of clinical psychological interventions.
Language is a complex adaptive system, but how does it change? For investigating this process, four diachronic Chinese word co-occurrence networks have been built based on texts that were written during the last 2,000 years. By comparing the network indicators that are associated with the hierarchical features in language networks, we learn that the hierarchy of Chinese lexical networks has indeed evolved over time at three different levels. The connections of words at the micro level are continually weakening; the number of words in the meso-level communities has increased significantly; and the network is expanding at the macro level. This means that more and more words tend to be connected to medium-central words and form different communities. Meanwhile, fewer high-central words link these communities into a highly efficient small-world network. Understanding this process may be crucial for understanding the increasing structural complexity of the language system. [ABSTRACT FROM A)
This research assesses the evolution of lexical diversity in scholarly titles using a new indicator based on zipfian frequency-rank distribution tail fits. At the operational level, while both head and tail fits of zipfian word distributions are more independent of corpus size than other lexical diversity indicators, the latter however neatly outperforms the former in that regard. This benchmark-setting performance of zipfian distribution tails proves extremely handy in distinguishing actual patterns in lexical diversity from the statistical noise generated by other indicators due to corpus size fluctuations. From an empirical perspective, analysis of Web of Science (WoS) article titles from 1975 to 2014 shows that the lexical concentration of scholarly titles in Natural Sciences & Engineering (NSE) and Social Sciences & Humanities (SSH) articles increases by a little less than 8% over the whole period. With the exception of the lexically concentrated Mathematics, Earth & Space, and P)
This study demonstrates that rumination is reflected in two behavioural signals that both play an important role in face-to-face interactions and provides evidence for the negative impact of rumination on social cognition. Sixty-one students were randomly assigned either to a condition in which rumination was induced or to a control condition. Their task was to play a speech-based word association game with an Embodied Conversational Agent during which their word associations, pitch imitation and eye movements were measured. Two questionnaires assessed their ruminative tendencies and mind wandering thoughts, respectively. Rumination predicted differences in task-related mind wandering, polarity of lexical associations, pitch imitation, and blinks while mind wandering predicted differences in saccades. This outcome may show that rumination has a negative impact on certain aspects of social interactions. [ABSTRACT FROM AUTHOR], Copyright of PLoS ONE is the property of Public Library of )
Results from a recent neuroimaging study on spoken sentence comprehension have been interpreted as evidence for cortical entrainment to hierarchical syntactic structure. We present a simple computational model that predicts the power spectra from this study, even though the model’s linguistic knowledge is restricted to the lexical level, and word-level representations are not combined into higher-level units (phrases or sentences). Hence, the cortical entrainment results can also be explained from the lexical properties of the stimuli, without recourse to hierarchical syntax. [ABSTRACT FROM AUTHOR], Copyright of PLoS ONE is the property of Public Library of Science and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to)
Mounting evidence from both cognitive and neuropsychological research points to the importance of conceptual and lexical-semantic contributors to short-term memory performance. Nonetheless, a standardized and well-controlled measure to assess semantic short-term memory was only recently developed for English-speakers, and no parallel measure exists for Spanish-speakers. In the conceptual replication and extension reported here, we develop and validate a Spanish adaptation of the Conceptual Span task as a tool to measure the semantic component of short-term memory. Two versions of the task were validated, the Clustered and the Non-Clustered Conceptual Span task, both in separate samples of 64 and 105 Spanish-speaking university students. We found that both versions of the Conceptual Span task correlate well with another widely used standardized measure of working memory capacity, the Reading Span task. The two versions also correlated, as expected, with discrimination of linguistic con)
Classically, in the bouba-kiki association task, a subject is asked to find the best association between one of two shapes–a round one and a spiky one–and one of two pseudowords–bouba and kiki. Numerous studies report that spiky shapes are associated with kiki, and round shapes with bouba. This task is likely the most prevalent in the study of non-conventional relationships between linguistic forms and meanings, also known as sound symbolism. However, associative tasks are explicit in the sense that they highlight phonetic and visual contrasts and require subjects to establish a crossmodal link between stimuli of different natures. Additionally, recent studies have raised the question whether visual resemblances between the target shapes and the letters explain the pattern of association, at least in literate subjects. In this paper, we report a more implicit testing paradigm of the bouba-kiki effect with the use of a lexical decision task with character strings presented in round or )
In the Speech-to-Song Illusion, repetition of a spoken phrase results in it being perceived as if it were sung. Although a number of previous studies have examined which characteristics of the stimulus will produce the illusion, there is, until now, no description of the cognitive mechanism that underlies the illusion. We suggest that the processes found in Node Structure Theory that are used to explain normal language processing as well as other auditory illusions might also account for the Speech-to-Song Illusion. In six experiments we tested whether the satiation of lexical nodes, but continued priming of syllable nodes may lead to the Speech-to-Song Illusion. The results of these experiments provide evidence for the role of priming, activation, and satiation as described in Node Structure Theory as an explanation of the Speech-to-Song Illusion. [ABSTRACT FROM AUTHOR], Copyright of PLoS ONE is the property of Public Library of Science and its content may not be copied or emailed to)
The present study investigated the interplay between selective inhibition (the ability to suppress specific competing responses) and nonselective inhibition (the ability to suppress any inappropriate response) during single word production. To this end, we combined two well-established research paradigms: the picture-word interference task and the stop-signal task. Selective inhibition was assessed by instructing participants to name target pictures (e.g., dog) in the presence of semantically related (e.g., cat) or unrelated (e.g., window) distractor words. Nonselective inhibition was tested by occasionally presenting a visual stop-signal, indicating that participants should withhold their verbal response. The stop-signal was presented early (250 ms) aimed at interrupting the lexical selection stage, and late (325 ms) to influence the word-encoding stage of the speech production process. We found longer naming latencies for pictures with semantically related distractors than with unre)
Imageability is a psycholinguistic variable that indicates how well a word gives rise to a mental image or sensory experience. Imageability ratings are used extensively in psycholinguistic, neuropsychological, and aphasiological studies. However, little formal knowledge exists about whether and how these ratings are associated between and within languages. Fifteen imageability databases were cross-correlated using nonparametric statistics. Some of these corresponded to unpublished data collected within a European research network—the Collaboration of Aphasia Trialists (COST IS1208). All but four of the correlations were significant. The average strength of the correlations (rho = .68) and the variance explained (R 2 = 46%) were moderate. This implies that factors other than imageability may explain 54% of the results. Imageability ratings often correlate across languages. Different possibly interacting factors may explain the moderate strength and variance explained in the correlations: (1) linguistic and cultural factors; (2) intrinsic differences between the databases; (3) range effects; (4) small numbers of words in each database, equivalent words, and participants; and (5) mean age of the participants. The results suggest that imageability ratings may be used cross-linguistically. However, further understanding of the factors explaining the variance in the correlations will be needed before research and practical recommendations can be made.
In Experiment 1, the symbol interdependency hypothesis was tested with both concrete and abstract stimuli. Symbolic (i.e., semantic neighbourhood distance) and embodied (i.e., iconicity) factors were manipulated in two tasks—one that tapped symbolic relations (i.e., semantic relatedness judgment) and another that tapped embodied relations (i.e., iconicity judgment). Results supported the symbol interdependency hypothesis in that the symbolic factor was recruited for the semantic relatedness task and the embodied factor was recruited for the iconicity task. Across tasks, and especially in the iconicity task, abstract stimuli resulted in shorter RTs. This finding was in contrast to the concreteness effect where concrete words result in shorter RTs. Experiment 2 followed up on this finding by replicating the iconicity task from Experiment 1 in an ERP paradigm. Behavioural results continued to show a reverse concreteness effect with shorter RTs for abstract stimuli. However, ERP results p)