Papers reviewed and determined not to be word norm studies. Use the flag icon to report errors or suggest re-inclusion.
18625 papers
A disponibilidade de recursos para o processamento computacional constitui um dos fatores de sobrevivência de uma língua. O objetivo deste trabalho foi implementar um fragmento do nheengatu no formalismo Grammatical Framework, especialmente projetado para o desenvolvimento de aplicações multilíngues. Outrora mais falado que o português na Amazônia, o nheengatu está ameaçado de extinção, embora ainda conte com estimados 14000 falantes. O fragmento restringe-se a orações que expressam estados contingentes e não-contingentes, mas inclui fenômenos gramaticais estruturalmente complexos típicos da família tupi-guarani, os quais contrastam fortemente com as construções equivalentes em português e inglês. Constitui um dos módulos da GrammYEP, uma gramática computacional multilíngue que integra módulos análogos do inglês e do português. A implementação tomou como ponto de partida as descrições gramaticais não formalizadas de Navarro (2011) e Cruz (2011). A formalização revelou lacunas e inconsistências nessas abordagens, em parte sanados por meio de uma reanálise dos dados. A GrammYEP alcançou resultados bastantes satisfatórios na tradução do e para o nheengatu. Traduziu para o português e o inglês a totalidade de um conjunto-teste de 142 sentenças dessa língua. Inversamente, verteu para o nheengatu 98,18% e 84,11% dos conjuntos-teste correspondentes em português e inglês. Por outro lado, analisou apenas dois exemplos de um conjunto-teste negativo com 171 construções agramaticais em nheengatu. Desta avaliação resultou um treebank com 243 sentenças do nheengatu, emparelhadas com as sentenças equivalentes em português e inglês.
Abstract Classical views suggest that experienced affect is related to a specific bodily response ( Fingerprint hypothesis ), whereas recent perspectives challenge this view postulating that similar affective experiences rather evoke different physiological responses. To further advance this debate in the field, we used representational similarity analysis (N= 64) to investigate the correspondence between subjective affect (arousal and valence ratings) and physiological reactions (skin conductance response [SCR], startle blink response, heart rate and corrugator activity) across various emotion induction contexts (picture viewing task, sound listening task and imagery task). Significant similarities were exclusively observed between SCR and arousal in the picture viewing task. However, none of the other physiological measures showed a significant relation with valence and arousal ratings in any of the tasks. These findings tend to support the populations hypothesis, suggesting that there is no clear match between the evoked physiological responses and the experienced subjective affect between individuals. Statement of relevance The subjective affective experience evoked by an event is accompanied by physiological responses. The correspondence between physiological response patterns and the experienced affect, however, is still under debate. Classical views ( Fingerprint hypothesis ) suggest that affect is related to a specific physiological response, whereas recent perspectives ( Populations hypothesis ) challenge this view, postulating rather different physiological responses. In the current study, we used representational similarity analysis (RSA) to examine the relation between affective experience, assessed using valence and arousal ratings, and the evoked physiological reactivity across three affect-inducing contexts. Results showed significant similarities exclusively between SCR and arousal in the passive picture viewing task. However, none of the other physiological measures showed a significant relation with valence and arousal ratings in any of the tasks, supporting the populations hypothesis. These findings invite to reframe the relation between physiology and affect from invariant and homogeneous to variant and context-dependent.
To the Editor: Coronavirus disease 2019 (COVID-19), which broke out in 2019, has become a global pandemic. Similar to severe acute respiratory syndrome coronavirus (SARS-CoV) in 2003, SARS-CoV-2 could cause acute lung injury and cytokine storms characterized by the increased interleukin (IL)-8, IL-6, and tumor necrosis factor α (TNF-α).[1] Perspective studies in those survivors from the severe acute respiratory syndrome (SARS) epidemic in 2003 revealed that those SARS patients manifested varying degrees of pulmonary interstitial fibrosis.[2] Similarly, patients with severe COVID-19 are also featured by the diffuse alveolar damage along with alveolar interstitial fibrosis.[3] Pirfenidone (Beijing Contini Pharmaceutical Co., Ltd, Beijing, China) can inhibit the biological activity of fibroblasts and reduce matrix collagen deposition, prevent inflammasome activation and limit oxidative stress responses, supporting a therapeutic potential against idiopathic pulmonary fibrosis (IPF).[4] Given the presence of alveolar interstitial fibrosis in severe COVID-19 patients and the effect of pirfenidone on anti-inflammatory responses and anti-fibrosis, we hypothesized that pirfenidone can play a positive role in COVID-19 patients, thereby reducing the incidence of complications following SARS-CoV-2 infection. We thus conducted a clinical trial to assess the potential therapeutic effect of pirfenidone on severe COVID-19 patients. This trial (ClinicalTrials.gov number: NCT04282902; Chinese Clinical Trial Register number: ChiCTR2000030333) was conducted from January 31 to March 3, 2020 at Tongji Hospital (Headquarters Campus, Caidian Campus, Guanggu Campus) and Jingzhou Hospital (Hubei, China), which was approved by the Institutional Review Board of Tongji Hospital and Jingzhou Hospital. Male and non-pregnant female COVID-19 patients (≥18 years) with a blood oxygen saturation (SaO2) of 94% or less, and a ratio (PaO2:FiO2) of ambient air or partial oxygen pressure (PaO2) to inhaled oxygen (FiO2) of 300 mmHg or less, were eligible for the study. The exclusion criteria were: patient disinterest in the study; the presence of conditions that did not allow for safe compliance, including hypersensitivity to pirfenidone; liver disease (eg, alanine aminotransferase levels >5 times the upper limit of the normal range [ULN] or aspartate aminotransferase levels >5 times ULN; contraindications of pirfenidone and pre-existing interstitial lung disease [ILD]). Consecutive patients, who meet the inclusion criteria, were randomly assigned in a 1:1 ratio to pirfenidone (200 mg, three times daily for the first two days and 400 mg, three times daily thereafter) plus standard therapy or standard therapy alone. Pirfenidone was given through a nasogastric tube in patients who were unable to swallow. The primary end-point was the absolute changes from baseline in the total score on the King's Brief Interstitial Lung Disease (K-BILD) questionnaire at the 4th week, a change between 4 and 8 points has been suggested to represent a meaningfulchange. Secondary endpoint was the absolute change in computed tomography (CT) values, the total CT value was the sum of individual lobe values and ranged from 0 (no involvement) to 25 (maximum involvement). Other secondary outcomes included clinical laboratory findings (cytokines, biochemical indicators, etc) and the proportion of patients with clinical improvement. Safety outcomes included adverse events that occurred during treatment and premature discontinuation of treatment. Adverse events were classified according to the National Cancer Institute Common Terminology Criteria for Adverse Events, version 4.0 [Supplementary methods in Supplementary materials, https://links.lww.com/CM9/A929]. A total of 146 COVID-19 patients were recruited, 124 of which were from Tongji Hospital and the rest 22 were from the Central Hospital in Jingzhou. Seventy-three patients were randomly assigned for pirfenidone treatment, and the remaining 73 patients received the standard treatment alone [Supplementary Figure 1, https://links.lww.com/CM9/A647]. The median age of patients was 62.0 years (interquartile range [IQR] 53.5–68.5 years), and 64.38% of patients were males. The median interval time between symptom onset and randomization was 40 days (IQR, 25–50 days). At the time of admission, there were no significant differences between the two groups in terms of demographic characteristics, basic laboratory assays, clinical treatment K-BILD scores, and CT scores [Supplementary Table 1, https://links.lww.com/CM9/A646]. Although the difference of K-BILD scores did not reach a statistical significance after treatment (75.93 ± 10.07 vs. 76.33 ± 9.15, P = 0.911), a trend for the increase from baseline in patients following a 4-week of pirfenidone treatment was noted as compared to that of patients assigned in the standard treatment group (ΔK-BILD, 26.53 ± 11.12 vs. 22.73 ± 8.00; 3.80 [95% confidence interval, CI = −4.87 to 12.47]) [Supplementary Table 2, https://links.lww.com/CM9/A646]. Similarly, there was no significant difference between two groups in terms of CT images (P = 0.745) after a 4-week of treatment, but some score changes including consolidation (0.30 ± 0.65 vs. 1.07 ± 1.17, P = 0.007), GGO (−12.27 ± 5.72 vs. −11.57 ± 4.07; between-group difference = −0.70, 95% CI = −2.97 to 1.57), and reticulation (−0.90 ± 5.26 vs. −0.30 ± 6.98; between-group difference = −0.60, 95% CI = −3.40 to 2.20) were observed, which reflected the improvement of lung inflammation and interstitial changes [Supplementary Table 3, https://links.lww.com/CM9/A646 and Supplementary Figure 2, https://links.lww.com/CM9/A648]. The levels of pulmonary inflammatory cytokines or coagulopathy biomarker from baseline to the 4th week after receiving treatment were significantly decreased in the pirfenidone group as compared to those from the standard care group, such as IL-2R (−299.00, 95% CI = −430.50 to −105.00, P = 0.010), TNF-α (−3.50, 95% CI = −5.00 to −0.10, P = 0.049), and D-Dimer (−4.57, 95% CI = −8.98 to −0.16, P = 0.021) [Supplementary Table 2, https://links.lww.com/CM9/A646]. In addition, the duration of patients in pirfenidone group from randomization to hospital discharge and in intensive care unit was reduced by 2 days (11.21 ± 10.06 vs. 13.21 ± 16.63 days, −2 days, 95% CI = −9.27 to 5.27; 19.00 [IQR 15.00–22.00] vs. 22.00 [IQR 16.50–25.50]; −2 days, 95% CI = −3.50 to 8.50) [Supplementary Table 2, https://links.lww.com/CM9/A646]. No significant difference was noted for other outcomes such as clinical improvement time, duration of oxygen therapy, and time from randomization to death. However, all patients survived in the pirfenidone treatment group, and two patients were declined to death in the standard care group. The proportional distribution of primary endpoint categories at days 1, 7, 14, and 28 in each patient was presented in Supplementary Figure 3, https://links.lww.com/CM9/A649 and Supplementary Table 3, https://links.lww.com/CM9/A646. The percentages of patients with any adverse event or serious adverse event were similar between the patients from both groups. Among patients with adverse events, 11% (8/73) of patients reduced the dose of pirfenidone and 3% (2/73) of patients discontinued. Among those eight patients with pirfenidone reduced-dose, four cases were reduced to 600 mg/day due to gastrointestinal discomfort and the remaining four cases were reduced to 600 mg/day due to rash. The most common adverse event was diarrhea, which was reported in 11 out of 73 (15%) patients from the pirfenidone group. Some patients have elevated alanine aminotransferase and alanine aminotransferase level [Supplementary Figure 3 and Supplementary Table 2, https://links.lww.com/CM9/A646, https://links.lww.com/CM9/A649]. Given that the COVID-19 is a type of infectious disease that could be transmitted through the respiratory tract, lung function test was not included in this study. According to previous studies, patients infected with SARS-CoV-2 are far more likely to form an interstitial change in the lung, while our statistical indicators including K-BILD and CT image ratings reflected improved situation in terms of interstitial changes in pirfenidone treated patients. However, we failed to observe a significant difference between the two groups both for K-BILD and CT scores. Since our observation period only lasted for 4 weeks, our trial did not yield a significantly positive result, and the observation time could be a major factor. It was noted that pirfenidone did not improve fibrosis, but it did not make the disease worse. Nevertheless, pirfenidone did manifest a strong effect on mitigating the cytokine storm, which seems to be responsible for the complications in severe COVID-19 patients. Indeed, comparative analysis revealed that the levels of IL-2R and TNF-α were decreased significantly following pirfenidone administration. Although the anti-inflammatory effect has not been widely appreciated, pirfenidone has been shown to downregulate inflammatory pathways and the compound may have considerable potential to be deployed as a non-steroidal anti-inflammatory agent.[5,6] To our surprise, our study also found that pirfenidone could significantly decrease the level of D-Dimer, which is relevant to the coagulopathy in the blood. There is evidence that COVID-19 renders patients with an increased risk for acute pulmonary embolism, and anticoagulant therapy might be associated with improved outcomes in patients with severe COVID-19.[7] Therefore, treatment of COVID-19 with pirfenidone may have the potential to reduce the incidence of thrombosis complications. The safety and side-effect profile of pirfenidone in patients with severe COVID-19 associated ILD was similar to that observed in patients with IPF.[8] Despite the presence of certain side effects, but they could be easily managed with supporting therapies and temporary dose reductions or discontinuation. No fatal events were reported in our study, confirming the good safety profile of this drug even in fragile patients. Our study also has several limitations. First, our sample size is limited. Second, although we have tried to avoid bias as much as possible during the trial, while this possibility cannot be completely excluded. Third, our trial lacks of dynamic clinical and laboratory data such as immune cell subsets and so on. Finally, our trail only lasted a 4-week of observation time, which could be a factor to confirm the antifibrotic effect of pirfenidone. In addition, glucocorticoids could also be a potential factor influencing the results of the study, even though there was no significant difference in the initial dosage, total dosage, and duration of treatment between the two groups. Although pirfenidone has not been found to significantly improve the interstitial changes in severe COVID-19 patients, the trial, however, confirmed the benefits of pirfenidone therapy in anti-inflammatory responses, and obtained feasible evidence supporting a potential benefit in anti-thrombotic complications. Collectively, our study found that pirfenidone can be considered as a viable drug to treat patients with severe COVID-19, and confirmed that pirfenidone possesses a good tolerability profile without safety alert. Funding This study was supported by grants from the SARS-CoV-2 Pneumonia Emergency Technology Public Relation Project of Tongji Medical College, Huazhong University of Science and Technology (No. 2020kfyXGYJ043), the National Natural Science Foundation of China (No. 81974456); and the SARS-CoV-2 Pneumonia Emergency Technology Public Relation Project (No. 2020FCA009). Conflicts of interest None.
Current practices to apply temperature scaling assume either a fixed, or a manually-crafted dynamically changing schedule. However, our studies indicate that the individual optimal trajectory for each class can change with the context. To this end, we propose context-aware temperature, a generalized approach to provide an individual optimal temperature trajectory over the context for each vocabulary, while allowing the temperature to be learned along with the remaining model parameters during training. Experiment results confirm that the proposed method significantly improves state-of-the-art language models, achieving a perplexity of 19.90 on Penn Treebank, 33.88 on WikiText-2, and 4.7 on WikiText-103.
As an engineering field, research on natural language processing (NLP) is much more constrained by currently available resources and technologies, compared with theoretical work on computational linguistics (CL). In today’s technology-driven society, it is almost impossible to imagine the degree to which computational resources, the capacity of secondary and main storage, and software technologies were restricted when I embarked upon my research career 50 years ago. While these restrictions inevitably shaped my early research into NLP, my subsequent work evolved, according to the significant progress made in associated technologies and related academic fields, particularly CL.Figure 1 shows the research topics in which I have been engaged. My initial NLP research was concerned with a question answering system, which I worked on during my M.Eng and D.Eng degrees. The research focused on reasoning and language understanding, which I soon found was too ambitious and ill-defined. After receiving my D.Eng., I changed my direction of research, and began to be engaged in processing forms of language expressions, with less commitment to language understanding, machine translation (MT), and parsing. However, I returned to research into reasoning and language understanding in the later stage of my career, with clearer definitions of tasks and relevant knowledge, and equipped with access to more advanced supporting technologies.In this article, I begin by briefly describing my views on mutual relationships among disciplines related to CL and NLP, and then move on to discussing my own research.Language is a complex topic to study, infinitely harder than I first imagined when I began to work in the field of NLP.There is a whole discipline on the study of language—namely, linguistics. Linguistics is concerned not only with language per se, but must also deal with how humans model the world.1 The study of semantics, for example, must relate language expressions to their meanings, which reside in the mental models possessed by humans.Apart from linguistics, there are two fields of science that are concerned with language, that is, brain science and psychology. These are concerned with how humans process language. Then, there are two disciplines in which we are involved—namely, CL and NLP.Figure 2 is a schematic view of these research disciplines. Both of the lower disciplines are concerned with processing language, that is, how language is processed in our minds or our brains, and how computer systems should be designed to process language efficiently and effectively.The top discipline, linguistics, on the other hand, is concerned with rules that are followed by languages. That is to say, linguists study language as a system. This schematic view is certainly oversimplified, and there are subject fields in which these disciplines overlap. Psycholinguistics, for example, is a subfield of linguistics which is concerned with how the human mind processes language. A broader definition of CL may include NLP as its subfield.In this article, for the sake of discussion, I adopt narrower definitions of linguistics and CL. In this narrower definition, linguistics is concerned with the rules followed by languages as a system, whereas CL, as a subfield of linguistics, is concerned with the formal or computational description of rules that languages follow.2CL, which focuses on formal/computational description of languages as a system, is expected to bridge broader fields of linguistics with the lower disciplines, which are concerned with processing of language.Given my involvement in NLP, I would like to address the question of whether the narrowly defined CL is relevant to NLP. The simple answer is yes. However, the answer is not so straightforward, and requires us to examine the degree to which the representations used to describe language as a system are relevant to the representations used for processing language.Although my colleagues and I have been engaged in diverse research areas, I pick up only on a subset of these, to illustrate how I view the relationships between NLP and CL. Due to the nature of the article, I ignore technical details and focus instead on the motivation of the research and the lessons which I have learned through research.Background and Motivation. Following the ALPAC report Pierce et al. (1966), research into MT had been largely abandoned by academia, with the exception of a small number of institutes (notably, GETA at Grenoble, France, and Kyoto University, Japan). There were only a handful of commercial MT systems, being used for limited purposes. These commercial systems were legacy systems that had been developed over years and had become complicated collections of ad hoc programs. They had become too convoluted to allow for changes and improvements. To re-initiate MT research in academia, we had to have more systematic and disciplined design methodologies.On the other hand, theoretical linguistics, initiated by Noam Chomsky (Chomsky 1957, 1965) had attracted linguists with a mathematical orientation, who were interested in formal frameworks of describing rules followed by language. Those linguists with interests in formal ways of describing rules were the first generation of computational linguists.Although computational linguists did not necessarily follow the Chomskyan way of thinking, they shared the general view of treating language as a system of rules. They had developed formal ways of describing rules of language and showed that these rules consisted of different layers, such as morphology, syntax, and semantics, and that each layer required different formal frameworks with different computational powers. Their work had also motivated work on how one could process language by computerizing its rules of language. This work constituted the beginning of NLP research, and resulted in the development of parsing algorithms for context-free language, finite-state machines, and so forth.3 It was natural to use this work as the basis for designing the second generation of MT systems, which was initiated by an MT project (MU project, 1082-1986) led by Prof. M. Nagao (Nagao, Tsujii, and Nakamura 1985).Research Contributions. When I began research into MT in the late 1970s, there was a common view largely shared by the community, which had been advocated by the group of GETA, in France. The view was called the transfer approach of MT (Boitet 1987).The transfer approach viewed translation as a process consisting of three phases: analysis, transfer, and generation. According to linguists, a language is a system of rules. The analysis and generation phases were monolingual phases that were concerned with a set of rules for a single language, the analysis phase using the rules of the source language and the generation phase using the rules of the target language. Only the transfer phase was a bilingual phase.Another view shared by the community was an abstraction hierarchy of representation, called the triangle of translation. For example, Figure 3(a)4 shows the hierarchy of representation used in the Eurotra project, with their definition of each level (Figure 3(b)).By climbing up such a hierarchy, the differences among languages would become increasingly small, so that the mapping (i.e., the transfer phase) from one language to another would become as simple as possible. Independently of the target language, the goal of the analysis phase was to climb up the hierarchy, while the aim of the generation phase was to climb down the hierarchy to generate surface expressions in the target language. Both phases are concerned only with rules of single languages.In the extreme view, the top of the hierarchy was taken as the language-independent representation of meaning. Proponents of the interlingual approach claimed that, if the analysis phase reached this level, then no transfer phase would be required. Rather, translation would consist only of the two monolingual phases (i.e., the analysis and generation phases).However, in Tsujii (1986), I claimed, and still maintain, that this was a mistaken view about the nature of translation. In particular, this view assumed that a translation pair (consisting of the source and target sentences) encodes the same “information”. This assumption does not hold, in particular, for a language pair such as Japanese and English, that belong to very different language families. Although a good translation should preserve the information conveyed by the source sentence as much as possible in the target sentence, translation may lose some information or add extra information.5Furthermore, the goal of translation may not be to preserve information but to convey the same pragmatic effects to readers of the translation.More seriously, the abstract level of representation such as Interface Structure6 in Eurotra focused only on the propositional content encoded in language, and tended to abstract away other aspects of information, such as the speaker’s empathy, distinction of old/new information, emphasis, and so on.To climb up the hierarchy led to loss of information in lower levels of representation. In Tsujii (1986), instead of mapping at the abstract level, I proposed “transfer based on a bundle of features of all the levels”, in which the transfer would refer to all levels of representation in the source language to produce a corresponding representation in the target language (Figure 4). Because different levels of representation require different geometrical structures (i.e., different the of this had to for development of a mathematical of representation with which levels (i.e., to be with their mutual relationships the we to the transfer phase was transfer and Tsujii which was by the of in CL. According to the views of linguists at the a language is an set of expressions in is defined by a set of rules. this number of one generate infinitely of the language. claimed that the of a was by the of its using the rules that the translation the same to translation. That is, the translation of a was by the of its In this of infinitely of the source language could be the translation the translation of a sentence would be by a of a source The translation of a would then be by the of its That is, translation would be in a up from of translation to the mapping of a from the source to the target would be by the of the the for the how to a to the In the project, we called this transfer and Tsujii (Figure with the MT systems, which source expressions with target in an and ad hoc the of transfer in the project was defined and and development of the MT systems from research into CL, more defined and design than MT The project and MT systems the of these design we could not have these in such a of the differences between the of the two disciplines also CL to focus on aspects of language as morphology, syntax, semantics, MT systems must be to all aspects of information conveyed by language. As climbing up a hierarchy that focuses on propositional content does not in good more between CL and NLP is the of of is the single significant in NLP it requires the in which expressions to be to be In other it requires understanding of of are in Figure The Japanese a of in and would be into have and so on the for with transfer, it requires to be (i.e., the in which a to be The nature of made the process of transfer was also a in the analysis which I in the general of CL or linguistics is that it to view language as an system and the of understanding, which requires to or However, NLP require an understanding or of language expressions in of and which may other such as and so I this in the on the of research.Background and Motivation. the I was engaged in MT research, in CL, its early in theoretical linguistics by Chomsky assumed that of of rules the two levels of that is, and surface A way of was also shared by the MT They assumed that climbing up the hierarchy would of which from the representation at one level to another representation at the Because each level of the hierarchy required its own geometrical it was not possible to have a representation, in which representations of all the levels view was changed by the of that used to allow of from one level to it mutual relationships among different levels of representation in a This view was in with our of transfer, which used a bundle of features of different levels for some at the the of That is, structures of all the levels are constrained by the of a and these are encoded in This was also in with our significant development in CL at the same a number of the and the had linguistics and to have significant on research into CL and NLP et al. the NLP of view, the of led to the development of (i.e., for research that would these two to the analysis is, parsing based on Contributions. It is claimed that of In the analysis phase of the up the lower levels of processing could not refer to in levels of representation. This was the main of the of at the early of climbing up the analysis could not refer to that in analysis would the other hand, the could describe at all levels in a single it was possible to refer to at all to down the set of possible in the was still This was we not have ways of and pragmatic linguists were interested in formal ways for and levels of representation, but not so much in how are to be To or pragmatic one may have to refer to the mental models of the (i.e., how humans the or structures single and so These of the of CL research at the main focus is on it is whether or be used as They may be more concerned with the of an than the which an should example, the in for parsing using of and how to the of for models were one of the for and the of an However, models for such as and context-free had to be changed for more complex for such as had to be for were in of describing in a the which was a for treating was very To NLP systems, we had to technologies and processing for at the of to study how we could a into and representations for parsing. The research of an abstract machine for processing of structures and development of a et al. et al. into a more representation, such as and Tsujii et al. and from of structures and models and Tsujii of parsing based on of and their and Tsujii et al. representation of our parsing model is in Figure a sentence, its representation of all the levels was at the stage by using the in the first two The first phase was a that would to in a were from the and a set of were to a in its A would the of for the of The was a which could be in a very and Tsujii This that the surface (i.e., of was used for of second phase was A which also was from the was used to whether of by the first phase could a The did not to whether a could or The second phase of would that could not phase not only the representation of all the but it also extra in the Because the first two phases only use in the the phase would by the first two phases if they to these extra In this the system would to the phases to the of these research a based on As in CL were for the systematic development of NLP changed the view of parsing as up the the systematic of of of into and so These also for in NLP such as of and so which are for treating the other hand, of CL to NLP did not this would in had to into more which required significant and on the NLP For example, we had to the into such as and so It is that, while the was to the hierarchy each stage in the was defined and related to each other through the single also that in the fields of computer changed was possible to in NLP. For example, the design of an abstract machine and its for in et al. systems for of and Tsujii Tsujii, and and so would be impossible in the broader fields of computer and much computational et al. the other hand, the in NLP. models in of the with the that we for the the NLP community with systematic ways of with of different models also which made systematic development of NLP systems possible. However, the in parsing still are the in of the number of was the sentence level, the That is, a sentence in which all are very Because of are (i.e., of or of in such as of and Tsujii using there are to a understanding is taken into This to the research language and and Motivation. I was interested in the topic of how to relate language with at the very beginning of my the my led to that a of could be used as a and was engaged in research of a system based on a and Tsujii However, resources such as a of processing of computer systems, and NLP technologies, such as were not available at the soon that the research would a whole of research topics in such as representation of common human ways of and so the topics had to deal with and of or the models that humans have may from one to I that the research target was through research in MT and parsing in the later of my career, I to that NLP research is if it how is in and that NLP are all related to of understanding and the same NLP as an engineering field, I it to be to have a definition of or information with which language is to be I would like to too much of research into and reasoning and to our research focus to the between language and As a research I to focus on the as the There were two for the was that colleagues at the two with which I was that, in to it had become increasingly for to of information in a of in diverse subject fields such as and In to the of they also had diverse that had to be with each In other they had a of shared by that was to be with information in other was that there were colleagues at the of who were interested in According to the on information in a by the group and research into at the of on between and and et al. the had been a natural of The was that information in a and were defined by the target and not by NLP had and to their own in the target Contributions. Although there had been a of research into information and for the there had been no to NLP to in the To address the at the of and the of a research in this this was a research we first had to tasks to to resources, and to not only NLP but also in the target the involvement of NLP and we found that a in the also began to be interested in research In to we a number of research in with colleagues the which led to of a at The first in with the The and shared It been and become one of the in NLP The research field of of NLP to is to et al. et al. and science et al. by the two include the et al. and Tsujii a of with their and Tsujii the et al. the et al. a design for information et al. an system based on Tsujii, and a system for et al. is one of the used in the To information in and how it was encoded in language, we not only from the of view but also from the of of and and and were to the et al. were with of the target which had been by the target to information in diverse in we developed a with which is used by the NLP In with we defined a set of NLP tasks et al. and Tsujii and Tsujii et al. and developed a set of et al. et al. et al. for which were to be into to of of et al. et al. a of this we between such as and and such as and and that (Figure The mapping between structures and the defined by was more complex than the mapping assumed by computational soon that, as an NLP information was very different from In particular, there were differences between the information that the to convey and in and the information that the readers (i.e., a group of to and from of the information that the to the would the information that they were interested of as an NLP made the mapping from language to information very different from the transfer phase in which to the same information in the source and target languages. While the of from structures (i.e., and their structures would only for the of and and these were to be with other The mapping to the transfer based on a bundle of the transfer in the level of representation, we first used the to climb up the hierarchy to the we called from which we to a set of to (Figure assumed that, based on surface of may be this would at a level of is, the same approach to simple transfer at the abstract Although this approach it soon reached its increasingly and we that this was of the nature of and to the approach based on a bundle of features (Figure et al. This to the research, which a language model In this information is assumed to be in the language The information is not in systems (Figure and et al. the other hand, our in the tasks and of In this it that structures more significant example, about an from different each As for the or of are fields such as and about an be made or with different of To the degree of of a we have to examine the of in which the is et al. and on the of an in a sentence, it may be as a and so The in which information by a be to and an research of an is the of in which an NLP system is used to a set of different from different to a of et al. In this a system must be to whether two in different be as the same in a To the system must be to the in which two by the of the This may also require structures to be taken into on the we forms of (i.e., by the target and diverse which include The of information in with these resources to research topics on the between language and of the target Because such as have views on which of information their knowledge, we the and of that may have research in the general with which NLP technologies such as parsing have been less than we research into the of information to the of is the nature of human The CL and NLP to reasoning as a of process based on However, the reasoning that the in the may not be so in example, we found that the reasoning by on is based on between For example, they that a A is to be in an by a that a which is to is in the same of The between A and is based on the between their Because such among are in their in language models on a of would be to their (i.e., a of also to such it may be to use of information, such as of collections of and so to such among and to reasoning based on have the progress and significant changes that models and have to the field of NLP. This is a in which in broader fields of computer up to and the NLP changes by and are and have had a not only on NLP but also and other of It is a the of diverse NLP I it the NLP by NLP with the processing of other information and with and so fields such as and reasoning based on used different and processing They the same basis of and It is much to forms of that NLP in and NLP with are more than we The research of the with which I are on these et al. et al. and the NLP based on language models is increasingly from other research disciplines that the study of language. The nature of and also the way of NLP systems the are very I that the may to by MT could the by computational but and systematic analysis of this to and the of the through analysis of parsing when the of analysis based on by other disciplines, and of NLP systems and the other hand, CL to language as a system or focus on study on aspects of that language in NLP systems, with NLP CL would be to the of their and to a theoretical basis for of NLP is the to NLP and was to the field of NLP by my who was a of the away It is that I could not my and with my career of almost 50 I have research into NLP at institutes Kyoto of the of and I the on of the research and who worked with at these my research could not have in the way that it I their
This work provides the first in-depth analysis of genre in Universal Dependencies (UD). In contrast to prior work on genre identification which uses small sets of well-defined labels in mono-/bilingual setups, UD contains 18 genres with varying degrees of specificity spread across 114 languages. As most treebanks are labeled with multiple genres while lacking annotations about which instances belong to which genre, we propose four methods for predicting instance-level genre using weak supervision from treebank metadata. The proposed methods recover instance-level genre better than competitive baselines as measured on a subset of UD with labeled instances and adhere better to the global expected distribution. Our analysis sheds light on prior work using UD genre metadata for treebank selection, finding that metadata alone are a noisy signal and must be disentangled within treebanks before it can be universally applied.
Arabic is a highly systematic language where its words exhibit elegant and rigorous logic. The field of Arabic word semantic similarity becomes more challenging due to its higher complexity and subtlety. This research is concerned with investigating the development of free open-source frameworks containing packages to calculate the semantic similarity between two Arabic words or concepts. These packages are known as AWN-ConceptSimilarity and AWN-WordSimilarity. The developed packages implement seven semantic similarity algorithms. One of these algorithms was proposed for Arabic and the rest were proposed for English where successfully adapted to Arabic using an Arabic lexical database, Arabic wordnet. The functionality of the developed packages is validated using two-word similarity benchmarks datasets previously produced for Arabic. The results of the validation process indicate that the developed frameworks represent an important contribution to the Arabic semantic similarity field. Moreover, the developed packages are reliable to use and embed them with Arabic researchers' projects for improving or comparing their methodologies.
Unlike English letters, Chinese characters have rich and specific meanings. Usually, the meaning of a word can be derived from its constituent characters in some way. Several previous works on syntactic parsing propose to annotate shallow word-internal structures for better utilizing character-level information. This work proposes to model the deep internal structures of Chinese words as dependency trees with 11 labels for distinguishing syntactic relationships. First, based on newly compiled annotation guidelines, we manually annotate a word-internal structure treebank (WIST) consisting of over 30K multi-char words from Chinese Penn Treebank. To guarantee quality, each word is independently annotated by two annotators and inconsistencies are handled by a third senior annotator. Second, we present detailed and interesting analysis on WIST to reveal insights on Chinese word formation. Third, we propose word-internal structure parsing as a new task, and conduct benchmark experiments using a competitive dependency parser. Finally, we present two simple ways to encode word-internal structures, leading to promising gains on the sentence-level syntactic parsing task.
This is a small hand-annotated partial treebank of Modern Tibetan, primarily in CoNLL-U format. Some texts were POS-tagged by machine, and then dependency relations between verbs and their arguments were added by hand. Other texts include only dependency relations and relevant POS-tags. A number of the texts have English translations which have been manually aligned to the Tibetan text. This work was created as part of the AHRC-funded project <em>Lexicography in Motion</em> (PI Ulrich Pagel, 2017-2021).
In the prefaces to his French translations of Tacitus (1640) and Lucian (1654), Nicolas Perrot d’Ablancourt rationalizes his substantial revisions by appealing to the canons of French literary taste that his translations helped to form. This view resulted in translations that were clearer and more stylistically felicitous than the source texts, but also bowdlerized so as to avoid any violation of French linguistic norms as well as any moral offense. Perrot d’Ablancourt is very much aware that his discursive strategies flouted conventional notions of equivalence. Yet he makes clear that his domesticating choices are not arbitrary, but based on an interpretation that displays an acute sense of historical difference. He just does not feel that this difference is worth preserving in itself and certainly not at the cost of departing from an elegant style as he conceives it.
In this paper we address the problem of the combined representation of heterogeneous sources of knowledge within a unique and homogeneous data structure. The goal is ultimately to enable the holistic processing of linguistic and world knowledge, where all the dimensions may interact seamlessly. We focus here on bridging the gap between Syntax and Semantics. We propose to link an abstract grammar to an existing lexical network through the adoption of the same underlying graph structure. The resulting structure may be seen as a multi-layer linguistic network. The solution we introduce for the abstract grammar layer relies on a graph-theoretic interpretation of Property Grammar. The typed structure we propose supersedes both phrase structure and dependency structure, which are covered with specific relation types-Constituency and Dependency respectively. We present a procedure to derive the grammar from an annotated corpus, and we illustrate the procedure with the French Treebank.
There is empirical evidence that expected yet not current affect predicts decisions.However, common research designs in affective decision-making show consistent methodological problems (e.g., conceptualization of different emotion concepts; measuring only emotional valence, but not arousal).We developed a gambling task that systematically varied learning experience, average feedback balance and feedback consistency.In Experiment 1 we studied whether predecisional current affect or expected affect predict recurrent gambling responses.Furthermore, we exploratively examined how affective information is represented on a neuronal level in Experiment 2. Expected and current valence and arousal ratings as well as Blood Oxygen Level Dependent (BOLD) responses were analyzed using a within-subject design.We used a generalized mixed effect model to predict gambling responses with the different affect variables.Results suggest a guiding function of expected valence for decisions.In the anticipation period, we found activity in brain areas previously associated with valencegeneral processing (e.g., anterior cingulate cortex, nucleus accumbens, thalamus) mostly independent of contextual factors.These findings are discussed in the context of the idea of a valence-general affective work-space, a goal-directed account of emotions, and the hypothesis that current affect might be used to form expectations of future outcomes.In conclusion, expected valence seems to be the best predictor of recurrent decisions in gambling tasks.
Recent years have witnessed significant improvement in ASR systems to recognize spoken utterances. However, it is still a challenging task for noisy and out-of-domain data, where substitution and deletion errors are prevalent in the transcribed text. These errors significantly degrade the performance of downstream tasks. In this work, we propose a BERT-style language model, referred to as PhonemeBERT, that learns a joint language model with phoneme sequence and ASR transcript to learn phonetic-aware representations that are robust to ASR errors. We show that PhonemeBERT can be used on downstream tasks using phoneme sequences as additional features, and also in low-resource setup where we only have ASR-transcripts for the downstream tasks with no phoneme information available. We evaluate our approach extensively by generating noisy data for three benchmark datasets - Stanford Sentiment Treebank, TREC and ATIS for sentiment, question and intent classification tasks respectively. The results of the proposed approach beats the state-of-the-art baselines comprehensively on each dataset.
Neural machine translation (NMT) models are typically trained using a softmax cross-entropy loss where the softmax distribution is compared against the gold labels. In low-resource scenarios and NMT models tend to perform poorly because the model training quickly converges to a point where the softmax distribution computed using logits approaches the gold label distribution. Although label smoothing is a well-known solution to address this issue and we further propose to divide the logits by a temperature coefficient greater than one and forcing the softmax distribution to be smoother during training. This makes it harder for the model to quickly over-fit. In our experiments on 11 language pairs in the low-resource Asian Language Treebank dataset and we observed significant improvements in translation quality. Our analysis focuses on finding the right balance of label smoothing and softmax tempering which indicates that they are orthogonal methods. Finally and a study of softmax entropies and gradients reveal the impact of our method on the internal behavior of our NMT models.
The article analyzes transformation of forms of degrees of comparison of adjectives in live television broadcasting. Particular attention is paid to the specific properties of different forms of degrees of comparison of adjectives. To analyze the peculiarities of their use for errors in speech of television journalists, associated with non-compliance with linguistic norms on ways to avoid these errors, to make appropriate recommendations to television journalists. The main method we use is to observe the speech of live TV journalist, we used during the study methods of comparative analysis of comparison of theoretical positions from the work of individual linguists and journalism sat down as well as texts that sounded in the speech of journalists. Our objective is to trace these transformations and develop a certain attitude towards them in our researches of the language of the media and practicing journalists to support positive trends in the development of the broadcasting on TV and give recommendations for overcoming certain negative trends. Improving the live broadcasting of television journalists, in particular the work on deepening the language skills will contribute to the modernization of some trends in the reasonable expediency of the transformation of certain phenomena, modernization of some tendencies concerning the reasonable expedient transformation of separate grammatical phenomena and categories and at braking and in general stopping of processes of transformation of negative unreasonable not expedient. This fully applies primarily to attempts to transform the forms of degrees of comparison of adjectives and this explains importance of the results achieved in these study.
International audience
Machine learning training methods depend plentifully and intricately on hyperparameters, motivating automated strategies for their optimisation. Many existing algorithms restart training for each new hyperparameter choice, at considerable computational cost. Some hypergradient-based one-pass methods exist, but these either cannot be applied to arbitrary optimiser hyperparameters (such as learning rates and momenta) or take several times longer to train than their base models. We extend these existing methods to develop an approximate hypergradient-based hyperparameter optimiser which is applicable to any continuous hyperparameter appearing in a differentiable model weight update, yet requires only one training episode, with no restarts. We also provide a motivating argument for convergence to the true hypergradient, and perform tractable gradient-based optimisation of independent learning rates for each model parameter. Our method performs competitively from varied random hyperparameter initialisations on several UCI datasets and Fashion-MNIST (using a one-layer MLP), Penn Treebank (using an LSTM) and CIFAR-10 (using a ResNet-18), in time only 2-3x greater than vanilla training.
The purpose of this study is to examine the orthographic and phonological characteristics of the Yeongsan Sillok(the biography of Yeongsan), published in Jeollabuk-do in the early 20th century. The author of this book is considered to be Jang Bong-seon, an educator from Jeongeup city in Jeollabuk-do. Accordingly, it is expected that this book contains the orthographic characteristics and attitudes toward the language of young intellectuals in Jeollabuk-do in the early 20th century. In Chapter 3, we looked at the orthographic characteristics of this book. The writing characteristics of this book largely follow the characteristics of the 19th century Jeollabuk-do dialect based on the tradition of modern Korean. However, a transitional characteristic of the language transforming into present-day Korean was also present. Although only a few examples have been confirmed, the writing of double consonant letters for tense consonant are gradually similar to the notation method of modern Korean. This can be understood as a dissolution process. At the same time, with the exception of some circumstances of verbs, the tendency to split consonants is widely confirmed, and the modern Korean notation for the /ㄹㄹ/ chain (ㄹㄴ, ​​ㄹㅇ) is gradually changing to ㄹㄹ. Above all, the fact that the notation of ․ or diphthong after sibilants no longer appears in this book is a characteristic feature that differs from data from the Jeollabuk-do region of the same period. This writing trend seems to be related to a set of linguistic norms compiled in the first half of the 20th century. Recalling that the author of this book established a private school in the 1920s and 1930s and devoted himself to educational activities, this assumption is somewhat probable. In Chapter 4, we looked at the phonological characteristics of the Yeongsan Sillok(the biography of Yeongsan). Front-vowelization was very active inside the morpheme, but at the morpheme boundary, it appeared only in the environment behind c. The simple vowelization of jə>e is confirmed throughout the interior and boundary of the morpheme, and it must have been a productive phonological phenomenon in the Jeollabuk-do dialect in the early 20th century, as hypercorrection types also appeared. Regarding the alternation of the ending ‘-a/ə’, when the stem vowel is ‘ø’, there is a high tendency to combine these to ‘-ə’. This is different from the 19th century and modern Jeollabuk-do dialects. In the case of umlauts, only very limited examples were shown. And although t-palatalization is quite actively realized, only a few examples of k-palatalization were shown. Through this realization of phonological phenomena, we were able to confirm whether the young intellectuals in the Jeollabuk-do region in the early 20th century had linguistic attitudes toward the Jeollabuk-do dialect. In this book, the typical phonological phenomenon of the Jeollabuk-do dialect was confirmed only to a very limited extent due to its negative evaluation by the author.
The main motivation behind this exam document is to look at the extent to which EWOM among customers can affect the brand image and the intent of buying the consumer in the clothing industry. A key condition display process is linked to the E-WOM impacts survey on brand image and buyer's purchase target. The exploration program was tested using an example of 385 respondents who included information within online purchasing groups and examined buyers of Pakistan's textile industry at the time of the investigation. The document recalls the methodologies to help a brand profitably through client-based social networking on the web, as well as typical suggestions for delegated websites and dialogues to enhance this note on a major path with people in their online dating. This explorative document extends the winning image rating to another set, in particular e-WOM. This document provides profitable knowledge on e-WOM estimation, brand image and purchasing expectations of the purchaser in the clothing industry and provides a facility for future search for tagging items.
Cloud-based enterprise search services (e.g., AWS Kendra) have been\nentrancing big data owners by offering convenient and real-time search\nsolutions to them. However, the problem is that individuals and organizations\npossessing confidential big data are hesitant to embrace such services due to\nvalid data privacy concerns. In addition, to offer an intelligent search, these\nservices access the user search history that further jeopardizes his/her\nprivacy. To overcome the privacy problem, the main idea of this research is to\nseparate the intelligence aspect of the search from its pattern matching\naspect. According to this idea, the search intelligence is provided by an\non-premises edge tier and the shared cloud tier only serves as an exhaustive\npattern matching search utility. We propose Smartness At Edge (SAED mechanism\nthat offers intelligence in the form of semantic and personalized search at the\nedge tier while maintaining privacy of the search on the cloud tier. At the\nedge tier, SAED uses a knowledge-based lexical database to expand the query and\ncover its semantics. SAED personalizes the search via an RNN model that can\nlearn the user interest. A word embedding model is used to retrieve documents\nbased on their semantic relevance to the search query. SAED is generic and can\nbe plugged into existing enterprise search systems and enable them to offer\nintelligent and privacy-preserving search without enforcing any change on them.\nEvaluation results on two enterprise search systems under real settings and\nverified by human users demonstrate that SAED can improve the relevancy of the\nretrieved results by on average 24% for plain-text and 75% for encrypted\ngeneric datasets.\n
Literary Works byAkaki Tsereteli are considered as versatile and diverse. In his works he touches upon almost everything by his poetry, prose, journalism or public work. It is obvious that he established "a type of versatile writer who is equally engaged in prose, poetry, journalism, dramaturgy, translations, children's literature and fables”. He was an extremely optimistic person who deeply believed in the future. The following words from one of his works seem amazingly and expressive: “Even if you kill a swallow, Spring will definitely come”. Connection between the old and the new forms, that is clearly shown within this emotionally colored expression, has become the goal of the research. We tried to find an answer to the question- what is the role of using old Georgian forms in Akaki's work?! Given paper analyses the samples such as: 1. Using proper name by its stem form in nominative case; 2. Ending words by - მან [-man] in the ergative form; 3. Full stems of demonstrative pronouns - ‘ამ’ [am], ‘ეგ’ [eg] (=this, that); 4. Using postposition – ‘ზე’ [ze] (=on), along with the forms - ზედ [-zed] and -ზედა [-zeda] (=on, over); 5. instrumental case forms formed by a suffix - ით [-it] (=with) (without postpositions); 6. Postposition and full agreement of attribute and antecedent 7. Characteristics of using inflection as a reflection of Old Georgian (გწყალობდესთ [gtskalobdet]...; გამოვჰკითხავ [gamovhkitkhav]...; ჰსვამ [hvsvam]...; ჰნიშნავს [hnishnavs]...; წარმოსთქვა [tsarmostkva]...; გასტეხე [gastekhe]...); 8. Using conjunction - ვით [vit] (=as/like) for comparison and so on. If we ask questions concerning the function of old Georgian forms in Akaki Tsereteli’s works, it becomes clear that they can be used for: 1. rhythm, emotiveness and expressiveness; 2. Preserving traditional forms, to maintain the connection between old and new Georgian. It should be mentioned that similar forms are equally reflected in Akaki’s prose and poetry which further reinforces the idea in favor of showing the connection between the old and the new and the desire to maintain this connection and always remember where we come from and who we are....This fact does not completely contradict the idea that Akaki is a representative of the generation that courageously rejected the old linguistic norms and contributed to the democratization (rapprochement process with the spoken language) of the literary language.
The main goal of this article is to give a general overview on the standardization process of the French language in Louisiana. After examining the sociolinguistic situation of Louisiana French and discussing the notion of “standard language”, following the definitions of Bagno (2011) and Milroy & Milroy (1999), we will try to understand what recovers the notion of “Standard French”. Thereafter, we will analyze how its introduction in Louisiana has triggered some issues on the linguistic norm to be used during the revitalization movement, which began in the 1960s, and how these debates influenced the French norm used nowadays in Louisiana.
We propose a transition-based bubble parser to perform coordination structure identification and dependency-based syntactic analysis simultaneously. Bubble representations were proposed in the formal linguistics literature decades ago; they enhance dependency trees by encoding coordination boundaries and internal relationships within coordination structures explicitly. In this paper, we introduce a transition system and neural models for parsing these bubble-enhanced structures. Experimental results on the English Penn Treebank and the English GENIA corpus show that our parsers beat previous state-of-the-art approaches on the task of coordination structure prediction, especially for the subset of sentences with complex coordination structures.
The article focuses on the linguistic personality of A.V. Suvorov – one of the most important historical figures famous for his military achievements, including his service and warfare in Slavic territories (military service in the Lublin region, participation in hostilities in Poland, the Battle of Brest, etc.), a prominent representative of the Russian cultural elite in the 18th century. The study employs methods of linguopersonology and historical lexicology. It aims to describe a historical language personality, viewed as a reflection of both an individual with a linguistic potential, a type of specific linguistic reflection, and of the era as a whole with its inherent linguistic features and tendencies. Processes in the language at a given time period are also manifested in the language of an individual. The study focuses on the borrowed lexis, reflecting the general instability of the Russian language system of the period, which resulted from the prevailing multilingualism of the Russian nation, a significant increase in foreign words in the Russian language, and a change in linguistic norms. Through the prism of xenolexis, the authors describe Suvorov’s language personality reflected in his letters to note his broad outlook, fluency in native and foreign languages, linguistic intuition, innovative use of units of native and foreign languages.
OBJECTIVE: To evaluate the effect magnitude of different parameters on smile attractiveness. MATERIALS AND METHODS: A reference and 13 images were produced by manipulating 13 parameters. Image rating was performed with a 4-point Likert scale from least attractive (1) to most attractive (4). Image raters included laypeople, dental students, dentists, and dental specialists. Friedman and Wilcoxon image were used for estimate of effect size. Parameters were classified into small (0.10- < 0.30), medium (0.30- < 0.5), or large (≥0.50). RESULTS: A total of 1040 people participated with good consistency (α = 0.861), and moderate reliability (0.64-0.7). The reference image had the highest rank (laypeople:11.79, dental background: 12.55). For effect size; gingival margin level (-0.11, -0.01), teeth width proportion (-0.09, -0.10), inverted smile arch (-0.09, -0.21), commissure line cant (-0.15, -0.17) and low smile (-0.24, -0.23) had small effect size; occlusal plane cant (-0.36, -0.49), midline cant (-0.36, -0.48), and midline shift (-0.37, -0.49) had medium effect size; diastema (-0.55, -0.54) and color (-0.56, -0.56) had large effect size for the laypeople and dental groups. High smile (-0.42, -0.51), incisor edge symmetry (-0.46, -0.54) had medium effect size in laypeople group and large effect size in the dental group. Width to length tooth proportion (-0.26, -0.39) had small effect size in the laypeople group and medium effect size in the dental group. CONCLUSIONS: Smile parameters had different effect magnitude on smile attractiveness and were classified into small, medium, or large parameters. Neither laypeople nor professionals have a collective judgment on what constitutes a beautiful smile. CLINICAL SIGNIFICANCE: This study investigated the effect magnitudes of 13 smile parameters and presented a small, medium, and large smile parameters classification. It should provide the clinician with an insight into the expected effect each parameter has on the smile.
Recently, Chinese Syntax-aware Semantic Role Labeling (SRL) has attracted the attention of many researchers because syntax information is related to semantic role labeling intuitively. In this paper, we integrate constituency representation into SRL by combining multiple methods into a unified model. Specifically, our proposed model combine three methods for integrating constituent into SRL, including pipeline (use syntax structure), hard parameter (share encoder), implicit representation integration (not share encoder). We verify the effect of our model on Chinese Proposition Treebank (CPB) 1.0 dataset and conduct some ablation experiments to verify the impact of various parts of the model.
The application value of the convolutional neural network (CNN) algorithm in the diagnosis of sports knee osteoarthropathy was investigated in this study. A network model was constructed in this experiment for image analysis of magnetic resonance imaging (MRI) technology. Then, 100 cases of sports knee osteoarthropathy patients and 50 healthy volunteers were selected. Digital radiography (DR) images and MRI images of all the research objects were collected after the inclusion of the two groups. Besides, the important physiological representations were extracted from their image data graphs, and the hidden complex relationships were learned. The state without input results was judged through convolutional network calculation, and the result prediction was given. On this basis, there was an analysis of the diagnostic efficiency of traditional DR images and MRI images based on CNN for patients with sports knee osteoarthropathy. The results showed that the MRI images analyzed by the CNN model showed a more obvious display rate than DR images for some nonbone changes of osteoarthritis. The correlation coefficient between MRI image rating and visual analog scale (VAS) was 0.865, which was higher than 0.713 of DR image rating, with a statistical meaning ( <math xmlns="http://www.w3.org/1998/Math/MathML" id="M1"> <mi>P</mi> <mo><</mo> <mn>0.01</mn> </math> ). For cases with mild lesions, the number of cases detected by MRI based on CNN algorithm in 0–4 image rating was 15, 18, 10, 6, and 7, respectively, which was markedly better than that of DR images. In short, the MRI examination based on the CNN image analysis model could extract important physiological representations from the image data and learn the hidden complex relationships. The convolutional network was calculated to determine the state of the uninput results and give the result predictions. Moreover, MRI examination based on the CNN image analysis model had high overall diagnostic efficiency and grading diagnostic efficiency for patients with motor knee osteoarthropathy, which was of great significance in clinical practice.
Search is one of the key functionalities in digital platforms and applications such as an electronic dictionary, a search engine, and an e-commerce platform. While the search function in some languages is trivial, Khmer word search is challenging given its complex writing system. Multiple orders of characters and different spelling realizations of words impose a constraint on Khmer word search functionality. Additionally, spelling mistakes are common since robust spellcheckers are not commonly available across the input device platforms. These challenges hinder the use of Khmer language in search-embedded applications. Moreover, due to the absence of WordNet-like lexical databases for Khmer language, it is impossible to establish semantic relation between words, enabling semantic search. In this paper, we propose a set of robust solutions to the above challenges associated with Khmer word search. The proposed solutions include character order normalization, grapheme and phoneme-based spellcheckers, and Khmer word semantic model. The semantic model is based on the word embedding model that is trained on a 30-million-word corpus and is used to capture the semantic similarities between words.
The present study aims at comparing the effects of two subtypes of cognitive reappraisal (i.e., stimulus-focused vs. goal-based reappraisal) to reduce anticipatory anxiety of pain. Affective ratings, startle reflex, and autonomic measures (electrodermal and heart rate changes) were used as a measure of emotion regulation success. A total of 86 undergraduate students completed an anticipatory task in which they had to regulate their negative emotions or react naturally when faced with the possibility of receiving a painful thermal stimulus. Participants were randomly assigned to two experimental groups to compare the stimulus-focused and goal-based strategies explored here. Our results revealed enhanced self-reported anxiety, electrodermal activity and eyeblink response when participants tried to voluntarily down-regulate their negative emotions, compared to the control instruction. Differences between both cognitive reappraisal groups were not found. These unexpected findings suggest that brief reappraisal instructions may not necessarily be favorable for regulating emotions during anticipation of aversive events. Moreover, these results are further explained in terms of the pain expectation, the painful stimuli modality, and emotion regulation instructions.
Compound probabilistic context-free grammars (C-PCFGs) have recently established a new state of the art for unsupervised phrase-structure grammar induction. However, due to the high space and time complexities of chart-based representation and inference, it is difficult to investigate C-PCFGs comprehensively. In this work, we rely on a fast implementation of C-PCFGs to conduct an evaluation complementary to that of~\citet{kim-etal-2019-compound}. We start by analyzing and ablating C-PCFGs on English treebanks. Our findings suggest that (1) C-PCFGs are data-efficient and can generalize to unseen sentence/constituent lengths; and (2) C-PCFGs make the best use of sentence-level information in generating preterminal rule probabilities. We further conduct a multilingual evaluation of C-PCFGs. The experimental results show that the best configurations of C-PCFGs, which are tuned on English, do not always generalize to morphology-rich languages.
Disyllabic verb-noun (V-N) items in Shanghai Wu have variable surface tone patterns: They can undergo either a rightward extension tone sandhi, which extends the lexical tone of the first syllable over the entire word, or tonal reduction on the first syllable. The current study investigates how the phonological properties of these alternation processes as well as variation influence how Shanghai speakers represent and access such words. We conducted an auditory-auditory priming lexical decision experiment on Shanghai V-N items that can undergo either tonal extension or tonal reduction with native Shanghai speakers. Each disyllabic target was preceded by monosyllabic primes with the canonical tone, the tonal-extension tone, the surface tone, or a tone unrelated to the tone of the first syllable of the targets. Results showed both canonical and tonal-extension priming effects, but no surface priming effect. Moreover, although more familiar V-Ns were recognized with shorter reaction time, the priming effect did not interact with speakers’ familiarity ratings or sandhi preference ratings of the targets. These data are consistent with the interpretation that both the canonical and tonal-extension forms are represented in Shanghai speakers’ mental lexicon due to tone sandhi variation, but the representation does not seem to be modulated by the frequencies of the variants. Also, together with findings from auditory priming studies of other tone sandhi patterns, the current study suggests that certain phonological properties of an alternation, such as its locality and transparency, influence the representation of words undergoing the alternation; but whether the alternation is structure-preserving does not seem to impact the representation.
Can the presence of unrelated flanker words change the way that lexical decisions are made to target words in the flankers task? Here we examined the impact of flanker presence on the effects of word concreteness. Target words had high or low concreteness ratings (e.g., fork, free) and were either presented in isolation or flanked to the left and right by an unrelated word (e.g., cold free cold) that was irrelevant for the task. Results revealed that the facilitatory effect of concreteness (faster responses to concrete words compared with abstract words) was significantly greater in the presence of flankers. A control experiment revealed the same pattern with pseudoword and nonword flankers. We conclude that the mere presence of flanking letter strings causes a greater depth of processing of target words. We further speculate that this might arise by flankers inducing a more "sentence-like" context by the presence of multiple, spatially distinct letter strings, that prohibits the use of more superficial decision processes and can be used to make lexical decisions to isolated words.
How health-related messages are framed can impact their effectiveness in promoting behaviors, and messages framed in terms of gains have been shown to be more effective among older adults. Recent findings have suggested that the affective response to framed messages can contribute to these effects. However, the impact of demands associated with psycholinguistic processing for different frames is not well understood. In this study, exercise-related messages were gain or loss framed and with a focus on either desirable or undesirable outcomes. Participants read these messages while their eye movements were monitored and then provided affective ratings. Older adults reacted less negatively than younger adults to loss-framed messages and messages focusing on undesirable outcomes. Eye-movement measures indicated both younger and older adults had difficulty processing the most complex messages (loss-framed messages focused on avoiding desirable outcomes). When gain-framed messages were easily processed, they engendered more positive affect, which in turn, was related to better recall. These results suggest that affective and cognitive mechanisms are interdependent in comprehension of framed messages for younger and older adults. An implication for translation to effective health communication is that simpler message framing engenders a positive reaction, which in turn supports memory for that information, regardless of age. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
OBJECTIVE: Nonsuicidal self-injury (NSSI) is often cited as a key risk factor for future suicidal behavior. Capability for suicide has been repeatedly cited as an important mechanism that can account for this association. Despite this, direct tests of this hypothesis have been rare and methodologically constrained. In the present study, we conducted a direct test of this hypothesis while addressing several constraints of prior literature. METHOD: In a large sample of suicidal and self-injuring adults (n = 1,020), we tested whether changes in fearlessness about death (FAD), a core facet of the capability for suicide, accounted for the relationship between NSSI and future suicide attempts at 28-day and 2-year follow-up. FAD was assessed using the gold-standard self-report form (ACSS-FAD), an implicit test of suicide-related affect (affect misattribution paradigm-Suicide), and explicit affective ratings of suicide-relevant images. Mediation with bootstrapping was implemented to test our main hypotheses. RESULTS: As anticipated, lifetime NSSI frequency was significantly associated with suicide attempt frequency at follow-up; however, FAD failed to consistently mediate this association. Results were largely consistent across all three measures of FAD. Post hoc power analyses indicated sufficient power to detect small effects. CONCLUSIONS: Taken together, these results fail to support the hypothesis that capability for suicide explains the link between NSSI and future suicidal behavior. We discuss the implications of our results for research and theory, situating our findings in the context of recent advances in the understanding of suicide risk more broadly. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
We propose two fast neural combinatory models for constituency parsing: binary and multibranching. Our models decompose the bottomup parsing process into 1) classification of tags, labels, and binary orientations or chunks and 2) vector composition based on the computed orientations or chunks. These models have theoretical sub-quadratic complexity and empirical linear complexity. The binary model achieves an F1 score of 92.54 on Penn Treebank, speeding at 1327.2 sents/sec. Both the models with XLNet provide near state-of-theart accuracies for English. Syntactic branching tendency and headedness of a language are observed during the training and inference processes for Penn Treebank, Chinese Treebank, and Keyaki Treebank (Japanese).
Recent impressive improvements in NLP, largely based on the success of contextual neural language models, have been mostly demonstrated on at most a couple dozen highresource languages. Building language models and, more generally, NLP systems for nonstandardized and low-resource languages remains a challenging task. In this work, we focus on North-African colloquial dialectal Arabic written using an extension of the Latin script, called NArabizi, found mostly on social media and messaging communication. In this low-resource scenario with data displaying a high level of variability, we compare the downstream performance of a character-based language model on part-of-speech tagging and dependency parsing to that of monolingual and multilingual models. We show that a characterbased model trained on only 99k sentences of NArabizi and fined-tuned on a small treebank of this language leads to performance close to those obtained with the same architecture pretrained on large multilingual and monolingual models. Confirming these results a on much larger data set of noisy French user-generated content, we argue that such character-based language models can be an asset for NLP in low-resource and high language variability settings.
This article provides information on the issue of naming in world marketing, naming technology various problems related to the linguistic aspect of naming technology, the specific norms of name formation in the Uzbek language. The sign of informativeness of the names of trading objects also indicates the original purpose of this object, what products it is intended to trade with. In creating a name, it is necessary to take into account the linguistic norms of a particular language, as well as people’s culture, worldview, mentality, psychology, etc. The name created by it serves as a useful communicative communication function between the commercial object and the consumer, the name helps the commercial object to occupy a strong position in the market competition. From this point of view, the development of norms for naming specific objects of each language is one of the urgent tasks of today.
Human uses social media platform such as Twitter to express feelings and opinions through text about the surrounding issues. Understanding emotions at the subtle level of expressed feelings are essential for better human and computer interactions. The previous emotion recognition approach required many training data and lexical databases. Unfortunately, the availability of very little labeled training data is a limitation and challenge to achieving high model performance. Therefore, we investigate the BERT language model for emotion recognition in Indonesian-language Tweets in this study. We choose to use fine-tuning instead of pre-training, which requires extensive data and resources. Two pre-trained models were used to determine the effectiveness and performance of the proposed model. Experiments show that the proposed model outperforms all existing baseline models, with the highest accuracy is 77%. Another advantage that we analyze is that BERT requires a relatively short computation time. In addition, BERT has a better context representation.
INTRODUCTION: The addition of graphic health warnings to cigarette packets can facilitate smoking cessation, primarily through their ability to elicit a negative affective response. Smoking has been linked to COVID-19 mortality, thus making it likely to elicit a strong affective response in smokers. COVID-19-related health warnings (C19HW) may therefore enhance graphic health warnings compared to traditional health warnings (THW). Further, because impulsivity influences smoking behaviors, we also examined whether these affective responses were associated with delay discounting. METHODS: In a between-subjects design, 240 smokers rated the valence and arousal elicited by tobacco packaging that contained either a C19HW or THW (both referring to death). Participants also completed questionnaires to quantify delay discounting, and attitudes towards COVID-19 and smoking (eg, health risks, motivation to quit). RESULTS: There were no differences between the two health warning types on either valence or arousal, nor any secondary outcome variables. There was, however, a significant interaction between health warning type and delay discounting on arousal ratings. Specifically, in smokers who exhibit low delay discounting, C19HWs elicited significantly greater subjective arousal rating than did THWs, whereas there was no significant effect of health warning type on arousal in smokers who exhibited high delay discounting. CONCLUSION: The results suggest that in smokers who exhibit low impulsivity (but not high impulsivity) C19HWs may be more arousing than THWs. Future work is required to explore the long-term utility of C19HWs, and to identify the specific mechanism by which delay discounting moderates the efficacy of tobacco health warnings. IMPLICATIONS: The study is the first to explore the impact of COVID-19-related health warnings on cigarette packaging. The results suggest that COVID-19-related warnings elicit a similar level of negative emotional arousal, relative to traditional warnings. However, COVID-19 warnings, specifically, elicit especially strong emotional responses in less impulsive smokers, who report low delay discounting. Therefore, there is preliminary evidence supporting COVID-19 related warnings for tobacco products to aid smoking cessation. Additionally, there is novel evidence that, for some warnings, high impulsiveness may be a factor in reduced warning efficacy, which may explain poorer cessation success in this population.
We propose the Recursive Non-autoregressive Graph-to-Graph Transformer architecture (RNGTr) for the iterative refinement of arbitrary graphs through the recursive application of a non-autoregressive Graph-to-Graph Transformer and apply it to syntactic dependency parsing. We demonstrate the power and effectiveness of RNGTr on several dependency corpora, using a refinement model pre-trained with BERT. We also introduce Syntactic Transformer (SynTr), a non-recursive parser similar to our refinement model. RNGTr can improve the accuracy of a variety of initial parsers on 13 languages from the Universal Dependencies Treebanks, English and Chinese Penn Treebanks, and the German CoNLL2009 corpus, even improving over the new state-of-the-art results achieved by SynTr, significantly improving the state-of-the-art for all corpora tested.
Despite their continued popularity, categorical approaches to affect recognition have limitations, especially in real-life situations. Dimensional models of affect offer important advantages for the recognition of subtle expressions and more fine-grained analysis. We introduce a simple but effective facial expression analysis (FEA) system for dimensional affect, solely based on geometric features and Partial Least Squares (PLS) regression. The system jointly learns to estimate Arousal and Valence ratings from a set of facial images. The proposed approach is robust, efficient, and exhibits comparable performance to contemporary deep learning models, while requiring a fraction of the computational resources.
Sentiment Analysis (SA) aims to extract useful information from online Unstructured User-Generated Contents (UUGC) and classify them into positive and negative classes. State-of-the-art techniques for SA suffer a high dimensional feature space because of noisy and irrelevant features from the UUGC. Researchers have also proposed feature extraction and selection techniques to reduce high dimensional feature space, but they fall short in extracting and selecting the most effective sentiment features for sentiment model learning. Effective feature extraction and selection are significant for the SA because they can boost the learning algorithm’s predictive performance while reducing the high-dimensional feature space. To address these concerns, we propose an Intelligent Hybrid Feature Selection for Sentiment Analysis (IHFSSA) based on ensemble learning methods. IHFSSA first identifies sentiment features in the review text utilizing Penn Treebank part-of-speech tagset and integrated Wide Coverage Sentiment Lexicons (WCSL). The sentiment features subset is then selected employing a fast and simple rank-based ensemble of multiple filters feature selection method. The selected sentiment features are further refined by applying a wrapper-based backward feature selection method. Finally, for textual sentiment classification, the well-known classification algorithms Support Vector Machine (SVM), Naive Bayes (NB), Generalized Linear Model (GLM) are trained in the ensemble model on the refined sentiment feature set. The in-depth evaluation using heterogeneous domain benchmark datasets demonstrates that IHFSSA outperforms existing SA techniques.
PURPOSE: Medical education has been transformed during the COVID-19 pandemic, creating challenges regarding adequate training in ultrasound (US). Due to the discontinuation of traditional classroom teaching, the need to expand digital learning opportunities is undeniable. The aim of our study is to develop a tele-guided US course for undergraduate medical students and test the feasibility and efficacy of this digital US teaching method. MATERIALS AND METHODS: A tele-guided US course was established for medical students. Students underwent seven US organ modules. Each module took place in a flipped classroom concept via the Amboss platform, providing supplementary e-learning material that was optional and included information on each of the US modules. An objective structured assessment of US skills (OSAUS) was implemented as the final exam. US images of the course and exam were rated by the Brightness Mode Quality Ultrasound Imaging Examination Technique (B-QUIET). Achieved points in image rating were compared to the OSAUS exam. RESULTS: A total of 15 medical students were enrolled. Students achieved an average score of 154.5 (SD ± 11.72) out of 175 points (88.29 %) in OSAUS, which corresponded to the image rating using B-QUIET. Interrater analysis of US images showed a favorable agreement with an ICC (2.1) of 0.895 (95 % confidence interval 0.858 < ICC < 0.924). CONCLUSION: US training via teleguidance should be considered in medical education. Our pilot study demonstrates the feasibility of a concept that can be used in the future to improve US training of medical students even during a pandemic.