Emotional stimuli are usually remembered with high confidence. Yet, it remains unknown whether—in addition to memory for the emotional stimulus itself—memory for a neutral stimulus encountered just after an emotional one can be enhanced. Further, little is known about the interplay between emotion elicited by a stimulus and emotion relating to affective dispositions. To address these questions, we examined (1) how emotional valence and arousal of a context image preceding a neutral item image affect memory of the item, and (2) how such memory modulation is affected by two hallmark features of emotional disorders: trait negative affect and tendency to worry. In two experiments, participants encoded a series of trials in which an emotional (negative, neutral, or positive) context image was followed by a neutral item image. In experiment 1 ( n = 42), items presented seconds after negative context images were remembered better and with greater confidence compared to those presented after neutral and positive ones. Arousal ratings of negative context images were higher compared to neutral and positive ones and the likelihood of correctly recognizing an item image was related to higher arousal of the context image. In experiment 2 ( n = 59), better item memory was related to lower trait negative affect. Participants with lower trait negative affect or tendency to worry displayed higher confidence compared to those with high negative affect or tendency to worry. Our findings describe an emotional “carry-over” effect elicited by a context image that enhances subsequent item memory on a trial-by-trial basis, however, not in individuals with high trait negative affect who seem to have a general memory disadvantage.