Cornell Movie-Dialogs Corpus

A large metadata-rich collection of fictional conversations extracted from raw movie scripts. (220,579 conversational exchanges between 10,292 pairs of movie characters in 617 movies).

Distributed together with: Chameleons in Imagined Conversations: A new Approach to Understanding Coordination of Linguistic Style in Dialogs. Cristian Danescu-Niculescu-Mizil and Lillian Lee. Cognitive Modeling and Computational Linguistics Workshop at ACL 2011.

Dataset details

Speaker-level information

speakers in this dataset are movie characters. We take speaker index from the original data release as the speaker name. For each character, we further provide the following information as speaker-level metadata:

  • character_name: name of the character in the movie
  • movie_idx: index of the movie this character appears in
  • movie_name: title of the movie
  • gender: gender of the character (“?” for unlabeled cases)
  • credit_pos: position on movie credits (“?” for unlabeled cases)

Utterance-level information

For each utterance, we provide:

  • id: index of the utterance
  • speaker: the speaker who authored the utterance
  • conversation_id: id of the first utterance in the conversation this utterance belongs to
  • reply_to: id of the utterance to which this utterance replies to (None if the utterance is not a reply)
  • timestamp: time of the utterance
  • text: textual content of the utterance

Metadata for utterances include:

  • movie_idx: index of the movie from which this utterance occurs
  • parsed: parsed version of the utterance text, represented as a SpaCy Doc

Conversational-level information

Conversations are indexed by the id of the first utterance that make the conversation. For each conversation we provide:

  • movie_idx: index of the movie from which this utterance occurs
  • movie_name: title of the movie
  • release_year: year of movie release
  • rating: IMDB rating of the movie
  • votes: number of IMDB votes
  • genre: a list of genres this movie belongs to

Corpus-level information

Additional information for the movies these conversations occur are included as Corpus-level metadata, which includes, for each movie:

  • url: a dictionary mapping movie_idx to the url from which the raw sources were retrieved
  • name: name of the corpus

Usage

To download directly with ConvoKit:

>>> from convokit import Corpus, download
>>> corpus = Corpus(filename=download("movie-corpus"))

For some quick stats:

>>> corpus.print_summary_stats()
Number of Speakers: 9035
Number of Utterances: 304713
Number of Conversations: 83097

Additional note

The original dataset can be downloaded here. Refer to the original README for more explanations on dataset construction.

Contact

Please email any questions to: cristian@cs.cornell.edu (Cristian Danescu-Niculescu-Mizil).