An example of a feature could be the following: How many times does the word “happy” appear in the text document? Three. The corpus is used to train a machine learning model in Gensim, and the models use the corpus to initialize parameters for the model.Įvery document is represented by an array of features, and you can think of the feature as a question-answer pair. More importantly, I want to talk about my experience of learning and using Gensim. The content on Gensim’s official website and its tutorial are a little too vague, so I wanted to talk a bit about what is Gensim. I started doing the project by using the same approach I took last time, but it didn’t go well. The tool was supposed to generate a set of dictionaries with the same or the most similar products in pairs with different similarity scores. I was told to build a tool that compares a large number of films and television products with their different attributes.

Thanks to this Python project, I was assigned to do a similar project alone during my summer internship. and compare them in a relatively efficient way. Back then, I merely used Python dictionaries to store different attributes of a text file - such as word frequencies, stem words frequencies, sentence lengths, punctuations, and etc. Two years ago, I built my first Python project: a tool that generates similarity scores between multiple articles.

Python gensim text compare online