Lets load a set of messages along with appropriate classification using following command.
messages <- read.table( file.choose(), sep="\t", stringsAsFactors=FALSE)
The messages data frame could have two features, such as type and text where each piece of text is associated with an appropriate type. Once done, lets go ahead and create a Corpus object out of all the message text. Following command helps to create a Corpus object. For those of you who are new to Corpus object, note that it comes as part of famous text mining R package named as “tm”.
corpus <- Corpus(VectorSource(messages$text))
Once Corpus object is created it is time to clean the text.
Following is cleaned as part of text cleaning activity:
Following is command set that achieves above objectives:
# Change all the words to lowercase
corpus_clean <- tm_map(corpus, content_transformer(tolower))
# Remove all the numbers
corpus_clean <- tm_map(corpus_clean, removeNumbers)
# Remove the stop words such as to, and, or etc.
corpus_clean <- tm_map(corpus_clean, removeWords, stopwords())
# Remove punctuation
corpus_clean <- tm_map(corpus_clean, removePunctuation)
# Remove whitespaces
corpus_clean <- tm_map(corpus_clean, stripWhitespace)
Last updated: 3rd May, 2024 Have you ever wondered why some machine learning models perform…
Last updated: 2nd May, 2024 The success of machine learning models often depends on the…
When working on a machine learning project, one of the key challenges faced by data…
Last updated: 1st May, 2024 The bias-variance trade-off is a fundamental concept in machine learning…
Last updated: 1st May, 2024 As a data scientist, understanding the nuances of various cost…
Last updated: 1st May, 2024 In this post, you will learn the concepts related to…