---
title: "Discussion on \"NLP basics\" | Hashnode"
description: "Discussion on \"NLP basics\". Cleaning: Pre-processing\nTokenization: It is a process to convert paragraphs or sentences into tokens\nCorpus: ParagraphsDocument: Sentences in the paragraphVocabulary: All the unique words in the documentWords: tokens in the sentences\n\nStemming\nReduc..."
url: "https://hashnode.com/posts/nlp-basics/67e425f8d98e91302b510fb4"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [NLP basics](https://exploring-gen-ai.hashnode.dev/nlp-basics?utm_source=hashnode&utm_medium=feed)

Cleaning: Pre-processing Tokenization: It is a process to convert paragraphs or sentences into tokens Corpus: ParagraphsDocument: Sentences in the paragraphVocabulary: All the unique words in the documentWords: tokens in the sentences Stemming Reduc...

Mar 26, 2025 · 3 min read · exploring-gen-ai.hashnode.dev  
Read the article

-   [#nlp-basic](https://hashnode.com/tag/nlp-basic)

## Written by

[Khushi Singh](https://hashnode.com/@khushi1282)

@khushi1282

  
[View profile](https://hashnode.com/@khushi1282)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
