---
title: "Discussion on \"Pre-trained Language Model: Survey 2022\" | Hashnode"
description: "Discussion on \"Pre-trained Language Model: Survey 2022\". This survey covers popular pre-trained language models like BERT, GPT, T5, OPT, and LaMDA, Python libraries, benchmarking, and their applications."
url: "https://hashnode.com/posts/pre-trained-language-model-survey-2022/64398ad6a7bc603ba1bf7b76"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Pre-trained Language Model: Survey 2022](https://cenz.hashnode.dev/pre-trained-language-model-survey-2022?utm_source=hashnode&utm_medium=feed)

This survey covers popular pre-trained language models like BERT, GPT, T5, OPT, and LaMDA, Python libraries, benchmarking, and their applications.

Jul 31, 2022 · 11 min read · cenz.hashnode.dev  
Read the article

-   [#nlp](https://hashnode.com/tag/nlp)
-   [#pretained-model](https://hashnode.com/tag/pretained-model)
-   [#gpt-3](https://hashnode.com/tag/gpt-3)
-   [#ai](https://hashnode.com/tag/ai)

## Written by

[Cenz Wong](https://hashnode.com/@cenzwong)

@cenzwong · localhost

  
[View profile](https://hashnode.com/@cenzwong)

Data Engineer @ TCEU | MSc Big Data Technology @ HKUST | Technology Enthusiast

Data Engineer @ TCEU | MSc Big Data Technology @ HKUST | Technology Enthusiast

## Responses

Markdown supported · ⌘↵ to post

No responses yet.