Deep Learning advanced
NLP
(3 days)


Learn to master the fundamentals of natural language processing

Nb. days
3
Face-to-face?
Yes
Remote?
Yes
Min. participants
2
Max. participants
8
Place
Toulouse, Paris, etc.
Pricing
2400€ HT
Deep Learning advanced <br/> NLP <br/> (3 days)
Natural language processing is a full-fledged field of artificial intelligence at the intersection of computer science, mathematics, linguistics and cognitive science. The goal is to build applications capable of analyzing, modeling, understanding and imitating human language.
Since the 1950s, from the Turing test to the creation of the first conversational agents such as the ELIZA chatbot, NLP has gradually become more sophisticated. Real advances have taken place with the implementation of Machine Learning and Deep Learning models allowing to address a large set of syntax, semantic, speech and language tasks.
Nowadays, NLP is everywhere, whether in machine translation tools, spell checking, writing assistance, automatic text generation, speech recognition, etc.
You already know the basic principles of Deep Learning and you have already implemented different neural network architectures, but you want to know more about the opportunities offered by Deep Learning in the field of NLP, this training is for you.

Goals

  • Set up an efficient preprocessing of a textual dataset
  • Master the architectures of recurrent neural networks and transformers
  • Implement concrete cases for each type of network
  • Reuse existing models with transfer learning
  • Measure the relevance of the implemented models & Visualize the learning
Alexia Audevart
To know the dates of the next training sessions,
to adapt this program to your needs
or to obtain additional information,
contact us!

Teaching method

  • This training is 70% practical and uses illustrated and didactic exercises.
  • A daily evaluation of the acquisition of the knowledge of the day before is carried out.
  • A synthesis is proposed at the end of the training.
  • An evaluation will be proposed to the trainee at the end of the course.
  • A course support will be given to each participant including slides on the theory and exercises.
  • A sign-in sheet for each half-day of attendance is provided at the end of the course as well as a certificate of completion if the trainee has attended the entire session.
  • A follow-up and an exchange with the participants will take place a few days after the training.

Prerequisite

  • Trainees must have experience in Deep Learning or have followed the Workshop Deep Learning training (mastery of Machine Learning concepts and have implemented different neural network architectures: convolutional, recurrent, ...)
  • Knowledge of Python, scientific libraries (scikit learn, pandas, numpy) and the Deep Learning framework TensorFlow is required.

Targets

  • Data Analysts
  • Data Scientists
  • Développeurs

Evaluation

This training does not require a formal assessment of learning

Program

Introduction

  • The basics of linguistics
  • Introduction to Text Mining / Text Mining (Data Mining for text)
  • Information extraction
  • Searching for information
  • Categorization of text
  • Text summarization

Text Normalization

  • n-grams
  • Tokenization
  • Stop Word
  • Stemming
  • Part-Of-Speech (POS) tagging
  • Lemmatization

Text vectorization

  • Term frequency analysis (Counter, TF-IDF, Word vectors)
  • Bag of word
  • Word Embedding : Word2vec, GloVe, FastText, etc.
  • preprocessing pipeline

Recurrent Neural Networks

  • Fundamental principles of RNN
  • LSTM and GRU
  • Encoder-Decoder
  • Rseidual connections (skip connections)
  • Named Entity Recognition (NER)
  • Sentiment analysis

Transformers

  • Attention is All You Need
  • BERT, GPT, etc.
  • Transfer Learning
  • Text generation
  • Text summarization (Seq2Seq Model avec attention)

FREN