In the context of span-based Question answering, we are going to look at what the F1 score means. Let us first give a few definitions. Span-based QA is a task where you have two texts, one called the context, and another called the question. …

In this article, my aim is to give an explanation of what pointer networks are, as defined in the article “Pointer Networks” (this is the article describing pointers network for the first time I believe), and why they are used. This work is done in the context of my PhD…

Masking is needed to prevent the attention mechanism of a transformer from “cheating” in the decoder when training (on a translating task for instance). This kind of “ cheating-proof masking” is not present in the encoder side. I had a tough time understanding how masking was done in the decoder…

Note: This article purpose is to give the reader interested in safety a brief summary of the book “Safety-I and Safety-II: The Past and Future of Safety Management” written by Erik Hollnagel. I obviously read the book before writing it. …