Jul 31, 2020F1 score in NLP span-based Question Answering taskIn the context of span-based Question answering, we are going to look at what the F1 score means. Let us first give a few definitions. Span-based QA is a task where you have two texts, one called the context, and another called the question. …QA3 min read
Jul 30, 2020Pointer networks : What are they?In this article, my aim is to give an explanation of what pointer networks are, as defined in the article “Pointer Networks” (this is the article describing pointers network for the first time I believe), and why they are used. …Pointer Networks7 min read
Published in Analytics Vidhya·Jan 27, 2020Masking in Transformers’ self-attention mechanismMasking is needed to prevent the attention mechanism of a transformer from “cheating” in the decoder when training (on a translating task for instance). This kind of “ cheating-proof masking” is not present in the encoder side. I had a tough time understanding how masking was done in the decoder…Machine Learning4 min read
May 7, 2019Safety I vs Safety IINote: This article purpose is to give the reader interested in safety a brief summary of the book “Safety-I and Safety-II: The Past and Future of Safety Management” written by Erik Hollnagel. I obviously read the book before writing it. …Safety4 min read