Summary JBC090 Cognitive Science II (Language and AI) 2021/2022
51 views 1 purchase
Course
Language and AI (JBC090)
Institution
Technische Universiteit Eindhoven (TUE)
Book
Speech and Language Processing
This summary contains all the theory provided in the JBC090 course in 2021/2022. This includes elaborate description and practical examples of the concepts. This will help you preparing for the exam!
Summary of the JBC090 Lab Sessions and Exercises 2021/2022
Samenvatting Taaltheorie en Taalverwerking Deeltentamen 2
Samenvatting Taaltheorie en Taalverwerking Deeltentamen 1
All for this textbook (5)
Written for
Technische Universiteit Eindhoven (TUE)
Data Science
Language and AI (JBC090)
All documents for this subject (4)
Seller
Follow
Lieve12
Reviews received
Content preview
Lieve Göbbels
Cognitive Science II (JBC090)
Semester 1, 2021-2022
Cognitive Science II
Introduction to Natural Language Processing (NLP) 2
Introduction 2
Why is language dif cult? 2
How do we learn language? 3
A brief history of NLP 4
Text mining preliminaries 4
Collecting Data 6
Noisy text 6
Regular Expressions 6
System evaluation 8
Normalization 8
Classi cation 10
Probability-based representations 10
Smoothing 12
Naive Bayes 14
ID3 Decision Trees 15
Linear and logistic regression 16
SVMs 18
k-Nearest Neighbors 18
Generalization 19
Representation 20
Meaning as counts 20
Predicting word meaning 22
Neural models of language 24
Information extraction 27
NLP for Data Science 27
Sequence classi cation 27
Information extraction 32
Deep Learning 34
Recurrent models 34
Transformers 38
Lab: evaluation 41
Ethics 42
Ethics in computational research 42
Research examples 42
Explainability and digital privacy 43
, Introduction to Natural Language Processing (NLP)
In short:
• Introduction
• Why is language dif cult?
• How do we learn language?
• A brief history of NLP
• Text mining preliminaries
Introduction
This course covers a part of the NLP eld and focuses more on applications than the linguistic part
of this eld. It is discussed how NLP and AI are linked and the role of cognitive science within this.
Several NLP techniques are explained and used for extracting information from language data.
Why is language dif cult?
For processing purposes language is complex, among other things because it is inherently
ambiguous. This is a challenge for text processing practices like sentiment analysis, for one needs to
implement for example sarcasm detection and some extent of world knowledge (or common
knowledge).
CONTRAST
In language objects are described with nouns, actions with verbs, and properties with adjectives.
These are so-called ‘part(s) of speech’ (word categories) and are usually denoted with part of speech
tags (see image). The collection of part(s) of speech from a sentence forms the syntax, or phrase
structure. Next to this, morphology explains the word form and its relations. Semantics (and
pragmatics) explain the meaning of the words, and discourse elaborates on the contextual meaning.
However, most sentences are ambiguous in syntax and semantics (and discourse). For example the
following sentences allow for multiple interpretations that lead to di erent part of speech tags and
overall meaning:
• “They saw a kid with a telescope.”
• “Flying planes can be dangerous.”
• “Time ies like an arrow.”
The benefits of buying summaries with Stuvia:
Guaranteed quality through customer reviews
Stuvia customers have reviewed more than 700,000 summaries. This how you know that you are buying the best documents.
Quick and easy check-out
You can quickly pay through credit card or Stuvia-credit for the summaries. There is no membership needed.
Focus on what matters
Your fellow students write the study notes themselves, which is why the documents are always reliable and up-to-date. This ensures you quickly get to the core!
Frequently asked questions
What do I get when I buy this document?
You get a PDF, available immediately after your purchase. The purchased document is accessible anytime, anywhere and indefinitely through your profile.
Satisfaction guarantee: how does it work?
Our satisfaction guarantee ensures that you always find a study document that suits you well. You fill out a form, and our customer service team takes care of the rest.
Who am I buying these notes from?
Stuvia is a marketplace, so you are not buying this document from us, but from seller Lieve12. Stuvia facilitates payment to the seller.
Will I be stuck with a subscription?
No, you only buy these notes for $6.25. You're not tied to anything after your purchase.
