Topic · Machine Learning & AI
← All topicsNLP & LLMs in Finance
49 articles · 6 checkpoints · 28 deeper reads · 15 reference notes
Every article, in reading order
plant a flag as you finish eachRead these first
A model trained by blanking out words and making it guess them, using the words on both sides. That pre-training produces context-aware representations you can fine-tune on a few thousand labelled filings.
A sentiment score is only as good as its weakest stage, sourcing, entity matching, scoring and timestamping each fail differently, and any one of them can quietly wreck the signal.
A company appears in text under a dozen different names, and pronouns stand in for it a dozen more times, resolving all of that to one stable identifier is what makes text usable as structured data.
Models trained to do one thing, predict the next token, at a scale where that single objective produces summarisation, extraction and reasoning as side effects. Useful in research pipelines, dangerous in backtests.
Instead of trusting a language model's memory, you search your own documents first and paste the relevant passages into the prompt. It turns an unverifiable fluency problem into a search problem you can measure.
A way of turning words into coordinates so that words used in similar contexts land near each other. Word2Vec learns those coordinates from raw text alone, and the geometry it produces turns out to encode meaning.
Then the rest