Ok, got it. Stupid me, I needed to actively switch to a valid dictionary in the bottom bar. Default seems to be the language detected by the browser or wherever it got it from, but this only says "English". Selecting something like "English - United States" activates spell checking from the point of the cursor onward.