Mostly because everyone assumes that all white people at the time all supported racism and slavery but people like John Brown and Karl Marx existed. It’s difficult but not impossible to find not racist white people in the 1800s