However I can’t seem to turn off the telemetry at all…

Which telemetry, specifically? Anything you can’t find in the standard settings menu can be found in about:config. There are plenty of articles with huge lists of settings to adjust in about:config with explanations on what different values do.