Ultimately, freedom is a harmony of reason and desire. While through reason you may know something is right, it can take time for your desire to be reordered towards the good so that you not only know the good but also have a willful disposition towards it.
Plus telling people “live and let live” is telling people how to live anyway 😉