What are major reasons behind giving legitimacy to religions & religious practices

Almost all major democracies have freedom of belief, faith and worship under the overall religious freedom.

Some religions include controversial practices such as caste hierarchy, circumcision, polygamy or strict dress codes for women.

Is religious freedom such a big thing just because majority of voters are religious? Or are there any other arguments for religious freedom which often legitimises controversial practices?