Israeli government members from the ultra-Orthodox Jewish party Shas have announced their resignation, protesting the ruling coalition’s failure to pass a law to exempt their community from military service, AFP reports.

However, the party stopped short of withdrawing its support for the coalition in parliament, and said it would not back a no-confidence vote to bring down Prime Minister Benjamin Netanyahu’s government.

The move came just two days after the Israeli legislature’s other ultra-Orthodox party, United Torah Judaism, quit both the government and the coalition over the failure to secure the long-promised exemptions.

The conscription of ultra-Orthodox Jews is a highly contentious issue for Israeli society, large parts of which are required to serve in the army.