Yes, alcohol is an exempt good though it is not leviable to tax. It is required to treat all non-leviable goods and leviable-but-non-taxable goods to be classified as exempt goods in order to restrict input tax credit.
(ICAI FAQ PUBLICATION 06-09-2017 EXEMPTION ON SUPPLY OF GOODS: FAQ NO. 22)