Supply of exempt goods is considered non-taxable so that such supplies do not trigger registration, claim for input tax credit and other relevant provisions. But existence of exemption itself indicates that there was a levy of tax but the exemption granted.
(ICAI FAQ PUBLICATIONS 06-09-2017 EXEMPTION ON SUPPLY OF GOODS: FAQ NO. 20)