Is lease of exempt goods treated as supply of exempt services?

Yes, lease is liable to tax at the same rate at which the goods are liable. Once the goods are exempt, then by the same provision prescribing such a rate of tax for lease would also stand exempted

(ICAI FAQ PUBLICATION 06-09-2017 : Exemptions on Supply of Services – FAQ NO. 33)