The only place where I saw horses (2 only) recently is in La Digue Union Estate. In Mahe, there used to be a horse riding place in Baie Lazare but I don't think they are around any longer.
You might have to fly out of the Seychelles to the Middle East on a regular basis to indulge in your passion with horses if you move here.