Stretch velvet for a fitted dress - bad idea?

I want to make a fitted midi dress for NYE and found some beautiful stretch velvet. But ive heard velvet is a nightmare to sew. Is stretch velvet easier or harder than regular velvet? Any tips for working with it? Pattern is a simple fitted sheath, no crazy details.