Do you use a walking foot for all wovens or just for plaids and stripes?

I got a walking foot specifically for matching a plaid and now I use it for everything out of habit. Is there a reason to go back to the regular presser foot for most woven fabrics or is the walking foot genuinely better for everything? The only thing I notice is its a bit slower.