Yoga skirts with leggings underneath are the best and cheapest way to exercise modestly. A big hoody or top can be used cover the extra giggle that some of us have. All of this can be found at Old Navy. This is also a very comfy ensemble.
*If you giggle a lot, find workout leggings with strong support.