By all means. You are not obliged to take part in anything you don’t want to. The guide on your trip may be able to help you make alternative arrangements – so just give us a heads up at the time of booking.
The only exception to this rule is when we are trekking, or travelling from one place to the next night's stop. And please note that anything organised outside of the group activity will be at your own cost.