Since it's really impossible to quantify recreational pleasure and it's worth to someone else later down the road about the only advice I would give would be not to secure recreational debt. In other words I wouldn't use my house as collateral to finance any recreational activity.
Good of luck on your decision it's not an easy one,
Jo