Go or no go?

New to down products and not sure of their durability. Got a Patagonia sweater vest for Christmas and love it. Love th e sweater jacket also and was wanting to to know how well they hold up to hiking and camping etc.. Leaning back against trees, or anything backpacking. I know they are high priced and highly packable and dcc maybe even able to breath better so you don't sweat while hiking but not wanting to pay that much if I have to baby it.