1 week post keyhole - no swelling - help with compression vest?

I started out with such small “breasts” that I only had breast buds because of hormone blockers and the fact that I started transitioning at 11. I was honestly scared I wouldn’t even have enough for top surgery, but here I am one week post semi-areola top surgery. I have 0 swelling or bruising, but the doctor said to wear my compression vest for another 2 weeks. The problem is I am autistic and it’s so deeply destressing im already having panic attacks + am unable to sleep. I have never had to bind before because of my buds. Anyone have a similar experience or advice on how to better cope with this? Can I only wear it during the day so I can at least sleep or would that have negative effects?