Recovery from lumpectomy

I was diagnosed with grade 1 breast cancer yesterday, I’m gradually learning to cope with this news, I am having a lumpectomy on 14 may and then maybe chemo and definitely radiotherapy and then 5 years of hormone tablets. My husband and I had already booked a 6 night trip to Vienna on 6 June, what do people think about me going and will I be recovered enough. The surgeon and breast nurse say I should be fine but any other opinions would be greatly appreciated.