Will be absent/on vacation, how can I stop feedback reminders?

Click on your name in the top right corner. Then select Schedule Vacation and follow the instructions.