Employers may risk losing more workers if they mandate too many days in the office.