The handshake timeout should just be an absolute timeout, we don't care about partial messages received during the handshake. (cherry picked from commit c7c43686878166cd0b93bed0cc712c8dd9845c89)