Correct and that is what the rule states:
https://operations.nfl.com/the-rules/nfl-rulebook/#section-2-fair-catch
Item 1. Contact with Receiver. It is interference if a player of the kicking team contacts the receiver, or causes a passive player of either team to contact the receiver, before or simultaneous to the receiver touching the ball.
Item 2. Right of Way. A receiver who is moving toward a kicked ball that is in flight has the right of way. If opponents obstruct his path to the ball, or cause a passive player of either team to obstruct his path, it is interference, even if there is no contact, or if he catches the ball in spite of the interference, and regardless of whether any signal was given.