Hey, here's a suggestion, the Move Towards ability has a Teleport On Early Stop bool set to true by default that can teleport your character if a specific amount of time has elapsed. Even if you're not actually using Move Towards to swim to the ladder the same logic can be used by manually using UltimateCharacterLocomotion.SetPositionAndRotation to teleport your character after a given amount of time. This is a trick used in famous games to make sure a character can reach a target even if complicated circumstances don't really allow for it - last year I replayed Batman Arkham City and the game does that in niche situations when using the grapnel or performing a takedown in cluttered spaces.
You can also do the opposite and stop the character's automatic movement if he fails to reach the target after a specific amount of time.