Update: It suddenly started working without having to do anything.
I suggest (worked on the second installation):
- Turning on SSL (to get all redirections work) if you have SSL. Shop Parameters → General
- Clearing cache and turning all cache off during initial build-up and development. Advanced Parameters → Performance