Well, looks like it was when opening the site from the gmail app. Then it stays within the app. If I open it in Chrome, it worked fine.
To open links directly on Chrome instead:
- Open the Gmail app
- In the left menu, open the Settings
- Click on "General Settings"
- Disable "Open web links on Gmail"