Anyone with your 12-word backup phrase can access your funds.
Make sure you enter your backup phrase in private.