Hi,
You are invited to their island, if you accept the invitation you can join their island. After you've done this you can still switch to your other world/island. There is no way they can join your solo island. If you have a co-op island you can invite other players and they can join your island. However, this is impossible without inviting someone.