No.  The only spirits who will come to you are those looking to share time with you.  Unbound spirits are not uncommon and their presence amongst humans is a regular occurrence whether the person believes in spirits or not.  They move & exist just as we do and coming into contact with an unbound is a certainty for every human being on Earth.  Welcoming spirits into your home doesn’t make you any more or less susceptible to other spirits.