Do you use call to actions so that they really click on this button?
And why don't you use social media? This is actually a nice topic for YouTube and/or Instagram.
You shouldn't invite people immediately after they've been on the list but first try to establish a relationship with the reader so that they're ready to share your newsletter. Otherwise they could unsubscribe because they feel too much under pressure.