This article talks about how to set up RSS feed. It looks like there's a setting for autposting independent of the RSS feed on your site. https://help.convertkit.com/en/articles/2502636-how-to-set-up-an-rss-feed76
Maybe there's a way to reverse engineer this so that you can turn it off.