How to fetch all past articles?

I'm new to rss, I'm trying to figure out if there's a way to fetch all old articles from a website not just the latest 10 or 20. Is there a way to do this? Or this something that websites control? And if so, does this mean that fetched articles will be deleted after website publishes new ones?