Oh, no, it's cool, don't get me wrong. The button I mention isn't a button per se. An RSS feed is a list of headlines like you see on many sites. You link that list to your site, and a list of your current headlines here appears there. You'll jsut need a script on your site that parses the xml feed.
Maybe you've seen sites that have, say, an up to date list of headlines from slashdot as a submenu? Same thing, except the link on the RSS button points to your blog.
Click the rss button and see, you get an xml feed of your headlines.