Yes best part is JavaScript and I have done it for my blog as well.

See this and you can embed this js file on any of your site and it will start showing the recent posts from my blog.

You have the have the ability in your PHP server to create a file which can make such an output and then its just plain adding in any page is fine.