If a site is banned in some organization, we surf that banned site through a proxy server. So what is happening inside?

I know proxy servers maintain logs, so they are not secure.

Virtual private connection is better than proxy server because they do not maintain logs.

I want to understand the basics of both the things: VPN & proxy server.

Can anyone please answer these in simple language..