Go to Settings > Podcasts, where you can:
Choose to keep your podcast subscriptions up to date on all of your devices.
Choose how frequently Podcasts checks your subscriptions for new episodes.
Have episodes downloaded automatically.
Choose whether to keep episodes after you finish them.