How do I Update the Application. Shall I Remove the Previous Version?

No, there is no need for that. The app will be automatically updated every other week or so. If auto-download updates is disabled on your device, please go to the App Store and check for updates manually.