The full answer is the combination of both the methods.
This folder really contains all the Sublime text 3 settings for the current user:
$HOME/.config/sublime-text-3
Folders structure may be like this:
Backup
Cache
Index
Installed Packages
Local
Packages
But to remove it completely you will need to call:
sudo apt-get purge --auto-remove sublime-text-installer
or
sudo apt-get remove --auto-remove sublime-text-installer
Then to install again you would call
sudo add-apt-repository ppa:webupd8team/sublime-text-3
sudo apt-get update
sudo apt-get install sublime-text-installer