Usually, when we install a package in Ubuntu using "$ sudo apt-get install ...", dependencies are downloaded and in some cases, configuration files are also created for a program to properly execute. When we uninstall a given package, excluding dependencies and quite possibly the configuration files are left behind, untouched. But there seems a way to completely uninstall a package. Let's take exo-utils as our example.
sudo apt-get install exo-utils
sudo apt-get --purge remove --auto-remove exo-utils