You can simply delete executable file from /usr/local/bin, and delete any shared files in /usr/local or /usr/local/share. As there is no concept of a registry, there wont be a problem.
A better way is to use checkinstall while compiling the app, check this post - TechEnclave
There is a way to make a rpm file out of a source tar. I dont remember it though. IT makes the entry in rpm database of ur ssytem for that compiled program also. Hence integrity is maintained n u can later on remove the program by “rpm -e” command.
I can find out the exact way…if u r interested