In addition to what some others have mentioned, the crackle might be caused by oxidation build up on the interior contacts of the female Jack. You could try cleaning it and/or using some contact cleaner to see if it improves.

If you do need to remove the jack using acetone on the glue is probably your best bet but it might damage the wood, so be careful.