Merging Networks the Hard Way