Tailscale for example had issues updating on VPN. To remove the unwanted PPAs, such as Tailscale, follow these steps:
Get a list of installed PPAs
ls /etc/apt/sources.list.d/
It returns something like this
asbru-cm-release.list proposed.list sublime-text.list tailscale.list unit193-ubuntu-encryption-jammy.list vscode.lis
To remove tailscale, use this command
sudo rm /etc/apt/sources.list.d/tailscale.list
Purge associated packages
sudo apt-get purge tailscale
Update the package list
sudo apt update
