The easiest way to disable this service is to rename its desktop launcher:
sudo mv /etc/xdg/autostart/org.kde.kdeconnect.daemon.desktop /etc/xdg/autostart/org.kde.kdeconnect.daemon.desktop.bak
After reboot it won't start automatically anymore. If you wish to revert this behavior, just rename its launcher back.
Update: Aforementioned method, which worked in Kubuntu 20.04, doesn't work anymore in 24.04: renamed desktop file still starts the service. Most proposals, mentioned by @mYnDstrEAm in the comment, aren't applicable in this case.
To disable kdeconnect autostart in 24.04, copy /etc/xdg/autostart/org.kde.kdeconnect.daemon.desktop file to ~/.config/autostart/ and add the next line to it:
X-KDE-autostart-condition=kdeconnect:General:Autostart:false
After reboot lsof -i shouldn't show kdeconnect in its output anymore.
Nevertheless, this daemon will start if you visit "KDE Connect" in the System Settings or initiate it with the widget from the system tray.
Any systemd rules won't help, as this daemon starts via dbus. To prevent its autostart completely, copy /usr/share/dbus-1/services/org.kde.kdeconnect.service file to the folder ~/.local/share/dbus-1/services/ and replace "Exec" parameter there with:
Exec=/usr/bin/false
Now, according to journalctl, it will try several times to start the service and give up.
Both files in home folder override the system ones, so this prohibition should survive possible package updates.
Hints are taken from this bugreport.