Who owns the GA4 and Tag Manager accounts?

You do. We work inside accounts owned by your business, with access granted to us, so your data and setup stay with you whoever manages them in future.