Update (June 22, 2022): Apple has fixed this bug with iOS 16 beta 2. Users can now run TestFlight apps without having to enable Developer Mode. You can read the original article below.