I haven't used phone cases since many years and usually only got a cheap one in the drawer if I ever feel the need for for additional protection.
It depends on how careful and confident you are in handling your phone. Personally I never had broken glass, be it the front screen or back panel. I endet up with some scratched frames, maybe some light scratches on the front glass - which can always be prevented with even a simple screen protector. If you don't feel confident enough or are too afraid something would happen, just keep using a case, maybe look for a thinner one. By the way: Just like there are protection films for the screen, companies also offering protection films for the back panel, you just have to look around.
My well over three years old Galaxy Fold 4 never seen a case and almost looks like new, you really have to take a close look and inspect it to see the minor imperfections.