Are you talking about the sounds of the haptic feedback when you’ve enabled only vibration for typing or are you talking about the actual audio feedback? If the latter, you can adjust the volume within the Gboard settings:
Settings - System - Keyboard - Virtual Keyboard - Gboard - Settings. Just go and check the option for typing sounds and you can adjust the volume.