The part your talking about is called the ‘tang’, and would have had a, probably wooden, handle around it. That handle would probably be wrapped in leather or similar to give a better grip. The larger bit at the end is the ‘pommel’ which can help stop the sword slipping out of your hand, protects the end of the handle and can also act as a counterweight to help balance the blade.