To close the tab which has the focus use Control + F4.