In order to delete the client folder, click on the three dots on the right side of it and in the pop-up, simply click on the "Remove folder and reports" option.
Please note that deleting a client will also delete all the data sources and reports associated with this client.