In order to delete the client folder, click on the three dots on the right side of it:

In the pop-up, simply click on the "Remove folder and reports" option.

Please note that deleting a client will also delete all the data sources and reports associated with this client.