Can I delete a folder from “Categories”?

No. You can not delete folders in “Categories”.