Should non-violent marijuana offenses be removed from criminal records?

Why I voted was, these non violent convictions is taking up space in the prison system that could be used for violent crimes..its sad that you get less time for rape than possession of Marijuana.