pencil holder — A container that holds writing supplies such as brushes, pencils, etc.
pencil case — A pouch or box carried to hold pencils, erasers, etc.