Installing MySQL on CentOS throws error that cannot find mysqld.sock

I have yum install mysql in CentOS 6.4. Now, when I use mysql command, it throws the following error:

ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock'

When I check the directory there is no mysql folder. How should I solve this problem? It's worth mentioning when I do service mysql start (or with mysqld) it errors unrecognized service.