Error SSH to a Centos 7 VM (Host-only)

I have the following setup:

• Host System: Debian Wheezy
• VirtualBox System: Centos 7
• Network Adapters: NAT and Host-only

On the host system I can "ping" the VM machine, when I try to ssh I get the following error: Coection Refused

When I change the VM's network adapter to Bridge, I can coect without problem. I would like to have the Host-only coection working because of the fixed IP Address.