I was not able to remember how to do this… Therefore every time I was rebooting my server OpenVPN was not starting.
So, here is how I did this:
mv my-cert.ovpn /etc/openvpn/my-cert.conf
chkconfig --level 35 openvpn on
service openvpn restart
And it worked like a charm!