the VAMI certificate change procedure is described here
Replace the vRealize Automation Appliance Management Site Certificate
it is fairly straightforward, you can revert to the previous cert or whatever.
on the VA side, the logs on the web-server responsible for VAMI are located here
/opt/vmware/var/log/lighttpd
you can look and see if it complains abt anything