The caller ID and the caller said they were with CIBC Fraud Department. They said that there was suspicious activity on my credit card. He continued to state they were conducting an investigation and needed the details of all my credit cards.
A simple call to the real CIBC Fraud department (number from their webpage), confirmed this was a spoofed caller ID, and the caller was a true scammer who should rot in hell.