Is there a way to track which customers I haven't contacted recently?

You can do this by viewing the latest activity columns in Deals and People tab.

If you're on the Grow plan you also have access to the Deal Intelligence field Days since Last Activity.