How can you restore to a previous sync (then the last sync) of your contacts in backup assistant?
Are your contacts also sync'd with iCloud? Although I sometimes back them up with Verizon Cloud (aka Backup Assistant) I always keep my contact sync'd first and foremost with iCloud.