We have 2 Note 4 phones. One has the Smart Lock work about 70% of the time. The other phone NEVER does. Always requires the pin as soon as it re-locks.
This is a real pain.
I cannot use the fingerprint reader as it will not reliably recognize my fingerprints - both phones. My partner has no problem with either phone as far as the fingerprint reader goes.