There's a place of peace that can be obtained and maintained. Don't believe anything different.
As believers, we have an obligation to stay in safety. If we leave out of The Lord's safety because of sin. It's on us.
We're instructed to abide in The Most High:
"Abide in me, and I in you. As the branch cannot bear fruit of itself, except it abide in the vine; no more can ye, except ye abide in me." - John 15:4
If we're not abiding then we're putting ourselves in danger.
"He that digs pit shall fall into it; and whoso breaks an hedge, a serpent shall bite him." - Ecclesiastes 10:8
A hedge is a covering of protection, and we know the wages of sin is death. When we sin and break away from The Most High's commandments we're only digging our own grave.
It's best to cut off and kill sin, before sin kills us.
"Mortify therefore your members which are upon the earth; fornication, uncleanness, inordinate affection, evil concupiscence, and covetousness, which is idolatry: For which things' sake the wrath of God cometh on the children of disobedience:" - Colossians 3: 5-6
If we're in any type of evil or sin, we can't dwell or Abide with The Most High:
"For thou art not a God that hath pleasure in wickedness: neither shall evil dwell with thee." - Psalm 5:4
If we do well, flee from sin and seek The Most High's will instead we will be in a good place. That good place is obtaining mercy from The Lord. It's standing in favor and righteousness. The good place is the place to abide.
