But while Joseph was there in the prison, the Lord was with himGenesis 39:20-21
God was with Joseph when things were going well and he was in charge of Potiphar's household. God was with Joseph when he was falsely accused. God was with Joseph when things were going badly and he was thrown into prison.
God is with me in the good times and the bad. My circumstances are not an indication that God has withdrawn his presence.