Low grade electrical current

I replaced a wall switch with a regular on/off type switch because our light continued to flicker and go out. I decided to replace the light fixture also, and now it seems I have a small amount of current
even though the switch is in the off position! What did I do incorrectly?