If a game has difficulty settings, I usually start on normal, just cuz you gotta learn the controls and mechanics. Hard to learn if you're just getting destroyed constantly.
Now, with that said, my favorite games are the souls series, which don't have player selectable difficulty...it's just fucking brutal right from the start. And yet, I love those games because of how rewarding it is to finally succeed after what feels like endless punishment.