You may want to have a look at both `org-adapt-indentation' and
`org-indent-mode-turns-off-org-adapt-indentation' variables.

Ahh, I'll look into them. Would be nice if they defaulted to the same behavior but being able to customize it solves the problem for me at least. =)