The reMarkable version of fbdepth doesn't support the -1 rotation so this was actually not setting the rotation at all. I didn't notice this as I was always launching koreader from xochitl so the rotation was already set correctly.