Thanks guys, I think a majority of my problem is that my edges have very subtle chamfers in the high poly, which you can't really tell in the screenshot. I think most of the edges have at least 4 extra lines to them. I'll exaggerate the edges and check the normal projection and check back on polycount again for some additional info.
Maybe since I've got this thread going, I should share my reference picture.
I'm not trying to recreate everything exactly like the image [i hate copy/pasting exact info] but I'm modeling the bed on the right, which is actually going to be a type of wall or something useless for decoration. Then the ceiling tiles will be my next project. Should I add in a lot more details in the high poly before I bake it again? I want the model to be simple, but I guess I should go all the way.