The answer to your question is proprietary gamer content. There's a certain generation that will spend big money to have an ideal gaming experience, and a subset of that set doesn't like that on PCs.
I know the audience you speak of won't do this, but Steam big picture mode does solve that problem. Plug pc into tv via hdmi, get a bluetooth adapter or just use a corded 360 or ps3 gamepad, play games. You can even do that with a gamer grade laptop which also happens to be portable, albeit expensive.
I see a full-os media server box plugged into the tv that can act as router, sync server, tv dvr, game console, and with miracast etc provide displays all over a home, but I don't think xbone is sophisticated enough to do it. Does it even support non-xbox gamepad input?
