Saved game files not transferring between Xbox one's consoles

I have an external hard drive where I have installed all my games that I will occasionally take to a friend's house. I was playing the 360 Oblivion on my Xbox One and got a good 30 hours into the game and then took the disc and external hard drive to a
friend's house where I stayed for a while and tacked on about 8 hours of gameplay, saving often throughout. He doesn't have oblivion installed onto his internal hard drive so I would have thought my save games would all be saved to either the cloud or my external
hard drive. However, when I brought the disc and external hard drive back to my house, I only had the saves that I played on my home Xbox and none of the hours I put in on his Xbox. So like 8 hours behind. If I go back to his house and plug up my external
again, all my saves are back. I can't figure out how to access the cloud or force a game to save to it. His Xbox says there's no Oblivion data, it's just on my external. On the 360 I could go into storage and see each individual game save and move them around
as I pleased and as far as I know I can't access that on the Xbox One. I have a gold membership. How do I access my saves on my home xbox?

:)