Can I watch apps like netflix and youtube without an xbox live subscription

Yes. Gold is not required to use apps.

Is silver required for it?

If your xbox has an internet connection, then you are connected to xbox live automatically. To use Youtube, on any platform, you must be connected to the internet. Meaning if you are running offline, you will not be able to use internet based apps. If
your inquiry is that you need Xbox Live Gold to watch Youtube, then that would be false. The Youtube app can work without a Gold subscription.

It's a shame because this wouldn't matter so much if Xbox let you watch Youtube and Netflix without your live account.

You can use apps like YouTube, Hulu, Netflix, etc. without an xbox live gold subscription. Although you will have to pay for each subscription individually on those websites. For example, xbox gold membership does not give you access to Hulu and Netflix,
etc. You must buy each subscription separately if you want to use them. Youtube is free mostly, anyway.

So no, no annual fee unless you want access to things like online multiplayer gaming and other features of xbox live gold like a couple free

games with gold every month.

If you do want to purchase xbox live gold, see here for prices in your region:
https://www.xbox.com/live/gold