It is difficult to develop any asset heavy application as an independent developer. Pretty much period. You have to find a way to contract out assets, or you will drown.
Unless you mean the programming of 3d transformations and such. That is, of course, still hard. Most of the platforms have done a ton of that work for you, though.
if you can 3d model in any capacity I reckon you can make VR apps, ive seen plenty of them done at game jams near here, including some that won. Don't need movie-quality textures or whatever, a cartoonly low-poly look works well. Don't let the player move, thats a can of worms.
speaking of 3d modelling, I taught myself this year in my spare time over a few weeks, and feel im pretty good at it now, ive made scifi wargaming terrain im happy with and almost considering selling some. Blender is free and good and there are literally endless high quality tutorials for almost any specific object you might want to make and after ten or so you will be able to generalise to anything simple you choose. Of course human bodies are more complicated and I was intimidated but I found sculpting caricatures fun despite not being an artist in the slightest after following an excellent tutorial