I’ve been using aframe and ar.js for displaying 3d models over markers. Mostly, non interactive artistic stuff. I used to copy files back and forth to my server (https is required for AR. Camera browser security), but discovered it’s easier to remix on glitch and once functional, move to own server.
Some challenges are (good model/bad model or bad code) so test models first.
Package them as glb. Just do it. It’s so much easier than trying to figure out where all your textures go (subfolders and relative paths etc…) I use this one. https://cesiumjs.org/convertModel/. Don’t even talk about the animation external .js files, glb will do all the work for you. [I suppose if you’re doing a commercial application, then serving dynamic json data to the model would be ok and glb might not work for this - not sure]
Scaling. Too big / too little = won’t work (or impossibly small) and relative scaling for scenes - it’s ok to do on PC, but in ar, impossible to test or preview until you actually deploy and “see it” - so it’s time consuming. Haven’t tested much with multiple devices (iphone etc…) so don’t know about how content is displayed everywhere. I did snag some code to set camera zoom level (small, med, large) just in case camera is too close (or far) on a device - the user could set their own zoom level.
Jitter/shake camera fighting. There are so many variables (that I don’t know) about how the camera detects a scene. For me, shake and jitter is my #1 nemesis.
Audio. Sometimes audio plays, sometimes it doesn’t (trying to do it without user interaction), so I’m using “on model loaded” - attaching the play to the loaded event.
Asset hosting. You need a fast CDN with https. Actually had to add the mime type for gltf and glb on personal server because it would 403 on those file types. Tried github, but they don’t always show you the link you “actually need” - it will complain about larger files and never show you the link. Round and round, so I discovered it’s MUCH easier to add an asset to a glitch project (file size irrelevant) and you’ll get a nice copy paste button.
Consumer friendly (to me) means no app-store, no download. But I might be in the minority. Lots of examples of people/companies requiring a 200 MB download for the “experience”.
USER CONFUSION. I use opera on android. When I click my search bar, there is a QR scanner already. So I haven’t had an issue - intuitive and easy. But if I’d be danged if every single person, every single time, every instance always and forever to this day, cannot figure out how to open a QR reader or doesn’t have one on their phone yet (another app to download).