Augmented reality (AR) software development – you've come a long way, baby.
Not too long ago, AR was the preserve of the programming elite. To create an AR app, you needed insider knowledge, boundless time or a brain the size of a planet.
Today, things are very different.
Low-code development platforms like Unity have embraced AR. Open-source, cross-platform initiatives like OpenXR have freed devs from the shackles of market fragmentation and vendor lock-in. The world of AR development is a brighter, simpler place to work and play.
And then there are the tools. Dozens upon dozens of tools. Add-ons, assets, SDKs – all designed to make AR development faster and more intuitive.
Here at SimplyVideo, we're readying the release of our own AR SDK (more on that later). So, in anticipation, we thought we'd highlight some third-party tools that work beautifully alongside it.
AR devs: don't C-sharp without these in your toolbox.
1. Unity (and AR Foundation)
Development environment
Available at unity.com
OK. If you have even a passing interest in AR development, you're no doubt familiar with Unity. Not knowing Unity as an AR developer would be like setting up a dairy when you haven't heard of cheese.
But we have to mention it because it's just about the most useful AR development tool on the market.
In fact, calling it a "tool" might be selling it short. Unity is a full-featured low-code development environment and 2D/3D engine. It empowers devs to create high-quality games and business apps without wasting months and brain cells coding at the architectural level.
And, crucially, Unity is bundled with AR Foundation: a framework that allows for quick and intuitive cross-platform AR app development. The framework is compatible with Google and Apple's AR SDKs (ARCore and ARKit, respectively), along with HoloLens and Magic Leap devices.
At paid tiers, Unity also comes with Unity MARS. This is a set of plain-language authoring tools that aims to speed up the development of complex interactions in AR space.
2. echo3D
Cloud platform
Available at echo3d.com
echo3D is a cloud platform for all things 3D. It can do many things – but one of its headline features is its ability to act as a content delivery network for 3D assets.
3D content – in a game, say, or a web-based interior design app – can be streamed directly from the cloud. This means you can build rich, immersive AR experiences that can be updated dynamically in real time – without hogging storage space on user devices.
echo3D can also act as a content management system. Global development teams can access, upload and collaborate on 3D assets through a single, cloud-based pane of glass.
The platform has a host of 3D-first features, too, such as real-time compression and low-latency streaming. It's available as an SDK for engines like Unity and Unreal, as well as AR camera frameworks like ARCore and ARKit.
3. MAXST
Software development kit
Available at maxst.com
MAXST is a general-purpose AR SDK. It makes it simple to add features like space scanning, object tracking and image recognition to your AR projects.
One of its USPs is its mobile device optimisation. The SDK is built primarily for mobile app development – and it's designed to wring as much power as possible from low-spec smartphones and tablets.
MAXST also boasts built-in support for Mac and Windows, as well as dedicated AR glasses from the likes of RealWear, Nreal and EPSON.
And according to its website, the SDK is used by household names like Hyundai, Samsung and Volvo – so you'll be in good company if you decide to add it to your stack.
4. NVIDIA Maxine
Software development kit
Available at nvidia.com
NVIDIA's Maxine SDK made baffled headlines when it announced its Eye Contact feature back in 2022.
The premise is simple. It uses augmented reality and AI to alter users' eyes so they appear to be facing forward. This means they can maintain clear, confident eye contact on video calls.
However, the effect was greeted with grunts and smirks. Press outlets variously described it as
"unnerving",
"somewhat scary" and
"a little off" – while a few enterprising users decided to have some fun with classic Hollywood scenes.
When you look behind the headlines, however, you'll discover a very useful and capable AR development tool.
See, Eye Contact is just one feature in a feature-packed SDK. Maxine can also track users' faces, detect poses and even take a guess at facial expressions.
This is all thanks to its cloud-based, AI-powered backend. Maxine gives your apps a direct pipeline to cutting-edge AI and NVIDIA's powerful GPU technology, making it easy to build powerful video-based AR apps.
Bonus entry: the SimplyVideo SDK
Software development kit
Available at simplyvideo.io (release pending)
Now. We couldn't talk about must-have AR development tools without mentioning our own, could we?
This isn't pure self-promotion, though. We truly believe that our SDK brings something unique and powerful to the table.
What does it do? Simple. It adds 2D video collaboration functionality to 3D AR projects.
Imagine, for instance, you're creating an AR training application that teaches the user to perform maintenance on machinery components. Using our SDK, you could include a click-to-call that connects the user with a remote expert.
The user would see the expert on a floating video screen in 3D space. The expert would see what the user sees. It's a window in and a window out. Together, they can talk through the problem and come to a solution.
You can also use it to share the AR feed with passive observers. This is a simple feature but an enormously useful one. You could use it, for example, to present a 3D mock-up of a building fit-out to clients – or share an in-progress build of an AR app with your team.
We haven't even got to the best bit.
The SimplyVideo SDK is built on the SimplyVideo platform. And our platform is built on interoperability.
This means our SDK works – right out of the box – with some of the world's most popular videoconferencing platforms. That includes Microsoft Teams and Google Meet, among others.
Want to integrate Microsoft Teams calls into your AR application? Our SDK makes it quick, simple and painless.
The SimplyVideo SDK will soon be available for Unity and will initially support Magic Leap devices. To keep up to date,
follow our blog.
All Rights Reserved | Simply Video