Unity can do just about anything. It's little wonder that it's one of the most popular development platforms on the planet.

Even the free version is packed with potential. With a little coding knowledge and imagination, developers can use it to create 3D games, Oscar-worthy animations and bleeding-edge enterprise AR apps.

But until now, developers have lacked an intuitive way to integrate video collaboration capabilities into their Unity AR (augmented reality) projects.

That all changes with our revolutionary new software development kit (SDK) for Unity and Magic Leap devices.

Let's take a look at what it can do.

What does the SimplyVideo SDK do?

SimplyVideo's new SDK makes it easy to embed WebRTC video feeds into Magic Leap AR projects developed using Unity.

Video capabilities are built into Unity, of course.  It's relatively trivial for developers to include 2D videos in their applications – or even to render prerecorded video files as textures in 3D space.

But our SDK ups the ante in three ways.

First, it's built for AR. The SDK works like an AR video toolbox, complete with a swathe of APIs that make it easy to work with streaming video in 3D space.

This makes development faster, more fluid and more intuitive. With our SDK, it only takes a minute to integrate collaborative video features into a Unity AR application. Without it, the same job might take weeks of coding, research and extra-strong espressos.

Second, the SDK uses SimplyVideo as its foundation – so it gives you access to SimplyVideo's XR-platform & enhanced features.

This includes features like Chat 4.0, which allows users to take screenshots and annotate them for confusion-free remote support. And bandwidth optimisation, which delivers smooth, hiccough-free video, even in remote locations with poor internet connections.

Third – and here's the biggie – it plugs your project directly into SimplyVideo's integrations, giving you the ability to connect into Microsoft Teams and Google Meet video calls. 

SimplyVideo uses Cloud Video Interop (powered by Pexip). This is the skeleton key that allows SimplyVideo to integrate with leading videoconferencing platforms and devices.

These include Microsoft Teams, Google Meet and video room hardware – so Unity projects developed for XR devices like Magic Leap can be delivered directly into boardrooms!

This is game-changing for AR development. By bridging the gap between Unity and market-leading video tools, the SimplyVideo SDK makes AR content more accessible, shareable and collaborative than ever.

Want to include a "Call for help" button that connects the user to a remote operative through Microsoft Teams? Or a "Share" button that casts AR content to Google Meet?

Our SDK lets you do both – with minimal code and minimal hassle.

What does it look like in action?

Imagine an AR environment. The user can see a 3D technical diagram overlaid on top of a piece of machinery.

The user hits a "Call" button and a floating video screen pops into view. A remote expert appears on the screen and – after a few pleasantries – starts delivering real-time instructions to the user.

This is our SDK in action. The screen exists as a flat object in virtual space – and can be hard-coded to connect to remote specialists using SimplyVideo or any of its compatible integrations.

Like the other 3D objects in the scene, it reacts to the user's position and movements. And it's entirely manipulatable – it can be dragged or resized to the user's (or developer's) content.

Our example hints at a possible use case: remote support for workflow or training apps. The student or worker, equipped with a Magic Leap headset, can receive instructions and guidance from a remote specialist. This specialist could be in the same building or in a different country.

But this is just one of many possible applications. As we'll see, the SDK has huge potential for a wide range of industries, from healthcare to manufacturing and beyond.

Why is video collaboration important in AR?

Unity has become a popular platform for AR development – and for good reason.

Unity's AR Foundation framework makes it easy for developers to code immersive AR applications and deploy them across multiple devices. That includes Android and iOS smartphones, as well as dedicated wearables like Magic Leap and Microsoft's HoloLens.

AR Foundation is no slouch. The framework supports features like device tracking, plane tracking and environmental anchors. These are the building blocks that make AR possible. Developers can combine them, like Lego, to create intuitive AR games, training simulations and collaboration tools that deliver more than the sum of their parts.

But one building block is absent. Despite their impressive capabilities, Unity and AR Foundation fail to deliver on a key component of enterprise AR: video collaboration.

Video collaboration is the missing link. Without video, AR is limited in scale – it can only reach the user and the room they're in. Video collaboration transforms AR into a shared, dynamic experience that can connect teams around the globe.

We've already seen one use case: remote support for AR training simulations. But this is just the start.

Imagine, for instance, a product development meeting in AR space. A designer in Curitiba can collaborate on CAD models with a product manager in Puerto Rico. No travel costs. No prototyping. No boundaries.

Or let's say you're a surgeon conducting a preoperative assessment. You can bring up a model of the patient's organ and dial into a call with an expert in another country. Together, you can forge a plan of action that saves time, reduces risk and requires no expensive in-person meetings.

The SDK works the other way around, too. At the touch of a button, the user can share a stream of their AR environment with other users – in a boardroom, say, or a remote breakout meeting. 

This has huge implications for cost and scalability. Now, if a business wants to give clients a guided tour using AR, they don't have to shell out for 16 headsets. Instead, they can stream the AR view directly to their meeting room projector.

Or let's say you want to share a build of your latest Unity project with colleagues or investors. You could include a "Share" button in the build that pipes the user's POV into a Discord chat room.

This means faster prototyping, fewer costs and a consistent experience for all stakeholders. And only our SDK makes it possible.

When will the SimplyVideo SDK be available?

The SimplyVideo SDK is available now for early adopters and we plan to release it on the Unity Asset Store (and GitHub) sometime in Q4 2023. 

To coincide with the release, we'll share detailed documentation, templates and sample apps to help developers make the most of the technology.

This is key. We want you to hit the ground running with our tools, so we'll be on hand to offer support and guidance as our developer community grows.

Initially, the SDK will support Unity and the Magic Leap 2 headset. But we'll soon add support for other development environments and devices too, starting with the Meta Quest 3.

In the meantime, keep an eye on our blog. We'll be sure to keep you in the loop with the latest news.

SimplyVideo is an XR-enhanced video collaboration platform. Our mission is to make XR deployment simple and cost-effective, with a suite of collaboration tools that integrate seamlessly with popular enterprise videoconferencing apps. Want to see it in action? Sign up now for a free 30-day trial.