Learning management system with multiplayer VR & AR

Learning management system with multiplayer VR & AR

Industry

Education

Platform

Web, Mobile, Desktop

company image
  • Company Profile

    In 2016 Solvd was approached by TriPointLab, a team collaborating with Stanford School of Medicine, for designing and implementing a project of high complexity. They were looking for an innovation partner to create a VR/AR-enabled learning management platform. The platform was expected to become an educational system that would be actively used for future surgeons training. It had to provide a fully immersive real-time VR/AR learning process allowing instructors to lead a group of students on-site or remotely and regardless of the device they use.

    Since the platform was supposed to work for multiple users in the virtual space, it should have had a complex network logic. Also, the subject field required medically accurate 3D modeling, largely based on real human data.
  • Engagement Model

    Outsourcing (time-and-materials)

  • Duration

    2 years

  • Effort

    5 engineers (including VR specialist with a medical background), 1 3D artist, 1 project manager, 2 designers

Technologies Used

  • unity3d
    Unity3D
  • net-core
    .NET Core
  • entity
    Entity Framework
  • sql-server
    SQL Server
  • docker
    Docker
  • swagger
    Swagger
  • arkit
    ARKit
  • google-vr
    GoogleVR
  • arcore
    ARCore
  • steam-vr
    SteamVR
  • oculus-vr
    OculusVR
  • microsoft-hololens
    Microsoft HoloLens
  • microsoft-azure
    Microsoft Azure

Solutions & Results

Solvd has built a product from an initial idea to a tangible enterprise solution. Pushed by deadlines and dedicated to the Apple ARKit release, our team had to iterate under a short cycle delivering portions of the working product to dynamically adapt the client’s vision and requirements.


We had to take risks and build the solution on the fresh top-industry technology stack, however, it paid off with a reduced budget and increased feature capabilities. Besides general AR/VR technologies, we also implemented AI-based computer vision for object detection on the live video to identify which students participated in a surgery practice most.

results image

Stanford University got the ultimate product corresponding to all the value from the initial vision. The resulting solution contains:

  • VR clients for desktop (Oculus Rift) and mobile (iOS, Android)

  • Mobile AR clients (iOS, Android)

  • Kiosk - an app for exhibitions and museums (3D desktop / VR desktop)

  • Solution for recognizing activities taken in a surgery practice room

  • Real-time and Mobile user analytics integration

  • Ads providers setup and integration

  • 360-degree test automation: mobile, web, API, localization, fitness gear integration

Client’s feedback

  • CEO at TriPointLab photo
    Matthew Hasel
    CEO and Founder at MyFitnessPal

    I’ve outsourced programming needs to many development firms over the years, from single contractors to larger groups, though I’ve never come across a company quite like Solvd. Instead of finding myself responsible for specifying, tasking and management, Solvd has found an ingenious way to seamlessly provide this level of service - riding on top of the FTEs we have working on the actual code. A business analyst works with me to understand our road map and applies a broad vision to make sure the team is executing properly. A managing partner is always available to make sure any blocks are removed and production continues smoothly. Our code ends up very scalable and conforms to best practices. I can’t recommend this group enough to any startup or established firm in need of quality developers who can be counted on to stick with a project and deliver world-class results.

Examples of system components

  • advantage image

    Kiosk application – exhibited at The Tech Museum of Innovation with a 10-year contract

  • advantage image

    AR application for students so they can preview all the elements available for the lecture

  • advantage image

    Full 3D anatomy models for students teaching

Want a similar project?