Inference machine learning models in the browser with JavaScript and ONNX Runtime Web

Cassie Breviu - Nov 26 '21 - - Dev Community

In this video tutorial we will go over how to do client side inferencing in the browser with ONNX Runtime web. Below is a video on how to understand and use a QuickStart template to start building out a static web app with an open source computer vision model. Additionally, you can find a written step-by-step tutorial in the onnxruntime.ai docs here. Let's learn a bit more about the library, ONNX Runtime (ORT), which allows us to inference in many different languages.

What is ORT and ORT-Web?

ONNX Runtime (ORT) is a library to optimize and accelerate machine learning inferencing. It has cross-platform support so you can train a model in Python and deploy with C#, Java, JavaScript, Python and more. Check out all the support platforms, architectures, and APIs here.

ONNX Runtime Web (ORT-Web) enables JavaScript developers to run and deploy machine learning models client-side. With ORT-Web you have the option to use a backend of either WebGL for GPU processing or WebAssembly WASM for CPU processing. If you want to do JavaScript server side inferencing with node checkout the onnxruntime-node library.

Video tutorial:

Written tutorial:
Check out the written tutorial here: ONNX Runtime Web Docs tutorial

Resources

Image
🌐 Building a Serverless Backend for Next.js with AWS Lambda

nextjs, webdev, aws, javascript
Image
Understanding Password Cracking
Image
Crafting the Perfect Walk-In Closet: Essential Closet Designs for Your Dream Space

design
Image
Know About Cloud Testing and Its On-premise Testing Challenges

testing, cloud, webdev, ai
Image
Why You Should Hire Professional WordPress Developers for a High-Performance Website

webdev, javascript, devops, node
Image
Which Coding Course is Best?

datascience, womenintech
Image
Getting Started with React Toastify: Enhance Your Notifications

react, javascript, frontend, webdev
Image
Model Selection Demystified: How to Pick the Right Algorithm For Your Data

machinelearning, datascience, algorithms, beginners
Image
Data Analytics Training in Porto: Empowering Portugal's Digital Future

career, careerdevelopment
Image
Higher Order Components are Misunderstood in React

webdev, react, tutorial, programming
Image
AWS Control Tower with Account Factory for Terraform

aws, terraform, cloud
Image
Global HR solutions | HR Platform

hr
Image
Boost React MultiSelect Dropdown Performance with Virtualization

react, development, dropdown, multiselectdropdown
Image
Boosting Your League of Legends Journey: Unlocking Success with Professional Services
Image
Maximize ROI with Professional D365 Testing Services

dynamics
Image
New Chapter Added in Angular Material 3 Theming System Complete Guide

angular, angularmaterial, webdev, typescript
Image
Perfect Microservices

webdev, microservices, javascript, productivity
Image
How to Build Scalable and High-Performance Web Applications React Js

reactjsdevelopment, react
Image
AS Keyword in SQL Server

sql, sqlserver, database
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Terabox Video Player