Edit Template

LIPSense™ 3D Body Pose SDK

Real Time Multi-Person Skeleton Tracking

Digital human body pose detection with industrial robotic arm and construction workers wearing safety helmets on grid background for AI motion capture technology workplace automation and human-robot collaboration in manufacturing industry

Industry leading Real-time Full-body skeletal tracking with 18 specific joints middleware.  Its tracking can include up to 43 people, with 360° motion tracking  for side view, back view, sitting and lying poses.

Features That Matter Most

skeletal tracking

18

Joint full-body skeletal tracking

people tracking

43

People tracking

Swing & staggering Motion

Swing &
staggering Motion

unity
python

Leading API Wrappers for Integration and Acceleration

NVIDIA® Jetson Orin & Xavier arm64-bit Platform

"Close-up of an NVIDIA Jetson development board featuring a cooling fan, multiple USB ports, Ethernet port, and an HDMI port. An inset image shows the NVIDIA module with its chip exposed."

Deploy LIPSense™ 3D Body Pose Skeleton Tracking on NVIDIA Orin or Xavier for Industrial Applications

"Illustration of an NVIDIA module encased in a transparent housing, highlighting internal components with green lighting. Below the image, a flow diagram shows the process: Deploy, Optimize, and Analyze."

Industrial Grade Skeleton Tracking

"Illustration of two construction workers with clipboards observing a robotic arm inside a safety enclosure. Another worker in an orange vest is positioned near the enclosure with a warning icon above."
  • Detect Body parts when entering sensitive areas
  • Multi-person Real Time detection with different IDs
  • Deploy on Edge-Computing for NVIDIA Jetson Orin and Xavier
"Illustration of three construction workers wearing safety vests and helmets, holding clipboards. Each worker is labeled with IDs: ID1, ID2, and ID43. Green skeletal tracking lines are overlaid on their bodies."

Multi-Person ID

"Green stopwatch icon with a black lightning bolt in the center, accompanied by a label reading 'REAL TIME' in white text on a dark green background."

Low Latency to Real Time

"Compact NVIDIA hardware device with a ventilated design featuring diagonal slats, exposed ports on the side, and the NVIDIA logo in green and black."

Deploy to Jetson
Xavier / Orin

Extended Full Featured Trial Time

Enjoy fully the complete featured SDK in Trial Mode !!!

  • Full-body Skeletal Tracking
  • Outputs RGB, Depth and Skeletal Image
  • NVIDIA® Jetson Orin, Xavier for arm64-bit Platforms
  • Joint-tracking capability of 18 joints
    • Eyes * 2
    • Nose
    • Ears * 2
    • Neck
    • Shoulder * 2
  • Elbow * 2
  • Wrist * 2
  • Hip * 2
  • Knee * 2
  • Ankle * 2
  • People Tracking up to 43
  • Capture of Swinging and Staggering Motions
  • Support for multiple 3D camera mechanical positions
    • 90 Clockwise
    • 90 Counterclockwise
    • 180 Flat
  • Capability to detect cameras connected during runtime
  • Full support from NVIDIA JetPack SDK
  • Supporting both Industrial and Consumer 3D Depth Cameras
    • LIPSedge™ AE400 Series
    • LIPSedge™ DL Series
    • Intel® RealSense™ D400 Series

Complete Documentation

documentation | LIPS Corporation

Online Documentation

Refer to our User Guides to know how easy it is to use

Read Documentation...

 
 

 

資產 | LIPS Corporation

Online Documentation

Refer to our User Guides to know how easy it is to use

Read Documentation...

 
 

 

updates

Releases and Updates

Most recent updates, new features and implementations

Know more...

 
 

 

資產 | LIPS Corporation

Releases and Updates

Most recent updates, new features and implementations

Know more...

 
 

 

資產 | LIPS Corporation

Code Samples

Codes in our User Guide to show how friendly our SDK is

Test and Verify...

 
 

 

資產 | LIPS Corporation

Code Samples

Codes in our User Guide to show how friendly our SDK is

Test and Verify...

 
 

 

NVIDIA | LIPS Corporation

NVIDIA JetPack SDK

End-to-End Accelerated AI Applications

Know more...

 
 

 

NVIDIA Logo@4x 1 | LIPS Corporation

NVIDIA JetPack SDK

End-to-End Accelerated AI Applications

Know more...

 
 

 

Unity API Wrapper

Save development time and cost with LIPScan™ 3D Body Pose SDK

3d body pose
Unity logo

“ Extend the power of the world’s leading platform for creating and operating interactive, real-time 3D content.”

Empowered with TensorRT™

LIPSense™ 3D Body Pose SDK  utilizes NVIDIA’s TensorRT enables you to optimize inference using
techniques such as quantization, layer and tensor fusion, kernel tuning, and others on NVIDIA GPUs

Speed up inference by 36x

Speed up inference by 36x

NVIDIA TensorRT-based applications perform up to 36X faster than CPU-only platforms during inference

Optimize inference performance

Optimize inference performance

TensorRT, built on the NVIDIA CUDA® parallel programming model

workload

Accelerate every workload

TensorRT provides INT8 using quantization-aware training and post-training quantization and Floating Point 16 (FP16) optimizations for deployment of deep learning inference applications

Deploy, run, and scale with Triton

Deploy, run, and scale with Triton

TensorRT-optimized models can be deployed, run, and scaled with NVIDIA Triton™, an open-source inference serving software that includes TensorRT as one of its backends

Empowered with OpenVINO™

LIPSense™ 3D Body Pose SDK utilizes the Intel® OpenVINO™ toolkit, and when equipped with Intel® HD graphics, it allows the acceleration of the inference engine and enhance the visualization experience

openvino-toolkit
inference engine

Specifications and Requirements

"Comparison table outlining the main specifications, software, and hardware requirements for industrial and general use of 3D cameras. Includes details on detection range, tracking numbers, operating systems, programming languages, and minimum/recommended hardware configurations."
Interactive entertainment

Applications

Interactive exhibition or entertainment

  • Audience interaction detection
  • Body motion range, crowd position & pose detection

Workspace monitoring

  • Operator monitoring for safety assistant
  • Human machine collaboration
  • Work elements record and working time measurement

Athletes Motion Analysis

  • Operator ergonomics analysis
  • Human factor engineering

Therapists & fitness analysis

  • Posture analysis, evaluation, correction and tracking

 

Build Once and Deploy Unlimitedly Runtimes

"Diagram illustrating the integration of SDK with LIPS 3D cameras and devices. The flow shows multiple LIPS cameras connected to a computing module for processing."
  1. Buy 1(one) PC License
  2. Develop with SDK
  3. Test and Verify with the selected camera
 
 

 

 

  1. Decide Camera Quantity for Deployment
  2. Purchase Runtimes
  3. Deploy Software

Demo Video and Pose Comparison

LIPSense™ 3D Body Pose Demo

LIPSense™ 3D Body Pose Comparison

Successful Use Case

Workspace Monitoring

Requirement

  • Real-Time Human-Robot Collaboration
  • Collision –free Path Planning for Mobile Robot

Challenge

  • Human Behavior Monitor & Prediction
  • Blind Spot for AMR onboard sensor

Benefits of LIPSense™ 3D Body Pose SDK​

  • Real-time & High-Performance 3D Skeleton Tracking
  • Enabling Workspace – Human Tracking Overview for AMR coordination.

3D Virtual Fence for Factory Automation

LIPSense™ Virtual Fence is a 3D Sensing Solution for Workplace Safety.

The cost of workplace accidents and operation hazards in automated factories can generate high costs when left unattended. A proper solution implementing the right tools is a key factor to reduce costs and improve efficiency.

Set in an automated factory line, LIPSense™ Virtual Fence can be integrated into  existing factory robotic systems, detects if on-site factory workers’ movements and presence fall within areas that could endanger them.

LIPSense™ 3D Body Pose Middleware

Get it Today

You can now buy LIPSense™ 3D Body Pose SDK directly from our official store. Order your SDK today!

Explore the solutions, products, and resources offered by LIPS

Quickly find what you need!