PHYSICAL AI MARKETPLACE Send a request
Egocentric video · UMI · Teleoperation

Buy and sell the footage robots learn from

Egocentric video, UMI gripper demonstrations, and teleoperated robot episodes. Send a capture request or a listing to marketplace staff. The boards on this site are examples. If you need footage that is not in those examples, ask staff to commission a capture.

Example hours 0
Example requests 0
Example countries 0
REAL-WORLD FOOTAGE · ANNOTATED DEMOVIDEO PREVIEW
SettingFood preparation
CaptureSingle view
ContentHandling tasks
ExampleAnnotation demo
ACTUAL SAMPLE RECORDINGS

Different environments. Real human tasks.

Examples of first-person video captured during real-world workflows.

01 / Commercial kitchen

Cooking and pan handling

Hands-on food preparation and tool use in a working kitchen.

02 / Kitchen operations

Cleaning and resetting

Wiping and workplace organization tasks from a first-person perspective.

03 / Food preparation

Dough preparation

Repeatable bimanual manipulation during bakery-style prep.

Three kinds of data

They differ in whether a robot is present during capture and whether actions are recorded. Most teams buy more than one.

Compare data types
EGOCENTRIC

People, filmed from their own eyes

Head-mounted video of real work. No robot, no recorded actions. The easiest to scale across countries and settings.

UMI

Handheld gripper demonstrations

A person works with a sensorized gripper. Wrist video plus the gripper's 6-DoF trajectory and opening width, with no robot on site.

TELEOPERATION

A real robot, driven by a person

Robot cameras, joint states and operator commands from the target hardware. No embodiment gap, highest cost per hour.

How a deal moves

A form starts the conversation. Staff follow up by email. Files and a contract come later, and only if both sides agree.

01 / FORM

You email staff

A buyer describes the capture they want. A seller describes a collection. Both forms go to marketplace staff. Neither is posted on the boards.

02 / FOLLOW-UP

Staff reply

Staff compare what was sent and reply by email. The spec check on a listing form scores the numbers you type. It is a guide, not a published listing.

03 / NEXT

Files, NDA, contract

If staff need clips, they email a secure upload link. NDAs are emailed and signed offline. A purchase is a separate written contract.

OFF THE SHELF

Buy existing collections

License footage that has already been captured, with hours, participants, sites and licensing authority stated up front.

  • Filter by hardware, country and environment
  • Per-requirement compliance against your spec
  • Exclusive and non-exclusive terms
See datasets
BESPOKE

Commission new capture

Describe the tasks, settings and rig. Sellers with contributor networks in your target countries can tell staff the hours, timeline, and price they can offer.

  • Set tasks, environments, regions and volume
  • Choose annotation and delivery format
  • Consent, face blurring and release terms built in
Start a commission
ABOUT PHYSICAL AI MARKETPLACE

Real-world data for the next generation of Physical AI.

Physical AI Marketplace connects buyers and sellers of egocentric and other robotics-relevant datasets, bespoke collection and supporting services.

Physical AI Marketplace is operated by Use Guardian AI LLC, a Wyoming limited liability company, the company behind Guardian AI, a provider of physical AI data collection and annotation services. Principal office: 5830 E 2nd St, Ste 7000 #33359, Casper, WY 82609, USA.

Founder background and memberships

Founder backed by Y Combinator, from a previous company (YC founder-led). Use Guardian AI LLC is a member of NVIDIA Inception and the ARM Institute.

Y Combinator and NVIDIA Inception logosARM Institute logo

These organizations do not own, sponsor, or endorse Physical AI Marketplace.

Datasets

Each example card is checked against the buyer spec you pick. Green passes, amber needs disclosure or a proposal, red fails a hard requirement. The OTS brief covers egocentric stereo only, so UMI and teleoperation examples show as outside it.

Scores are based on information declared by sellers and are not independent verification. Buyers should confirm specs on samples before purchasing.

These cards are illustrative examples, not live inventory. A form on this site is emailed to staff and is not added to this board. Seller contact details are not published here.

Illustrative example listings
 

Buyer requests

Example sourcing briefs. A real request is the commission form, which is emailed to staff and does not appear on this board.

Requests describe a buyer's current interest. They are not offers or commitments to purchase, and requirements may change.

These requests are illustrative examples. The commission form is emailed to staff and does not appear on this board.

Send a request

Commission bespoke footage

Tell us what to capture. The request is emailed to marketplace staff. It is not posted on the public board, and sellers are contacted only if both sides agree to a match.

00 · Data type
01 · What to capture
Environments
02 · Where and how much
Capture countries
03 · Hardware
Extras
04 · Labels, delivery and consent
Annotation
Consent and privacy
05 · Budget and timeline

List a dataset

Share metadata with marketplace staff. The check on the right shows how an egocentric collection scores against the OTS Stereo brief as you type. Nothing you send is published on the datasets board.

01 · Collection
Environments
02 · Hardware
Calibration provided
03 · Video delivery
04 · Qualifying clips

This form does not upload files. After we review the listing we will email you a secure upload link for three to ten clips of about 60 seconds. Those clips are for staff quality review. We share them with a buyer only if you approve. If you require your own NDA, the buyer signs it offline first, and where that NDA and the Buyer NDA conflict, the term more protective of you applies.

05 · Review preferences
06 · Commercial terms
Your own NDA (optional)

Data types

What each kind of data records, what it takes to produce, and what buyers and sellers should pin down before a deal.

General information for orientation only, not technical or legal advice. Requirements in any deal are set by the buyer's spec and the contract.

Egocentric videoUMI handheld gripperTeleoperation
What is recordedFirst-person video of people working with their hands, often with a head IMUWrist-camera video from a handheld gripper, its 6-DoF trajectory and its opening widthRobot camera streams, joint states and the operator's commands on a real robot
Robot on siteNoNoYes, at every capture site
Actions includedNo. Inferred later, e.g. from hand pose estimationYes, as end-effector pose and gripper widthYes, in the robot's own action space
Embodiment gapLargest: human hands versus robot hardwareSmall for parallel-jaw grippers; trajectories are filtered for each robot's reach and joint limitsNone for the robot used; other robots need retargeting
Relative cost per hourLowestMiddleHighest
How it scalesWearable rigs and large contributor poolsLow-cost grippers; operators need brief trainingLimited by robots, setup and upkeep at each site
Typical usePretraining, world models, task and affordance priorsManipulation policies meant to transfer across robot armsFine-tuning and post-training on a specific robot
Common failure pointsFisheye delivery, sync drift between cameras, missing calibrationSLAM loses tracking in low-texture scenes; trajectories the target robot can't reachCamera and joint logs out of sync; idle operator time; success-only episodes

What to specify, what to supply

Use these lists when you post a request or prepare a listing. The marketplace checks listings against the spec a buyer posts.

EGOCENTRIC

Egocentric video

Buyers specify

  • Stereo or mono, resolution and frame rate
  • Delivered geometry and minimum field of view
  • Camera sync, cadence tolerance and IMU rate
  • Codec rules and episode length
  • Countries, environments and participant variety

Sellers supply

  • Per-device intrinsics and extrinsics, including camera-to-IMU
  • Measured inter-camera skew and frame cadence
  • Disclosure of rolling shutter, resizing, rectification or re-encoding
  • Participant and site counts by country and environment
UMI

UMI handheld gripper

Buyers specify

  • Single or bimanual grippers
  • Wrist camera and lens. The original UMI uses a GoPro with a 155° fisheye and side mirrors, fed uncorrected to the policy, so egocentric no-fisheye rules don't apply
  • Target robots, so trajectories can be filtered for kinematic feasibility
  • Minimum share of episodes with a valid tracked trajectory
  • Delivery format: UMI pipeline output, LeRobot, RLDS or HDF5

Sellers supply

  • Raw video with IMU telemetry, plus processed trajectories
  • Per-episode tracking status and the share of episodes that failed SLAM
  • Gripper width calibration for each device
  • Demonstrator, scene and object counts
TELEOPERATION

Teleoperation

Buyers specify

  • Robot embodiment and model, and whether the seller's robot or yours is used
  • Teleop interface: leader-follower arms, VR hand tracking, 6-DoF controller
  • Camera count and placement, control rate and action space
  • Whether failed and recovery episodes are wanted, and how success is labeled

Sellers supply

  • Robot model file (URDF) and camera-to-robot extrinsics
  • One timebase across cameras, joint states and commands
  • Success and failure labels, and operator intervention markers
  • Operator count and hours per operator; idle time trimmed or marked
Commission capture Apply as a seller

How this site works

Forms on this site are emailed to marketplace staff. They are not published on the boards. The dataset and request cards are examples. Files are not uploaded here. If staff need clips, a metadata sheet, or an NDA template, they email a secure upload link. The Buyer NDA form asks staff to email the agreement. Signing happens offline.

What you can do here

Send a commission request, a listing, a seller intake, or a request for the Buyer NDA. Each one goes to staff, with a short confirmation that does not repeat what you typed.

What staff do next

Staff reply by email. NDAs are sent and signed offline. Seller details are shared only after both sides agree. Any purchase is a separate written contract.

What this site does not do

It does not publish listings, accept file uploads, sign agreements, or open a file review area. Example boards stay examples.

Open sourcing opportunity · Seller intake

Supply stereo egocentric footage to robotics teams

A robotics and embodied AI buyer has told us it is sourcing up to 100,000 unique hours of existing head-mounted stereo footage of people doing real work with their hands. It has said collections of any size that meet the spec are welcome, from a single country or a single specialized setting.

This page summarizes the buyer's stated requirements. It is not an offer to purchase, does not guarantee any volume or price, and the buyer may change or withdraw the request at any time.

Separately, buyers ask staff to commission new capture. If you run a contributor network in an eligible country, you can tell staff you can take a new capture as well as describe footage you already have.

The marketplace also takes UMI gripper demonstrations and teleoperated robot episodes, as existing footage or as a new capture. See data types for what buyers expect of each.

This form is the first step. It emails marketplace staff. It does not upload files. If we need clips, we email a secure upload link.

Volume soughtUp to 100,000 h
Minimum lotNo minimum
Data typeExisting stereo egocentric
Future captureReport separately
PricingSeller quotes per hour
Clips, if asked3–10, via email link

What the buyer wants

Summarized from the buyer's sourcing brief. Count simultaneous stereo capture once: one hour filmed by both cameras is one unique hour.

Content

  • Visible hand-object interaction is the priority
  • Variety across participants, sites, tasks, tools, objects and lighting
  • Episodes of 30 s to 30 min, ideally about 10 min

Environments

  • Homes and kitchens
  • Food service, retail, hospitality
  • Warehouses, workshops, light manufacturing
  • Practical outdoor work

Capture countries

  • India, Nepal, Indonesia, Vietnam, Philippines, Cambodia, Thailand, Malaysia, Uzbekistan
  • Brazil, Mexico, Colombia, Peru, Argentina, Chile, Ecuador, Costa Rica, Guatemala
  • Other origins may be proposed. State the actual capture country.

Does your data qualify?

The hard lines first. Items on the right disqualify a collection as delivered; some can be fixed before delivery if you still hold the originals.

Qualifies

  • Head-mounted stereo RGB pair, downward-facing, aligned with natural gaze
  • At least 1080p per camera (1920×1200 preferred), at least 30 fps (60 preferred)
  • Rectilinear delivery with at least 110° horizontal and 80° vertical field of view
  • Shared camera clock, or a wireless link under 10 ms latency
  • 99th-percentile frame interval within ±10 ms of nominal, with measurements
  • Head IMU at 200 Hz or more, raw accelerometer and gyroscope with timestamps
  • Per-device intrinsics, stereo extrinsics and camera-to-IMU extrinsics
  • AV1 or H.265; H.264 only as the original encoding. Keyframe at least every 30 frames at 30 fps; 10 Mbps or more recommended

Does not qualify

  • Mono footage, or stereo without a shared clock
  • Native fisheye output delivered without rectification
  • H.264 that has been re-encoded from another source
  • Video with B-frames, where frames don't decode in display order
  • Episodes shorter than 30 seconds or longer than 30 minutes
  • No calibration files for the devices used

Rolling shutter is accepted but must be disclosed. Any resizing, rectification or re-encoding must be reported.

What happens after you apply

01

Submit intake

The form emails marketplace staff your metadata, hardware, rights, and pricing. Files are not attached.

02

Staff follow up

Staff reply by email. If they need clips or a metadata sheet, they send a secure upload link.

03

NDA offline

If there is a possible match, staff email the Buyer NDA, and your NDA if you asked for one. Both are signed offline before seller details are shared.

04

File review

Any later file share is agreed by email. This website does not host the files or show them to buyers.

05

Contract and delivery

License terms, price, and delivery are a separate written contract. The intake form does not create one.

Seller data confidentiality

Your pricing, specs, and files stay with staff until you agree to share them.

Who receives the form

Marketplace staff at Use Guardian AI LLC receive the intake by email. It is not published on this website.

Who can see your details

Staff share seller information with a buyer only after both sides agree, and after the Buyer NDA, and your NDA if you require one, have been signed offline.

Who can see files

Clips and other files, if we ask for them, come through a secure upload link we email. We share them with a buyer only if you approve. If you require your own NDA, the buyer signs it offline first, and where that NDA and the Buyer NDA conflict, the term more protective of you applies. A buyer may inspect samples and run quality checks for the deal, and may not train or fine-tune a model on them or use them commercially.

We may also disclose information where required by law, to service providers who help us operate email and hosting, or with your consent. This is a summary. Our Terms of Service and Privacy Policy govern if there is any conflict.

How a later file review works

A buyer may inspect samples and use them for evaluation and quality checks for the purpose of the deal. A buyer will not train or fine-tune a model on samples, and will not use samples commercially, unless you sign a license that permits that use.

You set a preference

The form asks how much footage you are willing to have reviewed later, and for how long. Staff treat that as a preference. It does not open access on this website.

Files stay off this form

This page does not accept uploads. If staff need clips, they email a secure upload link.

Sharing is a later email

Staff share your files with a buyer only if you approve. Any share is arranged by email. If you require your own NDA, where it conflicts with the Buyer NDA, the term more protective of you applies.

NDA first

Staff email the Buyer NDA for signature offline before they share seller details. You can also ask that the buyer sign your own NDA.

Evaluation only

The Buyer NDA allows inspection, evaluation, and quality checks for the deal. It requires the buyer to delete or return what it received when the evaluation ends, and to certify that in writing if asked, except copies the law requires it to keep.

A separate contract

A license, price, and delivery are agreed in writing. The intake form is not that contract.

Seller intake form

Takes about 15 minutes if you have your collection metadata to hand. Fields marked * are required.

01 · Company and contact
Data types you offer *
02 · Egocentric inventory

Count simultaneous stereo capture once. Keep future collection out of the first number.

Breakdown by country and environment
03 · Egocentric capture hardware
Calibration available
04 · Rights and consent
Consent in place
Your own NDA (optional)

Sellers are responsible for obtaining every consent, permission and release required by the laws of each capture country, including data protection and privacy laws, for footage to be collected, licensed and used for AI training.

05 · Pricing and timeline
Metadata sheet

Do not attach it here. If we need a metadata sheet, we will email a secure upload link.

06 · Qualifying clips

This form does not upload files. After we review your intake we will email a secure upload link for three to ten clips of about 60 seconds, cut from the footage you are offering. Staff review them for quality assurance. We share them with a buyer only if you approve. If you require your own NDA, the buyer signs it offline first, and where that NDA and the Buyer NDA conflict, the term more protective of you applies.

07 · Review preferences
08 · Bespoke capture capacity
Countries you can capture in
09 · Anything else

Submissions stay confidential and are shared with a buyer or seller only once both sides agree to a match.

Submitted

Received. We'll be in touch.

Your intake went to marketplace staff. It is not published. If we need clips or other files, we will email a secure upload link. Below is a copy of what you sent, kept in this browser for you.