Built by Behavioral Robotics, our infrastructure arm

A research-grade pipeline for converting human behavior into structured data.

Every movement of the face, voice, and body, captured frame by frame and turned into data you can search, compare, and act on.

See what we capture

The Nonverbal Group · Capture

A very small percentage of what we capture.

Every conversation we record is measured along hundreds of behavioral channels, frame by frame. Here are six of them.

Face · mouth corners

Smiles.

Every smile measured from onset to offset: intensity, symmetry, timing, and how long it holds.

Voice

Prosody.

The melody of speech. Pitch, pace, volume, and the pauses between words, tracked across every turn.

Face · regions

Facial heatmaps.

Where the face moves, and how much, mapped region by region across the conversation.

Eyes

Eyes.

Gaze, blinks, and eye movement. Where attention goes, when it breaks, and the rhythm underneath.

Language

Linguistic analysis.

What gets said, and how. Word choice, hedges, and interruptions, aligned to the face and the voice.

Face · landmarks

Facial configurations.

How the face arranges itself, moment to moment: brows, eyes, mouth, and jaw measured together.

  1. 01HAND-CODED

    2009–2019

    We started with good old-fashioned manual labeling. Hours of conversations watched frame by frame, every blink, expression and gesture tagged by a trained coder. Slow and painful, but it taught us exactly what to look for.

  2. 02OFF-THE-SHELF

    2019–2025

    We automated with the best open tools available: generic face tracking plus AI review. It scaled the work, but a generic tool sees a generic face. It missed subtle signals, struggled with real-world footage, and couldn't show its work.

  3. 03OUR OWN

    2025–2026

    So we built our own. A 3D model of each person's face, fitted to every frame, with components trained on thousands of frames our experts labeled by hand. Every measurement is drawn on the video, so you can see that it's right.

  4. 04AT SCALE

    2026–2028

    Faster, sharper and richer. The system learns from every expert correction, runs at the speed of video, and covers more of the body and conversation.

  5. 05ROBOTICS

    2028 →

    The endpoint: the same perception running in real time, as the behavioral layer for machines that interact with people.

From the Content Lab

What the data is teaching us.

All entries

The Behavioralist · Free membership

Become a Behavioralist

One email a week from the lab: studies, breakdowns, and field tools, plus standing access to workshops and member content.

4,245 BEHAVIORALISTS AND COUNTING · NO FILLER · UNSUBSCRIBE ANYTIME

The Nonverbal GroupBehavioral research, education, and technology
New York City · Since 2009
© 2026 · The Nonverbal Group · All rights reserved