Case study · Salesforce · Human-in-the-loop AI

Einstein Validator

Designing trust, transparency and control into AI that turns customer emails into CRM orders.

Einstein Validator conversation ending with the order created and an Undo option
RoleProduct Owner & Lead Product Designer
TeamLed 5: 2 product designers, 3 technical architects
TimelineOct 2023 – Jan 2024 · Innovation competition
Outcome3rd place, company-wide Salesforce competition
01

The stakes

Multi-item orders arrived buried in conversational emails, and specialists re-keyed every one into Salesforce by hand.

It was slow, repetitive and error-prone, and errors were costly: bad CRM data flows straight into inventory, billing and fulfillment. That made full end-to-end AI automation a business risk, not just a shortcut.

The question we set How might we use generative AI to automate data entry without sacrificing accuracy, transparency or human control?
02

The call I made

AI proposes. People decide.

Rather than chase full automation, I designed the product around a human-in-the-loop workflow: the AI does the extraction, and no record reaches Salesforce without explicit human approval.

1 · AIIngestParses line items, quantities, addresses and accounts from the email
2 · PersonVerifySeller reviews fields, checks low-confidence values and edits inline
3 · CRMExecuteOne click creates the verified order and triggers fulfillment
03

See it work

The assistant lives inside the account record, so the seller never leaves Salesforce to validate an order.

04

Three decisions that build AI trust

Gmail inbox with the customer's order email open
Decision 1 · Meet orders where they arrive

No new form for the customer

Customers keep ordering the way they already do, in a plain email. The AI does the work of turning that message into structure, so nobody on either side has to change habits for the system.

Decision 2 · Transparency

Show exactly what the AI understood

The assistant plays back the customer, the account and every item with its quantity in the same terms as the original email, so a seller can check it against the source at a glance. Values the AI is less sure of are flagged for a closer look.

THE EMAIL
WHAT THE AI EXTRACTED
Assistant lists Jane McSnyder from Medical Device LLC and the four kits with quantities
Decision 3 · Human control

Nothing ships without a yes, and every yes can be undone

Explicit confirmation, one-click undo and a plain-language summary keep the seller in charge. Only then does the verified order land in Salesforce, item for item.

Yes, I confirm selected, then the success message with Undo Order Creation
The resulting Salesforce order with the four products, codes and quantities
05

How I led the team

Owned the roadmap

As product owner, defined the roadmap and balanced technical constraints with user needs.

Shaped the architecture

Defined the interaction model and product architecture with 3 technical architects, and ran the design sprints.

Pitched to leadership

Crafted and delivered the executive pitch to the leadership judging panel.

Architecture: the Einstein Validator component in Salesforce Service Cloud calls an Apex controller and LLM gateway to an order processing assistant, then the Order Review component writes order details
The system the team built: email in, AI extraction through an LLM gateway, human review, then order details written to Salesforce.
The 3-minute pitch our team presented to the judging panel.
06

Outcomes

Impact figures are projected, not measured
3rdPlace among company-wide submissions in Salesforce’s innovation competition
80%+Projected cut in entry time, from minutes of typing to a 10-second verification
100%Human oversight on every order, designed to prevent silent AI errors
Proposed roadmap · not committed work

Where the model goes next

Dynamic thresholds. Auto-commit routine reorders above 99% confidence; flag complex ones.

Inline disambiguation. Suggest matches when an email’s product reference is ambiguous.

Guided recovery. Clear fallbacks when order creation fails on inventory locks or account holds.

“Janie’s ability to coordinate, encourage, and motivate a busy team of people was a key success factor that enabled the team to complete the solution within the competition timeframes.”
Mathanan Yogaratnam · VP, Delivery Leader, Salesforce
Next case study Marriott Self-Service Vision → Turned business strategy into a future-state portal that helped win the deal
Marriott help portal category tiles