texture-eyes

A piece is enough.

A torn corner, a worn-off label, a chipped edge. texture-eyes finds where the piece sits, reads its grain, and names the object. Even when the object has an identical twin.

0 wrongin 374 pieces of real cards, identical copies included. Never the wrong card, never the wrong copy.real archival scans
80 of 80pieces from a twin copy refused when only the original was enrolled.40 pairs of identical cards
61 of 80pieces traced to the right copy with both identical copies enrolled. 0 to the wrong one.40 pairs of identical cards
31 of 40pieces, about 12 percent of a card, rotated and resized, traced to the right card among 100.real archival scans

Watch one recovery, step by step

One real example from start to finish. The piece was cut from a second, separate scan of the same physical card, rotated, resized, and searched against 100 enrolled cards.

STEP 1

Enrol the whole object once

One flat picture of the whole card is all texture-eyes keeps. It is the original every later piece is checked against.

The whole enrolled card
Guy Hecker, Louisville Colonels · enrolled scan
STEP 2

A piece turns up

All that survives is a patch of grass and one trouser leg, rotated and a different size. No label, no serial, nothing that gives it away.

The surviving piece
the piece · about 12 percent of the card
STEP 3

Find where it sits

Distinctive points on the piece are matched against the enrolled card. 107 points agree on one position, so the engine knows exactly where the piece came from, rotated and rescaled.

Lines joining matching points on the piece and on the card
107 agreeing points · green outline is where the piece sits
STEP 4

Line it up and look closer

The piece is turned and scaled onto the card. Left is the card at that spot. Right is the piece laid on top. The printed picture matches by design, so it says nothing about which card this is.

The enrolled region next to the piece laid on it
card at that spot · piece laid on it
STEP 5

Take the picture away. Read the grain.

The printed picture is removed. What is left is paper fibre and ink scatter, the part no press repeats. Left is the card, right is the piece. The specks line up.

Grain of the card and of the piece
grain of the card · grain of the piece
A small square of grain enlarged
enlarged · the same spot on two separate scans
STEP 6

Check a look-alike at the same spot

Another card from the same set has the same picture in the same place. Its grain at that spot does not line up with the piece: 0.00 against 0.81 for the true card.

Grain of a look-alike next to the grain of the piece
grain of the look-alike · grain of the piece
RESULT

Traced to the right card

One card in the gallery agrees on where the piece sits and on the grain at that spot. No other card comes close.

Guy Hecker, Louisville Colonelsscan 0433, the enrolled original. Found among 100 cards in 1.3 seconds.
grain agreement 0.81match line 0.68

The hard one: two identical cards

Same printed picture. Two different pieces of paper. Both copies are enrolled, and the piece below came from copy 2. Which copy is it?

Copy 1 of the card
copy 1 · enrolled
Copy 2 of the card
copy 2 · enrolled
The piece cut from copy 2
the piece · cut from copy 2
Grain of copy 2 beside the grain of the piece
copy 2 grain · piece grain · enlarged
grain agreement 0.96match line 0.68
Grain of copy 1 at the same spot beside the grain of the piece
copy 1 grain at the same spot · piece grain
grain agreement 0.02match line 0.68
Copy 2. Not copy 1.Two printed cards, identical to the eye, one picture. Only copy 2 has this grain.
copy 1copy 2the piece
grain of copy 2 beside the piece
COPY 2 · TRACED

Emil Geiss, Chicago White Stockings

right copy 0.95 · other copy -0.00
copy 1copy 2the piece
grain of copy 2 beside the piece
COPY 2 · TRACED

Jim Fogarty, Philadelphia Quakers

right copy 0.96 · other copy 0.02
copy 1copy 2the piece
grain of copy 2 beside the piece
COPY 2 · TRACED

Stump Weidman, Detroit Wolverines

right copy 0.95 · other copy -0.01
copy 1copy 2the piece
grain of copy 2 beside the piece
COPY 2 · TRACED

Al Myers, Washington Statesmen

right copy 0.95 · other copy 0.01
Piece from a twin copyPiecesRefusedNamed as the original
Only the original enrolled, piece from its twin copy40400
Same, with soft focus40400
Pieces of look-alike cards, never enrolled38380
Both copies enrolledPiecesRight copyWrong copy
Both copies enrolled, piece from either copy80610
Same, with soft focus80320

More recoveries

Pieces of other cards, each rotated and resized, each traced. The card with the piece outlined, the piece, and the grain of the card beside the grain of the piece.

Jack Glasscock, Indianapolis Hoosiers with the piece outlinedthe piece
grain of the card beside grain of the piece
TRACED

Jack Glasscock, Indianapolis Hoosiers

second scan of the same card

grain agreement 0.77 · 41 points agree
Joe Mulvey, Philadelphia Quakers with the piece outlinedthe piece
grain of the card beside grain of the piece
TRACED

Joe Mulvey, Philadelphia Quakers

rotated 13°, resized 105%

grain agreement 0.97 · 173 points agree
J. Ryan, Chicago White Stockings with the piece outlinedthe piece
grain of the card beside grain of the piece
TRACED

J. Ryan, Chicago White Stockings

rotated 3°, resized 93%

grain agreement 0.94 · 151 points agree
Icebox Chamberlain, St. Louis Browns with the piece outlinedthe piece
grain of the card beside grain of the piece
TRACED

Icebox Chamberlain, St. Louis Browns

rotated 6°, resized 88%

grain agreement 0.93 · 156 points agree
John McGraw, New York Giants with the piece outlinedthe piece
grain of the card beside grain of the piece
TRACED

John McGraw, New York Giants

rotated 13°, resized 114%

grain agreement 0.87 · 285 points agree
Jack Farrell, Washington Statesmen with the piece outlinedthe piece
grain of the card beside grain of the piece
TRACED

Jack Farrell, Washington Statesmen

rotated 5°, resized 104%

grain agreement 0.96 · 58 points agree

A look-alike can't fool it

Cards in a set share their printed picture. Matching the picture is not enough, and texture-eyes knows it.

A piece matched by its printed banner to a different card
65 points agree on the printed banner
Grain of the other card beside grain of the piece
grain of the other card · grain of the piece
Same picture, different card. Named no one.The printed banner lines up on an enrolled card, so 65 points agree on a position. The grain agrees 0.03, so texture-eyes does not call it a match.

Across 100 real cards

Library of Congress scans of old tobacco cards. Every piece is searched against all of them.

Pieces of an enrolled cardPiecesRight cardWrong card
Cut from the enrolled scan, rotated and resized40310
Same, with soft focus40170
Cut from a second scan of the same card850
Second scan, with soft focus830

100 real card scans enrolled. Each piece is about 12 percent of a card, cut from a scan, rotated up to 15 degrees and resized between 80 and 115 percent. Twin copies: 40 pairs of the same printed card as two different physical copies, drawn from 147 such pairs in the set. Look-alike pieces come from 19 cards of the same series that were left out of the gallery.