Concept Shapes

What shape does a concept have inside an embedding model? Put the same values into many sentences, embed them with bge-small-en-v1.5, remove what each sentence contributes, and look at what is left.

Loading…

Shape in the first principal components

Each point is one value, averaged over all sentences. Drag to rotate, scroll to zoom.

Similarity between values

Cosine between value offsets. A line or ring shows as a band along the diagonal; a ring's band also reaches the far corners.

Scorecard

Where in the network the order appears

How well a probe recovers each value's position on new sentences, layer by layer. Click a layer to jump to it.

Sentences used (0)