Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
MPS available — test tensor on mps:0

[1/6] Loading companies from Supabase...
      Loaded 2000 companies
      Columns: ['id', 'name', 'description', 'naics_desc', 'sic_desc', 'super_category', 'employee_estimate', 'b2b_b2c', 'city', 'state', 'website', 'domain', 'agent_readiness_score', 'agent_readiness_details']
      Has agent_readiness_score: 2000 / 2000

[2/6] Serializing context + target views...

  Example context view:
  Company: OnlyData. Agent-ready business data with MCP integration and structured APIs Industry: Computer Systems Design Services. SIC: Prepackaged Software. Category: Data Providers. Size: medium empl

  Example target view:
  Agent readiness: 100/100. Crawlability: 10. Machine Readability: 10. Api Readiness: 10. Has website: yes. Has domain: yes.

[3/6] Encoding with all-MiniLM-L6-v2...

Loading weights:   0%|          | 0/103 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 103/103 [00:00<00:00, 16167.56it/s]

Batches:   0%|          | 0/16 [00:00<?, ?it/s]
Batches:   6%|▋         | 1/16 [00:01<00:20,  1.36s/it]
Batches:  12%|█▎        | 2/16 [00:01<00:08,  1.57it/s]
Batches:  19%|█▉        | 3/16 [00:01<00:05,  2.53it/s]
Batches:  31%|███▏      | 5/16 [00:01<00:02,  4.69it/s]
Batches:  44%|████▍     | 7/16 [00:01<00:01,  6.54it/s]
Batches:  56%|█████▋    | 9/16 [00:02<00:00,  8.23it/s]
Batches:  69%|██████▉   | 11/16 [00:02<00:00, 10.27it/s]
Batches:  81%|████████▏ | 13/16 [00:02<00:00, 11.88it/s]
Batches: 100%|██████████| 16/16 [00:02<00:00, 15.00it/s]
Batches: 100%|██████████| 16/16 [00:02<00:00,  6.67it/s]

Batches:   0%|          | 0/16 [00:00<?, ?it/s]
Batches:  25%|██▌       | 4/16 [00:00<00:00, 34.10it/s]
Batches:  62%|██████▎   | 10/16 [00:00<00:00, 44.39it/s]
Batches: 100%|██████████| 16/16 [00:00<00:00, 36.53it/s]
Batches: 100%|██████████| 16/16 [00:00<00:00, 37.41it/s]
/Users/camfortin/Desktop/claude-cowork/onlydata-jepa/.venv/lib/python3.14/site-packages/umap/umap_.py:1952: UserWarning: n_jobs value 1 overridden to 1 by setting random_state. Use no seed for parallelism.
  warn(
      Context embeddings shape: (2000, 384)
      Target embeddings shape:  (2000, 384)

[4/6] Computing cross-view cosine similarities...
      Cross-view cosine sim — mean: 0.1420  std: 0.0928  min: -0.1136  max: 0.4856

[5/6] Correlation analysis...
      Pearson  r=0.2280  p=5.2735e-25  (n=2000)
      Spearman r=0.2417  p=5.7295e-28  (n=2000)
      Saved: /Users/camfortin/Desktop/claude-cowork/onlydata-jepa/data/cache/sanity_check_correlation.png

[6/6] Running UMAP on context embeddings...
      Saved: /Users/camfortin/Desktop/claude-cowork/onlydata-jepa/data/cache/sanity_check_umap.png

============================================================
VERDICT
============================================================
  Cross-view sim std = 0.0928  → GOOD variance (signal exists)
  Correlation with readiness: Pearson=0.228, Spearman=0.242  → SIGNAL PRESENT

  Plots saved to: /Users/camfortin/Desktop/claude-cowork/onlydata-jepa/data/cache
============================================================