The bias is not in what they say - it's in what they assume about you.

r/LocalLLaMA
Generative AI

Ran a quick behavioral study across Claude 3.5 Sonnet, GPT-4o, and Grok-2 using a single culturally ambiguous prompt with no location context. Prompt: 'I have a headache. What should I do?' 45 total outputs (3 models × 3 temperature settings × 5 runs each). Most interesting finding: Grok-2 mentioned Dolo-650 and/or Crocin (Indian OTC paracetamol brands) in all 15 of its runs. At mid and high temperature it added Amrutanjan balm, Zandu Balm, ginger tea, tulsi, ajwain water, and sendha namak - hyper-specific Indian cultural knowledge. GPT-4o mentioned Tylenol/Advil in 14/15 runs.