I propose a simple benchmark for robots replacing all human labor based on the textile industry

The moment robots can produce clothing (like the clothes you presumably are wearing right now) at a cost that is economically viable, they will at that point replace all human labor. Clothes are extremely tough for robotic dexterity, due to the variations in fabrics and the general physics around stretchable objects. Clothes are also very cheap to make, some person in Bangladesh making 60 cents an hour is manufacturing your clothes. If a robot can make clothes and displace all of the humans doing it, then there's no dexterity or cost roadblock remaining.