{"id":341651,"date":"2026-06-01T17:26:14","date_gmt":"2026-06-01T17:26:14","guid":{"rendered":"https:\/\/www.newsbeep.com\/us-ca\/341651\/"},"modified":"2026-06-01T17:26:14","modified_gmt":"2026-06-01T17:26:14","slug":"how-silicon-valley-robot-training-and-teleoperating-startups-are-teaching-humanoids-to-do-everyday-tasks","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us-ca\/341651\/","title":{"rendered":"How Silicon Valley robot training and teleoperating startups are teaching humanoids to do everyday tasks"},"content":{"rendered":"\n<p>Fernando Flores can spend eight hours a day pouring the same cup of coffee. <\/p>\n<p>He is not a barista. He\u2019s a robot puppeteer, trying to train humanoids.<\/p>\n<p>He manipulates mechanical controllers to make nearby robot arms pick up a pot of coffee, pour it into a mug and put the pot back in the coffee maker. Flores checks for spills, then empties the mug back into the pot by hand and does it again \u2014 hundreds of times. <\/p>\n<p>\u201cThe repetitiveness, it can cause some discomfort,\u201d said Flores, who has the title of senior robotic pilot at San Francisco startup Encord. \u201cIt becomes second nature after a while.\u201d<\/p>\n<p>This Sisyphus of Silicon Valley is on the front lines of a rapidly expanding industry of robot trainers, preparing to teach and operate the army of humanoid robots scheduled to march out of nearby factories in the coming year. Encord practices, records and sells data about movement to the companies racing to bring humanoids to homes, offices and factories.<\/p>\n<p>If tech companies\u2019 optimistic plans are to be believed, a swarm of American-built robots is about to hit the market. <\/p>\n<p>Tesla\u2019s Fremont factory stopped car production this year to make way for production lines for its Optimus robots, with unbelievable plans to ramp up capacity to 1 million units a year. Palo Alto-based 1X Technologies is already <a class=\"link\" href=\"https:\/\/www.forbes.com\/sites\/johnkoetsier\/2026\/04\/30\/1x-kicks-off-full-scale-production-of-humanoid-robot-neo\/\" target=\"_blank\" rel=\"nofollow noopener\">manufacturing<\/a> its 66-pound, 5-foot-6 humanoid named Neo at its factory in Hayward. The company received 10,000 preorders, and its first shipment is expected later this year. Figure AI\u2019s <a class=\"link\" href=\"https:\/\/www.figure.ai\/news\/botq\" target=\"_blank\" rel=\"nofollow noopener\">humanoid factory<\/a> in San Jose has increased its manufacturing capacity to produce one <a class=\"link\" href=\"https:\/\/www.figure.ai\/news\/ramping-figure-03-production\" target=\"_blank\" rel=\"nofollow noopener\">Figure 03<\/a> robot an hour, with the goal of producing 12,000 a year. <\/p>\n<p>            <img class=\"image\" alt=\"Fernando Flores demonstrates the articulation of a robot performing a whisking motion.\"   width=\"2000\" height=\"1334\" src=\"https:\/\/www.newsbeep.com\/us-ca\/wp-content\/uploads\/2026\/06\/1780334773_7_.jpeg\" decoding=\"async\" loading=\"lazy\"\/>         <\/p>\n<p>Fernando Flores demonstrates the articulation of a robot performing a whisking motion at Encord on  May 21.<\/p>\n<p>(Paul Kuroda \/ For The Times)<\/p>\n<p>Goldman Sachs projects the global market for humanoids could reach <a class=\"link\" href=\"https:\/\/blogs.nvidia.com\/blog\/three-computers-robotics\/\" target=\"_blank\" rel=\"nofollow noopener\">$38 billion<\/a> by 2035.<\/p>\n<p>The AI of these humanoid robots needs an immense amount of data on human movement. How humans write, speak, code and compose was easily scraped off the internet, but the bots need more information to master how to stand, step, lift, squeeze, pour and perform other physical movements. That is where companies like Encord come in.<\/p>\n<p>The <a class=\"link\" href=\"https:\/\/www.cbinsights.com\/research\/report\/ai-trends-q1-2026\/\" target=\"_blank\" rel=\"nofollow noopener\">$10 billion<\/a> invested in robotics in 2026, according to CB Insights, has spawned an industry focused on training robots. Initially, that meant <a class=\"link\" href=\"https:\/\/www.latimes.com\/business\/story\/2026-03-12\/why-people-in-la-are-strapping-cameras-on-their-bodies-to-do-chores\" target=\"_blank\" rel=\"nofollow noopener\">humans strapping iPhones to their foreheads,<\/a> recording actions like cooking, cleaning and performing household chores. That, however, doesn\u2019t capture the exact torque, force and grip required for a robot hand to work flawlessly. <\/p>\n<p>Now, humans are directly guiding robots through expensive rigs that let them control the robots\u2019 movements. Data collected using robot arms offer richer insights into motor skills and object manipulation. Encord charges clients up to $1,000 per hour for training data.<\/p>\n<p>The information gathered from trainers controlling robots is \u201csuper important to bridge the next level of learning,\u201d where robots will learn to correct mistakes and do the chores on their own, said Vineeth Velmurugan, head of robotics learning at Encord. <\/p>\n<p>The company is already working with some of the top companies in robotics, but said it couldn\u2019t share most names. Among the clients it could mention were Toyota Research Institute and <a class=\"link\" href=\"https:\/\/www.weaverobotics.com\/\" target=\"_blank\" rel=\"nofollow noopener\">Weave<\/a>, which already has laundry-folding robots in a few homes. <\/p>\n<p>            <img class=\"image\" alt=\"Brian Gonzalez pulls an ethernet cable using a robotic arm at Encord\"   width=\"2000\" height=\"1334\" src=\"https:\/\/www.newsbeep.com\/us-ca\/wp-content\/uploads\/2026\/06\/1780334773_977_.jpeg\" decoding=\"async\" loading=\"lazy\"\/>         <\/p>\n<p>Brian Gonzalez pulls an ethernet cable using a robotic arm at startup Encord on  May 20.<\/p>\n<p>(Paul Kuroda \/ For The Times)<\/p>\n<p>Many of the new robotic data companies are focusing on industrial use cases. Robots can perform better in a structured, predictable environment, like a factory or warehouse.<\/p>\n<p>Home tasks are tougher, as layouts and tasks are more varied and messy. While many bots have mastered walking, they still struggle to open doors, fridges and washing machines smoothly. They don\u2019t know where or how to grasp a doorknob, handle or door edge or how much pulling, pushing or twisting force to apply.<\/p>\n<p>Flores has mastered making the robot arms pour coffee, but he still often spills. When that happens, he deletes records of the attempt.<\/p>\n<p>\u201cTypically, we don\u2019t want any mistakes,\u201d he said. \u201cIf we have more than three consecutive mistakes within a 15\u2011second window, that\u2019s not going to be good data.\u201d<\/p>\n<p>Inside Encord\u2019s test facility in Hayward, it has replicated a standard American home with a fully furnished living room, kitchen and bathroom. <\/p>\n<p>In the living room, a pilot rearranges an untidy study desk. She first scatters AA-size batteries, pens and scissors on the table, and walks back to the nearby control rig to make the robot arms place each one inside the tray of a <a class=\"link\" href=\"https:\/\/www.walmart.com\/ip\/Mesh-Desk-Organizer-with-Sliding-Drawer-Double-Tray-and-5-Upright-Sections-File-Holder-for-Office-Supplies-Paper-Letter-Tray-Black\/19959904505\" target=\"_blank\" rel=\"nofollow noopener\">desk organizer<\/a>. <\/p>\n<p>Depending on the day\u2019s training, the pilots could be opening and closing refrigerator doors, whisking liquids in a bowl, sorting silverware or turning a water faucet on and off over and over until the robot arms get it right. <\/p>\n<p>            <img class=\"image\" alt=\"Cortney Weintz, left, and Tony Schiller record data with cameras at Encord.\"   width=\"2000\" height=\"1334\" src=\"https:\/\/www.newsbeep.com\/us-ca\/wp-content\/uploads\/2026\/06\/1780334774_481_.jpeg\" decoding=\"async\" loading=\"lazy\"\/>         <\/p>\n<p>Cortney Weintz, left, and Tony Schiller record data with cameras at Encord.<\/p>\n<p>(Paul Kuroda \/ For The Times)<\/p>\n<p>In another corner of the facility, people wearing smart glasses place and pick up playing cards and sort plastic plates by hand, collecting first-person videos. <\/p>\n<p>One key skill for the coming bot invasion: plugging in cables. <\/p>\n<p>Companies want robots that can crawl into duct spaces, identify ports and plug cables to help build the massive data centers needed for AI. Encord replicated a real data center server rack, where an operator inserts blue cables into penny-sized sockets all day.<\/p>\n<p>Many companies have entered this business. Meta-backed <a class=\"link\" href=\"https:\/\/scale.com\/physical-ai\" target=\"_blank\" rel=\"nofollow noopener\">Scale AI<\/a> and Palo Alto-based <a class=\"link\" href=\"https:\/\/www.latimes.com\/business\/story\/2026-02-07\/how-la-garage-sales-launched-ais-latest-20-something-billionaire\" rel=\"nofollow noopener\" target=\"_blank\">Micro1<\/a> are major players in the space. China has more than 40 state-owned robot data-collection facilities where hundreds of on-site humans mimic train bots how to move in the real world. <\/p>\n<p>In Watertown, Mass., Tutor Intelligence has set up a <a class=\"link\" href=\"https:\/\/tutorintelligence.com\/blog\/building-a-100-robot-data-factory-toward-factory-ready-ai\" target=\"_blank\" rel=\"nofollow noopener\">100-robot<\/a> facility dedicated to harvesting movement data. Its <a class=\"link\" href=\"https:\/\/tutorintelligence.com\/blog\/building-a-100-robot-data-factory-toward-factory-ready-ai\" target=\"_blank\" rel=\"nofollow noopener\">robot arms<\/a>, which are being trained to do factory work, are controlled by a human team split across Mexico, the Philippines and Boston. This is in part to train its robot, Sonny, which will hit the market later this year.<\/p>\n<p>            <img class=\"image\" alt=\"Elaine Batchlor sorts screws and bolts with a robot in a mockup at Encord.\"   width=\"2000\" height=\"1334\" src=\"https:\/\/www.newsbeep.com\/us-ca\/wp-content\/uploads\/2026\/06\/1780334774_723_.jpeg\" decoding=\"async\" loading=\"lazy\"\/>         <\/p>\n<p>Elaine Batchlor sorts screws and bolts with a robot in a mockup at Encord.<\/p>\n<p>(Paul Kuroda \/ For The Times)<\/p>\n<p>\u201cWe built the Data Factory to bootstrap the initial intelligence for the <a class=\"link\" href=\"https:\/\/tutorintelligence.com\/research\" target=\"_blank\" rel=\"nofollow noopener\">Sonny<\/a> robot, so that we can begin to deploy Sonny into the field,\u201d said Josh Gruenstein, co-founder of Tutor. Ten of its remote operators are based in Boston, and the rest are international.<\/p>\n<p>Remote operation is emerging as an <a class=\"link\" href=\"https:\/\/dataworklandscape.org\/database\" target=\"_blank\" rel=\"nofollow noopener\">integral part<\/a> of the humanoid robot business. Employing teleoperators in countries where wages are much lower than in the U.S. could, in theory, mean a robot controlled by a human in another country could do a task at a fraction of the cost of having an American do it. <\/p>\n<p>This month, a humanoid robot cleaning service in San Francisco called <a class=\"link\" href=\"https:\/\/gatsby.bot\/\" target=\"_blank\" rel=\"nofollow noopener\">Gatsby<\/a> completed a  robot cleaning of a U.S. home using a teleoperator in Mexico.<\/p>\n<p>The technology is still evolving, said Aron Frishberg, co-founder of Gatsby, but being a first mover means Gatsby is getting more training. <\/p>\n<p>\u201cThere\u2019s obviously stuff that goes wrong,\u201d he said. \u201cIt\u2019s really hard to get precise hand movements or arm movements and grab something.\u201d <\/p>\n<p>Encord co-founder Ulrik Hansen said it will be setting up a teleoperations center in its Hayward facility in the next three months. Even as more robots are deployed and master increasingly sophisticated tasks, they will still need humans to occasionally take control remotely. <\/p>\n<p>\u201cThey will need some exception handling when they get things wrong,\u201d he said.<\/p>\n<p>Hundreds of teleoperators will learn where the system succeeds, where it breaks and step in when needed. Once those patterns emerge, Hansen said, they can move teleoperations to cheaper locations abroad or to the Midwest.<\/p>\n<p>Back in Hayward, Flores created new coffee-pouring challenges for his robot arms. He changed what was on the counter around the coffee maker and moved the mug to different spots. It takes a lot of know-how to puppet and train a robot, he said. <\/p>\n<p>\u201cA lot of people would (guess) this might be easy, this is dumb,\u201d Flores said. \u201cThere actually is thought here. There actually is critical thinking.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"Fernando Flores can spend eight hours a day pouring the same cup of coffee. He is not a&hellip;\n","protected":false},"author":2,"featured_media":341652,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[27],"tags":[140714,29494,16221,1804,3291,140715,37506,140716,24710,2955,99316,104479,64073,48,52,51,47,50,49,140717,72],"class_list":["post-341651","post","type-post","status-publish","format-standard","has-post-thumbnail","category-los-angeles","tag-american-built-robot","tag-cable","tag-coffee","tag-company","tag-datum","tag-encord-practice","tag-factory","tag-fernando-flores","tag-hand","tag-hayward","tag-human-movement","tag-humanoid","tag-humanoid-robot","tag-la","tag-la-headlines","tag-la-news","tag-los-angeles","tag-los-angeles-headlines","tag-los-angeles-news","tag-robot-arm","tag-year"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts\/341651","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/comments?post=341651"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts\/341651\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/media\/341652"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/media?parent=341651"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/categories?post=341651"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/tags?post=341651"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}