--- title: Hate making your bed? Robots Are Learning to Complete Everyday tasks description: Combining depth sensing with deep learning, we are developing methods to enable robots to grasp objects in heaps—and, soon, even to make your bed. image: https://insights.roboglobaletfs.com/hubfs/Top-view-of-bedding-sheets-and-pillow-958961126.jpeg --- - [![](https://px.ads.linkedin.com/collect/?pid=2261676&conversionId=4842593&fmt=gif)Newsletter Signup](https://insights.roboglobaletfs.com/hate-making-your-bed-robots-are-using-deep-learning-and-depth-sensing-for-tasks-like-this#newsletter-form) ### Newsletter Form ROBO Global uses this information to keep you up to date on the latest investment insights and technology trends. You may unsubscribe from these communications at any time. For more information, check out our [Privacy Policy](https://insights.roboglobaletfs.com/privacy). If you cannot see the form above, you may have an ad blocker preventing it from loading. Please disable the ad blocker and refresh the page. ### Contact Form If you cannot see the form above, you may have an ad blocker preventing it from loading. Please disable the ad blocker and refresh the page. BEGIN YOUR SEARCH... [![VettaFi_ROBO_WHITE-1](https://insights.roboglobaletfs.com/hs-fs/hubfs/VettaFi_ROBO_WHITE-1.png?width=4320&height=1440&name=VettaFi_ROBO_WHITE-1.png "VettaFi_ROBO_WHITE-1")](https://www.roboglobal.com/) - [RESEARCH & INSIGHTS](http://www.roboglobal.com/research-insights) - [MEET THE EXPERTS](http://www.roboglobal.com/about-us) - ROBO Global Indexes - [ROBO Index](https://www.roboglobal.com/robo-global-indices/robo-index/) - [THNQ Index](https://www.roboglobal.com/robo-global-indices/thnq-index/) - [HTEC Index](https://www.roboglobal.com/robo-global-indices/htec-index/) - [How to Invest](https://www.roboglobal.com/robo-etfs) - [ESG](http://www.roboglobal.com/esg-policy) # Investment Insights Authored by: Ken Goldberg Date: August 20, 2019 Category: [ROBO](https://insights.roboglobaletfs.com/tag/robo) Share this: - - - - [mailto:?subject=Hate%20making%20your%20bed?%20Robots%20Are%20Learning%20to%20Complete%20Everyday%20tasks&body=Hate%20making%20your%20bed?%20Robots%20Are%20Learning%20to%20Complete%20Everyday%20tasks%20https://insights.roboglobaletfs.com/hate-making-your-bed-robots-are-using-deep-learning-and-depth-sensing-for-tasks-like-this](mailto:?subject=Hate%20making%20your%20bed?%20Robots%20Are%20Learning%20to%20Complete%20Everyday%20tasks&body=Hate%20making%20your%20bed?%20Robots%20Are%20Learning%20to%20Complete%20Everyday%20tasks%20https://insights.roboglobaletfs.com/hate-making-your-bed-robots-are-using-deep-learning-and-depth-sensing-for-tasks-like-this) ##### Related Posts - [![Turnkey Tech Investing: August 2023 Market Brief](https://insights.roboglobaletfs.com/hubfs/ROBOBrief_Blog%20+%20Turnkey%20Tech-Sep-20-2023-04-28-59-7091-PM.png) Turnkey Tech Investing: August 2023 Market Brief](https://insights.roboglobaletfs.com/turnkey-tech-investing-august-2023) - [![Autonomy Will Redefine Mobility in 2023](https://insights.roboglobaletfs.com/hubfs/Mobility-Trend-Blog-Thumbnail.png) Autonomy Will Redefine Mobility in 2023](https://insights.roboglobaletfs.com/autonomy-will-redefine-mobility) - [![Q2 In Review: Inside the ROBO, THNQ & HTEC Indexes](https://insights.roboglobaletfs.com/hubfs/Q1%202021-1.png) Q2 In Review: Inside the ROBO, THNQ & HTEC Indexes](https://insights.roboglobaletfs.com/q2-in-review-inside-the-robo-thnq-htec-indexes) - [![Automation Isn't Just For the Fortune 500](https://insights.roboglobaletfs.com/hubfs/SMEs%20Automation%20Webinar%20Deck%20(Tifin)%20(1).png) Automation Isn't Just For the Fortune 500](https://insights.roboglobaletfs.com/automation-isnt-just-for-the-fortune-500) ## Hate making your bed? Robots Are Learning to Complete Everyday tasks ![Hate making your bed? Robots Are Learning to Complete Everyday tasks](https://insights.roboglobaletfs.com/hubfs/Top-view-of-bedding-sheets-and-pillow-958961126.jpeg) *By [Ken Goldberg](https://www.roboglobal.com/insights/our_team/ken-goldberg-phd/), William S. Floyd Jr. Distinguished Chair in Engineering, UC Berkeley; ROBO Global Strategic Advisor* Hate making your bed? You’re not alone. According to [this article](https://www.huffingtonpost.co.uk/2014/09/11/make-your-bed-day-duvet-cover-tips_n_5797776.html?guccounter=1) in the Huffington Post, making the bed is one of the most annoying household jobs. My students and I at UC Berkeley’s AUTOLab are exploring how robots might address daily chores like this. Combining depth sensing with deep learning, we are developing methods to enable robots to grasp objects in heaps—and, soon, even to make your bed. Robots are getting better at assisting human workers. An exciting class of mobile manipulation robots that includes deliverables like the [Fetch Robot](https://fetchrobotics.com/) and the [Toyota Human Support Robot](https://blog.siggraph.org/2019/02/inspired-by-service-dogs-inside-toyotas-hsr.html/) has been making headlines for incorporating robotic arms and built-in depth sensing cameras that enable robots to identify, pick up, and carry objects. Investors have taken note. In late July, [Fetch Robotics ](https://techcrunch.com/2018/04/05/fetch-adds-two-new-robots-to-its-warehouse-automation-army/)announced it had raised $46M in Series C funding that it plans to use to expand its operations globally, boost production to meet growing demand, and fund new R&D). Toyota is investing $1B into its AI-focused Toyota Research Institute in Silicon Valley and establishing a $100M fund to invest in startups and new robotics technology. In the healthcare space, Johnson & Johnson recently acquired Auris Health for $3.4B, marking its largest investment to date in surgical robotics—a market that [Global Market Insights](https://www.globenewswire.com/news-release/2019/03/27/1773659/0/en/Surgical-Robots-Market-to-hit-24-Billion-by-2025-Global-Market-Insights-Inc.html) has projected to reach $24B by 2025. The race is on to create robots that can live up to the promise of our imaginations, and one key to bringing those visions to life is technology that can enable robots to perceive and interact with the complex world around them. Over the past 5 years, deep learning has been helping robots improve perception, often using [convolutional neural networks ](https://en.wikipedia.org/wiki/Convolutional_neural_network)(CNNs). CNNs usually use [RGB (red, green, blue) color channels](https://en.wikipedia.org/wiki/Channel_(digital_image)), similar to the type of image taken using a standard digital camera, to capture and analyze visual imagery. But in many tasks, such as driving and grasping, knowing just the colors of an object is limiting. What matters even more is the spatial geometry of the scene. The physical process of manipulation depends not on the object’s color or texture, but on its geometry, pose, size, etc. When you manipulate a pen with your hand, for instance, you can often move it seamlessly without looking at the pen, so long as you have a good understanding of the location and orientation of contact points. When it comes to perception needed to manipulate objects, geometry matters. ## **Adding depth imagery to the equation** In the past, robotic depth sensing has involved matching pairs of points between aligned color images from two different cameras, and then analyzing the differences between those points to perceive depth. While this stereo-vision approach has been somewhat effective, there is still often substantial error in the resulting depth estimates. An alternative is to use depth cameras that output single-channel grayscale images that specifically measure depth values from the camera. Depth is also used to ‘filter’ points beyond a certain distance to remove any background noise that can confuse the robot’s ability to perceive an object accurately. Microsoft had a breakthrough in this technology back in 2012 when it rolled out its [Kinect](https://en.wikipedia.org/wiki/Kinect) for the X-Box. The low-cost Kinect 3d (depth) camera changed the game (pun intended) by enabling much better body tracking than previous methods. Another benefit to depth images is that you can synthesize realistic examples effectively from geometric models. My students and I developed the Dexterity Network—or Dex-Net—research project to focus on robot grasping using deep learning and synthetic depth images. Using this method, we were able to ‘train’ an [ABB YuMi robot](https://new.abb.com/products/robotics/industrial-robots/yumi) to pick up a broad variety of previously unseen objects. The most striking fact about this achievement: our robot was able to outperform the RGB approaches despite not being trained on any real images. Combining the power of [deep learning](https://www.roboglobal.com/insights/tag/deep-learning/) and depth imagery, approaches like this can give robots the ability to learn about the world around them in new ways. Ultimately, this powerful combination will enable robots like Fetch to pick and pack objects in warehouses, and Toyota’s Human Support Robot to help with daily chores, including making the bed—a feat that will surely be more than welcome by senior citizens, parents, and teenagers around the world.   ##### For a closer look at our research in this area (including photos of the AUTOLab’s robot making a quarter-scale bed), see [Drilling Down on Depth Sensing and Deep Learning](https://bair.berkeley.edu/blog/2018/10/23/depth-sensing/) by UC Berkeley’s [Daniel Seita](https://people.eecs.berkeley.edu/~seita/), [Jeff Mahler](https://jeff-mahler.com/), [Mike Danielczuk](https://mjd3.github.io/), [Matthew Matl](https://mmatl.github.io/), and [Ken Goldberg](http://goldberg.berkeley.edu/). To learn more about the lab, including links to published papers, visit autolab.berkeley.edu. [Back to All Entries](https://insights.roboglobaletfs.com) VettaFi, a data, analytics, and thought leadership company, is transforming financial services from an industry to a community—one relationship at a time. In addition to providing interactive online tools and research, VettaFi offers asset managers an array of indexing and digital distribution solutions to innovate and scale their businesses. With billions in assets benchmarked to its indices– and more than 200 customers globally – asset managers look to VettaFi for benchmarks and best-in-class index solutions. VetttaFi owns and administers the ROBO Global Index Series. ## Navigation - [Home](http://www.roboglobal.com) - [ROBO Research](http://www.roboglobal.com/whitepapers) - [Investment Insights](https://insights.roboglobaletfs.com) - [ROBO Index](http://www.roboglobal.com/robo-global-indices/robo-index) - [THNQ Index](http://www.roboglobal.com/robo-global-indices/thnq-index) - [HTEC Index](http://www.roboglobal.com/robo-global-indices/htec-index) ### Newsletter Signup My rich text default content © 2026 ROBO Global Index, LLC. All Rights Reserved ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "Ken Goldberg", "url" : "https://insights.roboglobaletfs.com/author/ken-goldberg" }, "dateModified" : "2021-04-26T21:07:49.508Z", "datePublished" : "2019-08-20T18:45:11.000Z", "headline" : "Hate making your bed? Robots Are Learning to Complete Everyday tasks", "image" : [ "https://insights.roboglobaletfs.com/hubfs/Top-view-of-bedding-sheets-and-pillow-958961126.jpeg" ], "mainEntityOfPage" : { "@id" : "https://insights.roboglobaletfs.com/hate-making-your-bed-robots-are-using-deep-learning-and-depth-sensing-for-tasks-like-this", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject", "url" : "https://insights.roboglobaletfs.com/hubfs/Imported%20images/ROBO_LOGO_WITHTAG_STACKED_BLUE.png" }, "name" : "ROBO Global & Range ETFs" } } ```