Telexistence Inc. today announced the mass production of its originally developed artificial intelligence robot, TX SCARA, to be installed in 300 FamilyMart stores, Japan’s top-tier convenience store chain in major metropolitan areas, starting later this month, validating its AI-based “robot-as-a-service” solution for grocery retailers.

TX SCARA was created to do the specific task of restocking refrigerated shelves with bottles and cans, a repetitive, tedious job generally performed by employees in often uncomfortable settings. TX SCARA can be in operation 24/7, replenishing shelves at a pace of up to 1,000 bottles and cans per day, relying almost completely on its AI system (known as “GORDON”) to know when and where products need to be placed on the shelves. 

The implementation of AI robots in FamilyMart stores will allow retailers to take advantage of the newly created time and economic “surplus” in the store environment. Retailers can focus on further improvements in the store environment for both employees and customers, as well as the profitability of each store.

Tomohiro Kano, General Manager of Store Development Department and Railway and Corporate Franchisee Department, of FamilyMart, commented, “The decline in Japan’s labor population is one of the key management issues for FamilyMart to continue stable store operations. The introduction of Telexistence robots into FamilyMart stores will eliminate the need for store employees to replenish beverages in refrigerators, and the newly created time can be reallocated to customer service and shop floor enhancement, leading to higher quality store operations.”

Kano concluded, “We will continue to work with Telexistence to create a new way to operate stores.”

This initiative is a small step toward realizing Telexistence’s mission of improving all simple labor workflows in human society with robots. Telexistence is promoting this initiative based on a collaboration with NVIDIA and Microsoft Japan. Specifically, NVIDIA GPU-accelerated AI technologies are embedded in hardware originally developed by Telexistence to provide AI and remote control of robots via Microsoft Azure platform.

“Currently, the greatest limiting factor for any industry, in any nation, is human resources. Especially in developed countries like Japan, the shortage of human labor is rapidly becoming apparent in the retail and logistics industries, which support human life in society,” said Jin Tomioka, CEO of Telexistence. “We are promoting large-scale production and social implementation of our robots for industries other than factory automation, industries that function as the infrastructure for daily life in society. We also will bring our automated labor solutions to other regions, such as the United States.” Tomioka added, “Telexistence’s robots will become a powerful influence, providing a virtually inexhaustible supply of new labor. The new surplus resources will be appropriately redistributed through market mechanisms, and in the long run, this can lead to the transition of human society to be significantly augmented by automated labor.”

TX SCARA is autonomous with GORDON during normal operation. In rare cases where the AI encounters issues due to miscalculation or external factors such as an item falling or being out of place, remotely located Telexistence employees using VR glasses take control of the robot to correct issues across stores. Each TX SCARA can replace one to three hours every dayof human work at a single store.

The market potential for TX SCARA is vast. In Japan alone, there are 16,000 FamilyMart convenience stores, plus approximately 40,000 more from other convenience store chains. Telexistence next plans to expand to convenience stores in the U.S., where more than half of consumers say they visit one of the country’s 150,000 convenience stores at least once a month.

“Moving from proof-of-concept to mass production of 300 remotely-operated robots with deep AI capabilities is a major step forward,” notes Dr. Lewis Pinault, Airbus Ventures Partner based in Tokyo. “As an early investor of Telexistence, we are thrilled to see the company’s diverse, richly talented team begin to take flight, rolling out their advanced technology across Japan and activating new channels in support of their future expansion in North America.”

Masataka Osaki, Japan Country Manager & VP of Corporate Sales, NVIDA:
“Entire industries are transforming as customers build their next generation of robotics and edge AI applications on NVIDIA platforms. Aiming to empower retailers to address labor shortages, Telexistence’s robotics solution, powered by NVIDIA’s GPU-accelerated technologies, will enhance experiences for both retail customers and employees.”

Tomoko Mikami, Managing Executive Officer, Small Medium & Corporate Business, Microsoft Japan Co., Ltd.:
“Microsoft Japan will be collaborating globally with Telexistence in terms of cloud platform and business development in the implementation of Artificial Intelligent Robotics for qualitative improvement of industry, as promoted by Telexistence. We are pleased that our platform can contribute to this project, and Microsoft will continue to support the project to make a significant impact not only in the Japanese market but also on a global scale.”

---

<Technical Collaborator Details>

Main initiatives powered by NVIDIA

■ Improvement of TX SCARA’s eye and brain functions utilizing NVIDIA Jetson edge AI platform

TX SCARA is powered with the NVIDIA Jetson TX2 module on the head unit which is utilized to transmit video inputted from the camera. Furthermore, the NVIDIA Jetson AGX Xavier module installed at the foot unit attains autonomous operation functions using AI. For example, the TX SCARA is designed with a strong arm and a camera angle so that the same robot hand can grab all types and shapes of beverages sold at convenience stores. Furthermore, NVIDIA Jetson AGX Xavier improves functionality by running image recognition neural networks in parallel, such as recognizing optimal gripping points that differ from beverage to beverage.

■ NVIDIA DGX Station improves recognition accuracy of GORDON

TX SCARA monitors beverage inventory availability 24 hours a day. While receiving this, the AI system “GORDON” predicts and schedules product-display timing and instructs TX SCARA to refill beverage stock. NVIDIA DGX Station, an AI workstation, was adopted as the training environment for GORDON. By simulating product displays in a variety of patterns, it can create an efficient and optimum image recognition model.

■ Smooth remote operation and prevention of VR sickness

If the AI display fails because of an unanticipated environmental change, TX SCARA will shift to Telexistence mode (remote control) and a remote-control operator will make corrections via VR operation. “VR sickness” can occur when there is a misalignment between vision and body senses because of delay in 3D video transmission. In order to prevent this, the system uses NVIDIA’s powerful GPU-accelerated compute capabilities for advanced image processing performance, which enables video transmission at a maximum speed of 50 milliseconds (*).

*: The amount of time (including network delay) that elapses between when the video is inputted into the robot camera and when it is displayed at the operator’s display. A “millisecond” is a thousandth of a second.

---

Main initiatives powered by Microsoft Japan

TX has selected Microsoft Azure as the cloud platform for the robot solution service by TX SCARA and is using it for the robot’s task management system.

■ Microsoft Azure used by GORDON to make task decisions

The inventory information scanned by TX SCARA, which monitors beverage inventory 24 hours a day, is captured by Azure’s cloud system as digital twin information, and the AI system GORDON uses this information to predict the optimal beverage display based on past sales trends at each store and demand by time of day. The AI system “GORDON” then predicts the optimal beverage display based on past sales trends and demand by time of day and determines the next task (*) to be executed by TX SCARA and give instructions.

*: A task is a display task such as “Pick up products from point A and place them at point B.”

■ Database to Minimize Out-of-Stock Merchandise

TX SCARA’s cloud system by Microsoft Azure maintains and manages a database (*) of sales trends at each convenience store where TX SCARA operates. This enables TX SCARA to predict and execute optimal display tasks calculated from current inventory information scanned by TX SCARA in real time and accumulated historical sales trends, thereby minimizing out-of-stocks in stores.

*: Data on products displayed, date and time of display, and number of units.

■ Collaboration in the U.S. Market Entry

TX and Microsoft will strengthen our cooperation in business development overseas, especially in the U.S. market, by leveraging Microsoft’s global corporate customer network and its global startup support program.

---

Telexistence is strengthening its R&D, Business Operations, and Corporate organizations to move forward at an accelerated pace as the business enters a growth stage. Please see below for current open positions.

• Head of Mechanical Engineering
• Mechanical Engineer
• Robotics Automation Perception Engineer
• Robot Maintenance Engineer
• Robot Systems Engineer (Deployment Engineer)
• Robot VR Operator
• Finance Lead
• Accounting Manager
• Sourcing & Procurement Manager

See Careers Page for more details about each position.

---

See Telexistence Press Kit for more photos.

Telexistence Inc. (Headquarters: Chuo-ku, Tokyo; CEO: Jin Tomioka; hereafter TX) and FamilyMart Co., Ltd. (Headquarters: Minato-ku, Tokyo; President: Kensuke Hosomi; hereafter FamilyMart) introduced a new robot TX SCARA equipped with TX’s proprietary AI system Gordon to the “FamilyMart METI store” to perform beverage replenishment work in the backyard 24 hours a day in place of human workers, thereby automating high-volume work in a low-temperature environment where the physical load on store staff is significant.

TX SCARA is a self-developed SCARA (Selective Compliance Assembly Robot Arm) robot that can operate in a small space in a store’s backyard.  It is automatically controlled by Gordon during normal operation. In the event of a restocking failure, the robot can be switched to Telexistence mode, which allows an operator to control the robot remotely through the Internet for quick recovery. In addition, “Gordon” learns from the store’s past sales data to optimize the replenishment timing according to product sales trends that change with time of day and season. Through the use of robotics and AI technology, robots will take over the task of restocking about 1,000 beverages a day, 24 hours a day. Meanwhile, store staff will be able to stay in the shop floor to perform higher value-added tasks such as customer service.

Through the operation of the FamilyMart METI Store, FamilyMart and TX will automate and remoteize  shelr restocking work, which requires a large amount of man-hours and places a heavy burden on humans. It will enable a new store operation where store staff can work via robots from anywhere, safely, as long as there is Internet access. At the same time, TX and FamilyMart will continue to build an environment that is easy to introduce robots (a robot-friendly environment), thereby accelerating the improvement of productivity, non-contact, and customer convenience.

This initiative is also part of the “Task Force to Promote the Construction of Robot Implementation Models” led by the Ministry of Economy, Trade and Industry of Japan, in which FamilyMart participates since November 2019, aiming to reduce the number of workers in stores and build a new store operation infrastructure using robots.

Based on the concept of “FamilyMart, Where You Are One of the Family,” FamilyMart aims to be an indispensable place that goes beyond convenience, while staying close to the community and connecting with each customer like a family member.

TX is a robotics company that develops remote controlled robots with artificial intelligence, with the mission to change robots, change the structure, and change the world. Gathered by high expertise professionals from all over the world, the engineering team consistently develops robotic hardware, software and AI technology in-house. TX aims to expand the scope of robotics activities beyond the factory floor and transform the fundamental nature of labor society.

■Store Information
Name： Family Mart METI Store
Address： Ministry of Economy, Trade and Industry Building, 1-3-1 Kasumigaseki, Chiyoda-ku, Tokyo
Store Hours： 7:00 〜 24:00

■Press Kit for News Organizations

2021/6/4

In October 2021, Telexistence, Inc. (Headquarters: Chuo-ku, Tokyo; CEO: Jin Tomioka) and FamilyMart Co., Ltd. (Headquarters: Minato-ku, Tokyo; President: Kensuke Hosomi) will begin introducing Telexistence’s semi-autonomous remote-controlled robot and its Augmented Workforce Platform throughout FamilyMart retail stores, advancing FamilyMart’s operational infrastructure through groundbreaking remote-controlled robotic technology.

Read more