| Project Reference: | ITP/017/22LP |
| Project Title: | Enabling Technologies for Intelligent Human-Robot Interactions In Warehouse and Logistics Industries |
| Hosting Institution: | LSCM R&D Centre (LSCM) |
| Abstract: | Robotic technologies play an increasingly important role in many industries like warehousing and logistics. However, full implementation with 100% robotic automation can be expensive because some tasks are still difficult for robots and human workers still out-perform robots. Therefore, the best choice is to pair robots with human workers, combining the strength and speed of robots with the flexibility and ingenuity of humans. In this project, we aim at designing a model, and developing a sample implementation system, which will encapsulate the cooperative working mode where robots work seamlessly with human workers in the same workplace environment. With this background in mind, the system will be capable of: - Getting information about current human task and progress - Instructing robots what to do and when to be deployed - Providing information like, task allocation and robot status, to human workers at the appropriate moment In this project the project team will investigate and design the model based on a known warehouse environment in Hong Kong. The project team will implement the following technologies during the project: - Collaborative Video Analytics Engine for contextual human action monitoring to provide smarter robot interactions. Decision should be based on: - Human action recognition - Object recognition - Hand gesture command recognition - Tailor-made Graph Convolution Network (GCN) and CNN for the above - Information dissemination and robot status reporting in AR goggle or display devices |
| Project Coordinator: | Mr Martin Chun-Wai LAI |
| Approved Funding Amount: | HK$ 2.79M |
| Project Period: | 30 June 2022 - 31 Dec 2023 |
