Functional Object-Oriented Network for Manipulation Learning
videos, merging, robots, mirrors, neurons, object oriented modeling, visualization, manipulation motion sequences, functional object-oriented network, manipulation learning, structured knowledge representation, FOON, functional-related objects connectivity, manipulation tasks, graphical model, object state change, human manipulations
Digital Object Identifier (DOI)
This paper presents a novel structured knowledge representation called the functional object-oriented network (FOON) to model the connectivity of the functional-related objects and their motions in manipulation tasks. The graphical model FOON is learned by observing object state change and human manipulations with the objects. Using a well-trained FOON, robots can decipher a task goal, seek the correct objects at the desired states on which to operate, and generate a sequence of proper manipulation motions. The paper describes FOON's structure and an approach to form a universal FOON with extracted knowledge from online instructional videos. A graph retrieval approach is presented to generate manipulation motion sequences from the FOON to achieve a desired goal, demonstrating the flexibility of FOON in creating a novel and adaptive means of solving a problem using knowledge gathered from multiple sources. The results are demonstrated in a simulated environment to illustrate the motion sequences generated from the FOON to carry out the desired tasks.
Was this content written or created while at USF?
Citation / Publisher Attribution
2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, 2016, p. 2655-2662.
Scholar Commons Citation
Paulius, David; Huang, Yongqiang; Milton, Roger; Buchanan, William; Sam, Jeanine; and Sun, Yu, "Functional Object-Oriented Network for Manipulation Learning" (2016). Computer Science and Engineering Faculty Publications. 81.