Adaptive Learning Through Active Neuromodulation (ALAN)
Abstract:
Under the lifelong learning machines (L2M) program, Teledyne set out to research, implement and demonstrate algorithmic approaches to address two key problems. First, enabling intelligent agents to self-supervise in order to adapt and learn in complex environments without external intervention. To address this problem, Teledyne developed and validated the role of uncertainty tracking and modulation to enable agents to monitor their own performance and adapt with confidence when appropriate conditions exist. This is a significant breakthrough in that it demonstrated self-supervised learning and task performance by an embodied agent. The second problem was to enable robust knowledge representations that would remain accurate despite continual learning and adaptation and could accommodate the complexity of learning multiple tasks with likely differing requirements on knowledge granularity and composition. Teledyne developed and implemented a hierarchical learning system capable of decomposing task information across multiple layers to maximize robustness and re-use. This is a significant breakthrough as it enables a new class of learning systems that can maintain a consistent knowledge base and update it to accommodate multiple tasks without the requirements that they share a unified representation. The resulting algorithms were demonstrated to have a role in enhancing performance in state-of-the-art machine learning systems, and thus can be incorporated into many present-day AI solutions to equip them with lifelong capabilities. A key recommendation is to look for opportunities to transition these capabilities into existing AI systems, thus facilitating their transition to next-wave AI. Another recommendation is to see these accomplishments as a first step in elucidating lifelong learning mechanisms, and to engage in continued research to more fully understand how to achieve learning in highly complex environments and conditions.