• Corpus ID: 239616157

Self-Initiated Open World Learning for Autonomous AI Agents

@article{Liu2021SelfInitiatedOW,
  title={Self-Initiated Open World Learning for Autonomous AI Agents},
  author={Bing Liu and Eric Robertson and Scott Grigsby and Sahisnu Mazumder},
  journal={ArXiv},
  year={2021},
  volume={abs/2110.11385},
  url={https://api.semanticscholar.org/CorpusID:239616157}
}
A theoretic framework for this learning paradigm is proposed to promote the research of building Self-initiated Open world Learning (SOL) agents and an example SOL agent is described.
[PDF] Semantic Reader
6 Citations
Highly Influential Citations
1
Background Citations
3
Methods Citations
3

Ask This Paper
BETA
AI-Powered

Our system tries to constrain to information found in this paper. Results quality may vary. Learn more about how we generate these answers.

6 Citations

Open-World Continual Learning: Unifying Novelty Detection and Continual Learning

This paper theoretically proves that OOD detection actually is necessary for CIL, and shows that CIL can be decomposed into two sub-problems: within-task prediction (WP) and task-id prediction (TP).

Autonomous AI: what does autonomy mean in relation to persons or machines?

It is proposed that there are two distinct and separate concepts of autonomy, Person Autonomy and Machine Autonomy, and that this distinction can guide how the law should treat AI systems.

A Theoretical Study on Solving Continual Learning

This study shows that probabilistically, the CIL problem can be decomposed into two sub-problems: Within-task Prediction (WP) and Task-id Prediction (TP), and proves that TP is correlated with out-of-distribution (OOD) detection, which connects CIL and OOD detection.

From “Thumbs Up” to “10 out of 10”: Reconsidering Scalar Feedback in Interactive Reinforcement Learning

It is found that when considering how consistently a participant labeled the same data, scalar feedback led to less consistency than binary feedback; however, the difference vanishes if small mismatches are allowed, and scalar and binary feedback show no significant differences in their correlations with key Reinforcement Learning targets.

GOOD: Exploring Geometric Cues for Detecting Objects in an Open World

This work uses the geometric cues to train an object proposal network for pseudo-labeling unannotated novel objects in the training set, and significantly improves detection recall for novel object categories and already performs well with only a few training classes.

Open-Learning Framework for Multi-modal Information Retrieval with Weakly Supervised Joint Embedding

It is shown that topics and structural features can be used as a weak-supervision source, as well as provide a better semantic representation for retrieval of similar multi-modal data, in a weakly supervised open-learning framework.

23 References

Open-World Learning for Radically Autonomous Agents

This paper proposes a framework for characterizing environments in which goal-directed physical agents operate, along with specifying the ways in which those environments can change over time, and outlines some approaches to the empirical study of such open-world learning.

Towards a Unifying Framework for Formal Theories of Novelty

This work presents the first unified framework for formal theories of novelty and uses the framework to formally define a family of novelty types that can be applied across a wide range of domains, from symbolic AI to reinforcement learning, and beyond to open world image recognition.

Challenges of real-world reinforcement learning: definitions, benchmarks and analysis

This work identifies and formalizes a series of independent challenges that embody the difficulties that must be addressed for RL to be commonly deployed in real-world systems and proposes an as an open-source benchmark.

Learning on the Job: Online Lifelong and Continual Learning

On-the-job learning aims to leverage the learned knowledge to discover new tasks, interact with humans and the environment, make inferences, and incrementally learn the new tasks on the fly during applications in a self-supervised and interactive manner.

Learning Cumulatively to Become More Knowledgeable

Experimental results on two datasets with learning from 2 classes to up to 100 classes show that the proposed approach is highly promising in terms of both classification accuracy and computational efficiency.

Lifelong Machine Learning

As statistical machine learning matures, it is time to make a major effort to break the isolated learning tradition and to study lifelong learning to bring machine learning to new heights.

Continual Lifelong Learning with Neural Networks: A Review

Lifelong and Continual Learning Dialogue Systems: Learning during Conversation

This paper proposes to dramatically improve the situation by endowing the chatbots the ability to continually learn new world knowledge, new language expressions to ground them to actions, and new conversational skills, during conversation by themselves so that as they chat more and more with users, they become more andMore knowledgeable.

Open-world Machine Learning: Applications, Challenges, and Opportunities

This article has thoroughly analyzed the existing literature and provided a novel taxonomy of OWML considering its two major application domains: Computer Vision and Natural Language Processing.

Open-world Learning and Application to Product Classification

A new OWL method based on meta-learning that maintains only a dynamic set of seen classes that allows new classes to be added or deleted with no need for model re-training.