# Isaac
"The son of Samu is Isaac." It is our hope that Samu (and Isaac) will be the ancestor of developmental robotics chatter bots that will be able to chat in natural language like humans do.
See also the page [Family Robotics - Deep Q-learning with Samu](http://shrek.unideb.hu/~nbatfai/)

## Genealogy of Isaac

1. [Samu](https://github.com/nbatfai/samu)
The main purpose of this project is to allow the evaluation and verification of the results of the paper entitled 
**"A disembodied developmental robotic agent called Samu Bátfai"**, [http://arxiv.org/abs/1511.02889](http://arxiv.org/abs/1511.02889). It is our hope that Samu will be the ancestor of developmental robotics chatter bots that will be able to chat in natural language like humans do.
2. [Isaac](https://github.com/nbatfai/isaac)
*"The son of Samu is Isaac."* The project called Isaac is a case study of using deep Q learning with neural networks for predicting the next sentence of a conversation.
3. [Jacob](https://github.com/nbatfai/jacob)
*"The son of Isaac is Jacob."* The project called Jacob is an experiment to replace Isaac's (GUI based) visual imagination with a character console. 
4. [Judah](https://github.com/nbatfai/judah)
*"The son of Jacob is Judah."* In the project called Judah we equip Jacob with a text-based user interface.
5. [Super-Judah](https://github.com/nbatfai/super-judah)
6. [Perez](https://github.com/nbatfai/perez)
*"The son of Judah is Perez."* The project called Perez allows to perform experiments to test several parameter settings. Here each experiment is implemented as a separate git branch.
7. [Hezron](https://github.com/nbatfai/hezron)
*"The son of Perez is Hezron."* The project called Hezron gives the opportunity to experiment with different arrangements of SPO triplets in the visual imagery.
8. [Ram](https://github.com/nbatfai/ram)
*"The son of Hezron is Ram."* The project called Ram allows to experiment with different deep Q learning algorithms to express feelings when he is talking.
9. [Amminadab](https://github.com/nbatfai/amminadab)
*"The son of Ram is Amminadab."* In project called Amminadab we can significantly improve Samu's learning by using the Liv-Zempel-Welch dictionary tree to narrow the scope of selecting Q-actions.

## Use cases

- version 0.0.1, Isaac sleeps, wakes up, then sleeps again, https://youtu.be/LQKm_43CFYM
- version 0.0.2, 

# Samu
One of the purpose of the original Samu project was only to allow the evaluation and verification of the results of the paper entitled 
**"A disembodied developmental robotic agent called Samu Bátfai"**, [http://arxiv.org/abs/1511.02889](http://arxiv.org/abs/1511.02889).
This paper presents Q learning with neural networks approximators used by Samu. It is our hope and goal that Samu 
will be the ancestor of developmental robotics chatter bots that will be able to talk and read in natural language like humans do.
At this moment Samu is the generic name of rapid prototypes that facilitate achieving this goal.

## Highlights of Samu

Samu

1. directly implements the definition of machine consciousness (such as the definitions of conscious and intuitive computer programs) 
introduced in the paper entitled [Conscious Machines and Consciousness Oriented Programming](http://arxiv.org/abs/1108.2865).
2. corresponds the principles of Developmental Robotics, [Some Basic Principles of Developmental Robotics](http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=5200465&url=http%3A%2F%2Fieeexplore.ieee.org%2Fiel5%2F4563672%2F5290358%2F05200465).
3. applies Q learning with neural networks approximators
4. uses multilayer perceptrons for approximation of the Q function, 
it is a deep Q learning feature, [Human-level control through deep reinforcement learning](http://www.nature.com/nature/journal/v518/n7540/full/nature14236.html)