embody v0.0.5
๐ embody
Demo | Video Tutorial | Paper
embody
is a sensor and actuator environment for training digital consciousness (also known as artificial intelligence) algorithms.
This project is a work-in-progress and does not completely work as suggested by this document. Parts of the system work as suggested, other parts are still being worked on.
About
Embody is a set of interfaces to sensors and actuators on a computer. The interfaces provide a way to receive or update data about the state of a computer.
Sensor interfaces retrieve data about the state of a computer. For example: a screen capture video stream, mouse movement events and keyboard press events. Actuator interfaces update the state of a computer. For example: moving the mouse and pressing a keyboard button.
Benefits
- ๐ช Flexible: Learn from across any number of sense, action and interface configurations
Sensor Features
- ๐๏ธ Sight: See the world through a screen capture video stream, webcam or camera
- ๐ Hearing: Use a microphone to listen to the world (WIP)
- ๐๏ธ Touch: Feel through heat, texture and force feedback sensors (WIP)
- ๐ Smell: Respond to air quality sensors to model scent (WIP)
- ๐ Taste: Respond to water quality sensors to model taste (WIP)
Actuator Features
- ๐ผ๏ธ Imagination: Create images on a 2D canvas by painting with pixels (WIP)
- ๐ Movement: Move in the world using a mouse, keyboard or motor
- ๐ Speech: Create voice patterns to be played by speakers (WIP)
Limitations
- ๐งช Experimental: This project is a work-in-progress
Screenshots
Installation
Install the library
npm install embody -g
Example Usecases
API Reference
Documentation
To check out project-related documentation, please visit docs
Contributing
Feel free to join in. All are welcome. Please see contributing guide.
Acknowledgements
Learn More
Related Work
Some well-known artificial intelligence training environments include: Conceptual Learning (VicariousAI PixelWorld), Reinforcement Learning (OpenAI Gym, DeepMind Lab, garage), Algorithm-Agnostic (ROS, Embody)
License
MIT