Wednesday, December 13, 2023

Chatty robots are here...

A number of domestic and robot companies have been funded, some have already failed but two stand out, as being well funded because they have shown remarkable progress. If any are successful, and success means different things in different markets, there will be huge demand. Domestic robots are one thing but functional working robots is quite another. Increases in productivity, along with zero salary costs would create a radical shift in real world, vocational jobs.

There have been ridiculous pretenders like Sophie, basically chatbots in cheap bits of plastic but two companies stand out; Figure and Optimus.

Figure

Figure have been first to bring a general purpose robot to life with a superb robot integrated with OpenAI's ChatGPT. The dialogue is fascinating, with visual recognition of people and objects, interpretation of incoming speech, completion of tasks and what appears to be explanations of its own behaviour. There is a little latency, suggesting this will be a problem but that doesn't matter. One can imagine open source, local models, trained inside the robot (models are not that big) with developing functionality around dialogue.




It is dialogic is the full sense of the word, using dialogue in language as well as recognition and action dialogue with the real world. Note that there is a limited set of real world actions, limited by what the robot can and should do. Problems are broken down and turned into specific plans within certain constraints.

The demo is at normal speed and uses AI, namely an A-Z neural network. We now see the integration of image recognition (seeing), sound recognition through microphones, with speech the interpretation of planning then action. It uses a pre-trained multimodal model (we don't know what - probably better than GPT4 - one specific to robotics) with language recognition, generation, along with actions. These robots are likely to use specific MMNs.

Image recognition is recognition and reason. This also sounds like a human as the speech generation software does this. Then it moves and performs actions, keeps balanced, makes smooth movements, grasps, moves and places objects as a stand-alone robot.

Very impressive.

Optimus

Musk has stated that his robot business could out perform his car business. Potentially, he is right. Robots change the nature not just of driving but work itself - initially unsafe or mundane tasks. This would be an enormous shock to the economy, as 24 hour labour becomes cheap, plentiful and scalable.

He has told employees that Tesla could become a $10 trillion company on the back of this. The robot is the same size as a human so the it fits into existing work context as we do.

Still 2023 and progress by Tesla is phenomenal. Neck movements really bring it to life, tactile sensing on fingers can deal with an egg. The hands are where the action is. Waste of time walking and running if you can't do things. Five fingers, all the same length making manufacturing and maintenance easier. The dexterity is amazing. Within a year Musk tweeted, it will thread a needle.

There is nothing in the head, as it can all be in the body. The head is just a camera and possibly a display screen. The point is not to wholly mimic a human. Airplanes do no wholly mimic birds, the design is driven by needs.

The fact that it can walk shows they're after any domain where humans work and operate. We'll see fixed robots (factories), wheeled robots (limited area) and legged robots, I'm sure. Walking has toe articulation, a real advance. Looks slow but speed may not be the key issue. Most people are fairly stationary most of the time in life. It can squat and dance. Injection moulded body parts reduce weight and costs.

It's all in the acuators. An actuator is a device that converts energy (typically electrical, hydraulic, or pneumatic) into mechanical motion. This is the trick, to make these a high enough quality and easy to manufacture.

It will, of course talk and listen. You will be able to tell it what to do and it will have Chatbot functionality. 

I can see these being your butler, something you can chat to, a companion. But there are thousands of potential real-world applications in the workplace. Think care homes, hospitals, retail.

Go further and think Teachers and Doctors?

Release date 3-5 years?




No comments: