Lethal Shooter and Cue6
© Jason Halayko / Red Bull Content Pool
Basketball

Lethal Shooter and a robot shooter: Technology meets basketball

What happens when Lethal Shooter, the world’s best shooting coach, and the world’s most advanced AI shooting robot (Cue6) meet? This is the intersection between technology and basketball.
By Riley Hunter
9 min readPublished on
Chris Matthews, aka “Lethal Shooter," is known as one of basketball’s elite shooters and the best shooting coach in the world. He recently traveled to Japan for the ultimate collab with the world’s most advanced artificial intelligence (AI) shooter - aka “Cue6.”
Lethal Shooter and Cue6

Lethal Shooter and Cue6

© Jason Halayko / Red Bull Content Pool

Cue6 is Toyota’s AI basketball robot. In 2019, Cue set the Guinness World Record for the most consecutive basketball free throws by a humanoid robot. "It's not just a robot without feelings or thinking capabilities," said Lethal. "To shoot accurately, it analyzes the trajectory with multiple cameras."
A robot shooter like Cue6 relies on consistency, precision and objective feedback. "It's ahead of its time, belonging in 2050, showcasing the impressive technology from Japan," Lethal said. "Cue is not your regular robot. It never misses, and if it does, it self-calibrates for the next shot."
Both have perfected the art of shooting and they recently united to showcase their impressive skills and highlight their unique shooting techniques.
Lethal Shooter and Cue6

Lethal Shooter and Cue6

© Jason Halayko / Red Bull Content Pool

Lethal Shooter and Cue6 attempted three key challenges:
We caught up with the developer in Japan to learn more about how the robot and project came to life. Can the art of shooting be fully replicated by a machine?

When you heard about the opportunity with Lethal Shooter after he posted on social media, what were your first thoughts for Cue6?

Nomi (developer): I was asked, "Are we really doing this?" and I said, "I didn't know about it," that's how I found out. I first learned about Lethal Shooter then, and I thought it would be great if it could be realized someday, so I was really grateful that it actually happened.

Cue6

Cue6

© ALVARK TOKYO

When you actually started building the robot and developed the first model, where did you start?

At first, we bought things like LEGO blocks and tried making robots that swing like on a swing with a potentiometer, and we also researched and studied other robots in the world. We didn't start with assembly from the beginning, but tried to imitate other things. First, we made a simple one with LEGO blocks, then we made a robot with just an arm, and then a full robot, learning by imitating.

Lethal Shooter and Cue6

Lethal Shooter and Cue6

© Jason Halayko / Red Bull Content Pool

Were there any particular struggles in the process of shaping the robot?

The first model was not very impressive in the end. The point of struggle changed every time, but for the first model, the difficulty was simply trying something I'd never done before. We purchased things like motors and internal mechanisms from outside. When we created the first CUE, Akio Toyoda, the president at the time, told us that it seemed interesting and suggested we make it into a job. After we started tackling it as a job, we developed the internal components ourselves. Since it became a job, we started to make real robots, and there were various struggles in each part, including the hardware, electrical parts, and software. New technical issues emerged with each evolution, and the completion date for each match was set, but it often wasn't finished until the day before or even on the day. Somehow, we just made it in time.

Cue6

Cue6

© ALVARK TOKYO

Missing shots, or not being able to move or reach something. We struggled quite a bit with those more basic issues.
Nomi

Like failing to score?

Exactly. Missing shots, or not being able to move or reach something. We struggled quite a bit with those more basic issues.

How far can the sixth model shoot from at the longest?

We haven't tested it exactly, but it can shoot from as far as the opposite 3-point line.

Can it also score from close range?

It can to some extent, even from right under the ring. Though we haven't tested that.

Lethal Shooter and Cue6

Lethal Shooter and Cue6

© Jason Halayko / Red Bull Content Pool

We think it's gradually getting taller and heavier. Is there any meaning to that?

It wasn't intentional, but as we wanted to do more and more things, it gradually got bigger. Simply because of the weight of the hardware, or the addition of motors. Ideally, the lighter the better, so the fact that it's getting heavier is not really a good thing.

Is there any part you're particularly focused on?

From CUE6, we changed the overall design a bit. Until now, we've been working on a strange concept where various blocks with their own will gather to form a humanoid and play basketball, and the costume hasn't changed much. But from CUE6, we changed the silhouette a bit and changed the surface a bit to give a sense of evolution, such as having different colors visible when the movable parts move in 3D knit. We've also put a bit of effort into the design aspect.

Have you ever used actual players as references? We've heard that you got some assistance from Alex Kirk, for instance.

No, we didn't. We once asked Alex Kirk to provide us with videos to try and recreate the same movements under the notion that it might improve if we referenced human movements. However, the result was different because the physical structure is different. The robot couldn't move like a human. For example, too much torque was applied to the knees and it couldn't maintain the posture. Since the robot can't move like a human, it ended up finding the optimal way for its own body to shoot.

Cue6

Cue6

© ALVARK TOKYO

Are there other features that you referenced based on the robot's functions?

For instance, the robot has a map in its head for moving around and constantly grasps its current location on that relative map. This technology is essentially similar to that of AGVs and self-driving cars. The motor movement and batteries use cells from racing car batteries, and some parts that are also used in cars have been repurposed. We also obtained assistance from people involved in car manufacturing and equipment development for parts processing. In the technology development process, we've integrated a lot of knowledge gained from car manufacturing.

How long did it take to produce Cue6? Was it longer than previous models?

While there was overlap with previous models and we started development on Cue6 earlier, it took us about a year and a half.

The time has been increasing little by little. Cue1 and Cue2 took about half a year from the point we decided to do it. As the difficulty level rises, so does the time required.

How much does it cost?

I can't disclose the amount, but it might not be as much as you'd imagine.

Compared to the challenges with Cue3, is the accuracy of Cue6 fully improved?

I think it's improved, but I've never directly compared them, so it's hard to say. Rather, I feel like its functions, such as dribbling, have been increasing.

Lethal Shooter and Cue6

Lethal Shooter and Cue6

© Jason Halayko / Red Bull Content Pool

Did you feel any weaknesses or points of vulnerability with the robot during your challenges?

There are just so many things robots can't do. At every challenge, we appreciate the amazing capabilities of humans. The number one thing is probably flexibility. Humans, in a sense, can do anything, but robots can only do certain things at present. That, I feel, is the biggest difference between robots and humans. I think we can handle things like making it shoot more accurately to the center of the goal, but what about when the ball changes, or the location changes, or while running, or when the ball is moving? Adapting to various scenarios for each and every case is still quite challenging for robots. Perhaps the quickest way to improve would be to learn from a great coach like Lethal Shooter.

On the contrary, where do you see the strengths?

Strengths include precision, accuracy, the quality of repetitive motions, and a lack of mental distress. Honestly, there aren't many advantages to robots. Things like the resilience of the ball, the condition of the ball and the venue, the temperature, and the relationship with the people around us are always different. I've realized again how incredible it is that humans consistently make the best decisions in these varying situations.

Were there any adjustments made leading up to the day?

I heard that there was a goal specially prepared for the showdown, so I prepared things like shots with different trajectories for the match.

What did you think after filming with Lethal Shooter?

When I saw Lethal Shooter's videos on social media, I noticed he had various original goals, so I prepared to be able to handle such unique goals with shots of different trajectories than usual.

Lethal Shooter and Cue6

Lethal Shooter and Cue6

© Jason Halayko / Red Bull Content Pool

Do you have any future goals for Cue6?

Next, I'd like to make it capable of running.

We have to change the legs, so if we want to make it run, the things we've been able to do so far would have to be redone. For instance, with shooting, Cue uses a chest camera to determine the goal's position. Since its legs are wheels, it basically faces the goal directly and just measures the distance. Whether it's at 0 degrees or 45 degrees, once you've aligned the angle, you just measure the distance and consider how to move the body to throw that distance. But if it becomes bipedal, it can't always face the goal directly, the way of throwing changes, and if the legs go up and down, it's not just about understanding the horizontal direction but also the vertical one. There are quite a few things that can be done with the current Cue that would not be possible in the current state, so that part presents a major technical challenge. It would be like creating an entirely new robot.

Do you think a day will come when a shooting robot can coach like Lethal Shooter?

I don't think so. Even if AI advances and becomes stronger than humans at shogi, there will still be human competitions. I think robots and humans will exist as separate entities in their own worlds.

What’s the ultimate goal of the lab?

There isn't a clear one, but I hope we can create something interesting. As for Cue, I'd like it to learn from humans. I think it would be cool if a robot could do Michael Jordan's free throw dunk, so I'd like to try that. Also, we had this incredible opportunity, and next time, I hope we can team up with Lethal Shooter and challenge the NBA.

Part of this story

Chris “Lethal Shooter” Matthews

Chris Matthews, aka Lethal Shooter, is recognized as basketball’s most sought-after shooting coach and one of the sport’s leading creative minds.

United StatesUnited States
View Profile