From a passion for making things to Ocean Digital Twin

Throughout a long corporate career, my research themes often change, but the sensing and signal processing technologies I developed during my student years continue to play a vital role in my work to this day. One project I find particularly memorable was the R&D for an AI based gymnastics Judging support system using 3D sensing technology (*1). This system captures gymnasts’ movements during competitions and analyzes them as numerical data, enabling AI to automatically evaluate and judge routines. In addition to displaying the scoring results on screen, the system presents detailed numerical information—such as joint angles—tailored to situations where judges need to closely examine the precision of an athlete’s movements. This supports accurate and consistent judging based on a unified standard.

At the same time, real competition venues contain many sources of noise that cannot be fully anticipated through simulation alone, such as ceiling structures and reflections from lighting, which can degrade motion sensing accuracy. To ensure stable performance within limited timeframes under unknown environmental conditions, it was necessary to carefully fine tune the system. In addition, changes to sensor and camera placement required clear, thoughtful explanations and flexible responses to gain the understanding of stakeholders such as broadcasters and sports federations. Beyond the technical research itself, one of the most valuable takeaways from this project was learning the importance of making technology work through on site communication and persuasion. The moment when the system operated successfully at an actual competition—and the AI’s scores matched the judges’ correct evaluations—remains a deeply rewarding highlight of my work.

My hobby is fishing, but in truth, I’m even more absorbed in what comes after the catch—making dried fish and experimenting with how to prepare and enjoy it. Part of the fun is that even the same fish doesn’t taste the same each time: the final result changes significantly depending on factors like salt levels, drying time, weather conditions, and even where the fish is placed on the balcony. In the beginning, I made many mistakes: sometimes the fish dried too much and became hard, while other times it retained too much moisture and developed an unpleasant odor. However, by measuring changes in moisture content and thinking carefully each time about why things didn’t work, I gradually adjusted the salt quantity, drying duration, and placement. Through this process of trial and error, I naturally developed my own techniques. Even when I don’t make dried fish, I choose how to prepare the catch—sashimi, grilled fish, or other dishes—based on its condition that day. On days with an especially good catch, I’ve brought home dozens of fish, leading to long hours of preparation for freezing and the slightly embarrassing sight of a freezer completely filled with fish. Still, when I catch the aroma rising from a dish I’ve carefully prepared and taste the rich flavor spreading with the first bite, all the fatigue instantly fades away. Wondering what kind of fish I’ll catch next—and what new flavors I’ll discover—is all part of the joy of fishing.

My current ambition is to leverage next generation devices like robots and underwater drones—particularly in tasks involving physical labor or requiring high levels of concentration—to expand the ways we work to make full use of human capabilities and enhance vitality across society as a whole. As I have witnessed firsthand in field trials in marine environments, many worksites, including in the fishing industry, involve significant risks from weather and environmental conditions, still relying heavily on physical strength and accumulated experience. By enabling new devices to take on hazardous tasks in these settings, people can focus on the roles they are uniquely suited for—such as decision making, planning, and maintenance. In addition, even in work that demands sustained concentration—such as long hours spent monitoring underwater data collection screens while operating drones—automation can allow people to devote more energy to higher value judgment and analysis. The effective use of such devices can also broaden opportunities for individuals with physical limitations, enabling them to take on tasks and roles that were previously difficult, and expanding their options for work and social participation. Through R&D, I hope to help unlock the abilities and potential of each individual and contribute to a future where barriers to participation in society can be overcome.