Rapsodo

Rapsodo approached us with a challenge. They’d positioned Shohei Ohtani as the face of their brand, envisioning him actively demonstrating their tool to enhance his already remarkable skills and monitor his performance.

However, Ohtani’s Packed schedule created obstacles. Regular seasonal games, postseason potential, international travel, mandatory recovery protocols, and off-day obligations left no open dates for repeated shoots.

Besides, each attempt would demand a full production setup: securing a controlled studio or field, hiring a specialized sports photographer and videographer, assembling lighting rigs and high-speed cameras, and coordinating crew travel and lodging.

There was a risk of inconsistent footage due to fatigue or environmental changes, ultimately threatening the campaign’s timeline and budget.

The client required a solution that remains on-brand while operating without time or location constraints. So we devised an ingenious strategic one: the development of a fully realized digital twin of Shohei Ohtani.

What’s delivered wasn’t just a life-like image, but a virtual replica that goes beyond basic imitation, incorporating advanced AI-driven systems to capture Ohtani’s voice timbre and intonation patterns, facial micro-expressions, skin texture, fluid athletic movements, the details of his fully branded outfits, and the distinctive on-field energy.

Digital twins represent a rising trend that continues to evolve alongside advancements in AI, ensuring they remain relevant over time. In addition to eliminating scheduling risks, our strategy-driven approach future-proofs brand partnerships by allowing them to adapt to emerging technologies, new products, and fresh narratives, without significant overhauls, providing budget-savvy marketing solutions.

Additionally, creating a digital twin of Rapsodo’s brand ambassador enables them to scale their efforts across diverse platforms, gather valuable consumer insights, and position themselves as innovators in their industry.

Creating a digital clone of Shohei Ohtani involved significant steps. First, generating an AI twin for such a well-known figure required specialized knowledge and expertise in advanced AI technology, which our technical team expertly managed.

Second, we addressed the client’s concerns about the potential “fake vibe” that could arise from replicating exact details within the current capabilities of AI.
Third, it was crucial for us to ensure that every output felt authentically connected to the real athlete across various scenarios, which we successfully achieved.

We utilized a suite of sophisticated technologies to build the digital twin with precision. High-resolution photogrammetry scans from limited reference images generated a detailed 3D base model.

Extensive motion capture datasets, drawn from Ohtani’s game footage, were fed into machine learning algorithms to animate his biomechanics accurately.

Generative adversarial networks (GANs) enhanced visual fidelity, refining skin textures, hair dynamics, and muscle subtleties under different lighting conditions.
Real-time rendering engines simulated environmental interactions, such as shadow play on the uniform or dust kick-up from cleats.

His voice was captured through spectral analysis and synthesis to match pitch, cadence, and emotional inflection in commentary overlays.

Facial elements included precise eye tracking, lip sync, and subtle brow shifts during concentration or triumph.
Movement replication covered his unique two-way prowess: the explosive hip drive and wrist snap in batting, the elongated arm whip and release point in pitching, all calibrated to metric-level accuracy against performance data.

Even vibe-defining details, like his focused stare or post-swing reset, were consistent. Uniform accuracy was non-negotiable: exact logo placement, fabric drape, glove wear patterns, and cleat tread designs remained identical across assets.

What was delivered wasn’t just a digital replica but endless possibilities for visual storytelling with a celebrity, allowing the client to avoid concerns about budget constraints and scheduling issues.

Four videos were produced, each showcasing Shohei Ohtani’s digital twin playing baseball with Rapsodo’s device. The objective of this phase was to demonstrate how digital twin technology can effectively address the limitations associated with human brand ambassadors, all while maintaining a sense of authenticity.

This remarkable journey stands as a testament to the fusion of digital twin technology and the sports industry, paving the way for future innovations that will continue to inspire and engage fans and athletes alike.