- Dynamic JIT Injection: Structural 3D model arrays are generated as abstract syntax nodes by Gemini and executed on-the-fly inside the active WebGL rendering pipeline via client-side contextual evaluation.
- Stateful Frame loops: Leverages a non-blocking
window.customTicksevent queue to inject custom animation frames, proximity colliders, and collision listeners without disrupting the main thread. - Go Proxy Middleware: A specialized local Go router handles API transport, sanitizing payload variables and proxying client rate limits to prevent budget overflow.
- JSON Schema Enforcement: Restricts response models to structured formats, mapping verbal specs into immediate WebGL positioning vectors.
![Lead Developer Gemma](data:image/svg+xml;utf8,<svg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 520 380'><rect width='100%' height='100%' fill='%230c0c0e' /><circle cx='260' cy='150' r='55' fill='%23121a26' stroke='%2300ffcc' stroke-width='1.5' /><path d='M260,110 A35,35 0 0,1 295,145 A35,35 0 0,1 260,180 A35,35 0 0,1 225,145 A35,35 0 0,1 260,110 Z' fill='%231b2535' /><path d='M195,240 C195,205 220,195 260,195 C300,195 325,205 325,240 L325,260 L195,260 Z' fill='%231b2535' /><rect x='218' y='130' width='7' height='25' rx='2' fill='%2300ffcc' /><rect x='295' y='130' width='7' height='25' rx='2' fill='%2300ffcc' /><path d='M225,135 Q260,100 295,135' fill='none' stroke='%2300ffcc' stroke-width='3' /><path d='M225,150 Q245,170 240,180' fill='none' stroke='%2300ffcc' stroke-width='1.5' /><circle cx='240' cy='180' r='2.5' fill='%2300ffcc' /><text x='260' y='300' font-family='"Rajdhani", sans-serif' font-size='18px' fill='%238a99ad' text-anchor='middle' letter-spacing='2px'>LEAD DEVELOPER (GEMMA)</text></svg>)
Meet Gemma.
Gemma is five years old and built the entire 3D game using Antigravity voice commands.
- Zero Syntax barriers: She did not write a single line of JS, HTML, or CSS.
- Intent-Based specs: Spoke directly to the Antigravity agent to dictate environment visual elements, speed boosts, space navigation, and mechanics.
- Iterative Design: Insisted on physics behaviors like "going higher in space" and "feeling lighter" on the Moon.
"I want it to do whatever I want."
Gemma's gameplay session was an endless stream of quick ideas. She wanted to test new physics models, custom colors, and animal shapes on the fly.
- Endless Iteration: From a basic cop car to space flight, to moon gravity, and pop-on-impact balloon collision networks.
- The Laptop Bottleneck: Since the Antigravity voice engine ran inside the developer IDE, Gemma had to hog her dad's laptop to build and test—completely locking him out of his own computer.
"Why don't we put Gemini directly inside the game?"
Bypassing the developer workspace bottleneck. Offloading the compiler loop from the programmer's laptop directly into the player's running runtime canvas.
How child-like spoken commands are compiled into fully mathematical WebGL assets and game loops in real-time. (Click each card to reveal).
1. Intent Capture
Web Speech API captures verbal intent in real-time, outputting subtitle transcript tracks.
2. Code Generation
Gemini compiles spoken transcripts against schemas, compiling JIT-ready JavaScript blocks.
3. WebGL Scene Injection
Context-safe dynamic evaluation directly modifies active Three.js memory graphs on-the-fly.
A look at the actual code generated programmatically by the agent when Gemma commanded: "Turn the car into a tiger."
while(window.carGroup.children.length > 0) {
window.carGroup.remove(window.carGroup.children[0]);
}
// 2. Build tiger body
const body = new THREE.Mesh(
new THREE.BoxGeometry(1.6, 1.0, 3.2),
new THREE.MeshStandardMaterial({color: 0xffaa00})
);
window.carGroup.add(body);
// 3. Re-inject stripe loops on the back...
for(let i = -1; i <= 1; i++) {
const stripe = new THREE.Mesh(...);
window.carGroup.add(stripe);
}
Gemma wanted interactive logic. We enabled the AI to hook directly into the Three.js render frame loop, creating self-updating scene structures.
- window.customTicks: A global array executing custom code injection layers on every render frame.
- Proximity Colliders: Live distance checks triggering events when player coordinates intersect zone boundaries.
- Dynamic CanvasTextures: Vector billboards (like the glowing "CAR WASH" sign) drawn onto 2D canvas buffers and mapped onto 3D meshes in real-time.
From Writing Code to Orchestrating Intent
Gemma's sandbox game shows that the barrier to entry is gone—a five-year-old can voice-program a 3D simulation. For us, our role shifts from typing repetitive boilerplate to auditing agent code paths and defining architectural boundaries.