The GenAI Tool for Real-Time 3D Asset Generation 🤯
This in-depth interview with Andreas Edesberg, co-founder of Sloyd, unveils the unique hybrid AI approach behind their 3D asset creation technology and how Sloyd is enabling creators to produce optimized, customizable, and game-ready assets in real-time.
The newsletter is also shared with our 10k audience on LinkedIn and if you would like to become a sponsor just answer this email or contact me on LinkedIn 👉 Gabriele Romagnoli.
Interview with Andreas Edesberg
How does Sloyd's approach differ from traditional generative AI tools?
Andreas Edesberg: We’ve taken a very different route, focusing on a hybrid approach that combines procedural and parametric modelling with AI. Instead of relying on diffusion models to generate objects, we use pre-built templates created by our artists. This allows the AI to customize those templates, making it faster, optimized for games, and capable of delivering game-ready assets without manual cleanup.
How does Sloyd address IP concerns in generative AI?
Andreas Edesberg: This is a major focus for us. Unlike many generative AI tools that rely on datasets scraped from the internet, all of Sloyd’s assets are created by our in-house artists. This means there are no IP risks, and studios can confidently use our technology for commercial projects. Respecting artists and their work has been a core principle for us from the start.
What inspired the hybrid procedural and parametric modelling approach?
Andreas Edesberg: It started with the vision of creating dynamic games where content is generated in real-time as you play. To achieve that, we needed game-ready assets optimized for speed and low-end devices. Back in 2017, diffusion-based generative AI wasn’t feasible, so we developed a system where AI customizes modular components. This approach ensures scalability and quality, especially for hard-surface objects like buildings, vehicles, and props.
How does Sloyd ensure assets are optimized for low-end devices?
Andreas Edesberg: Optimization is built into our system. For example, you can adjust the level of detail (LOD) of an asset in milliseconds, scaling from low-poly to high-poly with a slider. This makes our assets perfect for mobile games, VR, or web-based experiences, where performance is critical. Our goal is to ensure that creators can work seamlessly across different platforms without worrying about performance issues.
What’s Sloyd’s approach to expanding the asset library and customization?
Andreas Edesberg: We’re tackling this by breaking assets into modular parts—handles, doors, windows, etc.—and enabling AI to mix and place these parts in new ways. This will exponentially increase variety without starting from scratch. Users will be able to create a piano with wings or a tank made of donuts. It’s all about empowering creativity while maintaining the quality and optimization required for game-ready assets.
Who benefits most from Sloyd’s technology right now?
Andreas Edesberg: Midsize and smaller studios benefit the most because they can produce high-quality environments and assets faster, levelling the playing field against larger studios. VR and mobile developers also gain from our optimized assets, which perform well even on low-end devices. That said, larger studios are beginning to explore how Sloyd can help them address industry challenges like rising production costs and tight deadlines.
Why should creators use 3D assets generated with Sloyd?
Andreas Edesberg: One of the biggest advantages is speed—our system generates assets in real-time, even on low-end devices. The assets are fully customizable, down to individual parts, giving you a level of flexibility unmatched by traditional asset packs. And because we’ve built everything from scratch, there are no IP concerns, making it safe for commercial use.
How does Sloyd handle texturing?
Andreas Edesberg: Texturing with Sloyd is seamless. When you generate an asset, it comes with a UV map that’s clean and logically organized—roofs look like roofs, not scattered pieces. This makes editing textures straightforward. A recent feature allows users to apply stylized or realistic textures through prompts. The textures are perfectly tileable and scale dynamically with changes to the object, ensuring everything stays consistent and polished.
What are the main use cases for 3D assets generated with Sloyd?
Andreas Edesberg: There are two primary use cases: production and generation at runtime. For production, it speeds up asset creation during pre-production, allowing artists to prototype or populate scenes faster. Generation at runtime is still in the early days and it enables real-time asset generation during gameplay. Imagine creating buildings, vehicles, or entire environments on the fly within a game.
How does runtime generation work, and what are its potential applications?
Andreas Edesberg: Runtime generation lets users create assets directly within a game in real-time. For example, a player could use voice commands to build a city or design custom props on the fly. This opens up possibilities for emergent gameplay and user-generated content. Paired with procedural storytelling or AI-driven campaigns, you can create deeply dynamic and interactive experiences that evolve based on the player’s actions.
What opportunities do you see for Sloyd in VR and XR spaces?
Andreas Edesberg: VR and XR are particularly exciting because they’re interactive by nature. Imagine creating and modifying environments with voice commands while immersed in VR. We’ve seen users do this, and the feedback has been overwhelmingly positive—words like “magical” come up often. With Sloyd’s speed and optimization, it’s possible to create dynamic, immersive worlds that respond in real-time to the user’s input.
What are some ways users can experiment with Sloyd’s asset generation?
Andreas Edesberg: Users can experiment with our web app, Unity integration, or API. For example, you can generate an entire asset pack for a theme—like a futuristic city—within seconds. You can then fine-tune these assets with sliders or prompts. The ability to quickly iterate and customize makes Sloyd a powerful tool for rapid prototyping, game development, and even 3D printing.
How can creators leverage Sloyd for emerging gameplay mechanics?
Andreas Edesberg: Sloyd enables creators to tie asset generation to gameplay mechanics. For example, a player could level up a weapon, and the weapon evolves visually in real time. This continuous transformation adds depth to gameplay. Similarly, assets can be dynamically generated based on story progression, blending narrative and environment seamlessly. It’s a new way to create engaging, evolving experiences.
What are some future updates users can look forward to?
Andreas Edesberg: We’re working on AI assembly to increase customization by combining modular parts in innovative ways. This will make our library even more versatile. Additionally, we’re improving support for organic shapes and exploring integrations with more platforms and tools. Our long-term vision includes real-time AI rendering, where textures and styles can be adjusted dynamically during gameplay or design.
Check out the full video interview on your preferred platform.
That’s it for today, and don’t forget to subscribe to the newsletter if you find this interesting
See you next week