Does AI Save Time on Product Design? A Randomized Controlled Trial of Figma Make Workflows
AI 真的能幫產品設計省時間嗎？首個 Figma Make 的隨機對照實驗揭密
This study conducted a randomized controlled trial with 50 product designers and 50 product managers to evaluate Figma Make. Participants attempted three standardized design tasks with or without AI assistance. While those with AI access completed tasks approximately 20% faster overall, the benefits were unevenly distributed: product managers enjoyed larger efficiency gains, whereas the impact on professional designers was highly task-dependent.
Key points
20% Average Time Savings
Access to Figma Make was associated with approximately 20% shorter task completion times among study participants.
Greater Gains for PMs
Product managers, who are traditionally non-designers, experienced larger relative efficiency gains than professional designers.
Task-Dependent for Designers
For professional designers, the practical time-saving benefits of conversational AI tools remain highly task-dependent.
How it works
| Product Managers (PMs) | Product Designers | |
|---|---|---|
| Time Savings | 更為顯著 (Larger gains) | 幅度較小且因任務而異 (Smaller, task-dependent) |
| Primary Value | 降低設計門檻，賦能直接參與原型製作 | 加速特定任務流程，但非全局適用 |
Why it matters
While AI productivity research has heavily focused on coding, this study provides rare experimental evidence for product design. It demonstrates that conversational AI lowers barriers to prototyping, empowering non-designers like PMs. However, it also cautions organizations that AI is not a one-size-fits-all accelerator for professional designers, requiring a more nuanced, task-specific deployment.
Who it affects
- Product Manager
- Designer
- AI Researcher
- Enterprise Leader
How to use it
- 1Product managers leveraging conversational prompts to rapidly generate early-stage prototypes.
- 2Design teams selectively deploying AI sketch tools to accelerate specific, task-dependent phases of creative workflows.
Limitations & caveats
- Efficiency gains for professional designers are highly task-dependent and do not generalize across all design tasks.
- The study evaluates speed of completion on short-term tasks but does not measure the long-term design quality or iterative maintenance costs.
Related
Who Said What to Whom? SpeakerMem-R1 Introduces Dual-Track Memory for Multi-Party Dialogues
「誰對誰說了什麼？」SpeakerMem-R1 打造多方對話專屬的雙軌記憶機制
SpeakerMem-R1 tackles multi-party dialogue memory challenges using a speaker-labeled dual-track system and GRPO training to improve message attribution and social relation tracking.
Testing AI Hardware Verification: EquivSVA Dataset Reveals LLM Robustness Across Equivalent RTLs
硬體驗證 AI 的試金石：EquivSVA 形式驗證資料集，揪出 LLM 程式碼生成的虛實
EquivSVA is a formally verified open-source dataset designed to evaluate LLM robustness in generating SystemVerilog Assertions (SVA), featuring 120 'behavior families' across 480 equivalent RTL implementations.
Google DeepMind Launches AlphaGenome Atlas: A Predictive Map of Every Possible DNA Letter Change in the Human Genome
Google DeepMind 推出 AlphaGenome Atlas：人類基因組所有 DNA 單一字母變異之預測圖譜
Google DeepMind, in collaboration with leading academic institutions, has introduced AlphaGenome Atlas, a predictive map of every potential DNA letter change in the human genome.