AI financial advice is surprisingly good — especially if you ask the right questions
-
Study Overview & Core Findings:
- MIT Sloan research evaluated LLMs on lifetime financial advice, finding that AI guidance is surprisingly sound overall.
- AI consistently promotes positive behaviors: saving during working years, drawing down assets in retirement, investing in diversified funds, and reducing equity risk after age 45.
- LLMs provide an accessible, low-cost alternative for individuals who cannot afford traditional financial advisors.
-
Key Weaknesses & Performance Gaps:
- AI fails to handle financial shocks well, often recommending overly drastic spending cuts after job loss even when adequate savings exist.
- Models let investment portfolios drift passively rather than proactively recommending portfolio rebalancing.
- Guidance frequently relies on basic rules of thumb unless given structured context.
-
Prompt Quality & Demographic Disparities:
- "Academic prompts" featuring complete financial details and explicit economic assumptions significantly improve advice quality.
- Prompt differences linked to gender, financial literacy, and prior AI experience caused up to a 5% difference in projected retirement wealth.
- Men and highly literate users tended to ask about strategy and growth, leading LLMs to recommend higher stock allocations, whereas women frequently included terms related to household management and family expenses.
-
Implications for Financial Services:
- AI is altering financial product discovery; LLMs frequently recommend major index providers (e.g., Vanguard, iShares) even when unprompted.
- Financial institutions may need to optimize product visibility for LLM recommendations rather than relying solely on traditional marketing.
Hacker News Discussion
-
Practical Budgeting Applications:
- Users report positive experiences exporting local budget data (e.g., YNAB, Tiller) into LLMs to identify spending patterns, organize budget categories, and compare reward programs.
-
Pitfalls in Local Tax & Jurisdictional Advice:
- Commenters warn that LLMs struggle with location-specific tax nuances (such as city-level tax rules for S-Corp conversions) because models tend to generate immediate answers instead of asking necessary clarifying questions.
-
Baseline vs. Expert Financial Advice:
- Some participants note a Gell-Mann amnesia effect: while LLMs handle basic financial principles well, they lack depth for nuanced financial planning (e.g., sequence of return risk, asset allocation glide paths).
- Counterarguments emphasize that generic, non-predatory LLM advice is still far superior to no advice or predatory human financial advisors charging high fees.
-
Behavioral and Structural Limits:
- Discussion highlights that key financial challenges stem from behavioral discipline or insufficient income, which high-level AI advice cannot directly solve.