6 Matching Annotations
  1. Last 7 days
    1. Create multilingual experiences that go beyond translation and understand cultural context.

      Gemma 4 E2B/E4B 原生预训练 140+ 语言,且强调「超越翻译、理解文化语境」。对 AI 硬件产品而言这个参数意义重大:一个能在设备端离线处理中文、理解文化背景的 2-4B 模型,意味着本地化 AI 硬件(录音笔、学习机、会议设备)无需依赖国内厂商 API,直接用 Gemma 4 就能构建多语言理解能力。

  2. Feb 2026
    1. Owning a $5M data center
      • comma.ai operates its own $5M data center in-office to handle model training, metrics, and data storage, avoiding the "cloud tax."
      • The facility consumes approximately 450kW at peak; power costs in San Diego (over 40c/kWh) totaled over $540,000 in 2025.
      • Cooling is achieved using pure outside air with dual 48” intake and exhaust fans, utilizing a PID loop to manage temperature and humidity.
      • The compute cluster consists primarily of 600 GPUs across 75 "TinyBox Pro" machines built in-house for cost efficiency and easier repairability.
      • Storage is handled by several racks of Dell R630/R730 servers with ~4PB of total SSD storage, favoring speed and random access over redundancy.
      • The software stack is kept simple to ensure 99% uptime, utilizing Ubuntu (pxeboot), Salt for management, and "minikeyvalue" for distributed storage.
      • By owning their hardware, comma.ai estimates they saved $20M+ compared to equivalent compute costs in a public cloud environment.

      Hacker News Discussion

      • Users discussed the spectrum of infrastructure, ranging from pure Cloud (low cap-ex, high op-ex) to colocation and on-prem (high cap-ex, high skill requirement).
      • A primary concern raised was "brain drain"—on-prem setups can become "legacy debt" if the senior engineers who built the custom systems leave without documenting unwritten knowledge.
      • Commenters noted that AWS and other cloud providers are incentivized to keep architectures complex (microservices, serverless) to increase billing, whereas on-prem encourages efficiency.
      • There was a debate regarding "software freedom" and the "WhatsApp effect," where small, highly motivated teams can outperform massive corporations by using lean, self-hosted stacks.
      • Some users highlighted that while AWS pricing is expected to rise due to hardware costs, the "Quality of Life" and managed services still justify the cost for many startups without comma's scale.

      comma-ai #self-hosting #datacenter #hardware-engineering

  3. May 2023
    1. ICs as hardware versions of AI. Interesting this is happening. Who are the players, what is on those chips? In a sense this is also full circle for neuronal networks, back in the late 80s / early 90s at uni neuronal networks were made in hardware, before software simulations took over as they scaled much better both in number of nodes and in number of layers between inputs and output. #openvraag Any open source hardware on the horizon for AI? #openvraag a step towards an 'AI in the wall' Vgl [[AI voor MakerHouseholds 20190715141142]] [[Everymans Allemans AI 20190807141523]]

  4. Oct 2019
    1. espite the potential of emerging technologies to assist persons with cognitive disabilities,significant practical impediments remain to be overcome in commercialization, consumerabandonment, and in the design and development of useful products. Barriers also exist in terms of the financial and organizational feasibility of specific envisionedproducts, and their limited potential to reach the consumer market. Innovative engineeringapproaches, effective needs analysis, user-centered design, and rapid evolutionary developmentare essential to ensure that technically feasible products meet the real needs of persons withcognitive disabilities. Efforts must be made by advocates, designers and manufacturers to promote betterintegration of future software and hardware systems so that forthcoming iterations of personalsupport technologies and assisted care systems technologies do not quickly become obsolete.They will need to operate seamlessly across multiple real-world environments in the home,school, community, and workplace

      This journal clearly explains the use of technologies with special aid people how a certain group can leverage it, while also touch basing on what are the challenges which special aid people face financially.