16 Matching Annotations
  1. Last 7 days
    1. HBC is designed to enable efficient scaling of AI agents to meet the demands of continuous reasoning, memory bandwidth, and real-time responsiveness

      大多数人认为AI推理主要是GPU的领域,而CPU主要处理通用计算任务,但Qualcomm提出其HBC技术专门为AI代理的连续推理、内存带宽和实时响应需求而设计,这一观点挑战了CPU和GPU在AI工作负载中的传统分工,暗示未来计算架构可能更加专业化而非通用化。

    2. > 2x better performance per watt estimate compared to existing product benchmarks for server CPU competitive offerings based on specs

      大多数人认为在服务器CPU市场,Intel和AMD已经建立了难以逾越的性能和能效优势,但Qualcomm声称其新的Dragonfly C1000 CPU能提供现有产品基准两倍的每瓦性能,这一挑战直接针对数据中心CPU市场的主导者,暗示移动芯片巨头正在颠覆传统服务器市场格局。

  2. Nov 2024
    1. Being at maximum temperature while running a workload isn't necessarily cause for concern. Intel processors constantly monitor their temperature and can very rapidly adjust their frequency and power consumption to prevent overheating and damage.

      Intel says there is no need to worry about CPU run at maximum temperature.

  3. Apr 2023
  4. Dec 2022
  5. Aug 2022
  6. May 2021
  7. Dec 2020
  8. Mar 2019
  9. Nov 2018
  10. Mar 2018

    Tags

    Annotators

  11. May 2017
    1. Optimum buffer size is related to a number of things: file system block size, CPU cache size and cache latency. Most file systems are configured to use block sizes of 4096 or 8192. In theory, if you configure your buffer size so you are reading a few bytes more than the disk block, the operations with the file system can be extremely inefficient (i.e. if you configured your buffer to read 4100 bytes at a time, each read would require 2 block reads by the file system). If the blocks are already in cache, then you wind up paying the price of RAM -> L3/L2 cache latency. If you are unlucky and the blocks are not in cache yet, the you pay the price of the disk->RAM latency as well. This is why you see most buffers sized as a power of 2, and generally larger than (or equal to) the disk block size. This means that one of your stream reads could result in multiple disk block reads - but those reads will always use a full block - no wasted reads. Now, this is offset quite a bit in a typical streaming scenario because the block that is read from disk is going to still be in memory when you hit the next read (we are doing sequential reads here, after all) - so you wind up paying the RAM -> L3/L2 cache latency price on the next read, but not the disk->RAM latency. In terms of order of magnitude, disk->RAM latency is so slow that it pretty much swamps any other latency you might be dealing with. So, I suspect that if you ran a test with different cache sizes (haven't done this myself), you will probably find a big impact of cache size up to the size of the file system block. Above that, I suspect that things would level out pretty quickly. There are a ton of conditions and exceptions here - the complexities of the system are actually quite staggering (just getting a handle on L3 -> L2 cache transfers is mind bogglingly complex, and it changes with every CPU type). This leads to the 'real world' answer: If your app is like 99% out there, set the cache size to 8192 and move on (even better, choose encapsulation over performance and use BufferedInputStream to hide the details). If you are in the 1% of apps that are highly dependent on disk throughput, craft your implementation so you can swap out different disk interaction strategies, and provide the knobs and dials to allow your users to test and optimize (or come up with some self optimizing system).

      What's the cache size to keep when reading from file to a buffer?

  12. Jan 2016
  13. Mar 2015