Technology Updates : Geekbench for AI

https://www.theverge.com/2024/8/15/24221382/geekbench-ai-benchmark-software

OpenAI

1. Geekbench has launched Geekbench AI, a new tool to benchmark device performance for AI tasks across platforms.

2. It evaluates CPU, GPU, and NPU performance using frameworks like ONNX, CoreML, TensorFlow Lite, and OpenVino.

3. The tool provides three scores: full precision, half precision, and quantized, each with an accuracy measurement.

4. The software aims to assess real-world AI performance, like predictive text accuracy or image editing capabilities.

5. Geekbench AI is available on Windows, macOS, Linux, Android, and iOS for users to try out.

My Thoughts

• Interesting tool. Very useful if it maintains objectivity across platforms.

• Like SpeedTest, hope that we can derive useful data to determine what device we should buy based on our usage patterns.

• But I think we are still far off on standardisation to get accurate benchmarks. The AI models are releasing products and getting upgrades at very fast paces.