
The latest squeeze on Training Bottlenecks...
| Jean Durand | 14 min read
We unravel the latest squeeze on training bottlenecks, exploring the impact of data quality and pipeline monitoring on training performance.

GPU Poor, GPU Rich: Training at Scale
| Preston Govender | 14 min read
We go down the rabbit-hole, exploring the recipes that train transformers at scale. These provide insight into network communication, GPU utilization, and the challenges of common transformer ops.

Architecture & Optimising: Determining Training Memory
| Nicholas Wilkinson | 14 min read
Understand the recipe and you'll know what comes next! We break down the memory requirements of transformer training and weigh in on some innovations born of these constraints.

Low-Level Performance Optimization in PyTorch on NVIDIA GPUs
| Marcus Gawronsky | 17 min read
Delve into the low-level details of Nvidia GPUs are their interaction with PyTorch execution.

Tracking Model Experiments
| Marcus Gawronsky | 10 min read
Let's jump into the Experiment Tracking - a guiding light in large-scale model training.

Vector Databases: A New Dimension in Data Storage
| Nicholas Wilkinson | 8 min read
Dive into the technology behind vector databases, one of the key innovations helping drive modern AI.

The Impact of Zero-shot Recommendations
| Marcus Gawronsky | 5 min read
Find out how Zero-shot Discovery unifies the search and recommendations experience in e-Commerce, and the impact legacy algorithms have on user growth.

What is Zero-shot Discovery? Let's dive in.
| Marcus Gawronsky | 3 min read
What makes this wave different? Here are how economics and hardware are building innovation in AI and Machine Learning that will last.

The Five Technologies driving AI 3.0
| Marcus Gawronsky | 6 min read
What makes this wave different? Here are how economics and hardware are building innovation in AI and Machine Learning that will last.

In a Pickle About AI? Let's Relish the Latest Developments!
| Marcus Gawronsky | 2 min read
Crunch time in AI research! Our tangy tour through the latest breakthroughs in PeFT, Upcycling and Zero-shot Learning will leave you feeling anything but sour.