Managing Thousands of DL Experiments and Staying Sane
At scale, launching ML research experiments is already complicated. Analyzing them without proper planning is just impossible.
Alex Dremov
I'm a Machine Learning Researcher and Engineer. Here I write posts on the intersection of deep learning theory and efficient machine learning
Latest posts
Rethinking Quantization-Aware Training: Why Your QAT Length is Probably Wrong
The optimal QAT fraction increases with scale. We research how long to train QAT to get the best results, and what bit size is the best
Understanding Flash Attention: Writing the Algorithm from Scratch in Triton
Find out how Flash Attention works. Afterward, we'll refine our understanding by writing a GPU kernel of the algorithm in Triton.
Speed Up PyTorch With Custom Kernels. But It Gets Progressively Darker
It's all about making your models run faster. In each step, we’ll implement a fast softmax function, but things are about to get dark by the end
Simple Ways to Speed Up Your PyTorch Model Training
If all machine learning engineers want one thing, it's faster model training — maybe after good test metrics.
Swift Actors — Common Problems and Tips
Swift actors are a powerful tool. However, it is also quite a sophisticated concept that requires deep understanding to write bug-free code
I Contributed to PyTorch. Here's What I Learned
When you see something that does not work in an omnipresent framework, you believe it can't be completely broken, right?
Conquer Data Races with Swift Actors
Unleash the power of Swift concurrency with Actors! Get all the information you need in this comprehensive article
Dive into Swift's Memory Management
Swift uses ARC to track and deallocate unused objects. Learn about the three types of reference counts and how ARC works — in this detailed post.
Data Binding in SwiftUI: Tips, Tricks, and Best Practices
Master data binding with this comprehensive tutorial. Learn how to use @State, @ObservedObject, @EnvironmentObject to create dynamic UI.
iOS App As a Microservice. Using SwiftUI in Modular App
How to implement modular architecture effectively with SwiftUI? In this post, I will describe tips on using SwiftUI with modular app design
iOS App As a Microservice. Modularize Your App With Tuist
I will cover implementation details using Tuist. It is an excellent CLI that helps you generate, maintain and interact with Xcode projects
iOS App As a Microservice. Build Robust App Architecture
MVVM, MVC, VIPER? Those all are problem-specific architectures. How to structure your app on a larger scale? More in this post
Exploring SwiftUI Layout Protocol | Creating Custom Layout
Apple introduces new SwiftUI's Layout protocol with the release of iOS 16. In this post, I will discuss the protocol and implement a custom view
SwiftUI Navigation Is a Mess. Here’s What You Can Do
Managing navigation in pure SwiftUI is hard and leads to messy solutions. In this post, I will show you how you can manage views effectively
Suffix Automaton and Rickroll Lyrics Graph
Easy to understand explanation of suffix automaton with implementation. Finally, generating correct Rickroll lyrics suffix automaton
Using Threads in Swift
Swift provides DispatchQueue as an excellent layer above raw threads. But sometimes you want to use a low-level thread API
SwiftUI Advanced Animation: Morphing Shapes
I'm going to show how complex SwiftUI views can be animated efficiently using VectorArithmetic protocol with Accelerate library for computations.
New Package: Look at Swift Async Algorithms
Apple released an async swift algorithms package that introduces useful ways of working with asynchronous sequences
Treap: The Easiest Search Tree (Explained)
Binary search trees are hard. I'm going to explain one of the easiest, yet efficient and powerful balanced binary tree — treap or cartesian tree.
Type Placeholders: New Swift 5.6 Feature
Type placeholders were recently introduced in Swift 5.6. Get in touch with new useful Swift feature.
Quick Guide to Async Await in Swift
Everything you need to know about new Swift asynchronous features. Async await, main actor, task, async get, and possible use cases — all covered
Top 7 Subtle Swift Features
I collected Swift features that are less known and can be useful when you prepare for interviews or want to deepen your Swift knowledge.
Note-taking apps
Here I cover note-taking apps for productivuty and creating your own knowledge database
The Mystery of Mach-O Object Structure
I’m going to tell you about the internals of the Mach-O file and give an introduction to the simple relocatable object file structure
Skip List Indexation and kth Maximum
Skip list is a nice structure that lets you to perform insertions, searches, finding n-th maximum. In this post I fokus on skip list indexation
How Deep Neural Networks Work
Here, I combine the explanation of Neural Nets with coding. By the end, we will develop a basic neural network and try to solve usual problems