Post from Aug 25, 2025

This page cannot be shown here. You can still read it on the original site — the toolbar below keeps your place in the directory.

Experimented with TensorRT-RTX (a new library offered by NVIDIA). The first step was a tiny toy model, just to get the build and test setup working. The reference model in PyTorch: import torch import torch.nn as nn class TinyCNN (nn . Module): def __init__ (self): super() . __init__ () self . conv = nn . Conv2d( 3 , 8 , 3 , stride = 1 , padding = 1 ) self . relu = nn . ReLU() self . pool = nn .…

import torch
import torch.nn as nn

class TinyCNN(nn.Module):
 def __init__(self):
 super().__init__()
 self.conv = nn.Conv2d(3, 8, 3, stride=1, padding=1)
 self.relu = nn.ReLU()
 self.pool = nn.AdaptiveAvgPool2d((1, 1))
 self.fc = nn.Linear(8, 4) # 4-class toy output

 def forward(self, x):
 x = self.relu(self.conv(x))
 x = self.pool(x).flatten(1)
 return self.fc(x)

Read on /blog/1756113601/ ↗