Paul Irish · X (formerly Twitter)

Paul Irish

26.9K

posts

Paul Irish profile banner

user avatar

@paul_irish

I 💗 the web • I work on the combo of dev tooling + AI + web.

Joined March 2007

  • user avatar

    Been loving NVIDIA's NeMo models recently to complement Whisper for transcription, but the startup felt a bit heavy. So I went on a profiling adventure! github.com/NVIDIA-NeMo/Ne… Turned out to be fruitful… stoked to land a big optimization in NeMO. github.com/NVIDIA-NeMo/Ne…

    A flamechart of loading NVIDIA's flagship ASR model, Canary. Captured with viztracer and shown in trace.cafe. It shows the load takes 52 seconds only for 3s of inference! Several annotations point out some opportunities for optimization (redundant tar extract, config read/write thrashing etc)

  • user avatar

    @flumewater

    I am absolutely loving the accuracy and data granularity. Not only have I verified it's only 0.083% off the neptune t10 meter.. but I can see flow rate differences for each station of the sprinkler system! Time to cut these numbers down. :) Thank you!

    screenshot of flume's web portal showing a chart of water usage per minute.

  • user avatar

  • user avatar

    Yeah, fuuuuck this. You can find me on mastodon. I'm not gonna hang out on Parler 2.0

  • user avatar

Read the original on x.com ↗