gpt-oss – Lottabytes

Using a Local LLM – Putting it All Together

by cstephenson@lottabytes.com November 11, 2025November 11, 20250 comments

As I had previously explored, there is now a great potential for anyone using commodity hardware, even that which can be purchased at your local Costco, to enable sovereign AI capabilities. From simple code generation inside Visual Studio Code, to generating function-level code blocks based on prompts of desired functionality, to doing in-depth security analysis …

Using a Local LLM | Function-Level Code Generation and Accuracy

by cstephenson@lottabytes.com August 29, 2025August 29, 20250 comments

As part of investigating the use of a local LLM on commodity hardware (specifically on an RTX 5070 TI), I wanted to step away from the more standardized testing (e.g., LiveCodeBench) and do a highly-unscientific, gut-check on what to expect. I mean, in the real world, what do those scoring numbers actually translate to as …