Septimaeus

joined 3 years ago
[–] Septimaeus@infosec.pub 2 points 2 weeks ago* (last edited 2 weeks ago) (3 children)

Atm the meta for local inference is unified memory and “routed” local agents (multiple smaller role-specific agents in a trench coat)

The former is standout for cost efficiency (e.g., 4x RDMA 48gb Minis for a 192gb cluster @ $43/gb vs a $45k b200 alone)

The latter is standout for many things, including resource efficiency on smaller machines

[–] Septimaeus@infosec.pub 3 points 2 weeks ago (5 children)

I mean, you can have that today, in some form or other, since that’s just how local AI works.

[–] Septimaeus@infosec.pub 2 points 2 weeks ago (2 children)

Ahh now it makes sense! Was living elsewhere when the first seasons aired in the states but have heard a lot about it since, even if I don’t recognize the characters. Need to watch it sometime. (OK just checked the wiki and apparently it’s up to 22 seasons lol, so maybe I’ll find an abridged version or try speed reading the manga or something.)

Thank you for the explanation!

[–] Septimaeus@infosec.pub 4 points 2 weeks ago

I’ll allow it

[–] Septimaeus@infosec.pub 5 points 2 weeks ago (2 children)

Oh god that’s gross. I mean the top frame. The bottom is funny.

[–] Septimaeus@infosec.pub 3 points 3 weeks ago

Ah that makes sense

[–] Septimaeus@infosec.pub 6 points 3 weeks ago (2 children)

I’m thinking with my one brain cell that this must be the plot of the movie the meme template came from, but I’m too lazy to check

[–] Septimaeus@infosec.pub 7 points 3 weeks ago (1 children)

Who are you who are so wise in the ways of science?

[–] Septimaeus@infosec.pub 1 points 3 weeks ago

Yeah something about mortars and pestles

view more: ‹ prev next ›