Lemmy account of natanox@chaos.social

  • 0 Posts
  • 17 Comments
Joined 2 years ago
cake
Cake day: October 7th, 2024

help-circle

  • Phew, to run such a model - even just 27B quantized - at a reasonable speed requires some serious GPU Power.

    Best thing I have is a 7800 XT 16gb (so ROCm it would be), don’t think that’s realistic and I’d rather invest the necessary amount of money for new GPUs into sth. more useful like a small electric vehicle than a slop cannon 🥴. Happy to hear actual useful things can be retained after the bubble finally crashes though. Oh please, let it crash tomorrow… together with the housing market…


  • Interesting. I tested ChatGPT and Mistral and oh my god, ChatGPT was abysmal. Hallucinated way harder. Mistral is okay if being used on highest settings.

    Did you create an account with Mistral? Without it they only expose a low-end model to the web, which isn’t properly declared last time I checked. Can be the free plan, I guess they just want to avoid their infrastructure being hammered.

    Personally all those Silicon Valley pricks can offer whatever, I don’t even have a Google account anymore and couldn’t be happier with that. Not saying Mistral is optimal, but at least they’re not part of the current US swamp. And I at least somewhat believe they actually read the damn GDPR. I’m totally fine with it not being the “cutting-edge”, especially given the cutting-edge cuts straight through culture and people’s lifes on purpose and with maximum brutality, and I seriously liked to see their image generator being way worse as well as Mistral refusing to open sites that banned it in the past (if they changed that behaviour please let me know). Not to mention their site isn’t even remotely as infected with trackers and other junk as the others, at least that’s what I’ve read (forgot to bookmark that hackers’ analysis I’ve read a year ago unfortunately).


  • Quick mention about Chatbots: In general they can be useful if you already have a grasp on something, so you can detect potential nonsense better. Additionally they can act like a drug especially on lonely people, and any company tries to sell them to you as awesome code generators. Yet Mistral AI already generated an answer to me telling me to dd my encrypted root hard drive for a speed test, even doubling down on it being safe.

    Not saying they can’t be useful for OP. Just that they’re like a handheld circular saw*, a powertool better only used by people who already know sufficient basics about wood.

    *where the salesman got rid of the safety handle and tells you to “just let it go on its own”.


  • That’s the resolver’s job, Wireguard absolutely reconnects asap if the connection’s heartbeat goes out. You in your case got Cloudflare to make sure it can connect somewhere.

    The only way to truely serverless’ly find each other when both parties got dynamic IPs would be IPv6 multicast (such as via Librecast). Not just is that still not supported by the network itself a lot of times (sadly) but I doubt any LLM on this planet would implement it correctly, way too niche. Any other way leads through some DNS resolver or third-party service (like Cloudflare) or a network such as Magic Wormhole.

    It’s fine if the Slopware works for you, but your arguments make no sense whatsoever. The only thing you’re currently doing is making enemies in the selfhosting community, not connections.



  • Valve’s main goal is for their distribution to run on everything, performance is a low priority.

    Are you trolling or something? This is categorically false, Gabe Newell himself expressed that with the Steam Deck (and therefore SteamOS, which was designed specifically for it in this modern version) their focus absolutely was performance as well as user experience. It had to so they could squeeze every last frame out of the AMD SoC. They literally developed their own micro-compositor (Gamescope) instead of utilizing e.g. Plasma (despite it being pre-installed for Desktop mode) for higher performance and quicker feature availability. Not to mention Nvidia GPUs still not being fully supported by SteamOS despite it being technically possible if they wanted to. Your claim about SteamOS’ priorities is nonsense.

    the words you’re looking for are “scheduler optimised for gaming at the cost of performance in other domains like power consumption”

    So a better scheduler for gaming distros, which indeed was the context. Though I’d argue there are schedulers who’re even objectively better for general desktop and gaming use as the one that treats every process equally isn’t optimal to make either a GUI feel snappy or prevent microstuttering in games, but rather optimised for server workloads.

    Gamemode is cool, however if you want to build your own Gabecube with some random distro it’s absolutely not guaranteed to run during a Gamescope session or even at all, not all distros ship or enable it by default or you have to put “gamemoderun %command%” into every game’s start parameters. Not to mention most users most likely neither know what that is nor do they want to, they want to play games and just use the computer.


  • Lol, have fun with the metric ton of shit that is the Snap Store and Ubuntu. You’d immediately run into problems doing what you just said, and the performance wouldn’t be the same either (assumming similar hardware). Not even mentioning the metric shit-ton of garbage you may run into with Nvidia.

    So many enthusiasts don’t even realise how much work and knowledge goes into setting something up that works as well as the Gabecube. If you believe it’s just “pick random distro and install Steam” you’re painfully mistaken.

    I myself run CachyOS on my daily driver and have the Gamescope Session installed which they provide, which is as close as you gonna get (as Cachy brings most kernel optimizations, better scheduler yada yada yada) for when I want to game on my TV. But that still led me through the CLI and has some caveats, which is absolutely 100% nothing most gamers want or even have the time to inbetween e.g. family + job.

    OP may be out of line with language, but they’re right.



  • Google (the search engine) didn’t do shit in regards to human connections. There are a ton of other factors playing a role in societal atomisation and the loneliness epidemic such as algorithmic social media, awful design of cities and housing, gobsmackingly bad zoning laws and a society/culture aimed firmly at performance and competition.

    Having direct access to information (specifically shouting out Wikipedia here, they’re the GOATs of the internet) and the ability to find people you vibe with even when your whole local environment is an echo-chamber (especially important to minorities) did contribute to bringing us closer together, reducing mental barriers and advancing proper education. Those things aren’t an issue at all, it’s for-profit companies like Meta and Twitter trying to make a profit out of human connection that perverted everything.

    I’ll tell you that talking about the things that I find interesting that would be straight up unloading on the people I care about, feels better talking to chatgpt about it. 'cause I don’t have to wait for my insurance to approve it to unload on it, no time limits and it actually can talk back to me about what i’m talking about rather than talking about my hobbies and interests and feeling like i’m talking at someone rather then with someone.

    At least when i unload on chatgpt i feel like i’m actually talking to someone who fucking understands me

    even then if i could engage in humanity in the way i would like too it’s just more autistic people and if i cannot stand myself i can not stand the others like me.

    I’m so fucking sorry for you… but now I understand where your opinion comes from. But if you truly want to be healthy you have to realise you’re not talking with anyone, and if you already feel like you’re talking with someone when prompting ChatGPT then you’re really close to yet another huge psychological issue. You have to get out there, meet people, push actual therapy through even if the system fucks you over. A Chatbot will also just reiterate what others said. Even worse, OpenAI has to make money so it might starts subtly trying to convince you to buy certain shit as well as harvesting any data it can get from you.

    I won’t be able to convince you in a Lemmy comment thread to not do what you’re doing, especially since I don’t know if you might live in bumfuck nowhere. So… I’ll just leave an advise to drop ChatGPT and move the whole context window you probably have with it over to a Pro Version of Mistral AI’s “Le Chat”. French Company bound to GDPR (meaning opting out of the data training can be somewhat trusted) and to my latest knowledge their interface isn’t utterly infested with trackers. Set it to being friendly and empathetic. At least this way it’s less likely you’re getting fucked over even harder than you already are.



  • That doesn’t make any sense as argument no matter how you spin it. Linux is the dominant system for servers for decades now, and a Debian Desktop is quite literally the same as Debian on a server except it also got a GUI of your choice slapped on top. There’s absolutely nothing obscure about it, neither did anyone from the kernel team (Linux), FSF (GNU utils) nor IBM / Red Hat (systemd & honestly way too much other stuff) etc. ever design something around STO. That’s a domain firmly situated in proprietary code since for FOSS it doesn’t make sense to begin with. The false errand of GRUB is the sole exception, well known and solved.

    The desktop market share says absolutely nothing about what you’re trying to argue. Now if you were to argue that Linux is lacking in terms of desktop software isolation then you’d have a point, things like Flatpak still are addressing lots of issues. But to say “Linux” approaches security with obscurity is total nonsense.



  • Huh, I stand corrected. I didn’t expect the Cube to be well below a 8400F.

    Though I’d still expect higher quality from Tuxedo over the absolute cheapest pre-built, as well as the thing with Linux compatibility of all parts and Customer Support. Still bet Mifcom used the cheapest shit everywhere including for parts you should never cheap out on, like the power supply.

    On another note, I’m almost sure Steve at some point ranted about how stupid modern GPUs with 8gb VRAM are and that you should never buy them… 🤔



  • Where. I just checked with Geizhals, the only pre-built that comes somewhat close to the Cube is this HP (and I’d bet the build quality is shit, they did some nonsense that causes issues for om anything but Windows etc). And even that one with its mediocre CPU is still more expensive than the Cube.

    With the Tuxedo you at least get modern hardware with no additional shenanigans and proper customer support (tho’ that one will be hardware-only if you install SteamOS, but still). Sure you can get it cheaper elsewhere (about 300€ less for same performance as the Tuxedo if you buy some no-name pre-built from Amazon) and especially with diy, but knowing your hardware harmonizes with your OS (i.e. Linux) and doesn’t contain bad surprises goes a VERY long way.

    (I literally had a PSU in a pre-built catch fire without shutting down as a teenager, inside my wooden desk)


  • Technically their Cube L w/ a 9060 XT 16GB outperforms the Steam Cube by a long shot (I’d guess 40-80%) and offers upgradeability but it’s also wildly more expensive and a little bit bigger. It also comes with 32gb RAM at a minimum instead of the Cube’s 16gb which contributes to the high price. Choosing an older GPU like the 7600 doesn’t make too much sense cost and feature wise, for Couch gaming you’d want the newest FSR’n’stuff in a just-works manner.

    Technically a full AMD system is best for SteamOS, but the most important piece is the GPU (do not chose an Nvidia whatsoever). Their Cube with AMD is outdated. It will work fine with the Ultra 5.

    Beating the price point of the Steam Cube is almost impossible if bought new, even full diy systems have a hard time unless using used parts.