• 0 Posts
  • 73 Comments
Joined 2 years ago
cake
Cake day: June 20th, 2023

help-circle

  • Anecdotally, I use it a lot and I feel like my responses are better when I’m polite. I have a couple of theories as to why.

    1. More tokens in the context window of your question, and a clear separator between ideas in a conversation make it easier for the inference tokenizer to recognize disparate ideas.

    2. Higher quality datasets contain american boomer/millennial notions of “politeness” and when responses are structured in kind, they’re more likely to contain tokens from those higher quality datasets.

    I haven’t mathematically proven any of this within the llama.cpp tokenizer, but I strongly suspect that I could at least prove a correlation between polite token input and dataset representation output tokens


  • For people with “that one game” there is a middle ground. Mine is Destiny 2 and they use a version of easy anticheat that refuses to run on Linux. My solution was to buy a $150 used Dell on eBay, a $180 GPU to be able to output to my 4 high-res displays, and install Debian + moonlight on it. I moved my gaming PC downstairs and a combination of wake-on-lan + sunshine means that I can game at functionally native performance, streaming from the basement. In my setup, windows only exists to play games on.

    The added bonus here is now I can also stream games to my phone, or other ~thin clients~ in the house, saving me upgrade costs if I want to play something in the living room or upstairs. All you need is the bare minimum for native-framerate, native-res decoding, which you can find in just about anything made in the last 5-10 years.

















  • Vizio is fantastic if you’re using your own source, I wouldn’t rely on their smart stuff though.

    I’d still refute that claim. I bought a vizio tv about ~7 years ago and it was perfect when I first bought it. A few software updates later and now the TV will switch to it’s internal bullshit any time there isn’t an input source for greater than ~3 seconds. It’s infuriating that if my nvidia shield takes a second too long to push out a video signal the TV will just switch inputs on me. There is no way to disable this antifeature. The best part is after I noticed this behavior, I (at the network level) prevented all outgoing communication from this TV and it is still perfectly happy to just switch to a blank internal input whenever an external source takes slightly too long.

    “If I can’t track you, fuck you I’ll make your TV basically unusable”