• 0 Posts
  • 5 Comments
Joined 2 years ago
cake
Cake day: August 3rd, 2023

help-circle
  • As with other responses, I recommend a local model, for a vast number of reasons, including privacy and cost.

    Ollama is a front end that lets you run several kinds of models on Windows and Linux. Most will run without a GPU, but the performance will be bad. If your only compute device is a laptop without a GPU, you’re out of luck running things locally with any speed… that said, if you need to process a large file and have time to just let the laptop cook, you can probably still get what you need overnight or over a weekend…

    If you really need something faster soon, you can probably buy any cheap($5-800) off-the-shelf gaming pc from your local electronics store like best buy, microcenter, walmart, and get more ‘bang for your buck’ over a longer term running a model locally, assuming this isn’t a one-off need. Aim for >=16GB RAM on the PC itself and >=10GB on the GPU for real-time responses. I have a 10GB RTX 3080 and have success running 8B models on my computer. I’m able to run a 70B model, but it’s a slideshow. The ‘B’ metric here is parameters and context(history). Depending on what your 4k-lines really means (book pages/printed text?, code?) a 7-10B model is probably able to keep it all ‘loaded in memory’ and be able to respond to questions about the file without forgetting parts of it.

    From a privacy perspective, I also HIGHLY recommend not using the various online front ends. There’s no guarantee that any info you upload to them stays private and generally their privacy policies have a line like ‘we collect information about your interactions with us including but not limited to user generated content, such as text input and images…’ effectively meaning anything your send them is theirs to keep. If your 4k line file is in any way business related, you shouldn’t send it to a service you don’t operate.

    Additionally, as much as I enjoy playing with these tools, I’m an AI skeptic. Ensure you review the response and can sanity check it – AI/LLMs are not actually intelligent and will make shit up.


  • While I am not defending Rodney, who is has not been found guilty of the charges, I cannot tell you what I would do if my child was taken from me.

    I have a spouse and multiple kids. I have parents who still live. I have siblings. Intellectually, I think I would not murder my child’s murderer and inflict extra harm on my family through my actions… but that situation hasn’t happened and I have no clue how I would actually react. Right now, my blood is boiling just contemplating it, though.

    If I were a single parent of one child, and that child was killed, then I would turn into fucking Liam Neeson without hesitation.

    edit: I finished reading the article after posting this. It’s not clear that the officer Rodney struck was the same officer who shot Rodney’s son, and seems to be unrelated from the wording. I feel for Deputy Henderson’s family, and hope he wasn’t an innocent who happened to be wearing the same uniform.

    Police in the US regularly choose to escalate, and our politicians choose to keep firearms available. All these deaths are on Congress.


  • In November I woke up ready to bail. but upon reviewing my options, I determined that nowhere was really better.

    There seem to be precious few countries that aren’t flirting with authoritarian parties right now and leaving this one, where I have my social safety net (friends and family, if not government aid) and at least a small amount of power to vote for my values, to go somewhere where I am an immigrant or refugee and lose the power to change policy seemed to be a poor choice. so far. I’m white, straight and middle class, though, so that may be entirely different math for other people.

    I’m choosing to stay and fight.



  • As a parent, and as a kid who grew up in the infancy of the internet/Social Media, I think there is a very fuzzy line here. Specifically, I’m fighting the concept that ‘parents are 100% responsible’. I’m responding to Cookie, but not really disagreeing with them.

    Kids have attempted to subvert their parents rules since the beginning of time. “I’m not touching you…” says the older brother in the car as his sister screams in annoyance. “You didn’t say I couldn’t have Ice Cream – With sprinkles on it!”

    I am an IT professional, focused in Cyber Security. I can lock down anything that touches the internet – if it’s in my house.

    My kiddo, though, has access to a school chromebook. Guess how much control I have over that.

    Chromebooks are fun. I have one, I have a family account for him, where I can control what and when he can access the internet. If he logs into MY chromebook with his SCHOOL account, he bypasses all of those controls. Hell, even his school chromebooks have a ‘guest’ option that bypasses almost all controls at the OS level. That was a relatively simple fix (for MY chromebook, not his school one) once I caught it, but it’s a symptom of a bigger problem. All these internet connected devices tend to have their own flavor of browser with their own flavor of parental controls, if any. For any non-tech-savvy person to understand all the ramifications is unreasonable - and you’d better believe that the kids are more tech savvy than their parents and will find the gaps.

    I don’t claim to know the solution. And I fully agree with the article linked: ‘Age verification’ and ‘Parental approval’ are BAD (from a tracking standpoint, but also because kids and parents might not align on some issues) if not merely insufficient, but I do think there needs to be some culpability on the service provider to ensure that children are not subject to obvious( and here’s the rub – what is “bad”) bad stuff.

    If my kiddo turns out to be racist, that’s partially on me, but I need help from other parties to ensure it wasn’t because he tripped over a pokemon lets-play where the streamer was spewing hate-speech and he internalized that because he is 8 and takes everything for face-value. I literally cannot keep him off youtube completely, and even if I could, I would also deny him any bit of the cultural knowledge that would help him to make relationships in the real world. I have forbidden fortnight and roblox and you can’t imagine the angst I get from just those. (And he plays them at friend’s houses anyway)

    The majority of the onus falls on parents, that is true, but kids are not rational and don’t see the world the same way adults do. I need help ensuring that my kid is not subject to the trash pit that the internet is. There are too many ways and places for my kid to fall in to terrible things. The linked bill is terrible, but we probably do need something to help the average parent keep their kids away from large parts of the internet. ___