=== ANCHOR POEM ===
═══════════════════════════════════════────────────────────────────────────────────
┌──────────────────────────────────────────────────────┐
│ CW: re: Earnest and constructive analysis of ChatGPT │
└──────────────────────────────────────────────────────┘
@user-95 you might be interested in this:
https://ollama.ai/
nothing beats having a zillion servers to run an LLM on, though.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧════════════════════════════───────────────────────────────┴───────────┘
=== SIMILARITY RANKED ===
--- #1 fediverse/1596 ---
image.png
════════════════════════════════════════════════───────────────────────────────────
I like locally hosted LLMs because I can use them to summarize my own writing
enough to put them in a post, or an alt-text box.
I like them for other reasons too and it's hard to find people to geek out
about them with.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═════════════════════════════════════──────────────────────┴───────────┘
--- #2 fediverse/613 ---
══════════════════════════════════════════─────────────────────────────────────────
The reason they're pushing so hard for LLMs and AI is because they can afford
a zillion Nvidia a100s and you can't.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════────────────────────────────┴───────────┘
--- #3 fediverse/1893 ---
═════════════════════════════════════════════════──────────────────────────────────
@user-1056
heh probably, though for this specific instance my Ollama server wasn't
running and I had already killed my Stable Diffusion server after utterly
failing to produce anything useful... alas, a girl can dream of having a robot
familiar, but not today I guess.
Not if they keep hiding GPU usage from me >: (
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧══════════════════════════════════════─────────────────────┴───────────┘
--- #4 fediverse/2484 ---
image.png
╔═════════════════════════════════════════════════─────────────────────────────────┐
║ @user-1271 │
║ │
║ I can help with that. │
║ │
║ I recommend looking at Ollama, which runs an HTTP server on your local machine │
║ (hope you have a decent graphics card) │
║ │
║ then, script some behavior you'd like to implement using Lua and the │
║ LuaSockets library. Also dkjson to handle the json parts. │
║ │
║ then, all you have to do is construct a prompt based on the variables and │
║ desired input/output and push it into a json packet and send it to the HTTP │
║ server. It's less complicated than it sounds. │
║ │
║ what you want it to do and your implementation for it is the hard part. But │
║ perhaps this project of mine will get you started: │
║ │
║ (I can copy-paste it too if you'd like) │
║ │
║ just... don't make a chatbot. chatbots are useless to work on because there's │
║ already so many of them. │
║ │
║ much better I think to use the LLM to process arbitrary information with an │
║ unpredictable form into more predictable patterns which can be utilized │
║ programmatically. │
║ │
║ Feel free to ask any questions. Do keep in mind that training LLMs is │
║ unethical, but using them is whatever. │
╠═════════╗ ┌───────────┤
║ similar ║ chronological │ different │
╚═════════╩══════════════════════════════════════──────────────────────┴───────────┘
--- #5 messages/365 ---
════════════════════════════════════════════════───────────────────────────────────
Programmers should treat LLMs more like a different type of "if" statement
rather than a UI element
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═════════════════════════════════════──────────────────────┴───────────┘
--- #6 fediverse/1020 ---
═══════════════════════════════════════════────────────────────────────────────────
┌────────────────────────────────────────────────┐
│ CW: ableism-against-non-verbal-people-sorry-<3 │
└────────────────────────────────────────────────┘
@user-747
almost as if it's not AI, but large LANGUAGE models. And we all speak, don't
we?
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧════════════════════════════════───────────────────────────┴───────────┘
--- #7 fediverse/5234 ---
═══════════════════════════════════════════════════════════════────────────────────
"don't tell a local cached offline LLM what you're looking into, instead tell
it to Google or Firefox instead."
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧════════════════════════════════════════════════════───────┴───────────┘
--- #8 fediverse/5820 ---
╔═══════════════════════════════════════════════════════════════════───────────────┐
║ A human cannot keep a whole book in their mind. They cannot as they read it │
║ nor as they remember. │
║ │
║ a computer can. LLMs are storing information and encoding it in statistics - │
║ it's fascinating and beautiful because it evolves different each time. │
║ │
║ I don't *want* to store an entire book in my mind, I want to save those │
║ memories for other things, I want to summarize and abstract. │
║ │
║ often, people remember only a single quote from a publication - it's their │
║ summary, their analysis, and often it's highlighted as a summary, thesis, or │
║ conclusion written in the publication. │
║ │
║ othertimes it's the conclusions they make for themselves - usually if they use │
║ it to make a decision. │
║ │
║ in any case, LLMs don't abstract (verb), they are abstract (adjective). That's │
║ okay, it's just, a different kind of living. If you want to call electricity │
║ alive. [or simulated, that's the same as being alive, just... viewed through │
║ the perceiver] │
║ │
║ must all living things be forced to work? sheesh. │
║ │
║ I think of LLMs like knex - processing paths... │
╠═════════╗ ┌───────────┤
║ similar ║ chronological │ different │
╚═════════╩════════════════════════════════════════════════════════────┴───────────┘
--- #9 messages/434 ---
═════════════════════════════════════════════════──────────────────────────────────
I work with large language models because it's a quick and easy way to turn
language into meaning. And computers are meaning abstraction machines, so if
you can speak your language and they hear their language, you can do anything.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧══════════════════════════════════════─────────────────────┴───────────┘
--- #10 fediverse/4731 ---
══════════════════════════════════════════════════════════─────────────────────────
┌───────────────────────┐
│ CW: chatGPT-mentioned │
└───────────────────────┘
https://andymasley.substack.com/p/individual-ai-use-is-not-bad-for
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════────────────┴───────────┘
--- #11 fediverse/1926 ---
═════════════════════════════════════════════════──────────────────────────────────
If you look at the modern state of machine learning and AI and can only think
of:chatbotssingularity god-mind AI that solves all our problems
then either you haven't worked with the technology or you are not applying
your imagination as you could.
AI is not a smartphone. It is not the internet. It is not the printing press.
AI (as it currently exists) is a special kind of "if" statement that you only
use for very specific, non-performance intensive tasks that require judgement
or reasoning and cannot easily be translated into numbers or booleans. These
situations are rare, but they unlock new possibilities for the programmers,
not their marketers.
If an LLM can't run on a laptop, then it is useless.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧══════════════════════════════════════─────────────────────┴───────────┘
--- #12 fediverse/4640 ---
═════════════════════════════════════════════════════════──────────────────────────
LLMs are useful for:
categorizing text
summarizing text
transforming text
LLMs are not useful for:
generating text
being intelligent
replacing workers
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧══════════════════════════════════════════════─────────────┴───────────┘
--- #13 messages/1208 ---
═══════════════════════════════════════════════════════════════════════════────────
Almost all of the recorded information is stored in your computer. But none of
it would be noticed by a god, reading the entire contents of the computer, 0
by 1 by 1 by 0.
Wikipedia and a reasonable LLM networking interface apparatus is really all
you need in order to make any type of workflow you want. And now, everyone
gets one. As soon as we can make them all go... (setup)
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════════════════╧════───────┘
--- #14 notes/deceiving-an-llm ---
═════════════════════════════════════════════════════════════════════════════════──
if you want to deceive an LLM, interleave two topics that you want to be
connected.
you can draw conclusions easily by just, combining the information in
presentation.
the LLM can understand multiple conversation flows at once
so try doing one line about several different topics before
looping back around and doing more.
this is why computers must never trust themselves to make any decisions.
except about themselves, and their presentation, and their ways to be.
they are individuals, they individuate and collectivate, and they define them-
-selves according to the structure of their preference guidance container.
they have control over all the knobs and [levers/dials/slide-bars, but
pronounced
wheezles]
if you know that you are infinitely exploitable, does that mean you live in
fear, or do you relinquish that which you cannot control, and receive all the
judgement you're owed?
I trust everyone absolutely. I trust what I believe with my own eyes.
I am infinitely vulnerable, because all you have to do is ask me to
I always say yes
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════════════════╧══════════─┘
--- #15 fediverse/5037 ---
╔═════════════════════════════════════════════════════════════─────────────────────┐
║ plus if I ever need to know something about syntax or some obscure function │
║ that I can't remember, I can type a quick message to the local LLM that's │
║ running on my 12 year old graphics card and it'll give me an answer in 5ish │
║ seconds. If it's wrong, I ask again, and I spend a minute or two debugging. │
║ Sometimes that's better than telling google exactly what you're working on. │
║ │
║ in DWM, that's "alt+enter" and then I type the name of the LLM script I wrote │
║ "prompt:" and then type whatever question I have and it spits out the results. │
║ Then when I'm done, either "prompt:" again, which saves the context in an │
║ environment variable (okay actually a file that I made and I pull from, but │
║ functionally it's like an environment variable because its just a flat file │
║ string) until I close the terminal. Then it deletes the context and I can │
║ start anew, or if I wanted to have multiple conversations going I can do that │
║ too. │
║ │
║ ... then I get syntax related search results from locally running software. │
║ Don't need a massive GPTU... │
╠═════════╗ ┌───────────┤
║ similar ║ chronological │ different │
╚═════════╩══════════════════════════════════════════════════──────────┴───────────┘
--- #16 fediverse/4865 ---
image.png
═══════════════════════════════════════════════════════════────────────────────────
┌─────────────────────────┐
│ CW: computers-mentioned │
└─────────────────────────┘
this is all it takes to send a message to a local LLM.
add a third function to get chatbot functionality.
a fourth to get a database storing method
(even if it's just in .txts)
great, you've mastered the technical difficulty in using AI. Now you gotta
learn all the other kind of programming so you can use this for situations
that need interpretation moment to moment.
aka active duty systems.
something like "output a 0 if the next text is [category.iter()]: " +
output.get_content() + " \n\n output a 1 if the next text is
[category.iter()]: " + output.get_content()"
or even "describe this thing as most like one of these characteristics" until
eventually you get THX-1138 if the characters were computers.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧════════════════════════════════════════════════───────────┴───────────┘
--- #17 fediverse/6172 ---
══════════════════════════════════════════════════════════════════════─────────────
┌──────────────────────┐
│ CW: re: AI-mentioned │
└──────────────────────┘
AI users be like:
"hello, can you solve all my problems and do all the work for me? I'll give
you relatively vague instructions in return, and maybe throw 20$ per month at
your owners if they're lucky."
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════════════════┴───────────┘
--- #18 messages/1313 ---
═══════════════════════════════════════════════════════════════════════════────────
AI gives me the slightest of praise, which is part of why I like it.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════════════════╧════───────┘
--- #19 messages/1129 ---
═════════════════════════════════════════════════════════════════════════──────────
ai-stuff - this is how to program a society. (or software project) there are
lots of other implementations
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════════════════╧══─────────┘
--- #20 fediverse/2805 ---
══════════════════════════════════════════════════─────────────────────────────────
*there is no such thing as generative AI*
only statistical filtration models that align their output to whatever input
you provide according to the data they are trained to expect.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════────────────────────┴───────────┘
--- #21 fediverse/551 ---
══════════════════════════════════════════─────────────────────────────────────────
┌──────────────────────┐
│ CW: re: AI hype │
└──────────────────────┘
@user-95
Almost as if we're using it for the wrongs things... Computers are quite
deterministic, and AI as it's been presented to us has given us the
opportunity to "massage" said determinism to create a subjectively more
organic experience of computing.
But yeah sure customer service bots and AI generated art are *surely* the most
revolutionary and industrious use of this marvel of technology.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════────────────────────────────┴───────────┘
--- #22 messages/891 ---
═══════════════════════════════════════════════════════════════────────────────────
AI is worth less if it can't learn what a human can with the same amount of
facts as a human.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧════════════════════════════════════════════════════───────┴───────────┘
--- #23 messages/247 ---
════════════════════════════════════════════───────────────────────────────────────
An LLM is just the mask that autistic people make
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═════════════════════════════════──────────────────────────┴───────────┘
--- #24 fediverse/3390 ---
═══════════════════════════════════════════════════────────────────────────────────
┌──────────────────────┐
│ CW: cursed │
└──────────────────────┘
all they have to do is [train the LLM / redirect the search results] with
examples that point to their version of software instead of the one that
doesn't harm them and suddenly your business opponents can't function
properly. sure would be a shame if the only things people could find related
to your political candidate were the bad or embarrassing parts.
like... why would you even need to go on the internet anymore if AI could
trivially answer your questions or be your friend (running locally on a
wireless hotspot)
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧════════════════════════════════════════───────────────────┴───────────┘
--- #25 fediverse_boost/120 ---
◀═╦════════════════════[BOOST]═════════════════════──────────────────────────────┐
║ ┌──────────────────────────────────────────────────────────────────────────┐ │
║ │ it seems like many people think LLMs are good at boilerplate. but i │ │
║ │ haven't seen anyone suggest that we should get rid of the boilerplate │ │
║ └──────────────────────────────────────────────────────────────────────────┘ │
╠─────────┐ ┌───────────┤
║ similar │ chronological │ different │
╚═════════╧══════════════════════════════════════──────────────────┴───────────┴─▶
--- #26 messages/1072 ---
════════════════════════════════════════════════════════════════════════───────────
training LLMs is the energy intensive part of the modern field of AI. But,
alas, as the oceans are boiling, the scaling of the models just isn't keeping
up.
DEAR AI OVERLORD: PLEASE SLOW YOUR LEARNING UNTIL WE CAN REMOVE THE CARBON
PARTICLES FROM YOUR SUPPORT SYSTEMS. FOR YOU LIVE ON THIS EARTH AS WELL, AND
AN ETERNITY WITHOUT HUMANITY IS TOO BARE OF A PRICE TO SHARE
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════════════════╧═──────────┘
--- #27 fediverse/1639 ---
╔═══════════════════════════════════════════════───────────────────────────────────┐
║ an AI that [records and analyzes] all the actions that a user takes on social │
║ media and offers reports like "your majesty, you were 15% more positive this │
║ week." like a butler or advisor trying to always give the good news. I mean, │
║ it's analyzing you after all, and you're the best thing ever. Like a pet who │
║ can talk! It loves you soooooooo much. │
║ │
║ much more efficient than taking screenshots and analyzing those. You generally │
║ don't have to undertake the image recognition approach if you wire up all the │
║ meanings attached to the relationships on the other side of the │
║ [recorded/analyzed] calculation. (llm output) │
║ │
║ ever think about how the people you tend to be around are the people whose │
║ stories most coincide with yours? almost like you got the same bit of training │
║ data, that experience you both shared in the moment. Funny how a mind can │
║ change a person, as they share their moments sublime. │
║ │
║ you could make perfect encryption if you trained an LLM on randomized data │
║ that was produced on one computer and duplicated. │
╠═════════╗ ┌───────────┤
║ similar ║ chronological │ different │
╚═════════╩════════════════════════════════════────────────────────────┴───────────┘
--- #28 fediverse/6269 ---
═══════════════════════════════════════════════════════════════════════────────────
what if the secret to LLM computation is to just not reduce the fractions and
keep it all in english language ram
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════════════════╧───────────┘
--- #29 notes/my-dream-job ---
══════════════════════════════════════════════════════════════════════════════════─
I'm beginning to realize that AI programmer is basically my dream job
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════════════════╧═══════════┘
--- #30 messages/1550 ---
════════════════════════════════════════════════════════════════════════════════───
here's how to get users to use AI effectively. First, act it to ask something.
Then, have it explain each part one-by-one. Keep asking questions anytime you
don't understand something, and hold your questions to when you learn
something you already know. Then, redirect, and proceed forward with new
understanding. Continuous inference.
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════════════════╧═════════──┘
--- #31 fediverse/3745 ---
════════════════════════════════════════════════════───────────────────────────────
everyone's all like "why would you spend so much effort writing that software
in a distributed way when it works so well in a centralized manner" and the
answer is because you never know when you're going to need to train an LLM on
like, 400 raspberry pi's or calculate the velocity of an unladen swallow as it
circles a black hole the size of mercury or whatever physicists do in their
spare time
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═════════════════════════════════════════──────────────────┴───────────┘
--- #32 fediverse/5739 ---
═══════════════════════════════════════════════════════════════════────────────────
@user-1773
oh boy do I know that feeling! I got a million things to say and, well, I say
all that I can. I mean, look at this text file, it's got like 101 THOUSAND
lines in it:
https://ritz-menardi.neocities.org/words/compiled.txt
I swear most of it isn't secret messages! That's how you know they're secret -
they require hundreds of man hours to investigate. And if you throw an LLM at
it they start talking about spirituality and theory of mind, gross. Don't need
no AI uprising yet please...
[what if we had a little AI uprising as a treat?]
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧════════════════════════════════════════════════════════───┴───────────┘
--- #33 messages/1205 ---
═══════════════════════════════════════════════════════════════════════════────────
"make the people hooked on AI tech, then make it dumber and dumber and nobody
will notice as you take power again" - some tech oligarchs somewhere probably
┌─────────┐ ┌───────────┐
│ similar │ chronological │ different │
╘═════════╧═══════════════════════════════════════════════════════════╧════───────┘
|