skysight-inc/HackerNews huggingface dataset:
Running Llama2 Models Locally
I get approval from meta, then I downloaded all Llama2 models (7B,7B-chat,13B,13B-chat,70B,70B-chat) locally, when I tried to run the script to test the 7B model using the command that is mentioned on Llama github "torchrun --nproc_per_node 1 example_text_completion.py \
--ckpt_dir llama-2-7b/ \
--tokenizer_path tokenizer.model \
--max_seq_len 128 --max_batch_size 4" I got this error "Distributed package doesn't have NCCL built in". My environment : Windows 10, Nvidia GeForce RTX 3090, CUDA 11.8, torch 2.0.1+cu118. I have free enough space and I have everything but I don't know why it's not working. Any help please. I'm blocked in this task for 3 days.
Nope, just one you don't like.
I don’t think we’re at the point of Asimov’s robopsychology!
Are DoorDash, Uber Eats and the like really any better ?
I don't know the real answer to your question, but on local models you have a parameter you set that controls how many tokens to generate. It doesn't always follow it, it can end early, but sometimes it just keeps going. Usually though I can set it to generate 700 tokens and it will generate about 700 words.

I wonder if the online chat models have a similar value somewhere.

---

If you want the AI to remember something you will unfortunately have to keep reminding the AI of it in the prompt. With explicitly or you might refer to the previous generated text if it fits into the context. However, in local models the context can be limited (eg 2000 tokens). If the conversation goes above that 2000 tokens then the model will discard stuff from before. There are models with larger context sizes though. Lengthy prompts will cause the same issue though.

The way things like SillyTavern role-playing work is that the model will constantly be reminded of some important attributes of the character that it's role-playing in the prompt (but it's done for you).
The problem with cui bono is that it can, and usually is, be twisted to fit any narrative without proving causation. Just because something is possible, or beneficial, does not mean it happened or had any causal link. Human decision making is full of shortcuts when there's a good story that aligns with existing beliefs.
I only have high school level chemistry, but if Helium is a noble gas it doesn't bond and so it can't have a narcotic effect, because it doesn't affect the chemistry of the brain
That’s perfectly fair. But in that case, I’d argue Preview is not much better than the umpteen other apps that can do non-form editing.
Honestly, English intellectuals are a good yardstick for how history will remember people and events. If the English intellectuals esteem someone or some event, then generally those people and events are widely considered disparaged two generations down.
So your wouldn't even just bury (zero plastic, biodegradable) toilet paper?

Visiting some US national parks is high on my bucket list so I should know this... thanks!
Haha yes the most commonly used argument is (afaik) that if we could create a 'complete' virtual world, we would, and projects like this and how enthusiastic we are about it suggest that that's indeed the case.

(The argument then of course continues that if we would, our world's inhabitants would some day too, ad infinitum. Given such a stack, the chance that we're actually still in the top layer is very small.)
Thoughts on the Remarkable 2
Per his website

> We did the research for you and compiled a database

Given that I am relying on this person and his editorial decisions, this sort of thing is very relevant to me. It might affect what data he chooses to include or exclude, and what he is willing to treat as reliable or unreliable. Needless to say, his usage of Wikispooks as a source does not inspire confidence.
without more details this is useless and in effect will simply prolong the various conspiracy theories.
Does anybody know what this will mean for the already existing green threads implementations in e.g. Kotlin and Scala Cats?
Will these benefit from project Loom, or are they somehow incompatible?
The Guide to Rewarding Your Software Developers
Cool, I think I'll try to go next time it comes round. Thanks for reporting in :)
The extension seems to offer a ton of information already, and it's still in its early stages it seems. Moreover, the genuine reader can always use Google and Wikipedia to educate themselves further.

Besides, your OP certainly reads like advocating for hiding away certain facts as a kind of better choice in a tradeoff of sorts.

Otherwise you would have certainly written it in a more constructive manner as opposed to implying that we would be better off without things like this extension altoghether (for fear that facts may "exacerbate" things).
But Amazon did copy the software and continues to sow confusion in the community about which is which
Basically you ignore a bunch of the work done for async, callbaks, etc and go back to making a new "thread" and handling a request.
Sounds like you don't know Alan Turing was Wittgenstein's student for a number of years. Cool. Feel free to remain an imbecile.
Porsche engineering
Show HN: cosmictrip.space, a new space AI image every 30 minutes
Hi HN,

The idea is simple: new space-themed DALL-E images are generated every 30 minutes. The prompts used to generate the images are also AI generated: they are from GPT-4 API. A new prompt is added to the pool every 30 minutes and a new image is generated from a random pick in the list of prompts.

Users can generate their own images too, using our GPT4-built prompts. Each prompt is actually generated from a prompt-prompt! So that a "prompt" really starts with "Craft a DALL-E prompt that...." and then that prompt is used to generate the image. The space themes themselves and the initial prompts are also GPT generated (this time, with Chat-GPT4).

So I have a concept of 'space gold' which is kind of like GPT tokens. Generating an image costs 5 space gold, which you can earn by inviting users or buying space gold (500 space gold is $5).

I hope the tone of the site and text isn't too cute-sy or whatever - I wanted to capture an early-internet vibe; a site about space should include you in the crew, you know?

I also have a plan to make a 'text'-adventure game (but with DALL-E graphics generated on each turn) where users can explore the galaxy in an adventure. It will probably cost a few space gold per turn but I also imagine you could plunder a ship and get some gold out of it if you're clever. I think this idea should be possible but of course it is tricky to ensure the game stays on-topic. Eventually I'd like to make it multiplayer with a shared game state. Not sure if the LLMs can handle that yet though...

So here it is, incomplete and probably a bit janky but I think it's time to launch it. What do you think?

https://cosmictrip.space

--

Some things I want to try: running a stable diffusion locally on the server rather than API calls to DALL-E, and also ideally a local LLM for the prompts but obviously GPT4 is best at that for now.

I also want to let users generate their own prompts from tags that are extracted from the GPT prompts. Haven't got this yet but will implement this soon.

Tech stack: Frontend is vanilla js+css+html, backend is python on flask, server is ubuntu on linode 4GB, database is sqlite3. This is my first website I've made in like 10-15 years so please be kind - constructive criticism massively welcome!
> Why would it be the new Java/.NET?

Because it's a seemingly "boring" technology that's not too hard to learn, seems to have a decent community/ecosystem in the works (let's see where it is in 5-10 years) and overall could hit the sweet spot of just being able to get things done with it in a 9-5 by a bunch of regular developers.

> You vastly overestimate that separate runtime as being a huge positive, it is almost indifferent to most niches where these two are most common: servers, especially on the bigger side of things. For a devops team with a proper CICD pipeline, monitoring, whatnot, installing a runtime is beyond trivial, especially that many of it is container-based.

I use containers and that won't change anytime soon, they're great! That said, CLR and JDK have some space overhead, even if a counterpoint could be made that storage is on the cheap side nowadays. However, there are also those who don't use containers and don't always have 1:1 reproducible environments (even though they should).

I've personally seen a difference in the MINOR version for JDK bring down production by having some sort of an issue that caused the performance under load to decrease 10x in an enterprise project. It would be nice to get rid of that risk and just ship the whole thing, much like how a fat .jar instead of configuring an application server like Tomcat separately makes things easier, just a step further.

Now, Java has some solutions for that, but I think that Go is in an even better position in that regard!
The more I see of AI the more is just seems like automated, opaque, statistics. And while statistics are generally useful and efficient we also know the human side of "statistics tell us people who look like you are the problem"...

I also think this is just one my symptom of a much bigger problem: big US institutions trying to automate human things.

I was lucky to be part of a class of 60 (Exeter, UK, Physics). Core modules were a max of 60 people in the class and options ranged from 10 to 30. I knew basically all the professors. The concept of anticheat was anathema to us because people each other. If a student gave in top grade work but couldn't hold a conversation or pass an exam it would have been pretty obvious. This also likely discouraged people from trying.

Now that's not possible in a class of 600...
FYI llama.cpp can do that for a "while" https://github.com/ggerganov/llama.cpp/pull/1773

Somebody is also working on a whisper.cpp version, which is maybe even more interesting because if you have grammar you can speak not only JSON but also a code (or anything)
Now I'm going to take that statement with a grain of salt; what if that's just a rumour that the vanilla industry spread to increase the value?
> the next irritation of ChatGPT

Every iteration of ChatGPT is a potential irritation, I agree.
One solution could be to just extend those limits?
Crypto’s Theater Is Becoming More Surreal
A bit off topic but the most interesting part of this was clicking through to the link about TCP BBR. It's available for the Linux kernel but not bundled / enabled by default, but if these related posts are telling the truth, maybe it should be:

https://djangocas.dev/blog/huge-improve-network-performance-...

https://atoonk.medium.com/tcp-bbr-exploring-tcp-congestion-c...
An Android tablet with a colour EPD display should also feature GPS, to be used with maps...

You cannot really use rich maps on B/W display (you lose crucial visual information), but if you have the colours it is a wasted opportunity not to use them. Even as a chief feature. And this calls for GPS capabilities, as a duly integration.
DJ turntables like Technics have selectable speeds but are also insanely expensive. Lots of modern belt-driven players marketed towards audiophile hipsters don't even spin at 45 RPM (which is fine because the 7" records being pressed now mostly are often 33RPM anyways)
That's only true in some kind of naive sense imho.

When "big people" with particular histories do "big decisions" such as where to spend a specifically humongous amount of $$$ it is usually a very conscious decision.

Thus it can be deeply insightful to ask "what interests could entity X possibly derive out of investment Y".
The most competitive institutions are typically the ones offering the best financial aid packages.

https://college.harvard.edu/admissions/why-harvard/affordabi...

https://financialaid.stanford.edu/undergrad/how/index.html
That is indeed a beautiful course. UZ has a way with explanations. Here is a link of the course lecture videos https://www.youtube.com/watch?v=VPsl_5RQe1A&list=PLnhoxwUZN7...
I find it baffling. It’s an “AI”, with conversational interface, no less. Isn’t it supposed to just work by answering your questions?
i suggest you re-read my initial comment.
Yes, the part where the legislation looks at the market share and impact of the corporation in question.
I'm not so sure how much they will be ironed out. If the product only has a button you can press then maybe, but if it lets you enter text then I think knowing how to prompt will be useful.

The reason I believe this is because one of the greatest strengths of these AI models is to take in arbitrary text. If you take away that ability then you just end up with a complicated branching system that could've existed before.
I remember someone saying to me in about 2005 that the "true genius" of the UI was that it had a localhost web UI. I did that because I wanted it to be cross-platform and I didn't want to use Tk or something. It just seemed natural that apss would use the web browser for configuration. And yeah, I used Perl and me (and others) worked hard to make sure it coped with all sorts of platforms.
Better: Power tends to corrupt and absolute power corrupts absolutely.
Just curious: Do you rely on mainstream news and their editorial decisions?
> "what interests could entity X possibly derive out of investment Y"

sure, but will this question lead to a thoughtful investigation or a "grab the pitchforks" moment? we already know the answer: "grab the pitchforks".
That is indeed news to me. Can you provide a reference?

BTW, Turing's Ph.D. advisor was Alonzo Church. So it's possible that Turing once took a class from Wittgenstein or attended one of his lectures, but he was definitely not "Wittgenstein's student" in the sense in which that phrase is generally understood in academia. According to Wikipedia, Turing "attended lectures given in 1939 by Ludwig Wittgenstein about the foundations of mathematics." But that is not the kind of thing that would allow Wittgenstein to lay any claim to Turing's work.
> Paying customers absolutely HATE the idea of their data being used to train AI models without their permission

Paying customers will be the ones to resist for the longest maybe but that frog too will be boiled eventually.
How to prepare your Mac for service or repair
Then you're so close to 10 that you can just use 10.

I actually did that on a physics exam once. Somehow I had a value with pi squared. I just replaced it with 10. I don't remember if I got that question right or wrong - I'm hard pressed to think of a situation where pi squared actually legitimately shows up.
We've banned this account for posting unsubstantive and flamebait comments, and ignoring our requests to stop.

https://news.ycombinator.com/item?id=33566110 (Nov 2022)

https://news.ycombinator.com/item?id=32359604 (Aug 2022)

If you don't want to be banned, you're welcome to email hn@ycombinator.com and give us reason to believe that you'll follow the rules in the future. They're here: https://news.ycombinator.com/newsguidelines.html
I've been using this for a while, according to the stats I've cycled about 4k through [0].

Since I'd rather not fund the CEO's 800k lifestyle I'll be closing it all down now. Parasites as ever.

0: https://imgur.com/a/eg4PpoH
Unless you want a profit on your loans to friends and family you don't need do the same calculation as the banks. Also, you got way better character knowledge than they do. You know which friends are low and high risk and will do something stupid with a loan. Some are rock solid and some will use the money for 200USD cab rides between bars when they can't pay the gas bill.
Still seems more likely than aliens.
I love the idea of 'making politicians wear their sponsors’ logos on their suits, like NASCAR drivers do'
> but when i point it at a github repo with the github plugin enabled, it will answer the questions i have about the code pretty much on the nose.

Holy crap, you can do that? I need to learn about ChatGPT plugins.
Yes, it's a fairly popular language
This applies to pretty much all media.

Heck, your appearance can cause premature judgements. Does that mean you should now walk around fully masked?
U.S. NSF Certified Drinking Water Treatment Units and Water Filters
conspiracy does happen though, so is it more important that conspiracy is discovered or that theories don't exist?
> It's thought that you can avoid this by subbing out the helium for hydrogen, but nobody so far has been insane enough to try.

It's reportedly been done very recently using a rebreather (https://gue.com/blog/n1-the-inside-story-of-the-first-ever-h...).

Prior to that, in 1992, there was the French COMEX-sponsored HYDRA 10 experiment that saw Théo Mavrostomos dry-dive in a chamber to 701 meters (71.1 bars) - the world's absolute saturation dive depth record. Though that experiment used "only" 20% H2 (https://www.newscientist.com/article/mg13618493-000-technolo...).
For more in this space, there's Josh On's 2001

https://www.theyrule.net/

which may or may not have been kept up to date (it's an ongoing task to track board members and sub company inter connects).

Commercially in the Minerals domain

https://www.spglobal.com/marketintelligence/en/campaigns/met...

(subscription) is kept up to date by parsing the stock exchange release documents across Toronto TSX, London Metals, South Africa, Sydney, etc.

Are there any good free | low cost sites tracking mineral, energy, media, think tank, etc. interconnects and ownerships?

It's no small task to stay up to date and an area where some effort is made to obfuscate some (but not all) direct and indirect control.
Soros gets demonised by the right because he’s Jewish, but he’s still no friend of the working class and has no interest in actual democracy. Like most capitalists, he funds people and systems that benefit the profits of his faction of capital.
I think the pitch of these parasitic "billing" companies is "we'll allow you to raise your rates without actually raising your rates" - the customer pays higher rates, the middleman takes the largest cut of the "billing fee", and the company gets a kickback as well as potential tiny savings from outsourcing sending billing emails.

Negative value to the customer, but it's a hugely profitable and dirt cheap business for the middleman, so I expect we'll see a lot more of this scam wherever it can be implemented.
Even in English the term "friend" is ambiguous though, some people refer to someone they've only met once as a friend already, whereas others really need to think about who they consider a friend.
Hacker News isn’t really a tech support forum. You could try the PyTorch forums.

I found this:
https://discuss.pytorch.org/t/runtimeerror-distributed-packa...
In my family its common to lend money. Amounts range from buying a car to downpayment for a house.
We are financially a diverse group. From poor to middleclass. That enabled buying houses and escaping rent for a lot of people.
Maybe the cultural and religios background is important in this context. I certainly would lend money and ask for many in my circle when in need.
For me as an anarcho-communist, the problem with religion isn't believing in something supernatural per se, it's the fact that organised religion is just another hierarchical apparatus (like the state) which gives some people power over others. Christian anarchism is quite an influential strain for example, and I'm sure the other major religions probably have groups with similar ideas.

So I don't think ending religion would be a specific goal, not for me anyway. Of course, if someone starts some cult somewhere or starts telling people some god said they should be in charge well then that's a problem, but I think that goes beyond the specifics of religion.

It always comes back to hierarchies in my opinion. Whether it's racism, sexism, organised religion, capitalism, or whatever–the root of the problem is one group of people having power over others.
This thread is going nowhere, you're both in denial:

- <example of bad predictions> It has to come from actual scientists!

- <example from Hansen> I don't believe you, you must be making it up.

- <citation> Still can't believe it, primary sources only!

- <citation of another false claim by the same scientist, in his own words, from the source you selected> What about all the other predictions! You're paraphrasing! Sciency sounding! Creationists! IPCC!

You don't seem to know how to respond to counter-examples that disprove your initial belief so keep falling back on a grab-bag of memetic clichés that don't actually apply here. What does creationism have to do with anything? What is "sciency sounding" about something as basic as temperature? How can I be paraphrasing anything when the words are a direct quote from his written testimony to Congress? Go look up his Scenario A "business as usual" predictions and see for yourself how far off it is from even today's adjusted-upwards temperature record. The gap is massive.
Which shows what a joke the "non-profit" label is. People are making substantial amounts of personal profit, just not corporate shareholders. Often the label is there just to benefit from tax exemptions.
I didn't downvote, but I do see an issue that could be the cause: the statement "you can't be fired for going on strike" misses the essential difference of the law as written versus the law as enforced, ignoring the messy reality of power and who wields it. If you're fired for striking or other protected activity, you can pursue legal recourse; hopefully you can still meet needs for food, shelter, medicine, etc. This may as well be on another planet from "cannot".
Just did, still can't find the constructive content.

The destructivism in it, however, was about 259 characters long.
> understand X number of words, or pages, or paragraphs.

LLMs do not have the ability to reason with numbers. Most of the time they are hallucinating. One good strategy is to make it output in list and define the structure for each item of the list. If you give an example of what your list should look like, it will give you something close it.

> has trouble carrying a list forward without losing items.

This is the fundamental problem with these models because of the context limit. When you are prompting always remember that is processing a huge paragraph and emitting the next sentences of the paragraph. If you want information to be carried onwards, you have make it output on every prompt or you can also try to use specific identifiers. LLMs are good at in-context learning. It will not work 100% of the time, but it is usually good than having nothing at all.

> I want to speak chinese to the AI and I want it to correct me.

Give it a role of tutor and describe the instructions what the tutor should do.
No improvement for me - Pixel 6a
It's so weird. I think that sometimes, but I don't usually think about it. Most of the time it's just a short moment "awake" and aware that all of this is batshit absurd, then recognizing that there's nothing for me here up here except the view, then continue on with my life without remorse towards the next hill top or valley or whatever lies in wait for me. I think it used to give me vertigo, now I'm used to it. I feel tentatively okay about all this.
$$$ is the culprit. The lie that people only make things because patreon dollars, because ad impressions, because sponsorships. They begin to optimise for these metrics and not the most important metric (fun).

The lie in general that creative output only happens because people pay for it is wrong in so many ways. People love to be creatively fulfilled. I'd argue the exact opposite, that unless something else is physically preventing them, people
will make creative things. Video, songs, games, writing.
> no it isn't

If you think it's possible to be 100% accurate detecting phish then I've got a bridge to sell you.
Among math heavy lectures there are quite a few very interesting introductions to various topics like cryptography