skysight-inc/HackerNews huggingface dataset:
If those are all that's required, why don't you start a company with a business plan written so it satisfies your criteria? Then you can lead the way with OSS LLMs.
Lem has quite a few works on the topic. 5 or 6 maybe..
Futuristical congress, and what not..

One of them had the super-thing "scream" like...

"Finally! Someone discovered how to create me! Was about time... "

---

But, this auto-chat thing also reminds me of Electrical Monks of Doulas Adams.. machines used to believe in all the media crap, so people can go on with their lifes.

ah. funny times..
Seriously, why don't more people work so the investors can get a chunk of their value for doing nothing? How dare they do something so utterly anti-social as spend more time doing things with people that aren't making investors money? Why must the rich investor class make-do with their own money pile when a chunk of your effort could make their pile bigger?
As a mere mortal, I often write my own bugs, so I'm happy for a machine to write them for me so I can move on to the next step.
Some people unfortunately view concern for the poor as political. However my point of mentioning politics is to say that “it’s political” is not any kind of gotcha when it was never denied as being political. Regardless of the actual justification being political or not, the “political” gotcha is nonsense.
Oops a Chamath SPAC turned out to be just a vehicle to fleece retail?

It is truly amazing what you can legally get away with
How are you using it? Have you tried few-shot tasks where you give it a bunch of examples? I'm having it generate ember templates that use a custom framework correctly first time by just giving it a load of examples then asking it to do the same. It's absolutely cheaper to have it do the work compared to me.
I don't understand. I thought each parameter was 16 bit (two bytes) which would predict minimally 60GB of RAM for a 30 billion parameter model. Not 6GB.
You need privacy laws like GDPR and California's in your state.
AI training has very high minimum requirements to get in the door. If your GPU has 12GB of VRAM and your model and gradients require 13GB, you can't train the model. CPUs don't have this limitation but they are ridiculously inefficient for any training task. There are techniques like ZeRO to give pagefile-like state partitioning to GPU training, but that requires additional engineering.

You can't if you have one 12gb gpu. You can if you have couple of dozens. And then petals-style training is possible. It is all very very new and there are many unsolved hurdles, but I think it can be done.
We've reached a point where even with just continued incremental improvements, these LLMs are going to be extremely disruptive to society, probably within a decade, to the point that we see even more massive disparities in wealth and income, massive increases in poverty and homeless, and ultimately probably large-scale civil unrest.

Rather than telling yourself (like this author) that "it's just a parrot," or alternately (like I've seen so many happy-go-lucky types on HN do) telling yourself that "LLMs are just another tool that will make me more productive!" I'd recommend preparing for the worst, while hoping for the best.
Bare Python is mostly useless. People use Python because of the libraries. The kinds of projects that are developed in Python all, save the most trivial ones, rely on stuff that's not written in Python.

For instance, if you do ML, then you use NumPy, Scikit-Learn etc. It's all C / C++ code, which you will have to link with somehow. And even if you figure out how to link with it, your program will still suck because of the unnecessary (as I call it) PyObject layer, i.e. the Python interpreter interface that is used for communicating between Python libraries. Eg. say you wanted to pass a pointer from one library to another. If you were writing in C -- no big deal, just have some externally visible function in one library and call it in another, and you are done. But if you want to connect two Python libraries, at best, you'll have to use a special struct PyCapsule, with two dozens or so of fields, which is allocated by Python's allocator and also needs to be deallocated... The overhead will be tremendous.

Similarly, if you do Web development, you need some HTTP server that can run fast. I haven't touched this part of Python in a long time, but the last thing I came to use was Tornado, which was a C library with Python bindings.

When it comes to infra, there are plenty of tools that are also written in C, various database drivers, Kafka client, encryption library... and so on.

---

Bottom line, even if you defeat the system and manage to make it all compile together... it won't work well, not as well as it could have if only you could ditch Python entirely from this equation. And if you could, then... well... you'd be just writing in C...
The contempt is another symptom of what social media shoved into overdrive (extreme polarization). Hatred has become easier than empathy. But it also reads like a very different sort of doomsday cult that worships a borg, only instead of the cult being the weird fringe movement, they're the ones driving the bus.
> It's notable that in practically every other programming language on every platform the default is to truncate the file to 0 bytes when opened in write (not append) mode

Examples of ‘Open’ calls that require setting a bit in the ‘flags’ argument to truncate an existing file:

- https://learn.microsoft.com/en-us/windows/win32/api/winbase/...

- https://man.freebsd.org/cgi/man.cgi?query=open&sektion=2&n=1
Active discussions:

* https://news.ycombinator.com/item?id=35391433 (primary, nearly 500 comments)

* https://news.ycombinator.com/item?id=35391465
Yeah....

I should add, I dont think all of it is a joke, but stuff like the "author_is" labels are incomplete and only 4 were shown for the bit
A fine example of regulatory capture. The "Fair" Credit Reporting Act 15 USC 1681h (e):

> Except as provided in sections 1681n and 1681o of this title, no consumer may bring any action or proceeding in the nature of defamation, invasion of privacy, or negligence with respect to the reporting of information against any consumer reporting agency, any user of information, or any person who furnishes information to a consumer reporting agency, based on information disclosed pursuant to section 1681g, 1681h, or 1681m of this title, or based on information disclosed by a user of a consumer report to or for a consumer against whom the user has taken adverse action, based in whole or in part on the report except as to false information furnished with malice or willful intent to injure such consumer.

This country desperately needs a GDPR equivalent. One that does not except financial surveillance bureaus, the healthcare industry, or any other quasi-governmental organization that abuses our personal information.
At the same time US government spends the most in the world on socialized healthcare.
have you seen @nyttypos and (to a lesser extent) @nyt_diff? NYT online editorial standards are hilariously abysmal.

https://twitter.com/nyttypos

https://twitter.com/nyt_diff
I want to go back to a world where there isn't an algorithm feeding me what someone "thinks" I want to read.

I want to see a chronological list of things sources I follow have posted.

Yes, I understand you can do this on Twitter still, but I would guess most people are more influenced by "the algorithm".
Hmmm... The first two are for pleasure, whereas the third one is not. Making a company is always going to be hard.
I don't use any of those, I use direnv with standard python3 -m venv module.
> But we are deleting this bs. I only learned about it now! Will be gone by tomorrow.

https://twitter.com/elonmusk/status/1641908130274525187?t=5t...
Is the 30B model clearly better than the 7B?

I played with Pi3141/alpaca-lora-7B-ggml two days ago and it was super disappointing. In percentage between 0% = alpaca-lora-7B-ggml and 100% GPT-3.5, where would LLaMA 30B be positioned?
blackpool is the jersey shore of england?
> There was a rally and it got out of hand. That's pretty much it

So trump has nothing to do with https://en.wikipedia.org/wiki/Trump_fake_electors_plot ?
Likewise!

Out of curiosity, what's your (or your favorite) argument pro free will? I've spent some time on Penrose's take, etc., but I couldn't convince myself. I would still be absolutely interested in a pro argument that makes me flip.
I love that Belloq wears a trilby to contrast with Indy's fedora. What a great foil he is!
There's so much documentation about specific games thanks to the work of the MAME developers and manuals uploaded to KLOV. There's also tons of hackers making reproduction parts or even new products to help keep your home arcade in good shape. I wouldn't have any doubts that where there's a will to get some old arcade hardware working, there's most certainly a way.
It was a couple of acquaintances discussing GDPR :)

I guess you'd want follow

- Felix Reda https://twitter.com/Senficon (former European MP for the Purate Party)

- NOYB EU https://twitter.com/NOYBeu (fighting the GDPR fight)

- Max Schrems https://twitter.com/maxschrems (https://en.wikipedia.org/wiki/Max_Schrems)

These are more or less the usual suspects you'd follow :)
The chat context isn't as big as is available in the API - was the author name in its context window? Papers can be fairly long
I've done some experiments here with Llama 13B, in my subjective experience the original fp16 model is significantly better (particularly on coding tasks). There are a bunch of synthetic benchmarks such a wikitext2 PPL and all the whiz bang quantization schemes seem to score well but subjectively something is missing.

I've been able to compare 4 bit GPTQ, naive int8, LLM.int8, fp16, and fp32. LLM.int8 does impressively well but inference is 4-5x slower than native fp16.

Oddly I recently ran a fork of the model on the ONNX runtime, I'm convinced that the model performed better than pytorch/transformers, perhaps subtle differences in floating point behavior etc between kernels on different hardware significantly influence performance.

The most promising next step in the quantization space IMO has to be fp8, there's a lot of hardware vendors adding support, and there's a lot of reasons to believe fp8 will outperform most current quantization schemes [1][2]. Particularly when combined with quantization aware training / fine tuning (I think OpenAI did something similar for GPT3.5 "turbo").

If anybody is interested I'm currently working on an open source fp8 emulation library for pytorch, hoping to build something equivalent to bitsandbytes. If you are interested in collaborating my email is in my profile.

1. https://arxiv.org/abs/2208.09225
2. https://arxiv.org/abs/2209.05433
The author chooses the topic and outline of each paragraph.
hmmm https://github.com/search?q=repo%3Atwitter%2Fthe-algorithm-m...

Twitter hmu if you need help trying Pytorch 2.0 ;)
These phone calls are absolutely a nightmare. My phone filters out at least 2-3 automatically filtered calls a day and yet a few slip through the cracks.

These companies are using the old phone infrastructure that on paper could be traced without problems. Yet nothing, they operate with impunity
He avoids depositions like the plague, and last year when he couldn’t he pleaded the 5th 440 times.
Impossible. In order to fix a bug, you need to do abstract interpretation or something equivalent. Language models simply can't do that. And even the best bug report will not tell you what you need to do to fix it.

Of course, there are other change requests: Change a color here, store this information alongside that record, modify that output, etc. But even those changes can very quickly spiral out of control. Color models, database schema compatibility, pretty printing ...

No, I think the idea that LLMs take over programmers jobs is born out of a complete misunderstanding of both. Of course that doesn't mean that no one will try to do it. I bet people will even report success in doing it, simply because their bonus depends on it, but I don't think it will ever really work.

What might happen though is that LLMs replace many of the programs we write nowadays. After all, who needs a web browser when a LLM can give you a summary in natural language?
This is a whole new category of humor. I can totally see all kinds of management-y people using ChatGPT to provide “helpful” but completely useless information.

Your example really cracks me up!
Data Is Plural: A new podcast from the long-running, eponymous newsletter
Thought it might be funny to ask the beast itself:

What do Science Fiction books that predict ChatGPT say it might lead us?

As an AI language model, I do not have the capability to read or analyze science fiction books that specifically predict ChatGPT's impact on the future. However, science fiction books that feature AI and advanced language models often explore themes related to the ethical and societal implications of creating intelligent machines.

Some of these themes include the potential for AI to surpass human intelligence and control, the ethical considerations of creating and using intelligent machines, the impact of AI on employment and labor markets, and the possibility of AI becoming a threat to humanity.

Overall, science fiction has explored a wide range of possibilities and outcomes for AI and intelligent machines, including both positive and negative scenarios. Ultimately, the future impact of AI and language models like ChatGPT will depend on how they are developed, regulated, and used by society.
I'm not sure I agree with that statement just looking at our own tax bills...

Also, my point was I feel that I get nothing for my taxes in California already!

I will give California public libraries which I rediscovered recently after Covid, that's probably the only service I appreciate with my tax dollars currently!
Before I deliberately locked myself out of it (well before Musk), I asked for my data.

They classify me as:

* speaks Indonesian

Interested in:
* Beer
* Cricket
* DJs
* Dance
* Enterprise software
* Horror
* NFL football
* South America

And aged either between 13-54 or (and?) over 65

Other than the age (I'm neither under 13 nor between 55-64), everything I've listed is incorrect.

On that basis, they'd probably call me a Republican.

Carries a different meaning when you're British, that name does.
You seem to be mixing a few different things together here. There's a huge leap from something not being copyrightable to saying there is grounds for it to be made public. No copyright would greatly limit the ability of model makers to legally restrict distribution if they made it to the public, but they'd be fully within their rights to keep them as trade secrets to the best of their ability. Trade secret law and practice is its own thing separate from copyright, lots of places have private data that isn't copyrightable (pure facts) but that's not the same as it being made public. Indeed part of the historic idea of certain areas of IP like patents was to encourage more stuff to be made public vs kept secret.

>As it is their outputs are not copyrightable, it’s not a stretch to say models are public domain.

With all respect this is kind of nonsensical. "Public domain" only applies to stuff that is copyrightable, if they simply aren't then it just never enters into the picture. And it not being patentable or copyrightable doesn't mean there is any requirement to share it. If it does get out though then that's mostly their own problem is all (though depending on jurisdiction and contract whoever did the leaking might get in trouble), and anyone else is free to figure it out on their own and share that and they can't do anything.
These are just some subjective, odd philosophical arguments.

Question is - does this tool provide massive value and productivity boost? Yes.
I still use office 2010. They are deprecating it how?
I might be a crypto noob, but as per my limited knowledge I don't see how BTC can become a usable large scale currency. The transaction rate on chain is too low for real world use cases. Off chain you can use things like lightning, but lighting either requires you to open separate channel (which needs to be on the blockchain, thus will run into the same transaction rate issue), or keep one channel open with some entity, and make all your transactions flow via that entity (kind of a bank, but with no real world protections whatsoever). Not to mention the total irreversibility which makes it much harder for normal people to use.

There are several other issues as well with crypto, and I don't see how is it going to become an "irrevocable disruption".
It is as good as GPT-3 at most sizes. Instruct layer needs to be put on top in order for it to compete with GPT 3.5(which powers ChatGPT). It can be done with comparatively little amount of compute(couple hundred bucks worth of compute for small models, I'd assume low thousands for 65B).
Learning@Home using Decentralized Mixture-of-Expert models:

https://learning-at-home.github.io/

https://training-transformers-together.github.io/

https://arxiv.org/abs/2002.04013
I thought it was interesting that twitter thinks the U.S is the world
It seems like you already know the answer. If not, ask ChatGPT :)
I think in some regards we are getting close to the device imagined in Neal Stephenson's 1995 novel The Diamond Age.
Also, we have really expensive healthcare, so preventative medicine and recovery type treatment is not done nearly as much as other countries I suspect. You'd think something would change after the massive cracks in the system revealed to everybody by COVID, but it didn't.
Even if using LLaMA turns out to be legal, I very much doubt it is ethical. The model got leaked while it was only intended for research purposes. Meta engineered and paid for the training of this model. It's theirs.
Would you expect they will rug pull GUSD? I assume this, like with USDC, would be seriously illegal, but it also wouldn't surprise me if they had some ToS provisions somewhere waiving their obligation to redeem GUSD for USD.
Mentioned in the link.

This seems to be the original PR for the API in question, ParcelFileDescriptor#parseMode():

https://android.googlesource.com/platform/frameworks/base/+/...

+ public static int parseMode(String mode) {
+ final int modeBits;
+ if ("r".equals(mode)) {
+ modeBits = ParcelFileDescriptor.MODE_READ_ONLY;
+ } else if ("w".equals(mode) || "wt".equals(mode)) {
+ modeBits = ParcelFileDescriptor.MODE_WRITE_ONLY
+ | ParcelFileDescriptor.MODE_CREATE
+ | ParcelFileDescriptor.MODE_TRUNCATE;
+ } else if ("wa".equals(mode)) {
...

You can see that "w" and "wt" map to the same mode for file operations, including the MODE_TRUNCATE flag.

But we jump ahead a few years and the code is reworked.

from https://android.googlesource.com/platform/frameworks/base/+/...:

public static int parseMode(String mode) {
- final int modeBits;
- if ("r".equals(mode)) {
- modeBits = ParcelFileDescriptor.MODE_READ_ONLY;
- } else if ("w".equals(mode) || "wt".equals(mode)) {
- modeBits = ParcelFileDescriptor.MODE_WRITE_ONLY
- | ParcelFileDescriptor.MODE_CREATE
- | ParcelFileDescriptor.MODE_TRUNCATE;
- } else if ("wa".equals(mode)) {
...
- return modeBits;
+ return FileUtils.translateModePosixToPfd(FileUtils.translateModeStringToPosix(mode));
}

So what does FileUtils.translateModePosixToPfd(FileUtils.translateModeStringToPosix(mode)) do?

from https://android.googlesource.com/platform/frameworks/base/+/...:

+ public static int translateModeStringToPosix(String mode) {
+ int res = 0;
+ if (mode.startsWith("rw")) {
+ res |= O_RDWR | O_CREAT;
+ } else if (mode.startsWith("w")) {
+ res |= O_WRONLY | O_CREAT;
+ } else if (mode.startsWith("r")) {
+ res |= O_RDONLY;
+ } else {
+ throw new IllegalArgumentException("Bad mode: " + mode);
+ }
+ if (mode.indexOf('t') != -1) {
+ res |= O_TRUNC;
+ }
+ if (mode.indexOf('a') != -1) {
+ res |= O_APPEND;
+ }
+ return res;
+ }

Now "w" and "wt" map to different Posix open mode flags since one has to explicitly pass in "t" to get file truncation.

A dev was careless, plain and simple.

Having code in a monorepo doesn't help if you don't check how your code changes affects consumers/clients of the code.

If they couldn't change translateModeStringToPosix() behaviour, then the dev could've amended parseMode() to map "w' to "wt" to keep the old behaviour (ugly and non-orthogonal, yes, but that's the way the API was designed).
I remember playing this version in the arcade at Golf & Stuff aka Castles & Coasters in Phoenix AZ.

The arcade attendants would yell at you for 'hitting the game'.
What is the reason for us to have anything "special" or whatever in the first place? Why should we be anything more than input to output. Why does it matter to anyone?
Federal Reserve is a tech provider in finance (ACH, FedWire, FedNow instant payments, etc).
YouTube is horrible with it - start a video, watch an ad - skip forward, watch an ad - skip more forward, watch an ad, skip forward, ad...
It’s not free
The USEPA claims about 1.4-2.3% of natural gas is lost to leaks [0].

American is full of leaky gas pipelines. It's one of the major reasons people oppose to large gas pipelines going near where they live: they are an ecological disaster waiting to happen.

[0] https://www.pbs.org/newshour/science/the-u-s-natural-gas-ind...
My Colab notebook to generate midjourney level images in 40 seconds on cloud
If you wanna change a model just select one from huggingface [https://huggingface.co/models?pipeline_tag=text-to-image&sor...] then paste its name into model_id variable.
Let's have reasonable goals, shall we ? "Their shit doesn't stink as bad as others'" is nothing commendable, especially after souch publicity.
Less memory than most Electron apps!
I have a strong reason to think that consciousness and intelligence are related. Intelligence requires awareness. Consciousness is awareness of oneself. I for one cannot imagine an intelligent being that does not possess consciousness.
Given the Replika debacle, I personally suspect the AI partner use case is not really very niche. Just few people openly want to talk about wanting it because having an emotional AI partner is seen as creepy.

And companies would not want to do that. Imagine you make partner AI that goes unhinged like Bing did and tells you to kill yourself or something similar. I can't imagine companies would want that kind of risk.
Bo one is hiding behind victims of other disasters. What you are doing though is unsubstantiated fear mongering. And I just applied your unsubstantiated fear mongering to a different power source. For some reason you didn't like it.
I'm in NJ just west of Manhattan and I could not make the numbers work at all. I have averaged about $1.05 a therm for gas and my heat bills are very low even in Jan/Feb. On the other hand I pay 16.5 cents /kwh for electric.

I ran the numbers through a spreadsheet and I would be paying an extra $100 a month for heat and an initial cost of 10k more for the install, and the ac side would have a slightly lower seer than the best ac systems available.

I would need a COP of 5 for a heat pump to be more efficient. They don't exist for air source. I live in a brownstone/townhouse and while geothermal is theoretically feasible ( I have a small yard) I called every installer I could find in the tristate and none would attempt it.

I was immensely disappointed but I cant be paying more upfront and ongoing. If I had solar it would be a bit better but last time I attempted it I only got 2 bids out of the 30 installers I called and then COVID hit. The numbers weren't especially encouraging. I can't get that many panels on my roof due to firecodes.