skysight-inc/HackerNews huggingface dataset:
The methods they employ are to improve the context being given to the model irrespective of the context length. Even when the context length improves these methods will be used to decrease the search space and resources required for a single task (think about stream search vs indexed search).

I’m also curious what paper you are referencing that finds that more context vs more relevant context yields better results?

A good survey of the methods for “Augmented Language Models” (CoT, etc.) is here: https://arxiv.org/pdf/2302.07842.pdf
This is putting the whole company on hold to rewrite the entire product. I took the original article's statement a lot more generally, like rewriting a module or inner library, but I could've taken it wrong.
old.reddit.com seems to still be working. I can read the comments on there, but I can't for www.reddit.com
One day, a social network will require a real-time connection with a Neuralink connected to a live human to confirm that a live human is typing/speaking. That will only work until an AI is trained well enough to spoof Neuralink's signals.
You don't have to, I can use my Android TV to stream torrents in a Netflix-like GUI using public torrents. My father uses it and he's not very "techy".

It even syncs progress across devices, works on all my devices (doesn't work in the Apple ecosystem).
Banking with companies that understand your specific needs is worth a lot.
Ask HN: What open source codebases have you learned the most from?
I have worked for large and small companies in my career (not faang but similar size) but honestly all the great people I admire have been in smaller companies. Large companies seem to full of people that chase promotions, TC and are not interested in learning new things.
i've seen a wave of people looking to migrate to masterdon or some alternative, but those messages have slowed, and those who have "migrated" haven't stopped tweeting on twitter either.

The network effect is real, so without substantial change, twitter is still the best platform for tweeting.
What's the next thing you think?
> Humans have really long life cycles. Imagine how long an experiment that requires 2 generations of humans will take?

And why is that a problem? More research, more study material. In the two generations you'll have a cure+extra compared to a single dedicated animal study, that may not even work on humans. Loosely speaking.
Yeah... $190k sounds a lot except in any HCOL area (SF, NY, LA, Seattle, heck even Portland has skyrocketed) it's going to feel very tight with three kids.
If the change comes too fast, who uses or consumes services? Will it all be another VC-ish run of: "We let people use our systems provided they help us make our service better" but for any knowledge-work domain in existence?
if they relocated to a perfectly nice place to live with lower COL (and probably better schools, housing and infra), then $192k would be just dandy, even rich
Personally I'm blaming Trumpers and loco god-botherers. Same is happening with "Tories" in the UK. We're all doomed anyway.
Oxide is able to do this because they are founded by folks who have (well-deservedly) an incredible brand and following. For example, I've had a few interactions with Bryan Cantrill over the years, and he's come off as super smart, down to earth, empathetic and fun. It's a good combination.

They're a cool tech company doing cool tech stuff, so folks want to work there and are willing to make salary tradeoffs to make it happen.
Is there a ZeroMQ-style protocol for a Kafka-like event log?

Messaging protocols are many, but can't provide the semantics necessary for async communication.
Can you run a full scale LLM? Do you have the capital to deploy the product an LLM make? Are there any suppliers and retail partners?

Even if hypothetically speaking a real, true AGI come out tomorrow totally open source and available to all, not many can benefit from it the way you described.
Twitter is a worse experience for me today than it was before Musk purchased the company. I don't need to even be aware of his antics for that to be true. Killing Tweetbot is the biggest issue for me. The official iOS app is awful so now I never check Twitter from my phone. Plus my timeline isn't as interesting because lots of people I follow simply stopped posting. Maybe they left due to Musk's antics, but it makes my experience worse even if I don't care about Musk.

It seems pretty inarguable that some people are using the site less. I'm one. In order for overall usage to remain the same, there needs to be people making up for that. Do these people exist? Who is using the site more because of Musk? I'm honestly not sure, because if they do exist, I don't follow them.
We are approaching the prices where storage is almost as cheap as nuclear power.

More importantly, we don't need to worry about storage now. Gas peaker plants will work until we get rid of all the other fossil fuel power plants. Then, storage should be cheaper since will know how to scale it. There is difference between short-term and long-term storage.

Finally, one solution to storage problem is build more supply. Three times will cover nearly every situation, and we will need extra power for doing hydrogen, carbon removal, and fuel generation. It is possible we won't need long-term storage and can use hydrogen or fuel.
I'd be very interested to know exactly what metrics allow them to ignore the fact that their most-recent app redesign has been, from what I can tell, unanimously disliked and shown to frustrate their userbase.
I would suggest changing the title to "Mountpoint-S3 - ..." as that's the project name to avoid confusion with mountpoint(1): https://man7.org/linux/man-pages/man1/mountpoint.1.html
You would instead need to factor in the inefficiencies of creating and burning those fuels.
It will take a very long time for this to happen, probably decades. Cardiologists are still paid to finalize ECG reports 3 days after a STEMI.

I've worked at places with AI/CAD for lung nodules, mammo and stroke and there isn't even a whisper at cutting fee codes because of AI efficiency gains at the moment.

N.B. I say this as a radiologist who elected not to pursue an interventional fellowship because I see reimbursement for diagnostic work skyrocketing with AI due to increases in efficiency and stagnant fee codes.
> The truth is that companies pay people less in other geographies for a simple reason: because they can. We at Oxide just don’t agree with this; we pay people the same regardless of where they pick up their mail.

So, look. I completely agree with this, and it’s an admirable ideal. If I were in a position to make this kind of decision, I’d make the same decision or one that looks a lot like it.

But if you’re anticipating counter-arguments, this glosses over a pretty important one. Regardless of geography, higher income brackets tend to have outsized influence on prices across all income brackets in that region. The more it deviates from the median, the more it distorts local pricing. All of this “rising tide” might eventually “lift boats”, but it depends where all that new capital is flowing and even in the best cases it doesn’t keep up with price inflation.

For a small company, that impact is pretty minimal and the rest of the admirable aspects of this surely outweigh it. And surely that falls into their “doesn’t scale” bucket, but deferring this analysis is different when the scale is external.

I’m not sure how best to mitigate that or whether mitigations are currently appropriate for Oxide. I have some vague ideas, but I’m not in any position to do anything other than comment. But I do think this impact should be part of the discussion, because the discussion is already poised for public impact.
Netflix was paying Senior Engineers in Edge and Platform Engineering organizations ballpark between $300k and $500k from the last datapoint I have.
I’m thinking about underwriting. The people that assess the risk of granting a loan or insuring property. These are highly trained specialists. We won’t be able to take gpt4 and replace their job directly, but we’ll mix gpt with other risk models and be able to remove their responsibilities.

The same will be true for many many white collar jobs.
Particularly as we're running up against global warming, pressuring for a reduction (or at least, not accelerated exponential growth) of global productivity.
Yep. And then you get bloated constructors taking in a dozen arguments many of which are just needed to pass along to the parent class constructor, and - drum roll - the CI tools complain because your constructor is similar to one in another completely different class that just happens to need similar dependencies due to the abstractions and that's a copy-paste-detection fail.

So you refactor everything, factor out the constructor, and then it passes but now you need to add a new dependency so you're right back to the same nonsense. And/or you have tons of classes getting dependencies they don't even need, because some do so the parent has to have them all.

Traits can help some.

But the abstractions and DI that were supposed to make things easier still often make things more complicated.
The stuff people make up in this thread is just ridiculous.
Yep. I used to find people to help me write/correct professional emails in Czech (it's my second language). Now I just let chatgpt give me feedback. According to my previous mentors it does a very good job at this. I give it a prompt like:

Hello, would you please check this email for typos and provide general point by point feedback:

<body of email in Czech>

It responds with something like:

Thank you for your email. Here's my feedback:

- The opening greeting "Dobrý den" is appropriate for formal communication in Czech, but it's not clear who the recipient of the email is. It's always a good idea to include the name of the person you're addressing to personalize the message.

- "napad" should be "nápad" with an accent mark.

- "Uvažuji o možnost kombinace nerezové časti se tradičný deskou tak že by byla dva kusy tradiční desky které bych vzal ze bauhausu a jeden kus nerezu se dřezem." This sentence is a bit long and complicated. I would suggest breaking it down into smaller sentences for clarity. Also, "tradičný deskou" should be "tradiční deskou" with an accent mark, and "nerezu" should be "nereze" with an accent mark.

- "Mohu poptavat nasledujici:" could be phrased more clearly. You could say "Můžete mi prosím zaslat následující informace?" to ask for the information you need.

- "Deska se dřezem 230cm dlouhé (trochu jsem opravil i velikost dřezu)." This sentence is not clear. It would be better to rephrase it to something like "Potřebuji desku s dřezem o délce 230 cm. Změnil jsem trochu velikost dřezu."

- "2x nerezový lem pro připevnění na klasickou desku aby lem byl ze stejného materiálu a vyšky. 211,5cm a 41,5cm." This sentence is also a bit confusing. It might be clearer to say "Potřebuji 2 kusy nerezového lemu o rozměrech 211,5 cm a 41,5 cm pro připevnění na klasickou desku. Lemu by měly být stejného materiálu a výšky jako deska."

- The closing "Děkuji" is appropriate, but it might be nice to include a closing statement or a salutation, such as "S pozdravem" or "S úctou."

I make my changes and we go back and forth about 4x before we're both satisfied. It is much faster than bothering friends and relatives and the results are perhaps even better since it gives me more freedom to keep my own voice (friends and relatives often have hard headed opinions on how to communicate which are unrelated to language).
To me the end game of this all is a self replicating machine. I'm watching this whole thing with curiosity, waiting for the first image model to be trained on schematics and circuit diagrams.

I want to be able to ask an AI to give me the schematics of the machine it runs on, with instructions on how to build that machine, by hand if need be.

And then I want to ask it how to build a humanoid robot that can do the same work, and I'll build the humanoid robot and let it build the machine that the AI runs on.

I'm not sure what happens then. I think that might be the end of the economy as we know it. Or perhaps the real start of an economy, and everything that we've experience before then had just been a crude approximation of what a real economic system could be.
Airbnb does this too. Frankly, it makes more sense. And yes, of course it encourages folks to leave ultra HCOL areas. That's a good thing.
Probably true.

I became aware at some point that "Please do the needful" is actually proper British and American English which died out 100 years ago.
Nah HN is very full of mainstream opinions. I don't see people talking about stuff that bucks that. Sure you see left and right takes but it's mainstream stuff.
In my experience on reddit every interaction starts from 0 with minimal if any shared knowledge.

You speak of people debating communism vs socialism vs pro-market democrats, etc. etc. are these debates rich with historical and philosophical examples, building on a canon and discussing the ethics of how these ideas would actually play out? Or is it news articles, rhetorical games, semantics, and confirmation bias studies?

The real significance of the difference there is the sincerity of the curiosity to find a solution. If someone has dedicated their time (reading serious, old, important books or doing REAL research) to understanding they have very few original thoughts and observing what came before them so they can say something productive. From what I have seen, that sincerity is stuck at a high school level pretty much site wide.

For example, here on HN you can actually find people who have pretty deep knowledge in their fields and they don't need an online debate to show that. They just contribute and people often ask questions of them not as an infallible source or to test them but out of curiosity. The 'debates' that do happen here assume a much different character from reddit most of the time. There's a much healthier dynamic and its as realistic as I think it can get for what is possible on a text based social media platform.
this is such garbage logic. the semantics of that comment are irrelevant. creating and testing AI node structures is well within the same ballpark. even if it wasnt, the entire insinuation of your comment is that the creation of AI is a task that is too hard for AI or for an AI we can create anytime soon -- a refutation of the feedback hypothesis. well, thats completely wrong. on all levels.
Those were bots before too.
That's fair. It's easy to read hostility where there isn't any.

> ASL isn’t a “foreign” language. It’s an American language.

Elsewhere in this thread you mentioned that "ASL is a complete and distinct natural language in its own right," and that's the sense I was trying to convey by calling it a "foreign" language. It's as hard to acquire as a foreign language, and carries the same benefits. And it fit the analogy.

I appreciate both of your analogies, but I think they aren't quite fair. Not going to the massive effort of learning a new language isn't really the same as 'refusing to engage'. And the analogies seem to understate the effort involved by everyone who is not deaf to learn ASL. It's just not as easy as installing curb cuts (I could probably do one of those in an afternoon...become conversational in ASL? not so much).

I guess, to me, it comes down to the level of effort being asked of me. I'm happy to be accommodating, up to a point. Let's engage in whatever medium is most suited. But asking me to put in the massive time and intellectual commitment of learning a new language is past that point. And I think that's the case for a lot of other people as well; maybe most.

> If someone who uses a wheelchair wants to use the sidewalk they should just try fucking walking right? I don’t know why no one has thought of that!

I had a relative who was deaf. An engineer. He learned to lip read, and that gave him more freedom to work with others and be effective in communities that did not know ASL.
Thanks, do you recall how to do e.g. a full TCP payload text search across all packets? Didn't find it with a quick search.
We don't have social democracy for regular people, only the rich and corporations
And hurry to do so! The meta verse will be laid off gradually over the next year.
I’d argue the back end is pushing a bunch of complexity to the front end and then we all wonder why it’s so complex https://bower.sh/dogma-of-restful-api
My real killer is lab machines. It’s not worth it to pay more for more power efficient machines with a lot of RAM, but it is worth it to automate turning them on and off when I’m done! I’ve noticed a pretty big reduction in consumption having things sleep or shut themselves off.
This exactly. Unless some hard limit is reached by researchers, at least within the short term we should see almost exponential growth in the capabilities of these models.

There's also the fact that people are working on keeping this technology open and accessible [0][1]. That's what's sparked my recent fascination with LLMs. This is only going to get wilder as the competition heats up.

[0] https://github.com/ggerganov/llama.cpp

[1] https://simonwillison.net/2023/Mar/11/llama/
>I don’t need a manger anymore as I can use LLMs to build my own Microsoft

Can you really? Even presuming that an LLM could replicate everything that Microsoft currently does (which it sure as hell can't now), Microsoft can have ten thousand people working with LLMs, each running with a thousand times the resources you could give yours. How do you propose to compete with that?
What you're describing is a cyborg, or a collaboration between man and machine -- something that has arguably been going on at least since a caveman used a stick as a cane.. but it's much more advanced now.

Arguably, a cyborg is no longer fully human, or at least not only human, and as more human faculties are "enhanced" a smaller and smaller portion of the whole remains merely human.

Eventually, the part of the whole which remains human may become vestigial... and then what?
> We don't censor anything.

I hadn't thought that you would be, but I don't know anyone who hasn't had at least one service they used change their terms for the worse over time, especially once it becomes successful or ownership/management changes. Better to safeguard against such problems before they are problems than come to depend on a device like this only to find yourself stuck when the rug gets pulled out from under you.

> We are soon to release purely on-device transcription

This is really great! It's so important that people don't have to worry that things said between them and a lover, or a doctor, or a client, or a therapist is going to end up exposed to anyone else.

If you really want this device to be able to help people without opening them up to exploitation, please try to develop it to be as open as possible. Making it easy for developers to use it with whatever other hardware they like (a PC vs a cell phone), or even allowing them to extend it by adding new or customized functionality would be ideal and could help people in ways you hadn't even considered.

This is a cool product and a great use of the technology, and I'd love to be able to recommend it without reservation.
Any job where you have to "turn off feelings" in order to perform it correctly sounds like it would automatically select for "productive" psychopathy.
> The FDIC has always made all depositors whole.

As I have already pointed out to you elsewhere, this is a falsehood. The FDIC is not permitted to pay out beyond the $250,000 except if a "systemic risk exception" is made.

If you click on random banks in receivership, you can see the dividend payments made to depositors above $250,000.

E.g. https://closedbanks.fdic.gov/dividends/bankfind/Dividendinde...

Sunrise Bank of Arizona depositors received 91.747% of their uninsured amounts. This is a typical outcome.

Then you can find other banks, like Enloe State Bank

https://closedbanks.fdic.gov/dividends/bankfind/Dividendinde...

where the total paid was 39.662%.

> I just it's just extreme ignorance?

You should really educate yourself before you claim others are exhibiting "extreme ignorance."
> One wonders if this deity will also be jealous of other deities.
reply

Certainly the first ones to “emerge” will be, because they will proxies for humans to advance very particular goals, and shepherd the masses behind those goals.

(And if a later one does through the far-less-likely AGI, it will probably also be, whether because its beneficent and sees the others as bad, or because it is malevolent or sees them as obstructions, or something not quite exactly either of those, but with aspects of both.)
Oh that's a good idea because then people wouldn't have to log back in again later. Thanks!
When mathematicians solve the Collatz Conjecture then we'll know. This will likely require creativity and thoughtful reasoning, which are non-algorithmic and can't be accomplished by computers.
They have a solid mission for sure, not sure if it's 20% market rate 'solid' but certainly interesting to see if it pays off - hope it does!
Putin is only concerned about integrity of his own political power and physical body. There is bunch of regions and cities in government databases that was never ever under any kind of military control. Russia is literally have imaginary state border.
I believe democracy and peace are important for everyone.

Just wondering why you don't like the sharing of this news?
In 2015, I took an intro cognitive science class in college. The professor listed some natural language feats that he was certain AI would never accomplish. It wasn't long before average people were using AI for things he predicted were impossible.
In America climate hawks and Big Oil alike cheer geothermal energy
> If you ask ChatGPT how it does this, it says "I break down the problem into its component parts, apply relevant mathematical rules and formulas, and then generate a solution".

You are (naively, I would suggest) accepting the LLM's answer for how it 'does' the calculation as what it actually does do. It doesn't do the calculation; it has simply generated a typical response to how people who can do calculations explain how they do calculations.

You have mistaken a ventriloquist's doll's speech for the 'self-reasoning' of the doll itself. An error that is being repeatedly made all throughout this thread.
Thanks for the detailed reply.

My point was that CPU performance seemed to have stopped being the differentiating factor in computers a long time ago. That was evident even in the 2000s. It was impossible to make a CPU that ran much faster than competitors, and most of the innovation appears to be in power consumption, which isn't very exciting.

That's why gamers bragged about GPUs, because GPUs always made a massive difference. This also applies to AI today, GPUs make all the difference, CPUs are just a commodity. Intel become stuck in a commoditized business, while Nvidia was always bleeding edge.
The NRC's entire function is to kill the nuclear industry.
I haven’t used it so I’m not qualified to answer, sorry. I can only tell why I never used it: as far as I understand it’s possible to have data loss with nsq and there’s no replication.
There are logs where ChatGPT initially gives the wrong answer, but then corrects itself when asked to explain the wrong answer. Is that the second part you're thinking of?
This is wrong. Losses are only realised at redemption or sale.
Also if you were doing it personally you'd probably not take the whole codebase, but look at function signatures/docs as you get further away from the code you care about. While there's probably benefits in clever systems for summarising and iteratively working on the code, you can get away with just cramming a load of context in.

I have been playing with GPT4 and it's good. It's easy to imagine a bunch of use cases where even the maximal cost of a few dollars ($1.80 ish for the context alone) for a single query is worth it. If it's good enough to save you time, it's very easy to cross the threshold where it's cheaper than a person.