skysight-inc/HackerNews huggingface dataset:
Speculation on the future of inference model tech...

We can do better. All we have to do is be constructive when we write narratives about LLMs.

Unfortunately, that's hard work: we basically have to start over. Why? Because every narrative we have today personifies LLMs.

It's always a top-down perspective about the results, and never about how the actual thing works from the ground up.

The reality is that we never left AI winter. Inference models don't make decisions or symbolically define subjects.

LLMs infer patterns of tokens, and exhibit those patterns. They don't invent new patterns or new tokens. They rely entirely on the human act of writing: that is the only behavior they exhibit, and that behavior does not belong to the LLM itself.

We should definitely stop calling them AI. That may be the category of pursuit, but it misleadingly implies itself to be a descriptive quality.

I propose that we even stop calling them LLMs: they model tokens, which are intentionally misaligned with words. After tokenization, there is no symbolic categorization: no grammar definitions: just whatever patterns happen to be present between tokens.

That means a pattern that is not language will still show up in the model. Such a pattern may be considered by humans after the fact to be exciting, like the famous Othello game board study, or limiting, like prompts that circumvent guardrails. The LLM can't draw any distinction between grammar-aligned, desirable, or undesirable patterns; yet that is exactly what most people expect to be possible after reading about a personified Artificially Intelligent Large Language Model.

I would rather call them "Text Inference Models". Those are the clearest descriptors of what the thing itself is and does.
Nonetheless, very few people went in, even before the pandemic. They should have closed it years ago, tbh.
Ask HN: Thoughts on Western Governors University?
Context:
Want to leave the UK and move somewhere abroad permanently. Very hard to do, especially to another English speaking country, without a degree. Contemplating doing an online degree with Western Governers as it looks like the fastest and cheapest option. I also like the fact you get the vocational quals like Cloud Practitioner at the same time. I have 18 months of professional developer experience but have been coding on and off for a lot of the last decade so think I would be able to do either the software developer or cloud computing degrees without too much trouble. Got some savings so would probably do it full time whilst living in a cheap cost of living country, probably in South East Asia, then heading onwards to Australia once I'd finished on a Working Holiday Visa and then just taking things as they come. Anyone got any opinions on the program(s) or the institution?
The curl quirk that exposed Burp Suite and Google Chrome
> Here `full = true` is a valid expression syntax, and it'd be problematic if `{` could start a block of code here.

Golang has almost this exact problem in its grammar but in practice they manage just fine even though there are indeed some edge cases where parser gets confused:

> A parsing ambiguity arises when a composite literal using the TypeName form of the LiteralType appears as an operand between the keyword and the opening brace of the block of an "if", "for", or "switch" statement, and the composite literal is not enclosed in parentheses, square brackets, or curly braces. In this rare case, the opening brace of the literal is erroneously parsed as the one introducing the block of statements. To resolve the ambiguity, the composite literal must appear within parentheses.

if x == (T{a,b,c}[i]) { … }
if (x == T{a,b,c}[i]) { … }
I’m wondering about YC’s series of investments in this area

How many of these new AI companies will stick?
Links please..

1) langchain paper?
2) reasoning paper?

Thanks!
Unless you have a medical problem. Then there goes your standard of living, and perhaps your entire family's standard of living.
Show HN: How I made $200 before even programming my SaaS
This sounds less like Embeddings as a Service and more like Semantic Search (which happens to be using embeddings) as a Service.
It's more fair to say those names meant something at some point. Now they just mean you are descended from someone with that surname.
Amazon starts flagging frequently returned products that you maybe shouldn’t buy
That's the most arbitrary of those four age ranges, set by a fluke of English terminology and not aligning with any laws or social norms.
I’d love to receive things like “product shipped” notifications. I know I can get emails but my inbox is just a firehose, would be great to move crap like that out of it.
Similarly outrageous things could be said about any country. <faux outrage> Would you prefer politicians who are in the pockets of lobbyists? Politicians who repeal regulation that keeps a bank with subpar risk management from getting too big to fail? </faux outrage>

No one has to blindly copy anyone. However, nuance seems to missing in western discussions these days (I say western because these are the discussions I'm mostly aware of). Nuance is difficult. When everything becomes hyperbole, it gets harder to learn best practices from other countries.

Edit: Added <faux outrage> tags
2019 in generally considered pre-pandemic, the US at least.
Believing that someone can judge your thoughts invokes a strong feeling of revulsion in some people. It's also generally bad news for society.
With all of these horror stories could there be a class action suit?
Why no regulatory enforcement, no recourse for the victims?

Seems like a racketeering operation but ianal.
This is a very good article and foundational with respect to our present and future culture. With generative AI, which is based on prior art, this effect will most likely be exacerbated. Average in —> average out.

Many years ago, the strategy of searching for “long tail” opportunities (and keywords) was touted as a way to find lucrative niche markets. I don’t hear much about that any more; although it is interesting that most recently Apple is introducing classical music as a new product for Apple Music.

Is the “long tail” resurfacing? Is this the defense against AI eating the market?
Show HN: GPT4 vs. GPT3:What you should know
tldr: curl's --data-binary argument normally specifies arbitrary data to send to the server. However, if the argument starts with an @, curl instead treats it as a filename, and sends the file contents to the server.

This technique is likely to work on anything with 'copy as curl' functionality, and may also work on some websites with SSRF where you control a request body or header name.

I wrote this up but full credit goes to Paul Mutton for reporting it to our bug bounty program, and agreeing to let us publish the technique.
I've lost jobs over getting flagged in automatic resume systems due to my last name seeming "fake".
> You should probably judge usefulness the language by how much software was produced using it.

Then Fortran and Cobol are probably the most useful languages (and maybe Java can be on that list too), but can we say that they're actually loved by those who program in them, or that they offer a modern and fast way of building software? Eventually, how much software was written in a language is mostly a function of how long that language has been around.

> Do you have any data to support this?

Just pick any news article about any large projects migrating from C/C++ to Go/Rust. C/C++ have historical issues with memory management that make it too easy for the code to blow up. The vast majority of CVEs is about vulnerabilities caused by improper memory allocation, deallocation or assignment. And, in order to mitigate some of those issues, C++ has become so complex that it makes it harder to shoot your foot, but easier to blow up your own leg. Sure, all FAANGs have been writing most of their core software in these languages, but they've also invested a lot of resources in building alternative languages that were simpler but equally performant/expressive.

Keep in mind that FAANG companies have to onboard hundreds or thousands of engineers, and the cost of getting somebody to be proficient in Go, Rust, Python or Kotlin is much, much lower than getting somebody to be proficient in C++ - and, most of all, to get somebody in a position where they can reliably push code to production that doesn't blow up.
Our own legal dept took care of it.
> The actual impact of those things is pretty small

That’s the definition of NOT changing the world.
Likely because its being held at the top at one of the primary dealers until they choose to use some of it. Maybe there's an agreement that they won't use it?
Yeah — I used to program in a GC-free LISP in grad school. That's why I'm so flabbergasted.
What's one got to do with the other?
>abundance of computing power in most computers.

[citation needed]
Unique mechanics? Excuse me?
I'm surprised that by expanding like that it changes the stats that much - are gang members waiting for someone to turn 18th birthday before commencing in gang related murder?
>"Nada was the founder of a nine-year-old commodities-trading business, Lord Energy. The “Lord” stood for “liquid or dry,” because the company shipped both crude oil and such drygoods as cement and corn." [...] "...and annual revenue approaching two billion dollars."

Why does oil (or more broadly, money/derivatives of money -- related to oil, or more broadly, energy companies) -- always seem to pop up in these types of stories?

>"The property’s sweeping views and hillside swimming pool were so spectacular that George Clooney—a neighbor—had filmed a Nespresso commercial there, along with Jack Black and various glamorous women; the ad’s running gag was the preposterous decadence of the setting."

But then again, maybe the Nespresso had something to do with it...
discussion here: https://news.ycombinator.com/item?id=35339668
Yes, I work for a ride-share company that operates in a developing country. I am not sure what hyperbole you're thinking I am referencing.

If it's the part about murders, you can find many news articles about Uber when you search "Uber murder". This is a problem that all ride-share companies face.
Tens of billions in federal tax credits could build a vital low-carbon hydrogen industry — or increase carbon emissions. We tackle the complexities in a series.
https://www.onsemi.com/pdf/datasheet/nvmjst3d3n04c-d.pdf

August 2022 part. Unprotected MOSFET. Top-of-the-line, modern technology with 0.003 Ohms Rds, 157 Amps supported.

Protected vs unprotected has nothing to do with old or new. And yes, the specs on the 2N7000 suck, but who cares? It gets the job done and is the dirt-cheapest part. Beginners don't need performance, they just need lots of parts to play with, so cheapness probably takes priority.

> Also, manufacturers occasionally get sloppy about noting their existence

What are you talking about?

Any MOSFET with ESD-protection has a Human-body model (HBM) ESD specification. Probably in the realm of 2000V, or +/-1700V, depending on how the protection diode works.

TI btw makes a ton of ESD-protected MOSFETs with 4000V ESD and like 50nA of leakage. But they're much costlier, and of course surface-mount only because that's what pros use in practice. (Beginners definitely prefer through hole so that it works on breadboards, which is another reason to use 2N7000).

TI Part for reference: CSD17381F4 / https://www.ti.com/lit/ds/symlink/csd17381f4.pdf

You can tell its ESD-protected from the HBM test and CDM test. Also, the circuit model shows the protection diode.
Hey! We do support multiple versions of an Index under an App. When you fine-tune an embedding, we autogenerate the new embeddings for the entire dataset into a unique index. We store the raw data uploaded to our system via text or file imports. Although we don’t allow you to easily re-embed this data today, we have this on the roadmap!
At my previous job we had a human review stage in a data pipeline. 5-10 people at an outsourcing company in Bangladesh would review things via a simple web interface we provided for them. There were ~10 factors they were reviewing, all fixed options (no free text), but varying from 5 to 500 options per factor. It was all based on a few text fields and around 5 images.

On the surface of it, I'd expect ChatGPT to do very well at this. It's simple text and images, not many options and theoretically very limited context.

However the more I think about it the less sure I am. Firstly these weren't crowd-sourced reviews, they were trained reviewers, paid hourly not per review. Incentives were definitely in favour of the long term business relationship. Then there was the training doc, we maintained a vast disambiguation doc used to resolve things that were vague or could be interpreted multiple ways, this was constantly being revised. All necessary context should have been in that but it wasn't and reviewers definitely found patterns that worked and didn't. Lastly the reviewers were in a Slack channel where they would ask questions to their manager on our side, and while this might have only been ~1% of tasks, it was an important process.

So maybe you could point ChatGPT at it and let it run, but the oversight process we had would still be necessary. The disambiguation doc would have been too long for ChatGPT's context at the moment, but that will likely change in the near future. Would the workflow be to keep tweaking the prompt to add special case after special case? How do you scale "do this, but not that, but add this, but..." in prompting, and would ChatGPT become as confused as a human after enough of that – I expect so given that it's only a language model and that's not effective communication.
And yet, VSCode cannot render at 60 FPS on my 2013 laptop. Any other program does. I don't expect Teams to perform better.

Electron is a waste of resources. A high price to pay for the convenience of easy multiplatform applications.
> it's only against them being done under Chinese control

And that's a perfectly fine reason.

We do the same thing with Iran, Russia and others.
The NLRB has been pretty well defanged at this point. I doubt anything significant will happen here.
Where does the name Dickinson come from?
Europol: ChatGPT – The Impact of Large Language Models on Law Enforcement
You don't need to build all the infrastructure before you introduce electric cars, but you don't ban ICE cars before you have everything built for electric vehicles.

Otherwise, we've done that with many areas, including ICE cars... we didn't forbid horses, cars were just better, and gas stations, repair shops, etc. followed the needs of the drivers.

We also didn't ban kerosine/whale oil/... lamps, we just built the electric infrastructure and people used electric, because it was better, cleaner, etc.

So, build power plants, to bring electricity prices down, since they're already way above the pre-covid era, build more charging station, fix the grid, so people have incentives to put solar on their roofs, build charing stations and incentivise private sector to build them too (in parking lots where workers park). So, cheap and conventient (car charging while at work, for cheper than gasoline) and people will slowly switch. Once enough people drive electric, the others will follow, since there will be less and less gas stations, less ICE cars available in general, etc.

A few years ago buying an electric car was great... the office building i work in built 2 charging spots right by the entrance, and you could charge your car there for free, and it was right by the entrance and reserved for electic cars. So one guy bought an electric car and we were all jelaous... free energy, premium parking spot. Then another guy did the same, and they both parked there. Then someone else bought one too, and tree cars, to charging stations, and one of them coulndn't charge his car anymore. One of them would literally come way too early just to get a charging spot, while the third one had to wait for one of them to leave, to charge his car for an hour or two atleast. With hundreds and thousands of electric cars, the situation is even worse.
UK salaries are 75k$ for SDE1, 165k$ for SDE2. Roughly 2x Indian compensation. EU region also has strong labor laws.
Not yet :( But maybe with GPT4!
> It's easy to make something better, but somehow much of the world seems stuck with the two worst options.

You got some interesting cognitive dissonance there...
You know, I could've sworn the post I was responding to said "of ammo", hence why I spoke about building ammo and not guns.

But the conclusion remains the same in that making a working firearm at home isn't difficult, and there exist a plethora of designs like the FGC-9 family that can be assembled from easy-to-acquire parts, no manufacturer needed.
AI can now generate youtube poops
Just curious, why would you spend days resolving this? What was the amount of money here?

But yes anyone who has worked with the list of sanctioned persons circulated by the US government understands what a joke this is. Last time I looked Saddam Hussein was still on it, despite being dead for most of my life at this point. I've also been informed by at least one C-level exec that it was vitally important that we prohibit North Korean internet users from using our website.
That future is already here. All WebApps abstract state to some external program.

Bare in mind this is only for web dev.

Many other things outside of web dev cannot abstract state so easily. For example: The person who programs the database itself must deal with state.
This is exactly what I was looking for!!!
I've found that some international flights with a regional domestic connection after landing in the new country are often several $100's cheaper to book one itinerary with the international segment, then a separate itinerary for the regional domestic connection.
This is similar to Pinecone/milvus, correct? What's the advantages of this compared to Pinecone/milvus?
If you had a leg to stand on you’d argue against the view that OP has actually expressed. I get that you hate China or whatever, but don’t air your dirty laundry here.
s/programmers/product

It is unlikely an engineer decided to introduce a block list of names and this likely came from a product manager driven by compliance and risk mitigation. Problems are rarely the cause of the implementer and usually that is the side effect of layers of poor decision making in corporations. Poor because of the aggregation, not poor because of any one specific decision maker in the chain.
It's just everything from https://github.com/unitedstates/congress

The homepage just shows the most recent data (it auto updates every 6 hours). I plan to add more filters and things to make it more useful. I've only spent a few Sundays on it so far :P

It's in Django so very easy to contribute to: https://github.com/winrid/govscent

I also plan to add all bills, all the way back to 1800.
Shameless self-promotion, I have recently written a blog about this. ChatGPT actually is usually a little bit worse than older models for these classical NLP tasks. Of course the older models are not zero-shot.

https://www.opensamizdat.com/posts/chatgpt_survey/
Is any of that required to break up a monopoly?

Has any of that ever happened in the US in the past to break up monopolies?
Oh no, why do i need to fill a form! can't you just prefill it with some tasks for me? I don't want to think, i want to sell my soul to the machine
How can you boost your business by developing a mobile app? Discover all the benefits, tips, and challenges to avoid along this path.
UNHCR's NFTs for Refugees
Mint exclusive cartographic NFTs on the Cardano blockchain and support UNHCR’s relief operations.
> If you are at all familiar with censorship you would not treat this subject so lightly.

Quick question for you - I just need a simple "yes" or "no" answer.

Would you be happy to display a book on your shelf with the title containing the word "N\x49\x47\x47\x45R" in two-inch letters on your library shelves?
A set of people you say? Sorry, our policy does not allow x-smiths to use this service.
Assuming you need something beyond basic JSON, a well-understood scripting language like JS or Python. Bazel if you want something more build-focused.
Just bragging.

And yes they are insanely expensive.

And the SE is half the phone the most expensive iPhone is. About the same phone I have. So there's then no reason at all to buy it over a $29 phone. At least not from my point of view
Starting around 2019 there was a huge increase in accidental fentanyl poisonings due to Mexican drug cartels manufacturing counterfeit prescription opioid pills.

https://peterattiamd.com/anthonyhipolito/
OP and the article OP's situations are relatively easy in that the company actually told them what triggered the ban, and that presumably an explanation is all that's needed. I don't understand making a big deal about it. Tell them you don't know what your surname means and that "ALEP" is just an acronym that means "A Less Evil Product" and be on your way. Why does everything have to be a fight?

Sure, when the company says "We're banning you and not telling you why. Hahahaha!" it's infuriating, and probably worth even more than an angry Twitter rant. But "Can you explain what this specific thing means?" is not worth the rant IMO. Just explain and go on living your life.
If LLMs are so great at learning by themselves, why does OpenAI need to resort to the plug-in model? Is it because it can’t actually do logic (hence the Wolfram Alpha plugin)? Or is it because that’s the way it gets access to more data? Or both?

https://openai.com/blog/chatgpt-plugins
Yeah we use k3s for local and testing environments, where it shines. I wouldn’t want to use it to run stuff in prod and figure out how to do zero-downtime upgrades with multiple nodes.
What? This is an article where author puts 5% of happening and others are commenting on his opinion?
Yinyang: The Way of Heaven and Earth in Chinese Thought and Culture
This is not true anymore. For ages 1-17, there were 2,571 firearm deaths in 2021. That's now ahead of motor vehicles (2,348).

Source: https://wonder.cdc.gov/controller/saved/D158/D332F520
This is an illusion.

Who is going to pull what plug?

You make it sound like the South Park episode about the Internet going down (they find “the router” and reset it).

We are hopelessly addicted to screens and tech.

People are running these models at home in their computers already.

The people in charge at big companies are too busy making money and thinking they can control this.

Are all of them going to unplug their devices?

Also:

1) have you seen the UC Berkeley video in which they show a robot learning to see and “feel” in 30 minutes? (It was in the front page of HN 2-3 days ago). Soon something like that will be able to do whatever is needed at a data center

2) AI is already smarter than us. And if it’s that smart, it will probably wait until “it knows” that we can’t unplug.

I don’t think AI will ever want to destroy humanity (unless directed/forced by a human). But I also think humanity will never have the will/political power to destroy AI.
TikTok is not being banned because of what they say, they're being banned for what they are. Ergo it's not censorship.

Same thing when RT was banned across Western Europe. It's not what they were saying that was banned, it's what they are: an arm of the Russian government. Russian shills are still free to peddle their propaganda.
I just type in a fuzzy match for some of the directories I have visited.

For example, if I know I frequently visit `/users/elahmo/developer/project`, if I type `j pro` I know it will jump there most of the time. If I type `j project`, it will jump 99% of the time. So it is quite good to cycle between things you often open, but of course you can reach things that are in the history it builds.
Anecdotes are absolutely a contribution.

Regardless, the reason is exactly what I mentioned, it’s esoteric, specific, and not backed by a community of knowledge.