skysight-inc/HackerNews huggingface dataset:
Ask HN: Options for using GPT models using proprietary data
Hi everyone,

While there has been a lot of progress in leveraging GPT models for various use-cases, the model weights themselves are closed and only accessible via API. As an internal team within a startup, we don't have the resources to train our own model. We have loads of proprietary/internal/client data that we'd like to use but are concerned about sending it to third-party APIs like OpenAI's.

Are there any comparisons available between the various models with publicly available weights vs ChatGPT?
How should we go about choosing the model to use? Is it the case that beyond a certain size of the model, say 10B parameters, there is very little difference in performance between two models?
Additionally, are there any examples of people building tools for internal usage within a startup/enterprise?
Is it possible to run GPT models locally for inference and fine-tune them for our specific use-case? What are the steps required to achieve this, and what are some best practices to follow?
am i on Reddit?
Maybe? Definitely not always.

My team is the heart of my company's innovation center and we've very intentionally sacrificed a lot of productivity for alignment and it's been really good for the business. It's an internal platform with probably another ~20 eng years of work left, turns out the bits of work our team thought would be most impactful weren't. By focusing on alignment we've been able to sequence the work so that more of company gets onboard early and the company as a whole delivers more value, faster, with less long term debt.
I used to not care but the rental scooters really are a nuisance. Apparently deploying their kickstands is literally the hardest thing in life. The ones in motion don't bother me, and most of the people in Berkeley that ride e-scooters own theirs so they buy the lighter ones and carry them indoors, but the rental ones are much larger and heavier and their stands simply don't work.
let us know when Java's type system is sound, and can be completely inferred.
Yea. That's the internet in a nutshell.

On a separate note, it honestly sucks how HN has legitimately gone to shit. A lot of old timers are basically boiled frogs and don't realize how alienated most other techies are by HN.

@Dang, ik I've harped about this a thousand times (and I myself have contributed) but y'all legitimately need to fix the toxicity on this board. Lots of early career techies don't want to be associated or go
on HN. I've heard this sentiment across the board from early career interns and friends of mine at Cal, MIT, UIUC, UMich, UW, IIT D/K/M, and Harvard - all feeder programs to YC

People will still apply to YC of course, but the brand has been increasingly tainted. I know for a fact in India Sequoia Surge gets the pick of the litter over YC.
What's dangerous is that it will amplify both the good and bad in society.
The Cardiac Arrhythmia Suppression Trial (1995)
Sounds like you haven't been there for a few years.
It's clear enough who owns a speech, and like the OP I'm in favor of hosting your own speeches (and essays). But who owns a conversation? Does this rugged individualist approach to hosting one's own work end the possibility of online discussion? Or do we just hold our nose and do the hypocritical thing and host comments - encouraging others to NOT own their work?
It is also supported by iTerm2, Wezterm, and foot. Alacritty does not (yet) support dynamically modifying the key encoding per-application, but you can hardcode the encodings in your config file (there is an issue in the Alacritty repo that explains how to do this).

You may not have to switch at all if you are already using one of these terminal emulators.
> It's just not possible to get around modern American cities without cars.

Well but it is. Restricting/Eliminating cars in city centers especially would do wonders to promote them as places that people want to live in.
Cities must upgrade as well in order for this to work out. Must be a transition period but without public measures to implement the urban mobility this won’t work.
As someone who regularly uses them I would be very sad if they were banned. It is a very convienient mode of transport and can often cut journey times in half for me compared to public transport. I also ride a bike but I don't always have it with me, or want to lock up my bike somewhere overnight and risk having it stolen.

I think it would be unfair to punish responsable users because of a few bad apples. Half of the people leaving them in the sidewalk aren't even the users themselves, but frustrated vigilantes who see them as a symbol of capitalism gone wrong and who want to vandalise them.

Maybe some actual enforcement of cycling rules is needed, but outright banning is draconian and unnecesarry.
So basically author agrees with Prusa but wants him to become a bankrupt martyr so that Chinese clones can start behaving more responsibly? Even in software nice companies dual license their SW to keep afloat.
It's not only the far right that value tradition and culture. And it's not only the right that tries to force the people around them to conform to their ideas of how the world should be.
In my experience, they are perfectly fine in bike lanes. If your city doesn't have those, that's the problem. Not the scooters.
Virtual Memory for an Object-Oriented Language (1981)
I just found out about YMO in January and have been slightly obsessed with them since then. Now another member dies, it's sad to read. Seeing this on the front page of HN is nice though, and I just am now realizing the massive breadth of Mr. Sakamoto's musical skills. There's still so much amazing music to discover out there, and I'm glad to see that his legacy will remain, and that his music will be listened to by many people who might have never heard it before!
Go well with your hambu- I mean, Liberty Sandwich.
It's maybe not even possible to expel all the loanwords from Norman and more recent French, as well as Latin, from the language. But things like Anglish[0] exist.

[0]: https://anglish.org/wiki/Anglish
Maybe there's other ways of improving the service without outright banning it. I would be surprised if there has not been a lot of innovations that caused a lot of accidents and endangered a lot of people that have been properly regulated and improved without just saying "this is a menace, let's ban it!". I personaly have enjoyed riding around on scooters along many cities in Europe including my own and would support improvements if stats really show they are very dangerous (couldn't find very supportive data for that at least in my city), but I still believe it would be very shortsighted if the solution is just "ban them" because some people don't like this change.
They control engagement and they can make it higher for the checkmark. Hell, they can push engagement to zero for anyone who doesn't pay, and it looks like that might be the plan. The problem is that the set of people with the checkmark is small and (in aggregate) fairly terrible, and is mostly disjoint from the valuable content creators on the platform.

Twitter has lost a lot of good users and communities, but it's still relatively usable and stable. It's not going to survive another artificial engagement squelch targeted at non-paying posters. So either Musk will do that and there's no reason to pay for a dead platform, or he won't do it and it's better not to pay him. But the real argument is that enough people refuse to pay, perhaps it will speed up the process of forcing Musk to back off from his current approach and instead focus on making the platform better for all users (and hence bringing back high-paying advertisers) rather than doubling down on this failing subscription idea.
It doesn’t elude us. Anyone that looks outside of the country knows that but hate is hate. You don’t choose the color of your skin any more than you choose where you are born.
In Texas, he likely had his gun regardless.
There's nothing that said the victim of the theft short first, but even if he did, the criminal forfeited their right to life. I feel no compassion for an adult that takes what's not theirs.
That's because they were never designed to be enviroentally friendly. They were designed to be able to be marketed as environmentally friendly. Big difference. If someone sees it disintegrate they'll think "good, biodegradable" even if that's not actually what's happening. The manufacturers don't care. They know, most of the people raising the hubbub about it don't take the 5 minutes to understand what theyre screeching about, they don't have to appease the environmentalists, they have to appease the pantywads, the kind of people who don't buy animal tested cosmetics but flush them down the drain all the same.

Just use paper for Christ's sake and quit it with all these shenanigans. Brown, recycled paper, maybe some wax. And glass for bottles and things. It's all you need.
> dramatically improving various urban areas

That’s just in your opinion though. Scooters are super convenient if you’re not just an old fuddy dud afraid of new things.
Desperate? It’s not like they’re facing a margin call. They’re just looking for funds to be VC’s with, because that’s the business they’re in.

Your attempt to frame it as “desperate” is just kinda sad.
Having more people with about the same size as US (and mind you, not all europe is EU) means more population density and you have a land route to asia and close to africa.

In the US everything international (except americas) comes by ship and you have large distances between population centers. It isn't just the size and the amount of freeways but the way they are interconnected that allows all kinds of truck routes between ports and production centers (e.g.: veggies and fruit in cali or florida) to not just big cities but middle of nowhere montana or dakotas as remote and underpopulated as they may be, they all have easy access to the same interlink.

If this was networking, europe would be like a very large campus network but the US would be a metropolitan area network with a similar physical size but connecting all types of buildings.

Honestly, I think you just have to drive around and see what I mean. Many americans also don't get this. I don't mean just the roads but go to random walmarts or targete in the middle of the desert or mountains that get the same goods as big city stores and they're just as large. You can easily spend half a day shopping in a walmart.
If pure red is at 0° hue, and orange at 30°, then that engineering value at 3° is much closer to red. The other two at 18° and 19° better fit the reddish-orange description, still more orange than red, while safety orange is up at 28°.
Often it's a hint generator that tells you where to look and what you could try.

The hints are not calculated from the input, they're from the training set.
And Poland has the best pierogis and I like pierogis more than operas. ;-)
> The problem is, human intelligence is likely also based on a similar advanced chat bot setup.

This is so wildly wrong and yet confidently said in every techbro post about LLMs. I beg of you to talk to an expert.
Did you also "hear" a sound in your head like a guitar string breaking when it happened?
Discussion is different from work. As you hint, there is no good way to co-own a discussion. Either you do it on neutral grounds and someone else owns it, or one party is the host and owner.
I don't miss restrictions when writing code, I miss them when reviewing code.
You can delay the release of your newer designs by 1-2 years so that you can squeeze the juice at the beginning while being nice to your regular users.
yep, and they'll complain the entire time saying Microsoft never does anything new.

this has happened a couple times, really.
The space is moving blazingly fast.

There’s already GPT4All that can run locally in your computer with just CPU.

Pretty sure by this time next week there will be several companies or projects built around this in different flavors: self-hosted, cloud, hybrid, distributed…

Also an open plug-ins architecture protocol so that plug-ins can work across multiple different LLMs/models/services
Hello, LaMDA
And Linux - every Azure blade has an embedded ARM SoC running a hardened Linux with various daemons that interface with both the Azure backend and the Windows host, control offloading of network and storage processing to the FPGA, and other tasks.
hey Maksadbek, thanks a lot for reporting this! looking into it right now. in the meantime, you can hold down the button in the email to copy the magic link and paste into your browser
Rental scooters are often competing with walking. A 10 minute walk might perhaps be a 2 minute scoot. Great.

But in my city, for every 1 scooter ride, you will see 100 pedestrians walk past. Ie. they have a sub-1% market share. And the scooters are idle >95% of the time.

I suspect, the friction of needing an app is too high. The complex signup process needing a driving license is too complex. The pricing (multiple dollars just for a 2 minute scoot!) is too expensive. The rules about not taking them out of the area and locking them properly or risking a fine are all too scary.

I think these scooters would do far better if they were entirely free and appless for the first 5 minutes use. If you want to go further, scan the QR code and watch an ad and get 5 more minutes. Pay money, and get more time yet.
Cars have a dedicated space. Most cities don't have a dedicated bicycle infrastructure, or at least not enough and not well connected, so scooters are forced to share pedestrian paths. And, again, people treat them like somebody-else's property and misbehave, for which there are no consequences.
I beg to differ. I've been biking in Paris regularly for the past 10 years. It has always been a great experience. And it is getting better year after year.
To be fair it's very easy to outperform a DBMS by not offering ACID guarantees.
A great article with excellent advice that I hope Prusa will pick up.
it's more control than letting people own them, in a certain aspect

of course, carelessness is a problem but that also happens with so-called Boris bikes (Livingstone bikes)
I have never felt more safe about my job.
> Is it though?

Yes.

> I’m not sure radio is still relevant for anyone under the age of 30.

Maybe you don't drive? If you drive and you get tired of listening and re-listening the stuff you have on your phone… radio it is.
Sometimes communicating is worth it for interrupting the team

Perhaps, but the first thing any emergency responder will tell you is that there should be one incident commander, and that all communication and allocation of resources should go through that one person. And that the person with the incident commander role should not carry out any operational duties besides coordinate and control, because those other tasks require the same mental faculties, but use them in a different way, making them less effective in either.

If there is a requirement to update customers affected by an incident, the company should have processes in place to streamline the flow of information without interrupting the team. And the team responsible for updating customers should only communicate with the incident commander, and absolutely steer clear of the operational responders. If specific details are required, it falls to the incident commander to gather those details from the team, not to outside people running interference.
It doesn’t remember anything unless you mean that intermediate values in calculation of forward pass is “remembering”. The prompt continuation feature is just a trick where they refeed previous questions/replies back to it with new questions at the end
Exactly my point. But it's relevant to listeners :)
Yes but there are diminishing returns to alignment. The difference between 90% and 99% alignment is minimal, and cutting productivity in half to achieve it is not worth it.

I also hypothesize that when you have systematically low productivity, the business/product no longer becomes aligned with the market. In that situation you actually don't want your employees to be 100% aligned with the business.
The Conscience of a Hacker (The Hacker Manifesto, 1986)
The table on p15 shows the US doing more tkm than all EU combined for the road columns.
There have been many North American cultures imported from Europe. In the US and Canada, they all tend to die out after a certain amount of time. E.g. the Spanish had a colony in Florida. The Dutch had a claims to the Hudson valley in NY/NJ. Lots of Scandinavian settled the frontier. Italians in the NYC area. The list goes on.

Quebec is one of the oldest cultures in the former British NA colonies. Say whatever you want about the Quebecois, they know how ti preserve their culture.
About 94.6% of caesium-137 decays by beta emission, so any Geiger counter would have shown abnormally high readings.
> A helpless manager is like a child - if left alone, they'll just shout and cause problems. What they really need is direction and structure.

What they really need is to find a different job. Needing to "manage up" is the ultimate waste of resources IMO and puts a lot of stress on the employees, why even have a manager at that point.
All true. The real reason Toyota is interested in hydrogen is that it would maintain its current balance sheet.

Hydrogen would allow Toyota to swap one messy, expensive, heavy power plant requiring lots of maintenance (ie fuel cell) for ICE technology.

Whereas EV technology has almost no maintenance, a motor with one moving part and regenerative braking that means even the brakes last forever. The accountants at Toyota would definitely frown at that.

All the other car companies did the same calculations and said 'NO'. Lets just say we'll do that and keep kicking the can down the road for as long as possible.

Now, thanks to Tesla, the cat is out of the bag and the entire industry knows they'll need a new financial platform to survive in the future and no, hydrogen will not save their sorry butts.
Hard agree.

This sounds more like Josef and perhaps the author have a romantic idea about open source but now dislike the realities. There’s no way you can get people to pinky swear to not use the rights in the license you chose. There are so many cases of millions or billions of dollars being generated through companies built on open source software. To not expect the same of hardware is unrealistic.

I’m not an expert on synthesizers but it sounds more like reverse engineering than building from open source and permissive licenses. I don’t think that’s the right lens to think about the reproductions.

If Prusa doesn’t want this then they need to close their licenses and stop talking about being open. That’s ok, it’s their business after all. I just expect that becoming “source available” will have its own set of thorns for the brand that has been built.

The irony of course is that the GPL was started due to…
closed source printers.
Never fails that when a techbro has been told LLMs aren't what they think they fall back to a field they certainly have more authority on: The human brain/intelligence.
Considering how common radiation sources are in Chinese gadgets (some even containing radioactive materials in loose powder form), a dosimeter or a geiger counter is mandatory safety equipment when moving house.
Paris has a pretty good shared bike service, there is no need for a personal bike.
Countries in OPEC+ tend to not really care about little things like the rule of law.
>"sounds are airborne"

ehhmm... yep?

Do we know of any special type of sound unable to travel by the air that could be recorded by a microphone separated by several cm of air?

>"this sound is informative"

Not different than saying "Plants had evolved a plant telephone to be informed from other plants or inform animals that they need a pee, right now"

Why a plant in a humid spot at the valley should suffer and react as its neighbors in a dry spot on the top of the hill? That would be inefficient and negative for their survival. Does not add much to the info that they have yet (collected with their own roots) and can be deceptive.

I noticed that forks emit a sound when they are drop and hit the soil. So this means that is a mechanism to alert other forks of the danger. So forks must have ears. Pure logic.

"We assume a link between many things that could be unrelated in order to sell animism 2.0 and grab eyeballs" would be a better title
The scooter companies should also add screens to the scooters, and use them for promotions. Eg. "Ride me to XYZ bar for free!".

These promotions can be paid by businesses who want traffic, but also help the company redistribute the scooters back to gaps in coverage.

The promotions should again be appless and authless. Friction is what prevents people using these things.
The rental escooters in London are terrible. You need a driving licence to use them, unlike rental ebikes. Yet they are slower than an ebike or even a regular bike. They are also really expensive. Then add to that the fact that'll they all have geofencing which (i) forces you off the less occupied bike lanes or roads in many cases (eg in/near the Royal Parks - including roads which are open to cars) and (ii) doesn't work properly so that if you're just near to a "slow" area but not on it then you end up having to push them.

This is all entirely down to government enforced regulations - honestly I'm not sure why the companies bothered putting them in at all as they must have pretty well zero repeat custom.

Meanwhile there are plenty of non rental escooters on the bike lanes which seem to work pretty well for people, despite being technically illegal.
There are two big concerns:

1. GPT-8 or something is able to do 70% of people’s jobs. It can write software, drive cars, design industrial processes, build robots and manufacture anything we can imagine. This is a great thing in the long term, but in the short term society is designed where you need to work in order to have food to eat. I expect a period of rioting, poverty, and general instability.

All we need for this to be the case is a human level AI.

2. But we won’t stop improving AIs when they operate at human level. An ASI (artificial superintelligence) would be deeply unpredictable to us. Trying to figure out what an ASI will do is like a dog trying to understand a human. If we make an ASI that’s not properly aligned with human interests, there’s a good chance it will kill everyone. And unfortunately, we might only get one chance to properly align it before it escapes the lab and starts modifying its own code.

Smart people disagree on how likely these scenarios are. I think (1) is likely within my lifetime. And I think it’s very unlikely we stop improving AIs when they’re at human levels of intelligence. (GPT4 already exceeds human minds in the breadth of its long term memory and its speed.)

That’s why people are worried, and making nuclear weapon analogies in this thread.
The key component in this system that understands human psychology is to set reasonable expectations. Most places don't have that kind of SLA, but when an event occurs you can set an expectation of when the next communication will be and as long as it's not crazy, people will go along with it. But if you just leave people hanging, not knowing when/if an update is coming, they have nothing to do but panic about the lack of new information.
D&D didn't even have a (main product line) sorcerer class until 3rd edition. What Lina's doing throughout the series has no connection to Vancian magic which was overwhelmingly the D&D magical mode at the time. (Her powers actually best align with Druid or some of the other shamanic classes which were... a long ways off, in D&D at least. She can in fact heal.)

Your underestimation of Japanese knowledge of English/European fantasy is verging on offensive.

Sure, D&D inspired Slayers, but so did other stuff. It's no obvious system-specific replay like Lodoss War.