skysight-inc/HackerNews huggingface dataset:
They are totally connected, they just start door close before waiting of a usual timeout which gets annoying. At least here in EU, if i pressed the floor button i will wait a few seconds before it starts closing doors, if i press floor button then "door close" then, unless something is blocking the door, they start closing immediately.
Funny ideas. But seriously, large companies employ regulatory capture to limit competition all the time. One mechanism is to require a high compliance burden before a product or service can be brought to market. This increases capital requirements and risk for any competitor.
> Ugh that testing graph confirms that AP Environmental Science was indeed the easiest AP class

No, it just indicates that it was the one whose subject matter was best covered by GPT-3.5’s training data.
> 2) Lobby to get TikTok banned. If Zuck can't defeat TikTok on product development then he can get it banned. Spend dollars lobbying politicians and demand results.

That's their only realistic hope of seeing out the next five years. Get TikTok banned in the States, Europe and parts of Asia, then clone their app and launch in those markets to capture market share.

It's an underhand business tactic, but there's nothing too low for Zuck I guess.
Passing the LSAT with no time limit and a copy of the training material in front of you is not an achievement. Anybody here could have written code to pass the LSAT. Standardised tests are only hard to solve with technology if you add a bunch of constraints! Standardised tests are not a test of intelligence, they’re a test of information retention — something that technology has been able to out perform humans on for decades. LLMs are a bridge between human-like behaviour and long established technology.
They weren't true in past iterations. Since the new version is 10x as accurate (if you believe the test score measures, going from bottom 10% score to top 10%), we're going to see a lot less confident falseness as the tech improves.
Congrats on the launch. I think you should share some technical details for a more substantial pitch. You are using the OSS BigCode effort and "The Stack" [1, 2] (as you say in another comment), which is great.

A few questions that might help an enterprise customer: How big is your base model? Where did you find more datasets (maybe just a hint would be sufficient)? Are you using SantaCoder [3]? Anything you can say about your fine-tuning that makes it special? Totally on board with you that HumanEval/MBPP are not great benchmarks for real world, and do you have a suggested alternative to help me see the value?

The calculus for an enterprise customer might be: "We could fine tune a 6B model on our internal code and internal benchmarks (say with a month of work, a few thousand in compute, 2 people on task), but I'd rather buy an off-the-shelf solution like codecomplete.ai. They give us XYZ benefits." Articulate the XYZ for a technical decision maker who will be your target audience.

* [1] https://huggingface.co/datasets/bigcode/the-stack

* [2] https://arxiv.org/abs/2211.15533

* [3] https://huggingface.co/bigcode/santacoder
Luckily the current world hegemon doesn't just kill people that it cannot find a use for, just to make powerful people richer via weapons sales.
> Does completion tokens mean that you also get charged for the answers that the AI gives?

Seems like it, prompt tokens = input, completion tokens = output
Without exponential increase in computing resources (which will reach physical limits fairly quickly), exponential increase in AI won’t last long.
Does anyone have any context as to how the image understanding works? From what I can gather they are simply using separate text-summarization step to generate some text like "and now we have an image of chicken nuggets" that it then feeds to the text-only network, but I wouldn't be surprised if there is some dialog I'm missing between the previous context and the image understanding mechanism.
Reminds me of the (false [1]) "Einsteins driver gave a speech as him" story.

[1] https://www.snopes.com/fact-check/driver-switches-places/
Good idea, wrong metric. What should fit in a screen is the concept. If you take a big, hairy, complicated thing and just chop it into several functions that fit on a screen you have gained nothing.
Besides the fact that this comment reads written by GPT itself, using this particular AI as a source for your education is like going to the worse University out there.

I am sure if you always wishes do thave a personal PhD in a particular subject you could find shady universities out there who could provide one without much effort.

[I may be exagerating but the point still stands because the previous user also didn't mean a literal PhD]
You need to follow some engineering standard. If your engineering org is not optimising away vendor lockin, blocking someone from using tailored-feature-number-367 is unlikely to have any positive effect and you'll just make everyone move slower. If avoiding vendor lock-in is something the org cares about and is doing properly, yeah sure, enforce it, otherwise I've seen many people fighting windmills on this and bikeshedding about "not getting locked-in" when effectively many other things already lock you into that vendor.
There's proof everywhere that this world is just an incredibly detailed simulation. Even if you inspect the tiniest grain of sand, the simulation is such high resolution that you simply can't tell it apart from a real world. Just goes to show how perfect the sim is. Praise the sim, blessed be its circuits.
A difference with chess is that chess engines try to play the best move, and GPT the most likely text.
It could always happen, of course, especially now that we're in a bear market.

Most of us techies, at some point in our career, have managed to automate some boring or tedious part of our job. We don't tend to get let go for doing this, it just frees us up to do other, possibly higher-value things. Or, if you are less lucky, your employer just comes up with other not-yet-automated tedious things for you to do to demonstrate toil.

Our days are all filled with a combination of useless, low-value tasks and useful, high-value tasks. I'm personally a believer of finding the low-value tasks and automating them, so that you can spend more of your time on the high-value ones. I've worked with people who have the opposite view: Spend your time visibly toiling on whatever is easiest, because most employers can't tell the difference between spinning your wheels being busy and providing actual value.
I disagree that out of all possible use cases for a large context model that a chatbot is really the "best use case".
How will they ever survive without you using the service for free...
I mean, I generally trust Mozilla + Mullvad a lot more than Spectrum. The only reason Spectrum wouldn't be selling or otherwise mishandling every bit of data about me they can is if they're too incompetent to realize they have the data. Mozilla has a good track record; they could always become compromised or make other mistakes, but Spectrum fucking sucks.
GitHub Container Registry is a decent option for orgs, open source and private. I believe it's free to host public images and private images are just tied into your GitHub billing.
They mention in the article that other than incidental material it may have seen in its general training data, they did not specifically train it for the tests.
Yep, metaverse was the stupidest idea ever. I said it at the time back in October/November 2021 when the stock was at its peak and then proceeded to interview realizing I was on a sinking ship. Sadly since I suck at interviews I could only get offers for much lower than what I had even after the collapsed share price.

"Year of Efficiency" immediately following "Year of Metaverse" succinctly captures how things went lol
That would be my response but without the /s. Of course, depending on the definition it can always be said to be "happening", but to me it feels like the angle of the curve is finally over 45 degrees.
What jobs?
If the credit reporting companies are all such sleazy incompetent dirtbags why is it still impossible to opt-out from most credit reporting data collection?
Schools are obsolete if they want to use these tools.

The world has changed and their job is to prepare students for it.
I think this is a clever way for OpenAI to trade access to GPT-4 and simultaneously decrease their own intellectual burden for their for-profit models. Here's the offending parts of the README.md:

"For a limited time, we will be granting GPT-4 access to those who contribute high quality evals. Please follow the instructions mentioned above and note that spam or low quality submissions will be ignored!"
Of course the solution is not portable. It works for me, though. Ever since I spent $50k on my gold-plated, custom-tuned 486dx in 1992 I haven't been able to justify an upgrade (many of the Pentium series chips produced terrible audio, even in the high-end market).
Just because lots of people do it, doesn't mean it has to continue to be done.

If you're growing so fast you're sending hundreds of emails in a short time span, then maybe you should replace a pseudo-personal ai-written "welcome email" for new hires with something that scales better and feels personal.
Perhaps the difficulty is that how deeds are handled right now already makes ownership transparent and easily verifiable, and not much more difficult to transfer ownership of (because transferring the "token" of ownership isn't where the friction is).

So those don't look like things that NFTs make better in this space.
This has been possible already...
Instead of one large prompt there's now 'system', 'user', and 'assistant' prompts which are meant to be given specific instructions each. So you could tell the system prompt that it's a librarian and ask the message prompt what date a book was published.
>Even if it just switched the mirror between reflecting and not, I think it would be cool.

This is basically how DLP projectors work
Let's say I sent up a key "foo" to get the value "bar", and I did this again and again. Will either "foo" or "bar" be encrypted to the same ciphertext again and again? Or is there some kind of nonce or salt or other mechanism that will make the ciphertext always different? Congrats on launching and thank you for any answer.
A "bailout" is a mitigation of consequences, generally supported by an injection of cash or a guarantee thereof. It can apply to any class of interests in an enterprise. "Shareholders were bailed", "bondholders were bailed out", "depositors were bailed" -- these are all possible sentences.

Shareholder bailouts are the worst but there are negative consequences to all cases.
Seriously.

Why is it that in a forum skewed libertarian techbros, there's this nigh-religious faith that corporations will not only get AI right, but get its impacts on society right? You know, with their stellar track record and all.

To me this is just another of countless demonstrations of silicon valley ego/hubris.
Its GRE verbal is only 169/170? These guys need to realize that statistical language modeling can only get us so far, and we need real research in the underlying mechanistic and symbolic methods to begin to approach human level cognition. Also I'm an AI skeptic, which means that I don't think that AI should be used in politics, law, or medicine.
I lived there for 10 years and worked startups, not FAANG. Place after place, all run by people I’d never trust. Shady, dishonest, near criminals. Was happy to leave. I feel like Stanford basically produces criminals.
What brand? Yes, they developed and popularized the container workflow, but what does Docker the company have to offer me? Container registry? I can get that at a number of providers who will do their best to offer an API compatible service.
> That's why BTC uses energy. It's a means of resistance to people with guns.

That logic makes about as much sense as using crypto currencies in general.
From the paper:

> Given both
the competitive landscape and the safety implications of large-scale models like GPT-4, this report
contains no further details about the architecture (including model size), hardware, training compute,
dataset construction, training method, or similar.

I'm curious whether they have continued to scale up model size/compute significantly or if they have managed to make significant innovations there.

I just skimmed the paper but seems they are also omitting details about how they actually feed the images in too, which is a shame as a curious outside observer.
> IMO effective guard rails seem like the most meaningful competitive advantage an AI company can offer.

Configurable guard rails are; the right guard rails are very use-specific, and generic guard rails will, for many real uses, be simultaneously too aggressive and too lenient.
> How are you going to create Docker images?

Once. On a build server. Or a dev's workstation who had the time to fiddle with all the breakage that is python envs. This absolutely does sidestep the issue of distributing Python packages to your users.

We're talking about different problems here. You are talking about library dependencies for devs (and I understand that I'm a bit off topic for this thread)
Curious since it does well on the LSAT, SAT, GRE Verbal.
This feels the same as a human attending cram school to get better results in tests. Should we abolish them?
Imagine ingesting the contents of the internet as though it's a perfect reflection of humanity, and then building that into a general purpose recommendation system. That's what this is

Is the content on the internet what we should be basing our systematic thinking around?

No, I think this is the lazy way to do it - by using commoncrawl you've enshrined the biases and values of the people who are commenting and providing text to the internet into the recommendation system which will be impacting all other systems which integrate it

Congratulations, you made 4Chan into the borg
Shutdown: Agora (YC S19)
That's exactly why I have a "teams" account on Docker, we had previously posted Images for an OSS project to the hub, but migrated to a different repository later on. We still push public images there, but, we tell everyone to use the new repo for upgrades/new installs. How frustrating.
Are we reading the same thing?

It pretty much sounds like they are doing what they said they are going to do? Expecting some sort of free API feels like entitlement to me. Have you tried running the models? Or training them? They get expensive very very fast. They charge a pretty reasonable amount all things considered. If they didn't have the name "Open" in them and or started as a subsidiary of one of the other 3 tech companies things would have gone a very very different route.
Although the technology occasionally produces incorrect information, I still find it to be a helpful learning tool. I break down the information into bullet points and cross-check it with other sources to differentiate between accurate and inaccurate information--I know this isn't infallible. One of the advantages of using this technology is that it often presents me with new and intriguing information, which I might not have found otherwise. This allows me to ask new questions and explore the subject matter more profoundly, resulting in a better understanding and an opportunity to create a mental model.
Tell that to the magnet link I clicked on
It is amazing how this crowd in HN reacts to AI news coming out of OpenAI compared to other competitors like Google or FB. Today there was another news about Google releasing their AI in GCP and mostly the comments were negative. The contrast is clearly visible and without any clear explanation for this difference I have to suspect that maybe something is being artificially done to boost one against the other.
Interesting take. Post title should be more precise, the article focuses on engineers’ roles.
AI will prove to be an excellent mechanism for extracting and retaining tacit (institutional) knowledge. (Think 'Outsourcing to AI')

A lot of institutional verbiage, formalisms, procedures, and machanisms are ~giberish for the general public but meaningful within the domain. Training machines that can informationally interact within that universe of semantics is powerful and something these machines will likely do quite well.

If you have domain knowledge, you should ramp up on your prompting skills. That way, there will be a business case for keeping you around.
> if you could have valued their government bonds at face value rather than market value, they had plenty of money

that is not technical definition of insolvency. if you can cover your debts but need time to do so, thats the definition of being illiquid, not insolvent.

my understanding of their books is that they could not cover their debts. the change in market conditions drove down their bond portfolio to the point of insolvency.
Then what is the issue if you know both the “fast-but-panicking” and “slow-but-Option-ing” versions?
"At least three of the California governor’s wine companies are held by SVB, and a bank president sits on the board of his wife’s charity."
I have actively tried to incorporate ChatGPT in my everyday life as a dev and architect. ChatGPT is mostly a Litmus test when it comes to coding. If you are impressed by the version before this you are most likely a beginner. ChatGPT is mostly wrong when it comes to any advanced qs in maths or software development. It often gives code that uses features, options, responses in APIs that simple does not exists. Would love to try this version out... It will probably suck too.
They're using specialized hardware to accelerate their development feedback loop. Without a doubt researchers and hackers will find ways to cut down model sizes and complexity, to run on consumer hardware, soon enough. Just use stable diffusion as an example: 4GB for the whole model. Even if text models are 16GB that'd be great.
Start with this guy and then go as deep as you want with various textbooks.

https://youtube.com/@ControlLectures
My experience is that MySQL scales as high as you need it when coupled with Vitess, because most data schemas can be sharded, and you can scale each shard vertically enough for all the workloads I've seen.
Scrcpy was a tool that I used everyday during my android dev years!

Really cool to see audio integrated into scrcpy without having to use sndcpy - https://github.com/rom1v/sndcpy
Which companies would use this and why? Data worth making private is also worth some $$ to the business hosting it.
Werner Herzog recipe websites
You could indeed argue that. I think there's a difference between the product and the revenue. Google still feels like they produce a number of technical products, even if their revenue is mostly driven by ads. GCP, Android, and Chrome would be examples.
Peak denialism? Answering LSAT questions requires general intelligence. They present real life scenarios that test-taker has to understand. It requires "common sense" knowledge about the world and reasoning ability. It's not something you can memorize answers to or solve by following prescribed patterns or templates. And GPT-4 wasn't trained specifically to solve LSAT questions.
How else would you pay?
I honestly think answers like this one are the reason more software aren't open-sourced
Of course 99.9% of humans also struggle with competitive programming. It seems to be an overly high bar for AGI if it has to compete with experts from every single field.

That said, GPT has no model of the world. It has no concept of how true the text it is generating is. Its going to be hard for me to think of that as AGI.
Show HN: Service Builder – Build data access layer with SQL and JSON only
Hi NH,

I have just published a milestone version of Service Builder in VS Code Marketplace. It is a tool for creating query, command and repository services in a few streamlined steps.

For exampe, to create a query service, you would simply
- specify the input and output of the service with plain JSON
- write a plain SQL query to return the data set for populating the output,
- click a button to generate the input and output bindings (data mappings) as JSON, and then
- click another button to add a test to test the service you have just comleted.
The service engine takes care of the object-relational transformation. You have the flexibility to go as complex as you need (really?) on the output.

Give a try and let us know how far you go. BTW, just for the purpose of grilling the query engine, you can write a simple query but a complex output to test it out.

It also helps me and probablly to everybody else, if you could share the most complex objects that you have done with ORM or raw SQL in your current or past projects.

Thanks.

Ken
Not sure I understand. WalletA has $300m BUSD and WalletB has $420m BTC. Both wallets are 'owned' by Binance. This is lower than the $1b funding on Jan 29th, 2022, but it is still a significant amount of "real" (if you believe crypto has value) funds. This is just an insurance fund that we are talking about here.

I think you're referring to the rest of Binance proof-of-reserves, which are here. Note, I fully realize this isn't perfect.

https://www.binance.com/en/proof-of-reserves

There is also some interesting compliance stuff going on in Ceffu.

https://www.binance.com/en/blog/ecosystem/ceffu-formerly-bin...

https://www.ceffu.com/blog/ceffus-core-solution-achieves-soc...

https://www.ceffu.com/blog/ceffu-obtains-cold-storage-insura...
Turns off 1% of potential users, attracts 10%. Net win.
Yes, what crypto doesn't have that fiat has is the government bailing them out when you convinced them that you are not system relevant and gamble to a point of failure just to then be considered system relevant. /s
System message is available today (and has been) in the playground under the chat setting.
They charge that amount (on loss) to create a trench that will not allow a truly open model to proliferate, as happened with Dall-E and stable diffusion.

And no, I would not train or run the models, even if they released them. This does not mean I cannot point out the hypocrisy.
at least they admit the competitive landscape is a factor rather than going 100% with "it's for safety reasons". I'm sure somebody will release an equivalent soon, the way open source has completely surpassed OpenAI when they try to keep things closed like DALLE vs Stable Diffusion shows that OpenAI really isn't that special, they just have a sweetheart deal with Microsoft
“GPT-4 can also be confidently wrong in its predictions, not taking care to double-check work when it’s likely to make a mistake. Interestingly, the base pre-trained model is highly calibrated (its predicted confidence in an answer generally matches the probability of being correct). However, through our current post-training process, the calibration is reduced.”

Interesting that the post-training has that effect.
As a Duolingo user who has refused to upgrade, if they roll the two into one it might entice me, but not for another higher tier above what they've got. But I guess there's a subset of super-users who may be keen.
+1 But I found that it is also the most fun to understand. Even better - when you actually implement them from ground up (I did this in typescript literally by going through about 30-40 papers - it is public but am a bit scared to publicize them) the satisfaction is immense. You almost forget you have to go back to a dreadful day job the next day for a tiny second! And that second my friend can feel like an entire universe!
That sounds like the "skill assessment" rather than a certification. I think the former is just a small LinkedIn quiz, and the latter comes from some sort of integration with the cert issuer.