skysight-inc/HackerNews huggingface dataset:
Job listing based metrics are much better, though still not perfect.
I've spent an embarassing amount of time since the llamas leaked playing with them, the tools to run them, and writing wrappers for them. They are technically alternatives in the sense that they're incomparably better chat bots than anything in the past. But at least for the 30B and under versions (65B is too big for me to run), no matter what fine tuning is done (alpaca, gpt4all, vicuna, etc), the llamas themselves are incomparably worse at doing useful tasks than openai's gpt3.5 models like text-davinci-003, or even the gimped gpt3.5-turbo.

I wish it wasn't so, but the llamas are toys. Amazing toys, but toys. What openai is getting out of gpt3.5 (and presumbably 4, though I have no access) are actually useful responses for getting work done.
To a certain extent both approaches are viral. If your library uses the one big enum approach you'll want to add a DepFoo variant, and if you want to expose granular errors you'll need that info from your deps.

I increasingly think the best of both worlds is either extreme, but never the middle ground. Either you actually need very granular errors or you should just use anyhow/eyre and have opaque errors with good human readable descriptions. The middle ground still takes a lot of work, but doesn't seem to give correspondingly better results
Do these scale as well as transformers? My understanding is that classic RNNs don't scale well, and that is one reason why transformers became popular.

As a pleb who doesn't even own a data center, I've been hoping that a superior machine learning architecture will be discovered that doesn't scale well. We would be fortunate if our personal computers end up being half as good as Microsoft's or Amazon's best models; fortunate if the best architecture gains little from an additional 10,000 GPUs. This would help spread the benefits of AI evenly among anyone with a phone or computer -- a utopia compared to the other possibility, that everyone can learn how to build AI, but only those with a few hundred million to throw at a data center can actually control the means of production -- err, I mean, the means of intelligence.

Philosophically, this wouldn't be unlike people. Humans are still the greatest intelligence we're aware of, and humans don't scale. I'm hoping computer intelligence ends up not scaling well either.
> It boggles the mind how anyone could suggest with a straight face that your personal usecases should be automated away even though it screws over everyone else using it.

Should the orgs that have exposed private data in S3 to the public internet have been using AWS Config and AWS CloudTrail and properly scoped IAM roles and eaten their broccoli and flossed their teeth every night? Yes, they should have. But they did not.

These problems continue to happen, even as AWS adds even more warning boxes that say "Do you really want to open this bucket/object to the public internet? Type 'SHOOT ME' to continue..."

In the grand scheme of things, I imagine that those data exfiltrations from corporate and government customers is a larger net negative for S3 than the positive of the fact that I can wire up my JAM stack static site to an S3 bucket and pay $0.0001 per month to host it on the public internet (rather than paying $0.0002 per month for S3 + CloudFront or S3 + Lambda).

In any case, I'm not the AWS general manager of S3, so there's no need to worry about my comments on this website affecting anyone's use of S3 :)
Their consultants are probably utilizing ChatGPT now to 10x their buzzword bingo outputs
While there are times where government needs to step in and force things, I'm cautious about presuming it.

Workers in the US are free to get together and argue (without a union) for a group or general pay increase. Workers can as a group walk off the job. Workers are free to quit at any time.

Voting with your feet is the most democratic thing we have.

And employers can ignore workers or fire them. If the company ignores too much or fires too many, then the company will suffer.

IME, that works much better than using the law to privilege either side.
As far as I can tell, you can claim credit for the output of a tool which produces something at your direction. If you write an algorithm to generate patents, and you execute that algorithm and submit its output to USPTO under your own name, no problem. If you gave credit to the algorithm, their policy is to deny the claim.
There is no need for 'decoupling'. In fact, Macron and the EU (through Von Der Layen) have just rejected that stance during their trip to China.

This is actually what this is about: 'decoupling' is an American stance aimed at helping American interests. And so 'sovereignty from America' is indeed rejecting that stance if it does not fit your own interests.

More broadly, with China and Ukraine, those being the most salient issues, the US have pushed their interests at the expense of Europe. Macron is sending a very unsubtle hint that they can follow so far (and don't get him started on the little Australian subs issue...)
Any type of additional explanation that isn't strictly necessary is currently painful on the GPT-4 plan.
Lots of words to just say "Enter then ~."
Books are a marketing solution in search of a problem. Watch a movie.

…convincing, isn’t it?
Well, I have. It still certainly goes the way you're describing often as well, to the point I was flabbergasted when it happened, but it did. Specifically I asked it to give me examples of using an NPM module published after the knowledge cutoff.

[To be clear, I did not tell it it was from after the cutoff]
I guess the question is how much R&D is actually involved in building schooners modelled on a 1907 design which was itself modelled on hundreds of years of what worked well in long-distance voyages under sail?

It's a great plaything though!

(Sent from my narrowboat)
Ex accenture here, left and started my own. M u c h better and my clients love that I am not from a big shop. Money is good and life is smiling.
I think people haven't really wrestled with why Java checked exceptions were so bad. IMO the big problem was a lack of expressiveness. As a simple example, you should be able to write "map" in a way that says "this might throw whatever its argument throws" rather than saying "this can't throw anything" or "this might throw anything" if you want something reasonably generic.
Based on what I understand of the rating methodology, though, I'm still very surprised that Ada beats TypeScript. My understanding is that it's basically a measure of search results, and I would expect TypeScript to have vastly more of those than Ada, given that most Ada applications aren't going to be publicly discussed.

I suspect that it has to do with names—Ada is highly overloaded in ways that are adjacent to programming (ADA, Ada Lovelace) and is a short enough word that Google may ignore it. A naive search for `ada programming` turns up 896 million results, compared to 28 million for `typescript programming`
Yes, but what is the alternative? In order to be combat effective in the Pacific theater, NGAD will need to have a long unrefueled operating range (roughly F-111 size), super cruise, broadband stealth, large AESA radar, numerous other sensors, advanced EW, and an internal magazine large enough to accommodate weapons with greater range than the AIM-120. Those capabilities are all terribly expensive. But what's the point of building a lesser aircraft? Anything less capable won't even be survivable enough to make it to from US air bases to the first island chain.

The dilletantes on here always claim that manned tactical aircraft are obsolete and should be replaced by swarms of cheap drones. But it's impossible to build a cheap drone with the range, sensors, and payload necessary to be effective in that environment. Look at the unit cost of something like an MQ-4C or MQ-25A. Remote piloting isn't going to viable in a hostile EW environment, and current AI software is incapable of handling highly dynamic situations. I do expect though that at least some NGAD variants will be designed as optionally manned so that they can be employed as drones against heavily defended fixed targets.
Of course that would be silly. Who is claiming that?
> 'decoupling' is an American stance targeted at helping American interests

Nobody is advocating decoupling right now, just being mindful of decoupling risk.

If Xi invades Taiwan tomorrow, Washington deploys the Russia playbook. The parts of the French economy that depend on China would overnight have to deal with sanctions compliance, payment risk, write downs and freezes. Having your ally’s economy go depression at the outset of conflict isn’t helpful.

> the US have pushed their interests at the expense of Europe

Europe pushed for tougher actions on Russian oil and gas than Biden wanted. Reality is more complicated than a one liner.
> Llama was not initially open-sourced, but a week after its release, the model was leaked on 4chan, sparking thousands of downloads.

The author very clearly does not know what Open source is. Proprietary code that’s been leaked isn’t open source, and code that is derived from proprietary code is still proprietary.

Windows had it source code leaked, that doesn’t make it open source.

So did the game Portal. Not open source either.

Something being leaked does not change the license.
Part of the grift is that roughly one of ten of these unproven low-paid MBAs will be exceptional. So when one does a good job they'll use it as an example of typical performance. I see this happen with dev talent agencies and unproven software engineers. Only the great projects go in their portfolio and the satisfied clients are happy to appear on their website because they don't realize they just got lucky.

With software engineers some of the remaining 90% really are talented but spend most of the project learning on the job, fixing an issue in a few hours that a senior engineer in their stack could fix in 30 minutes with their arcane knowledge. Meanwhile the senior engineer goes to the scrums (they love to hide behind agile). It's a solid grift.
Kinda related, but a flatcar was historically a kind of railcar you could mount shipping containers, chassis and large +100 short ton loads onto.

These days we call them intermodal frames or an intermodal chassis. It can go from rail to cargo ship to truck to plane, and its all highly standardized and scalable :) CSX even uses them to test their robotic conductor/ automated locomotive technology
Thank you for sharing this! It is helpful in explaining things easier
Sure, given they can compete commercially against containerships. The baseline would be like launching a new containership which is just as good, except it has a couple of thousand crew instead of a dozen.

Uphill battle...
Yeah I think something somewhere is saying 'damn, that's a suspect User Agent, must be a bot'.. like really?
Very good blog post.
Only because publicly visible actions are worse for them

People have gotten DMCA takedown requests from them over Llama repositories
You can disable this by running Chrome with —-disable-web-security. If you only need this to access local files, you can do —-allow-file-access-from-files
The problem is, that despite JSON's clear and numerous flaws, people still overwhelmingly prefer it to XML. XML is that unpleasant.
Tokamak cannot be spherical since To stand for Toroidal.

How about Sphekamak?
My only experience with a slide rule is a Hughes-Owens Versatrig, which is made from some bamboo-like material.

Knowing that metal slide rules were widely used makes me think that IKEA might come up with this “revolutionary” kitchen gadget in the next decade or two.
I'm familiar with liquid mirror telescopes, but I was responding to some theorizing about using an inflated film. Without gravity, the film would produce a sphere; suspended in gravity, it would produce a catenary.
green username = new account
I agree that the US are powerful enough to bully everyone else. Up to a point.
I think the ideas is that the LLM cannot think internally. It’s output is its thinking process. Especially with an auto regressive architecture like GPT, where each output token becomes part of the input.

I imagine it like handing the LLM a piece of scratch paper.
We can't even track nuclear programs all that accurately and those create a radiological and isotope signature that can often be detected from space. We couldn't even stop a relatively small nation like North Korea from developing and testing nukes.

This proposal is just so clearly unenforceable and infeasible. Attempts to pause scientific progress have never worked in the past. How would it ever work now, especially when the cryptobros around the world have already been amassing hidden GPU clusters for mining.
Okay, this is fair.
Your conclusion seems not to be warranted since you haven't tried out the 65B model.
Is there such a tool for use with python? preferably matplotlib compatible. I often find myself needing to plot some data to get a quick idea of what it looks like, and my work is generally on a remote host. Having to open a new ssh session with X forwarding is not difficult but a more frictionless approach would be nice.
With hope and living?
It is a dream come true for people.
An abstract perception of a knowledge, is like sniffing a rose.
It feels, yes, I get there.
This 40.000 pages book, woow, I'll make time to live it or sniff another daisy?!
Transliteration means taking the symbols of one readable language and converting them to another set of symbols. Like 'Владимир Ильич Ульянов' in Russian Cyrillic becoming 'Vladimir Ilyich Ulyanov' in English Latin script.

I think what you meant was 'literal translation'. Sorry if this seems like a nitpick but these terms mean completely different things.
Ofc, you should be punished for both. The number of crimes and the amount stolen in each. Just add everything up and come to some nice number. Like with 50000 homes something like 50000-150000 months and then 50000 days as 1 day per 100$. And for Van Gogh the 1-3 month and then price divided by 100$ for extra days.
Could this be an intentional decision?

Or maybe the cost to test on alternative browsers and operating systems is greater than the revenue lost by not properly supporting Firefox & Linux?
> The auditor has a responsibility to plan and perform the audit to obtain reasonable assurance about whether the financial statements are free of material misstatement, whether caused by error or fraud.1 Because of the nature of audit evidence and the characteristics of fraud, the auditor is able to obtain reasonable, but not absolute, assurance that material misstatements are detected.2

https://pcaobus.org/oversight/standards/auditing-standards/d...
so at what point does your in person interview become the problem?

what is the line for you when the day to day doesn't involve unassisted time trials, but instead requires code reviews of assisted work and code reviews of colleagues work
>it's no more a god given right that it's an incited mob's right to burn down the fab or datacenter that someone else "own"s

If you change societies current outlook on morality and law then yes you are right. But currently society has laws in place that define burning down a data center as wrong. Those laws do not differentiate between whether it was done by an individual or a mob. These laws are also agreed upon by most people. You can make up your own personal morality, but good discussion should be founded on a shared reality and the status quo majority interpretation of it.

>property rights in liberal democracies will not survive a starving middle class

And this is the paradox I am referring to right? Our current interpretation of morality is at odds with practicality.
I'm one that believes that super intelligence is not likely to happen any time soon. It's not likely to happen within any ones lifespan that's living now. But I do believe the current crop of AI will lead to some very scary weapons that will help us kill each other even better. The real harm is giving our monkey brains more powerful weapons. Harm mitigation is well within out reach and it will be for many years to come. Banning or voluntarily stopping it in one country will only fire up other countries to continue the development. We all know that AI brings with it both economic and military advantages. It may be wrong but no country wants to lose the AI race.
I’ve got access to 4 and it’s a huge leap up from 3.5 - much more subtlety in the response, less hallucinations, less hitting a brick wall, but all of it adding up to a giant leap.
Probably. I've been through this process of worrying about the future, specifically about climate change. I now think that climate change is something that, although it's going to be painful, humanity is going to get through OK. We're making progress. But even when I was in a good bit of despair about the problem, I learned from climate change activists that you have to keep putting one foot in front of the other and do what little bit you can. Even if it's just confiding in others that you're worried about the problem - that has a bigger impact than you might think. And of course it can help you feel better to share the burden.

Imagine if 6 of your 10 best friends are all worried about AI risk, but they don't ever talk about it. You'd think that nobody was worried about it, and you were the odd one out. If one breaks the silence, they set an example, making it easier for others to talk about it. And if all of the sudden all of your friends are talking about this, you are more likely to share the concern, even if you didn't before. The more people talk about it to everyone they can, the more it breaks into the mainstream as an issue. Yudkowsky (who of course has more reach than most people) wrote that open letter published in Time, and a Fox News reporter asked about it in a press conference. Let's keep people talking about it. I've talked about AI risk with my spouse, family members, and a lot of my co-workers, and any time I see a good chance to bring it up on Hacker News or Reddit, I do.

The issue needs to filter out of nerd-circles into the mainstream, so talking about it with family is great. Calling and emailing politicians is a good bit of a higher bar, but it's effective as well.
Here is a proof of Pythagoras using a geometric series:

https://www.cut-the-knot.org/pythagoras/Proof100.shtml

The proof is by John Arioni and also features an infinite number of similar triangles.
You are misreading intent. When she is able to productively use computers as computational tools, she can have one. There has to be a positive to balance the negative.
If they were interested in limiting distribution, saying essentially "go ahead and seed this torrent more" is worse for them than doing nothing.
I find that our entire industry is encouraging and rewarding type-3 behavior. While tech is definitely a requirement in any business, the tech should always be directed at helping accomplish the business' real goals which is ultimately to make money. Any tech that is above that or deviates from that goal is superfluous and a waste of money/resources/time/brainpower.

The issue I find is that the last decade of free VC money and "growth & engagement" means that there were a lot of companies that were given free money regardless of their profitability or even basic sanity-check of the proposed business models, instead rewarding them based on hype or some unspecified potential to turn some vague idea of "growth" into profit (hint: if your "growth" is based on giving away free stuff, those users will leave as soon as you attempt to monetize them), or "engagement" (engagement is a very uncertain thing to monetize in a world already saturated with advertising).

As a result this has funded entire careers based on what is effectively mental masturbation as opposed to actual tangible improvements in the software's ability to drive actual business value (in many cases it is negative value if you account for the salaries spent on it), only made possible because the free money sidestepped normal market dynamics that would usually encourage businesses to reduce overheads and focus their efforts on profit-generating operations (or go out of business).

My personal experience with technology is that the collective effort spent over the last decade over things that are considered "modern" didn't actually improve the customer experience in the vast majority of cases. Ordering food for example is still ultimately browsing a list of items and submitting a form of what you want, yet nowadays despite orders of magnitude greater bandwidth and processing power, I had to sit through seconds of stuttering while megabytes of JS load, execute and make dozens of subsequent requests to get data that the backend could've embedded in the initial server-side-rendered HTML. Same with Microsoft boasting about how their new Teams taking only 9s to load while Skype from 2009 delivering the same functionality faster on much more constrained hardware.
I don't think it's about being fair or unfair... I just think it's the only pedal the Fed has. And the Fed is the only body that is able to make actions right now.

Taxes would be a great vehicle for this, because they would probably do a much better job of filling the fed's dual-mandate. But because the fed can't raise taxes, and congress can't do literally anything, we're stuck with the response that we have where a non-elected body is leaning on the only lever it has to run our economy.
For those unfamiliar with Haxe, imagine Actionscript, but without tying it to Flash Player.
Isn't Eufloria just a GalCon clone? There are a bunch of games like that, albeit without the plant theme.
Are you sure this isn’t because you have more talent/competence for programming than writing? Or that you haven’t set the bars differently?

Writing is a daunting task for me, but that has more to do with my own talents and experience than anything. Not implying anything about yours, just something to consider.
Does outsourcing major strategic initiatives even work? Seems like the definition of the sort of things you shouldn't outsource
Somewhat related: WizzAir adds £10-£20 "system surcharge" if you're buying tickets from Firefox and Linux. Or use ad blocker.
Not at all. It is very common for businesses to buy up domains like this and redirect them to themselves so other people can't use them.
It’s not open source. Llama is proprietary, the license hasn’t changed. Just like the source code to windows leaking doesn’t make windows open source.
The big difference is that the transformer is (approximately) permutation equivariant, which makes a massive difference in generalization and training speed.
We should be imagining the long-term health implications. We should be considering the costs of these things. If you don't want to think about it, you don't have to, just stay out of comment threads about it.

If you want some reading material about solutions though, there's a lot of stuff out there about reducing car reliance. Building proper public transport infrastructure, building walkable and bikeable cities, that sort of stuff. Keeping the advantages of easy and efficient transportation, while alleviating some of the disadvantages. I can suggest some if you want?
Tesla is opening a Megafactory in China
They are not data.tables and sometimes I prefer working with data.tables.
Believe it or not, there are REST APIs and frontend frameworks for almost every programming language under the sun. And I mean EVERY. Example: this Prolog works in your browser https://github.com/SWI-Prolog/swish, and this is the corresponding package to do the API https://www.swi-prolog.org/pldoc/man?section=http-running-se...

But I can agree Rust has better marketing than Prolog.