skysight-inc/HackerNews huggingface dataset:
Yes, that makes sense. But do you think Reddit would actually do that? Apollo has a better UX. Reddit has proven they don’t want to build a good UX. If they bought Apollo they would only ruin it.
I mean have you seen the whole "encode a poem in made up emoji" followed by "decode the poem from emoji" stuff? I think it's not unreasonable to think with the right prompts LLMs could do this.
The one sure way to make a point, simply move to another platform. Let them die with their "passing".
sorry, thirty years ago I could have subscribed to "and keep retiring doctors happy" but now, no way Jose
Skilled or not, the government modus operandi is not designed to facilitate nuanced, bespoke, individualized responses to people and problems.

If you think it's frustrating dealing with Google/YouTube arbitrarily and capriciously and erroneously and mercilessly shutting down your account and providing zero explanation and zero accountability and zero helpful customer service...

Now imagine that for crucial government services. If there is a flag or datapoint in your government data, then that's that. Too bad. Can't help you. That's what the computer is telling me.

This happens on a daily basis right now, for any number of human or computer errors.

Now insert a hallucinating ML model that only a subset of the population truly know how to use in small doses for productivity, and expect the GOVERNMENT to utilize it in a non-erroneous way?
hey sorry about that, I just checked and apparently for unknown reasons codepipeline just pushed a commit to prod that wasn't supposed to go out! site broken atm sigh, please check back in ~hour or so and apologies! working on a big change and unsure how it went through.

edit: apparently AWS us-east-1 is down which brought the site down! (https://news.ycombinator.com/item?id=36315300)
i don't see the parent comment as suggesting that pointing out the lack of support in our society is a bad thing. personally i think pointing out how the social net is failing is exactly what we need. if that is really the effect that his videos have then that is good.
Our RDS instances seem to be fine (can connect, run queries, ...). The console is borked though.
ModCoord Response: (Suggestion for indefinite blackout)
https://www.reddit.com/r/ModCoord/comments/148ks6u/indefinit...

Some subs have moved from a limited time blackout to indefinite (r/Chicago and r/ChicagoMeetup have gone this route)
That seems weird though, right? Cause in the US teachers, especially for early-childhood, have been predominantly female since before this gap.
There's a single medium.com grifter claiming 100 trillion with nothing to back it up. 1 trillion for the unavailable instruct model and considerably less for the chat model is most likely.
I agree, although there is always some minority that will know things at that level. If you think your job (or if your current job) will involve optimizing ML libraries or a large ML project that's over budget, or under performing, having an idea what's being performed under the API can give you a quick insight into what can be changed.
Well, to be fair, doctors sold themselves out. In New Jersey and New York City, I have to explicitly state that I only want to meet with an MD and not an assistant physician or nurse practitioner. As to how this is even legal is probably explained by insurance company lobbying efforts for cost control.
Selig acquihire to head of iOS/mobile dev could have been a good move.
A (now 6 year old) discussion that might be helpful: Anders Hejlsberg on Modern Compiler Construction: https://www.youtube.com/watch?v=wSdV1M7n4gQ

Also https://github.com/salsa-rs/salsa
Looks like it is a problem with lambdas.
>a justifiable reason for the price discrepancy between the RTX 4090 and the A100

1. they're a publicly listed company operating in a free market in an industry they themselves helped develop who's purpose is to make returns for their investors, not be liked by the public, they don't need to justify their pricing to their buyers. They're not selling essentials for survival like insulin, baby formula, or housing, they can charge as much as the market will bear for their consumer electronics products. Don't like the pricing? Don't buy it. Simple. Buy from the competition instead or older generations off the second hand market that fit your budget.

2. the price justification is that cutting edge silicon is and will always be in short supply, and buyers of the silicon in A100 form, like datacenters, use it to make money, therefore it's an investment that will yield returns, therefore they can justify spending way more money to outbid the gamers who buy the same silicon in RTX 4090 form and don't use it to make money but use it to play games therefore for them the product is worth less and it makes Nvidia smaller margins than what selling it to datacenters can. It's basic price segmentation that's been going on for decades.

I also don't like the GPU pricing situation but that's the market reality I can't change and downvoting the messenger won't change it either. My 2 cents.
no one is manually searching through petabytes of data. it's all ingested into ML systems which spit out inferences and predictions about individuals. repeat with enough people, combine datasets, now you're generating increasingly accurate predictions about society at large. less privacy = more data = better training = more accurate predictions.
I wasn't aware of this editor, looks quite nice, might be the opensource Sublime Text alternative that I was looking for, thanks for sharing!
I think you're kind of missing the point I'm trying to make. There's no point in someone who can define a term for broader trends if they cannot balance a personal budget. The capacity to define a broader trend can inform budgets, but I wouldn't date someone who is shocked when they have no money left for food because they spent it all on a shoe sale. I wouldn't consider that person a functional adult even if they happened to be thin and understood nuances between cost of living statistical measurements.
> Finishing requires courage

Oh man, I feel this. I’ve been doing a lot of furniture refinishing lately as a hobby. One piece is 90% done and another is 80% done. I was working on the 90% done one today, and was planning to lacquer it today so I can put the hardware on tomorrow and be done… but instead I found a few places where I should really touch up the paint. That pushes back completing it at least one more day as the lacquer needs to sit for a day and… I just need to “ship” the darn thing. I realized it’ll probably never be 100% perfect, and that’s okay - done is better than perfect, as they say. Having the courage to create something that isn’t perfect is a skill.
def broken for us
You're missing the point though, which is that that LLM was already trained on trillions of examples of human languages. Once it already knows many languages, inventing one more isn't hard. (Though I don't think it's actually "invented" this language to any great depth.)

Let's see it invent language from scratch without being presented any examples of languages to use as training data. That's what humanity did. Can LLMs do it? I doubt it, not yet.
On Chomsky, here is a recording of some audio from Chomsky where he uses a rhetorical argument for why language may be innate to humans rather than (fully) learned. From 1992. Just 5 minutes.

https://youtu.be/CPgDALpS-7k

Let's make sure what the computer scientists understand Chomsky to have stated is actually aligned. Chomsky didn't say the ONLY way to create language is via the brain. His view, instead, is that evolution programmed language development into the brain -- that it is not learned (entirely) by peer osmosis. That the brain has some structure for language, built-in, which is the unlocked in various ways via socialization.

Summary of Chomsky's view, paraphrased:

"It is a strange intuition [that most other people have]. Above the neck, we insist everything [in human development] comes from experience. Below the neck, we're willing to accept the idea that [...] it comes from inside. [...] But: it is hard to look at the Sun setting and say, it's not 'setting', the Earth is actually turning. Similarly, with people, it's hard for us to look at them and not see them as minds inside bodies. This leads us to this false approach: below the neck, we are willing to pursue the sciences, and if that leads us to believe development is internally programmed, we'll accept it. But above the neck, we'll be completely irrational; we're going to insist on beliefs and explanations we'd never normally dream of in other rational areas."

---

This YouTube clip came to mind, but here is a more detailed explainer from Stanford Encyclopedia of Philosophy:

"Clearly, there is something very special about the brains of human beings that enables them to master a natural language — a feat usually more or less completed by age 8 or so. ... This article introduces the idea, most closely associated with the work of the MIT linguist Noam Chomsky, that what is special about human brains is that they contain a specialized ‘language organ,’ an innate mental ‘module’ or ‘faculty,’ that is dedicated to the task of mastering a language.

On Chomsky's view, the language faculty contains innate knowledge of various linguistic rules, constraints and principles; this innate knowledge constitutes the ‘initial state’ of the language faculty. In interaction with one's experiences of language during childhood — that is, with one's exposure to what Chomsky calls the ‘primary linguistic data’ or ‘pld’ — it gives rise to a new body of linguistic knowledge, namely, knowledge of a specific language (like Chinese or English). This ‘attained’ or ‘final’ state of the language faculty constitutes one's ‘linguistic competence’ and includes knowledge of the grammar of one's language. This knowledge, according to Chomsky, is essential to our ability to speak and understand a language (although, of course, it is not sufficient for this ability: much additional knowledge is brought to bear in ‘linguistic performance,’ that is, actual language use)."

source: https://plato.stanford.edu/entries/innateness-language/
I used to like The Onion before they got super preachy...
Keep this as a secret! You are over-scientific and over-intellegent against humanities folks gethered here!
I think most European countries have swim lessons in Physical Education classes. At least Portugal does, I had it every year in middle school.
ya, we're also seeing lambda failing across the board
> The article doesn't directly state "new" anywhere in regards to loans.

Yes it does. It literally says:

> are raising huge amounts of money

Not "previously raised" but "are raising". That's necessarily "new".
issues with STS and IAM galore #thisIsFine
Also, dogs and cats, and even our close relatives, primates, don't develop a capacity to language.
> This is such an incredible steal, especially when you consider that no open source option comes close to GPT3.5.

Orca comes close or is better.

Good explainer here:
https://www.youtube.com/watch?v=Dt_UNg7Mchg
Tips for Building SSR/HDA Applications
Yeah because all the other things are innate; visual/spatial awareness, touch, smell, vocalization…

Humanoids went millions of years literally learning to navigate 3D space and sense “enough heat, food, water” etc

Nomadic tribes had built shared resource depots millennia before language.

I can see the color gradients of the trees and feel muscles relax without words.

Human language beyond some utilitarian labels just instills mind viruses that bloom into delusions of grandeur.

90% of human communication is unspoken. Neuroscience shows our brains sync behavior patterns with touch and just being in a room.

Reality is full of unseen state change every moment that we have no colloquial language for; human language is hardly the source of truth and the “North star” of human society in reality.
> On the contrary. The ocean in Iceland have a surprisingly even temperature.

Sure, it holds steady at a frigid and deadly 5-11 C, depending on the season!

https://www.seatemperature.org/europe/iceland/reykjavk.htm

> In addition to that, its not like you can control when you might fall in water.

No doubt, but there are lots of dangers that are outside your control, and many preventative skills are not compulsory. My question is why swimming in particular is considered a required skill to have, as opposed to other survival-related skills like, say, orienteering, first aid, bushcraft, krav maga, improvised appendectomies, etc. Is this because swimming is so common? Are there an unusual number of people falling into the ocean, compared to other countries with oceans?

> Thats extremely hyperbolic, the avg temperature in december in Reykavik is -1.2 celsius.

That was meant to be an exaggeration; a joke. Being wet in below freezing temperatures is certainly dangerous to your health, though you'd have a way to warm up in most cases.
>> One immediate internal benefit would be the information retrieval bit - you kind of get rid of the "data" barrier, which involves knowledge in databases/SQL etc.

In that case, I would recommend a search engine (i.e. Lucene, Elastic, Solr, or other) that holds the agency's 'knowledge' before I'd try feeding all of that into an AI such as GPT-4. Granted there are a lot of ML tools that can be statistically rigorous but GPT-4 is generative and therefore not providing access to original source material, which is troubling to reconcile with its potential use in any organization that needs to establish and maintain a ground truth.
It appears to be an outage in IAM which is trickling down to every service which relies on IAM auth.
> Or, they are a self-aware trolley that eats run-over people after choosing to switch tracks to where a bunch of people are tied down.

This is pure poetry.
Nobody is (or should be) above the law.

I agree. I was just pointing out that AFAIK this would be the first time a former president in the US has actually served time for their crimes. He surrendered today [1] so I guess we will see what comes of it.

[Update] He has been released without bond. [2]

[1] - https://news.ycombinator.com/item?id=36315011

[2] - https://apnews.com/article/trump-classified-documents-court-...
MacBook Air 15-inch Apple shares secrets behind design
Agreed in genera but the volatile edit history of many Wikipedia articles would bely your definition of constant.

Also scientific articles being constant don't quite matter when the "status quo" of science is asymmetrically understood.

There are doctors today still pushing the "fat is unhealthy" myth because of the sugar industry. Despite the ubiquity of modern unbiased research papers and proof.

But when you ask a doctor for advice, you're essentially getting the wetware equivalent of a stochastic parrot, because this random doctor is giving you dynamic answers coming from his/her own completely non-standardized corpus of knowledge.
> No, they say to use AZ's

Using 3 AZs in us-east-1 won't save you.

I guess a demanding customer would have said 'you should have implemented disaster recovery so you could failover to us-east-2' but that's easier said than done. The more regional AWS services you adopt, the bigger the impact is. How does one recover from a regional outage if their pipeline is in that region?
You could use a Markov chain to generate poetry with rhyme and meter[1]. Granted, it wouldn't be a very good one, but that just makes an LLM a refinement to older probabilistic methods.

As for something LLMs are unlikely to do under any circumstances, there's already a fairly obvious example. They can't keep a secret, hence prompt injections.

[1] https://us.pycon.org/2020/schedule/presentation/112/
I don't see how this proves anything. This isn't how human languages came about, there's a lot of conlang content online, and this doesn't describe a complete language anyway.
Netlify is down as well. https://www.netlifystatus.com
Sounds like GCP will soon get rid of its Twitter feature.
yep can't even get into console to diagnose / troubleshoot / fix
https://health.aws.amazon.com/health/status reports:

Increased Error Rates and Latencies
Jun 13 12:08 PM PDT We are investigating increased error rates and latencies in the US-EAST-1 Region.

They list Lambda as the only affected service
Most storage is short term, so the same battery can be re-used again and again by charging and discharging it, e.g. 365 solar peaks a year in sunny countries. Longer term storage would lock up the battery for longer, which given the cost of batteries, wouldn't make financial sense.
Online Pitch Pipe
I have read both of these but I did not notice any in-context examples, meaning prompts fed to the model showing it how to call a function and response to a user query, rather than docstrings telling it how to call a function.
> And despite that big fat check of $30 or whatever you see, Gamestop has lost money last quarter and severely declined in revenue.

But you see that's my point. In my opinion, pushing away their core audience through such crappy buy-ask spreads they've accelerated their own demise. They treated it as their cash cow for a while and kept jacking up their spread, and now most people just don't care about trading games anymore. From my perspective there's almost zero benefit to trading in the physical game or buying used since the discount isn't much at all, might as well just buy it direct from the digital marketplace.

I know for me, they'd have made significantly more off my friends and me the past several years if their bid-ask spread hadn't driven us away from the store seeing them as a greedy store. A few dozen used trades each versus literally $0 as there's no point in shopping there versus Target or Walmart or the digital marketplace. They had one thing that made them unique, and they ruined it over the years.

And I disagree that the entire used games marketplace is dead, but I do agree its dying. There's a small local chain of used movies, music, and games nearby they seem to turn of a good bit of merchandise. They don't set up locations in expensive real estate locations and they're not spending a lot of money trying to make NFT marketplaces, and from what I gather they're probably pretty low debt so they're not forced to make a lot of interest payments.
IBM Watson 2.0
Depends on how you're slicing it. By the total flux of energy batteries may be able to handle 80% of the "energy traffic" over the course of a day by smoothing out day/night cycles.

However that last 25% needs to be stored over long periods where the cost is prohibitive to store in current battery systems.
That's exactly it. Who wants to try pulling in an entire language with wide depenencies and it's ecosystem of envs/containers/etc when a single program will do it? Not people who just want to run inference on pre-made models.
Written in Microsoft FrontPage 4.0, back when that was a thing, and still useful many years later.
The LLMs that are doing this are trained on trillions of examples of human language. This is not remotely a counterexample. Now if an LLM can invent a new full language from scratch, without any training data of existing languages (like how AlphaZero learned to play Go), then that will be impressive, and a difference in kind.
https://www.youtube.com/watch?v=B1kJhSMuV60&t=90s
The data is not the problem. I could train on any of the public datasets combined with my own data. And here comes my point:

The result I'd achieve by training on that combined dataset from scratch cannot be achieved cheaper by utilizing an already pre-trained model of the huge generic dataset plus whatever additional training with the large domain-specific dataset.

From what I understand:

If you fine-tune only with the domain specific data and just enough so that the model picks up that knowledge it will have forgotten most of its generic knowledge already.

If you train on the combined dataset it will take as many epochs for the domain knowledge to shine through as for training the original model. It would cost the same as training from scratch.

You need enough tokens but you also need to train your model
the right amount on them. Too much or too little training is bad and the base models we have are just trained for the sweet spot and will tolerate a little bit of fine-tuning to adapt their behaviour but not nearly enough to teach them new facts.

I'm not an expert, so I could be wrong. What makes me a bit confident is that I have not yet found a single project that reports to have used the approach you suggest successfully.
Ammonia is no greenhouse gas, it has a GWP of zero. Burning ammonia produces N2O, which is a potent greenhouse gas, and NOx, which is an air pollutant. But these can be taken care of by scrubbers, and are irrelevant if you ship ammonia for other uses. (I mean the biggest use case of hydrogen these days is making ammonia for fertilizers.)
s3 is down for us
>Humans learn from the structure of the world -- not the structure of language.

No we don't. Humans don't experience or perceive reality. We perceive a nice modification of it and that's after excluding all sense data points we simply aren't capable of perceiving at all.

Your brain is constantly shifting and fabricating sense data based on internal predictions and that form the basis of what you call reality. You are not learning from the structure of the world. You are learning from a simplified model of it that is fabricated at parts.
AZs don't really help when it's AWS' own services across the entire region that break. Anecdotally, we have had customers accept outages that were out of our control without penalty.
This line makes me think this might be a physically-owned system:

>> Total mass of 3,291 kg (GPUs only; not counting chassis, system, rack)
I spend a decent amount of time at my local pool. It's a good space, but not as socially developed as what's described, and has a distinct authoritarian vibe.

600 yards is a solid workaday distance - daunting to the inexperienced, something I crank out pretty easily after a few years.
Humanity invented language though. LLMs did not; they're merely parroting our language back to us.
There's a lot of ad fraud in the industry, there's a lot of money in advertising. Everyone is incentivized to say they showed an ad but not actually show the ad. There's a lot of very sophisticated ad fraud operations and the tracking is designed to be difficult to defeat. We've seen app developers try to render ads in hidden iframes or muted behind/under content or on server farms with headless browsers or click scripts being served with the ad.

The default is to not pay for an ad shown until the publisher can prove it was actually shown and independent verification matches. It's a lose-lose situation for the user and publisher to show an ad but not get paid for it (but the advertiser still benefits, so they'll make a good effort to find reasons to not pay).

Brand safety is also the highest priority for most advertisers. They don't want their ads shown next to content they disagree with. Which the publisher also has to prove they've done in a way that can be independently verified.

Some of these problems are very hard to solve with tech, and for these cases, the solution is often "just trust me". It's not uncommon to simply let advertisers have access to audit ad serving code. It's easy to trust a big entity like Google or Facebook or even Reddit, but it's very hard (and a lot of work) to trust random single dev apps (or even companies lead by untrustworthy figures like Twitter).

The bigger (unsolved) problem is: how do you prove your advertising actually worked? How do you convince a customer like Coke or McDonalds with massive advertising budgets and not immediate trackable sale/action that their money was well spent? So far the tech solution is to just provide a lot of data supporting that the ad was served exactly as the advertiser wanted.
Yes, I acknowledge that we have evidence that groups of tribal humans will evolve language constructs over tens of thousands of years.

Whether that happens in 1 generation or 10,000 generations is completely unknown.
I don’t get it. Why would this be a troll?