skysight-inc/HackerNews huggingface dataset:
Why don't go ask ChatGPT then?

But seriously I am asking a very similar question with a focus on LLMs for classification (e.g. "Is this an article about a sports game?"), information extraction, clustering and such. I am not so interested in generation (Which I am assuming you are.), however the GPT style embeddings and those are are useful for the kind of work I do and are interchangeable with BERT-like and other embeddings.

"Good" or "Best" is something you have to define for yourself and the one thing every successful A.I. developer has done is develop a facility for testing if the solution was performing acceptably. With that library you can download a model and start working with the model, again, the successful people all tested at least one model. In the time since your post, a run-of-the-mill Python developer could have made some progress. Learn Python or get a non technical co-founder,

For my kind of tasks I want something that handles bigger documents than ChatGPT and when I go shopping for models I cannot find a high quality very large transformer that has been assembled with a tokenizer and trained hard on language tasks. When I look at the literature it seems the very long transformers like reformer wouldn't perform so well if somebody did try to build an LLM so I wait. I am certain that somebody will upload a better model to huggingface someday -- that's the thought process it takes to get an answer for questions like yours.

If you look though at the process used to make ChatGPT-3 able to converse there is the GPT-style embedding and then a process of dialog generation trained on totally different principles which is the "Reinforcement Learning from Human Feedback"

https://www.assemblyai.com/blog/how-chatgpt-actually-works/

and I think you are not going to get that kind of capability open source in that the training data doesn't exist for it. There are many things you have to do once you have that training data, but I think there are many people able to follow that path now that it has been blazed.
It is possible that the resources were allocated towards initiatives that the decision-makers believed to be valuable and aligned with their own goals. Permit me to offer a few examples in a respectful manner:
1. The Duke and Duchess of Sussex
2. Michelle Obama
3. Kim Kardashian
4. Brené Brown

With all due respect, it appears that these particular selections exhibit a marked bias and detachment from the preferences of the average podcast listener.

Such choices may be seen as lacking a true appreciation and understanding of the diverse range of tastes and interests within the broader podcast community.
Does everyone also know about the outsize influence China has on Vietnam? If the goal is to de-risk a China / US Trade War scenario and prevent Chinese government from stealing chip tech etc - then you dont get much by going to their pals next door ;)
Yes, please open source
Caravaggio and Rembrandt came up with some pretty impressive shadows- so it always depends on the renderer.
What even the greatest renaissance painters really could not do well is children!
> 2012 was a year of large layoffs and tough hiring, so was 2016/2017 and now 2022 for seemingly arbitrary reasons.

Everything is relative, I suppose, but those are the sorts of things a person might say if they've never actually seen a downturn.

When I say "downturn", I mean: 2001. 2008. Compared to that, 2012 was boom times. I was running a startup then, and hiring was a brutal competition. Maybe not compared to 2020, but again...that's not normal.

In 2008 we were hiring Ivy-league grads into hourly customer support roles. Circa 2000, programmers with decades of experience were going on unemployment.
What do you watch that YouTube's getting heavy handed with strikes?
Article doesn't mention what any of these subscription services cost. To me, that's the most important part.
That's two orders of magnitude!
I've never listened to a Podcast on Spotify. I never intend to. I wish I could turn off the podcast spam that clutters the homepage of the app, and just focus on music.

I miss Google Play Music (before it too got cluttered with Podcrap) and Grooveshark
> There are no cars or electronics, or chip fabs in this country.

This is only partially true.

India has factories that provide inter-mediate parts required for creating final product. For example, a car needs axles, engine, dashboard plastics, alloy for body, brakes and electronics. You are more likely to find an Indian name in top-10 vendors for above parts sorted by marketshare. With the exception of engine, transmission, they have expanded.

What it does lack is tack of exporting finished products such as iPhone or smartphone or cars or jets.
And I think this will be a long process. Someone with deep pockets like Apple is willing to bet and here we are.

Example:
https://en.wikipedia.org/wiki/Bharat_Forge
Philosophical Science Fiction Novels [video]
I've never been moved in the slightest by the trailers for the franchise, and so never bothered watching them.

"Saw" on the other hand? For that franchise, I find even the adverts disturbing… though not as disturbing as the logical conclusion that a significant number of people must be responding to those adverts with "that looks interesting, I desire to spend two hours looking at cinematic footage of the content that this image or clip only hints at".
You probably want a Lisp or a Forth instead then. Maybe (maybe!) Lua.
When you say "fine tune" here what are you looking to do?

The impression I've got is that fine tuning large language models is mostly useful for very simple tasks, such as training a spam or categorization filter.

If you're looking to take a model and then e.g. train it on a few thousand additional pages of documentation in order to get it to answer project-specific questions, I've got the impression that fine tuning isn't actually a useful way to achieve that (I'd love to be proven wrong about this).

Instead, people are getting good results with "retrieval augmented generation" - where you first run a search (or an embeddings-based semantic search) against your docs to find relevant snippets, then feed them to the large language model as part of a glued together prompt.

I wrote about my explorations of this technique here - plenty of other people have written about this too: https://simonwillison.net/2023/Jan/13/semantic-search-answer...
You seem to be describing an overlay network rather than a method of avoiding destination addresses in IP packets sent over the internet.
Snowden can pound sand for repeatedly regurgitating Kremlin propaganda that they weren't going to invade Ukraine, that it was all US government scaremongering.

https://twitter.com/Snowden/status/1493641714363478016

He doesn't know shit when it comes to this topic.
Huh, it was but I can't take credit for being clever about it, just simple order of magnitude estimation with a factor: e.g. I thought of a handful I was pretty sure were 500k+, rounded up to 10, then doubled as I know I don't know much about the space.
You talk about the effect and outcome but what's actually "bad" about it?
And yet Far-UVC seems quite safe for people.

Presumably what’s going on is that longer wavelength UVC from welding is extremely dangerous.
I hope this kind of thing will be open source or standard one day.
Make a Google of "hardware overhang"

Our brains outperform GPT-3 with only 30w of power. The potential for software optimization may be many orders of magnitude.
Mysteries of Counting: Euler Characteristic vs. Homotopy Cardinality (2005) [pdf]
I think in an "idea" space, which then I transcribe into words.
You should take a look at https://sequencer.party

Collaborative real-time audio/video/midi platform that supports VST-like web plugins (the WebAudio Module 2, or WAM2, standard)
Indeed check out my other post here - and it definitely was fun!
In the Supplementary Materials, there's a set of example videos of this work in action. In particular, the helix shape is pretty cool to see form in (essentially) the blink of an eye.
There are many cities around the world that don't prioritize cars at all. None of them are in the US. We got pretty much screwed on this count -- the US wasn't always so car-centric, but then we got suckered into it only to discover that it's a trap after it's too late.
When Rust Hurts
Ah yeah, makes sense... I confused myself.
Bing didn’t even release it in the main flow. It is a separate tab within bing like images or maps. So Google could have done a similar thing
Thanks, I would not have thought of clicking on that in a million years.
Was there anything else happening to black americans in the second half of the 20th century?
Seriously, it has become a pattern now in every thread related to India. Really shows how HN techies are clueless about real world trends and live in their small bubbles.
https://archive.is/S9jBN
It's OK to be taken advantage of a little bit.
I think it's important to understand why people use spotify for podcasts. They use spotify because they already have spotify for music. No one is buying spotify for the podcasts. So the player has to be.... fine. It needs to be just good enough not to actively force people away from it. Spotify podcasts fits the corporate software quality model. And podcast players have been around for about 15 years anyway by now, so it's not rocket science. Anyone who doesn't like it... there are dozens of other podcast apps out there that are great.
Thank you for that. I found 2012 gaming computer in the garbage room three years ago. Now I am 2-star General in GS:GO.

I have never had Windows computer. Moved right from DOS to Linux around 1992. And I gave up gaming after DOOM/MYST in 1990's because there was nothing new happening and hardware requirements were excessive.
What cars??
> which is why they (if not you) might want to consider unions if they want to protect themselves from the stark meritocracy that you posit.

Why would you prefer a system under which you have to know someone to get a good job instead of a system under which you just have to master a skill?
My First Hanami App
Can you network boot a Raspi? This source seems to think so, as of the 3B+, anyway: https://www.makeuseof.com/tag/network-boot-raspberry-pi-with...

I guess it requires them to be on wired network, but if they're in a closet, that's probably the case anyway.
Microsoft has been a billion dollar investor of OpenAI since 2019. They also exclusively licensed GPT-3 several years ago.
they did need bollards at the entrances to these lanes otherwise someone in a smaller vehicle would eventually try to use it to get around the traffic

In Beijing, many of these lanes (辅路) double as parking lanes. The side by the sidewalk is full of parked cars, and the side near the island is for bicycles, scooters and cars getting in/out of parking spots.

Even though cars may be present anywhere in the 辅路, they're not going fast when looking for parking. So I still felt far safer cycling in Beijing (a city of 20MM people) than I do in San Francisco (sub-1MM).
I'm disappointed to hear this news. Understanding the origins of Covid is one of the most important things we can do in this century.
If you're not self-employed there's like a 0% chance you're getting your taxes wrong by holding TurboTax wrong.

If you're FAANG there is some chance you're overpaying by not doing the RSU cost basis properly.
> There's videos of entire coops of chickens dying out

There is currently a rampant bird flu ripping through the US shared between wildlife and farm chickens with a 90%-100% mortality over 48 hours. This is exactly the kind of situation human threat-assessment is bad at.

I know experts make mistakes, but replacing expert wisdom with "the guesses of the masses" is a bad idea in general. I don't trust Norfolk Southern, but I trust a mob a darn sight less.
It is, in fact, a thing

It isn't. "Grow weary of" is a common phrase. "Grow wary of" are words you can put together, but it's not a common phrase.

I've already posted all the evidence needed, and I grow weary of this misguided argument.
That is one of the most frustrating things about bike advocacy in NYC. 90% of the people who would bike don't because they think it is dangerous, and then people at CB meetings say we don't need to build bike lanes because they don't see anyone biking. They think of it as a way to increase safety of existing bikers and not a way to draw in new bikers.

And because of fractured nature of how these decisions are made, and the vetocratic nature of how our political system gives everyone a way to say 'no', every bike lane is a painful fight. And in the end, even if a bike lane gets built, the city doesn't actually put physical barriers to stop people parking cars in them. Then you factor in the lack of traffic enforcement in this city and the situation is pretty dire.

That said, there has been very slow progress. Compared to 15 years ago it is quite a bit better, but good lord it is a very drawn out fight. I try to encourage folks to show up to local community board meetings to advocate for bike lanes because I do think it makes a difference.

Thinking about how much is within a 5-6 mile distance of you at any point in time in NYC, you can see the potential for NYC to be an incredible place to bike if we prioritized safety, pollution and efficiency when we allocate street space in the city.
> The cost for developers to fix things after the fact is generally lower than the cost of developing it again from scratch

I don't follow - could you expand on why this would be the case? What's the distinction here between the developer and the contractor when it comes to costs?
I already see some DIY attempts at some level of editor integration like codeGPT and I’m aware chatGPT is more expensive but it provides several times the value of copilot. Not only do I find chatGPT more useful at coding it can also do things like draft emails amazingly well.

I cancelled my $10 copilot subscription after chatGPT came out and am happy to pay whatever ChatGPT is charging. I just can’t justify paying for both at current pricing.

Copilot made me faster at pumping out boilerplate but when ChatGPT is already being used by me to pump out boilerplate and so much more it feels too expensive for something so redundant. $120/yr to $240/yr USD is a TON to pay for a nice-to-have. Cut the price in half or even offer a Chatgpt+copilot bundle with a discounted price and I’ll consider it.
There are plenty of alternatives if you want something less commercial. ExcelDna is a great choice.
Tulip Creative Computer
Still afloat, but nobody can find a use for the ship. Not for lack of trying.

"You can’t set her on fire, you can’t sink her, and you can’t catch her." — William Francis Gibbs.

The S.S. United States was built to warship standards, and could be used as a troop ship. Multiple engine rooms, many watertight compartments, few large interior spaces, and high speed. Look at cruise ships today. Those things are resort hotels that float. Huge open interior spaces. Open decks and pools. That's what people want. Not plowing across the Atlantic at a speed where you don't go on deck without a good reason.
My question was about how you spot that status.
Thank you for the polite insults. I hope you feel good after this wonderful display towards a stranger online. The education you provided is invaluable. Your moral compass is high and you defeated me and defended an entire generation of people. I think this is the first of its kind in the history of internet, you must feel like a hero :)

Sadly, you didn't read what I wrote but I'm still grateful for being called an idiot, and since I value your opinion I am gravely hurt.
1. Vehicular drivers have no incentive to care. The laws around liability have to be changed.
2. Cities have to deprioritize car traffic to below pedestrians, bicycles, buses/trams. Free parking mandated or provided by the city needs to be eliminated. Zoning for building dense hS to be loosened up. Thankfully, this trend is picking up.

Car lifestyle is heavily subsidized by the state now.
Yes!

The surface reflects light it scoops up from the visible hemisphere around it. If some of the hemisphere is sky, then the light cast onto that surface will be tinted blue.

I'm not sure if people have access to it, but here's an example from an airborne imaging spectrometer that is flying over a partially-shadowed domed building (on the Caltech campus):

https://www.sciencedirect.com/science/article/pii/S003442572...

Figure 4 shows the dome (really a cone) - note the shadow at top-right.

And figure 5, panel C, shows the contrast-enhanced light reflecting off that dome. You can see that the shadowed portion in the upper-right of the dome is bluer than the directly-lit stuff. (The directly-lit stuff is more golden, from the direct sunlight.)
If building a distributed KV store interests you, you might want to check out Georgia Tech's OMSCS Distributed Computing course: https://omscs.gatech.edu/cs-7210-distributed-computing . While rewarding, this class was hell and still gives me nightmares....

By the way, the course is built on top of Distributed System's lab: https://github.com/emichael/dslabs
Anyone looking at the Google ads targeted at them by a BILLION DOLLAR INDUSTRY wondering why Google thinks they are pregnant, mysteriously trying to buy a dump truck, or mysteriously inundated with Ozempic promotions instinctively knows the limitations of AI. When the system literally knows your interests and search habits but still can't offer the compelling ads then clearly, no amount of AI research funding will bridge the valley of understanding.

McDonalds would be better off with a string tied to a lever that starts the hamburger machine
This is ironic considering just this last month there was a controversy over their pharmaceutical standards with multiple children dying from over the counter medicine.
They haven’t done well and there’s constant issues with Indian “genetics” not actually delivering the amount of a given medicine claimed. There’s also almost no recourse one can take here.
Air Force jets intercept Russian aircraft near Alaska
This remark applies to all IT outsourcing companies: more billable hours. Love to see how a Chinese IT outsourcing company fares in contrast with TCS, Wipro, Infosys of the world.
Freewrite: Distraction-Free Writing Tools
As you say, if you want to have 0-RTT data, you must have some prior information about the server. This information can come in two main forms.

1. Have the client know the server's public key in advance. You can then do a RSA or ephemeral-static key exchange, as in gQUIC, OPTLS, or TLS Fasttrack.
2. Have the client and the server do an initial handshake and then reuse the symmetric key for future connections, as in TLS 1.3 and IETF QUIC (which uses TLS 1.3).

The public key version has a number of superficially compelling properties, in particular that you can publish the server's data somewhere like DNS ("0-RTT Priming") and thus have 0-RTT with the first connection. By contrast with the symmetric version you have to have a connection first. The public key mode also will work in this setting. However, making this work in practice has a number of challenges around authentication, anti-replay, anti-amplification, etc. Initially TLS 1.3 had both of these modes but we ultimately removed the public-key based one in favor of a symmetric-key based mode.
Do you happen to know other spec's on these or similar? (Eg, CPU type/speed, RAM etc)
AWS has added hundreds of products - they even arguably have a better hosted Kubernetes than Google Cloud does. I suspect AWS Aurora alone makes hundreds of millions of dollars a year as well.
Vehicular cycling at least puts you where drivers expect other vehicles to be coming from. It's a good choice in many situations. Being in pedestrian areas, riding as far right as possible (area-specific mandate), or in a bike lane makes you practically invisible in many cases.

Cycling specific infrastructure can do a lot, but it can never be a solution for all destinations because of limitations enforced by pre-existing infrastructure.
What's the reasoning here? Do they think that someone is going to pull them out of their cars and force them to bike?
I’ve used types.MappingProxyType on occasion for this
Capital always behaves this way, it isn't really surprising. What's embarrasing is the federal government and the news coverage making it seem like the strike was a huge risk and the only way to deal with it was to forcibly silence them when the obvious solution is to meet their demands. It's like such a thing never crossed their minds, and it's nuts.
The books discussed in the video:

- Brave New World by Aldous Huxley

- Klara and the Sun by Kazuo Ishiguro

- Parables of the Talents and Parables of the Sower by Octavia E. Butler

- The Three-Body Problem Trilogy: Remembrance of Earth's Past by Cixin Liu

- The Hainish Cycle by Ursula K. Le Guin
Please provide a magic trick that will assign programs to "strict categories" in a way that no one will dispute :-)

> … straightforward, idiomatic code…

Even with tiny programs, once you ask for "idiomatic code" things stop being straightforward: different languages do things differently —

https://benchmarksgame-team.pages.debian.net/benchmarksgame/...

> … hand-written SIMD…

One approach is to filter those programs into their own section — hand-written vector instructions | "unsafe".

Another is to use source code size as a proxy —

https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
I don't re-read the whole sentence before every word I type, contrary to transformers. Also, I can go back and correct my mistakes.
welding light is broad-spectrum, so it's not relevant when comparing to a narrow-peak light source.

> UV-C As Potentially Mutagenic/Causing Damage not caught by normal replication suppression mechanisms - [https://pubmed.ncbi.nlm.nih.gov/9951833/]

p53-/- human keratinocyte cell line means that those were in vitro experiments which don't account for the wavelength-dependent penetration depth, which is the point of discussion here.
For the most part yes. Post below me named some exceptions, but in general the US has done a better job than Europe at standardizing rail gauges everywhere. New York runs at standard gauge, and that alone accounts for about 1/3 of all the metro rail on the continent.
https://archive.ph/87Cmm
The article is interesting but quite pedestrian. Subjective experiences are not objective and therefore no basis for science. Sure. That's pretty obvious. But does nothing to help me understand my own subjective experience.
> Azure has been on a tear

The only “tear” I’d put Azure on, is “tear inducing” in the context of “being forced to use this disaster brings tears to my eyes”. Most of my friends and peers who’ve had to use Azure feel the same way.

> Microsoft's thunder, they flubbed something as simple as an ad.

Have you seen bingGPT? It’s not exactly doing much better.

> Now people are _really_ wondering if Google can execute anymore

Google has done this to themselves. Endlessly launching and axing products inevitably erodes people’s confidence, long before a marketing whiff with a language model.