skysight-inc/HackerNews huggingface dataset:
Hey HN! I am one of the people working on Bytewax (https://github.com/bytewax/bytewax). Bytewax came out of our experience working with ML infrastructure at GitHub. We wanted to use Python because we could move fast, the team was very fluent in it, and the rest of our tooling was Python-native already. We didn't want to introduce JVM-based solutions into our stack because of the lack of experience and the friction we had trying to get Python-centric tooling working with existing solutions like Flink.

In our research, we found Timely Dataflow (https://timelydataflow.github.io/timely-dataflow/, https://news.ycombinator.com/item?id=24837031) and the Naiad project (https://www.microsoft.com/en-us/research/project/naiad/) as well as PyO3 (https://github.com/PyO3/pyo3) and we thought we found a match made in heaven :). Bytewax leverages both of these projects and builds on them to provide a clean API (at least we think so) and table stakes features like connectors, state recovery, and cloud-native scaling. It has been really cool to learn about the dataflow computation model, Rust, and how to wrangle the GIL with Rust and Python :P.

Would love to get your feedback :).

`pip install bytewax` to get started. We have a page of guides (https://www.bytewax.io/guides) with ready-to-run examples.
Looks interesting but I wonder if this abstraction doesn't leak and it doesn't just become a more limited version of vanilla python + vanilla SQL.
Wow. What are the odds of this re-discovery! Hacker News is awesome.
I feel like we read different articles, because almost every second line is about explicit infrastructure and laws, involving legistlation/surveillance/prohibitve infrastructure:

> on-street parking in Japan has essentially been outlawed since 1963

> neighbourhood streets tend to be narrow and slow

> on-street parking restrictions are accompanied by proof-of-parking laws ... prospective car owners have to prove to the police they have off-street parking sorted before purchase:

> If you had a garage at your home, the police would come to inspect it

> Tokyo benefits from extensive and reliable public transport by train, subway and bus

> separation is enforced by keeping the streets defined around people—a condition that both law and the presence of people themselves seem to reinforce

In fact so far, the only sentence that supports the "culture" aspect is an admitted guess:

> I’d be interested in understanding more about the regulatory or commercial ‘dark matter’ involved in ensuring this system, but at the same time, suspect that it could equally be an implicit outcome of a culture subtly attuned to qualities of hierarchy, politeness, transience, and communality
It is just me, or is having every paragraph of a 200 paragraph essay punctillated by a link that takes you to another page full of paragraphs dotted with links a little too overwhelming?

I didn't follow the links. I generally like Cory Doctorow but this was just a huge doom rant.

Everythings' terrible. Got it.

Now how do I participate in fixing it?
There's also https://github.com/cisco/mlspp
Thank you!
It has been a great ride so far, hope others find a similar path through the meetups or hackathons
If you do anything in AI it's literally never been better. People not doing things in AI are finding that it's getting very bad very quickly.
Combining data with multiple fetch requests
If I remember correctly the Pro also has a better screen as well as fans. I've got a 16GB Pro and I think I've only heard the fans kick in a few times though, I think you could easily get by without them. I'm selling it soon and going to see if I can get by solely on a Steam Deck. If I can't I'll probably buy an M3 Air when they get released next year as the new chip design should mean significant battery life improvements.
How are joins handled? A relational db is largely about the relations, otherwise this is more of a document query language.
Turns out you're not the first person to think of this, and as a result they operate out of other countries (ie China or Indonesia). https://www.bleepingcomputer.com/news/security/north-korean-...
This implies that any RLHF is introducing human bias into any "thoughts" the model may have?
Elon Musk Has Damaged Twitter Brand So Severely Boffins Suggest Dumping It
Going forward, the current business model (with caveat that pivots are always likely this early stage) is to train on companies' proprietary survey data so we can estimate how their specific users respond to questions.

In the backend, we check to see if the answers are stated in a high-quality survey and just retrieve that. I know we do this for gender, and I'm not sure whether that happens for presidential polling.

Great idea, thank you. We're still figuring out whether the business model will be a general-purpose tool that anyone can use or those custom models I referenced above. If the former, your suggestion is spot on.
That's honestly also a little older than I expected. It is a little weird I'll admit. It would be interesting to know if the slow adoption in OpenBSD is deliberate or done on purpose.
indeed, and i wonder if you could elide the vacuum entirely with a noble gas (presuming the vacuum is required to avoid reactions with atmospheric gases)
640x480, but that's not important right now.
You have not understood what I said. I'm not talking about unappealing features of the idealized version of capitalism that GP is lionizing. I'm talking about how capitalism as described brings about the conditions that undermine free competition, by its nature. You're talking about it as though we can just agree as a society "we're doing free competition now" and that's that. Capitalists won't agree to this -- every incentive leads them to want to restrict competition. And they have too much control for a notional agreement among citizens or whatever to overcome.
Max wholesome. Non-conventional career origin stories are almost always unique and endearing.
That sounds about ideal to me.

Any tricks or issues you've had to figure out while pairing? My thought was just "assign a couple of people to a non-trivial ticket and see what happens". But I'm curious if that's really naive.
States have different tax rates - I used to buy cartoons across the border in another state because it was way cheaper.
> “You didn’t actually want to do X, here’s how to do Y instead” may indeed be helpful for the beginner who initially asked the question

Stack Overflow isn't a site for beginners, it's for "professionals". At least, that's what all the Stack Overflow defenders tell me every time I criticize the snarkiness, rudeness and patronizing manner of many answers/comments you receive on Stack Overflow.
Perhaps this conjures different sentiments from other HN readers, but what instantly pops to mind for me is my childhood web browsing experience where I had the wrong toolbar or plugin or whatever, and thus every page was filled with automatically generated double-underlined green links that invariably went to a page I regretted visiting.

If there is one thing the SEO and LLM crazes have taught us, it is that small curated beats big generated, every single time.
"Every institution fails due to an excess of it's own first principle."

I have watched/experienced SO go from a super useful/helpful site with a balance that pitted people's desire to be recognized with a desire to be helped, and slowly be subsumed by those overbent on organization and bureaucracy. And is it did so, it became less useful, to me as a questioner as well as an answerer.

Now I have to put up with stochastic parroting from GPTs to try and steer me in the right direction. Yay.
A though occurred to me the other day. Taxes have become the offset for the inefficiencies capitalism. Each entity is independent, and therefore has to reproduce common things that could have been shared if society was organized differently.

Rabid liberalism is expensive.
Neat! In case anyone else is curious where it was, apparently it’s the present-day location of the Bowery Electric. https://www.theboweryelectric.com/
Curious whether it is utility or habit that keeps you from actively stopping.

Personally I relied on it for reading, had thousands of interesting upstreams and was programmatically pulling content...but basically stopped cold turkey once Elon took over. Missed it for its utility but had decided to vote with my feet. And at this point about 3/4 of my upstreams have left.
Is it really triple, or is that just looking at FAANG? I'd imagine US average to be low to mid 100k. Looking at Germany as an example, it seems their average is 70k Euros, so more than half?

Then there's health insurance which never stops going up, and having to save a large portion of each check for our own retirements because when we're past 50 we're relegated to greeting at WalMart.

I'm not sure which is better, since each Euro country is different and such, but just looking at salary numbers isn't much to go on.
> ~16 visits * 40$ vs 4 visits at $125.

To be fair this seems like a bigger problem to me than Medicaid recipients "overusing" healthcare.

Are services to people on Medicaid provided at a cost and effectively subsidized by others?

Or are clinics just maximizing their profit margins by charging as much as they can since there are no incentives to decrease prices (insurance companies don't have that much interest in lowering overall costs since they can just raise the premiums).
ONNX is pretty old at least 5 years and its still mostly useful on Nvidia GPU's or x64 CPU.
TBH. cool that projects like that are still alive but MLIR looks like the future of proper model storage, and custom format and loading is still a king today cause you can easily modify model and optimise or even fine tune which isn't even possible in ONNX without ton of work (also static spec and versions in protobuf sucks wish they migrate to flatbuffers).
I'm not really picking anything, just sharing how it went with elixir in my org. I'm sure we could have done better, but the pit of success was not there for the polyglot teams. the elixir-only teams did a bit better, but mostly they just learned the ecosystem and then GTFO'ed out to greener pastures since they just wanted to write elixir and only elixir.

about your specific counterpoint, I think it's partially valid; I don't instantiate modules, I might not have named structs but just operate on Maps so I don't know the supposed module name, I might have misplaced the function in another module (while it's very intuitive to stick it to the object in oop)...and a million other things that are way too different for the average joe.
Insurance costs more, at least where I live, if you admit you smoke.
The survey / behavior gap is very real. Short-term we're focused on surveys, but we'd like to integrate behavioral data long-term (and potentially be primarily behavioral data, but that is TBD)
i expect so. there are some chemistry youtubers who read HN. i’d imagine they’re gonna have a fun few days!
Please do, it is an insightful comment. Complexity is the enemy of reliability, 100%. I wish engineers were better at resisting it. Sadly, many stars must align for complexity to decrease.
Etiquette and the Cancer Patient (2017)
Since you're familiar with this stuff, and I didn't see it in the article, what's the impact if it were to collapse? To the ecology? To the weather? To other ocean currents?
Good news! Now that "sleep" supports fractional seconds, you could ratchet up the suspense verrry slllowly...
If people are paying for the software, then they should be able to use the software as they wish.

If you were selling a towel, you wouldn't put restrictions on someone wetting it and using it for hand to hand combat, would you?
Who ensures the software is compliant? How does the process work?
I had the same question. From the docs, it looks pretty elegant:

from employees
join side:left positions (employees.id==positions.employee_id)

which translates to

SELECT
employees.*,
positions.*
FROM
employees
LEFT JOIN positions ON employees.id = positions.employee_id
I mostly used the one from libxml2 but it's been a while and I could not remember if the SAX parser did namespace resolution :)
Thank you for writing this out so clearly. I've attempted to make this point in the past, but am too tired to these days.

Of all the animosity in the discussions regarding Remote vs Office, this is the one that genuinely bothers me. Saying that I prefer the human interactions of working in office does not imply that I struggle to find or make friends outside of work. You've put it brilliantly.
All the best, Josh! Resilience is certainly a Founder's trait.
Relational algebra is still great, it is the sql that made an unbelievable mess out of this beautiful idea.
>>It’s related to Jelinek’s Law, named after language-processing AI pioneer Frederick Jelinek: “Every time I fire a linguist, the performance of the speech recognizer goes up.” The joke is that having linguists on your team means you’re still trying to hand-code in deep principles of linguistics, instead of just figuring out how to get as big a blob of intelligence as possible and throw language at it. The limit of Jelinek’s Law is OpenAI, who AFAIK didn’t use insights from linguistics at all, and so made an AI that uses language near-perfectly.

It seems a small conjecture to note that the problem here is that "deep principles of linguistics" the linguists are attempting to hard-code, are in fact more like "intermediate principles of linguistics".

The linguists haven't approached anywhere near the deeper layers of how the brain works on language (nevermind how the Wernicke's area coordinates w/the visual cortex to generate "I see a bird over there"). So, when they code in their principles, they only screw up the deeper relationships. Of course the LLM has zero actual understanding of any abstract meaning such as "I", "see", "bird", or "over there", but it's still better off without those hardcodings to generate the phrase in a valid or hallucinated context.
All the money in the world won’t get you relandable rockets or put EVs on the map unless you have talent.. to set direction/vision, make partnerships, find talent that wants to work with you, etc.

If money alone was enough we’d see more Teslas from places like Saudia Arabia. But we don’t.
Benevolent ownership works well, till the owner passes on. Then all of the unwritten promises no longer exist.
Works great in old conference rooms... I have a USB-C VGA adapter in my bag still.
If you haven't seen Redline, I highly, highly recommend it - I don't watch much anime, but I've seen that movie half a dozen times, and generally re-watch it at least once a year. (Usually when I'm reminded of how good it is by the soundtrack randomly coming on in my playlists.)
Appeal to authority is only a fallacy where the authority is not actually an authority.
Why don't you want to name two countries on earth? Either people can fact check you or you're just full of it.

Also don't think you are special to live in two countries. This will not dox you.
Even if you were right, it behooves us to act as if our actions mattered. Otherwise, what’s the point.

I don’t think you’re right, for the record.
It's funny you say that, because it's the one I remember most from that collection.
i did some contracting for a place that i think hired one of these guys.

in his case i think he more or less knew what he was doing, and showed up on calls, but delegated the work to some other people.

we’d hear people in the background of his audio discussing things really oddly similar to tasks he’d been assigned and had outstanding. he was putting in (bad) PRs at all hours of day and night, and never had any recollection of any email, slack conversation, or his own PRs.

the company fired him after six months or so.
Geopolitically infeasible, look at the mayhem caused by nord stream alone
Its funny how writing a user login replacement seems kind of ubiquitous for all future hackers. Mine was in Visual Basic (5 iirc) for a Windows (Novell?) network. This was back in school. You could trivially change win.ini to set it up to run _before_ the real login screen. Mine would save the username and password to either a shared network drive or a local file, then display a "password error" and exit to the real login prompt.

What got me in the end was that a "friend" used the same trick and started copying peoples files from their network account to his own. My suspicion is that when he eventually maxed his quota, the system must've warned the network admin... a cursory look would later reveal he copied some teacher's thesis files, and that was a big no no.

Eventually this incident would land me my first computer related job as a junior tech support/network admin.
absolutely, that's what I said when I talked about strong org support.

also, if you don't have strong org support, you risk getting onboard people that just want to work with that specific technology that WILL gtfo as soon as they need to change team to one that doesn't use it, or if the technology is sunset, etc., so it's even more risky to have an exotic stack in the middle of more common stacks
It is somewhat of a common thing in VRC communities that simply blocking Quest users cuts out the vast majority of annoying kids running around.
My questions usually go unanswered for years with several "me too"s and "did you ever figure it out?"s nailing my inbox.

I do typically self-answer if I figure it out, but you know, if I'm going to be ignored maybe it should be a github issue so I can get the sweet zero replies and that juicy 90 day auto-close from inactivity.
You are right - but because each hire is less risky, a US company can afford to take the risk of hiring for an "experimental" role that may not work out. I think this additional risk is what they were referring to.
Nonsense. If Julius had not been isolated with his tutors he would be dumb as a rock.
It was sustainable as long as interest rates were near or at zero. Businesses could raise money seemingly forever, and could grow on the backs of other businesses raising easy money.

A lot of this could be a zero interest rate phenomenon.
Got a decent position after ~4 months of looking. ~120 applications, ~10 interviews.

It was nuts, my resume and skillset have never been stronger but this was my hardest search by a huge margin. Referrals were not working, bulk applications were getting no response. What finally worked was just persistence and trying to add a lot of character to my cover letter. I had way more replies when I:
A. complimented what they were doing
B. Included a few little quips/jokes.

The huge number of fake applicants and AI generated cover letters/resumes is making recruiters jobs a nightmare, I think a few jokes and compliments can make it clear you are an actual person. One recruiter told me he had ~3000 applications for a pretty low paying remote position.
> Question for the community: how does one navigate such uncertainty?

This is one of the key reasons I come to HN. Yes, for the news, obviously ;) But mostly for the various insights on that news.
I accurately quoted the OP, which you must be able to see for yourself.

If OP meant "that one guy" instead of "many", they could always edit/reply to clarify. For my part, I can only respond to the ideas actually expressed.
Apple is big but insular. I never bought any Apple device so I never had Safari (*) and any attestation affecting Apple's customers didn't affect me. Web sites could harass them but not everybody else. Google is a different beast. Their browser engine can't run on iOS but it runs on Macs and on every other major OS.

(*) there was a Safari for Windows in the early days of the iPhone. It had a Mac UI which was horrible to look at inside Windows. Maybe it was the time Jobs thought web sites were the way to go for the iPhone. Then he realized that an app store would make a lot of money. Nobody gets everything right all the times.
RLHF is not part of LLaMa pretraining, or pretraning of any other models for that matter. RLHF comes after pretraining. https://twitter.com/Jeande_d/status/1661833563069620247/phot...
They never understood how to build a product line or a roadmap. To them, the Amiga was a on/off kind of thing, a product they acquired once and planned to sell for some years. They would have happily sold some new, completely incompatible home computer, afterwards.
If it were possible to manufacture towels that couldn't easily be stolen from hotels, then yes I would want that to be allowed. Hotels would like it, and guests who do not steal would benefit from lower prices.

And more directly yes I would want exactly what you're describing to be possible. We do this with alcohol so that rubbing alcohol can be sold at a reasonable price.
Likely a lot of labs doing it right now.
fly new hires some place and make them work in person with somebody for a week.

i think remote work is great, but some early face to face can fix a bunch of problems imo.
I don't think you actually need reversibility if you don't discard the energy but return it to the power supply?

In other words, "reversibility", but you can actually pool the useless results together, you don't need to separate them later. Or so I read somewhere...
TensorRT with torchscript is a king as its a lot easier to modify, but ONNX is fine as you can also import some ONNX models to TensorRT -> https://docs.nvidia.com/deeplearning/tensorrt/api/python_api... But ofc. as everything it depends on OPs version of ONNX.
Amazon's "customer experience" is one of the reasons I no longer purchase from them.
Probably not the most optimal solution, but how about spinning up a small "demo" server without captcha, that is reset as often as possible?
People really like to associate relational algebra with SQL, probably because they learned them one alongside another. But SQL is really terrible relational language - it breaks a few core concepts in different places, like relations being unordered sets, that you can ORDER BY. This bubbles up as relations losing ordering after being wrapped into a subquery, which is really unexpected.

PRQL has a data model very similar to the relational one. The only big difference is that relations are ordered - they are defined as arrays of tuples. So let's hope that PRQL gets to be known as "the relational language Mk II"
Think Aloud Protocol
Hey HN! Author here.

For the many Obsidian users here, wanted to share an Obsidian demo/plugin that I saw recently by Justin Smith[0] that I think faithfully carries over a lot of what I liked about this idea into the Obsidian land, complete with a semantic index w/ language models.

If you're an Obsidian user, do check out the demo. I can't take credit for any part of building it, but it's really cool to see the idea in action :)

[0] https://twitter.com/justindsmith/status/1679978286955532296
Losses to resistance inside your home don’t matter much. In your computer they do, but it’s not clear this helps with that.

This would enable really long distance electrical transmission, which solves the whole intermittency issue with solar energy.
> that would tend to be evidence that they might be a good thing

I had written a super long comment weighing the pros and cons of it but lost it because of a keyboard shortcut typo. In hindsight that's probably for the better...

I've used LSD about four times and don't regret anything, except for maybe making one of my friends feel really bad by having a breakdown in voice chat... the trip was still worth it in my opinion, but it still hurts a bit that I worried someone so much over it.

I hold the opinion that most people are right not to take psychedelics. I think there are still tons of people that could benefit from it, but only once they're actually ready to try it. I absolutely support legalizing them, and giving people the choice to try them. Maybe at a clinic, but importantly also at home.

My home is my safe space and my computer is where all my friends are, I wouldn't have wanted to do it in a clinical setting. And I definitely wouldn't have wanted to have to get a prescription for it.
I need someone to burst my bubble, this is too exciting